-- Logs begin at Mon 2022-07-25 15:07:40 UTC, end at Mon 2022-07-25 17:57:28 UTC. -- Jul 25 15:51:22.798261 n-d-846219-13 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 15:51:22.807700 n-d-846219-13 devstack@n-api.service[104022]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 15:51:22 2022] *** Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: nodename: n-d-846219-13 Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: machine: x86_64 Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: clock source: unix Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: pcre jit disabled Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: detected number of CPU cores: 4 Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: current working directory: / Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: detected binary path: /usr/bin/uwsgi-core Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: your processes number limit is 47680 Jul 25 15:51:22.809772 n-d-846219-13 devstack@n-api.service[104022]: your memory page size is 4096 bytes Jul 25 15:51:22.810797 n-d-846219-13 devstack@n-api.service[104022]: detected max file descriptor number: 2048 Jul 25 15:51:22.810797 n-d-846219-13 devstack@n-api.service[104022]: lock engine: pthread robust mutexes Jul 25 15:51:22.810797 n-d-846219-13 devstack@n-api.service[104022]: thunder lock: enabled Jul 25 15:51:22.810797 n-d-846219-13 devstack@n-api.service[104022]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 15:51:22.810797 n-d-846219-13 devstack@n-api.service[104022]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 15:51:22.848911 n-d-846219-13 devstack@n-api.service[104022]: Python main interpreter initialized at 0x560d622499c0 Jul 25 15:51:22.848911 n-d-846219-13 devstack@n-api.service[104022]: python threads support enabled Jul 25 15:51:22.848911 n-d-846219-13 devstack@n-api.service[104022]: your server socket listen backlog is limited to 100 connections Jul 25 15:51:22.848911 n-d-846219-13 devstack@n-api.service[104022]: your mercy for graceful operations on workers is 90 seconds Jul 25 15:51:22.849406 n-d-846219-13 devstack@n-api.service[104022]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 15:51:22.849406 n-d-846219-13 devstack@n-api.service[104022]: *** Operational MODE: preforking *** Jul 25 15:51:22.849592 n-d-846219-13 devstack@n-api.service[104022]: *** uWSGI is running in multiple interpreter mode *** Jul 25 15:51:22.849592 n-d-846219-13 devstack@n-api.service[104022]: spawned uWSGI master process (pid: 104022) Jul 25 15:51:22.853395 n-d-846219-13 devstack@n-api.service[104022]: spawned uWSGI worker 1 (pid: 104023, cores: 1) Jul 25 15:51:22.853395 n-d-846219-13 devstack@n-api.service[104022]: spawned uWSGI worker 2 (pid: 104024, cores: 1) Jul 25 15:51:22.853395 n-d-846219-13 devstack@n-api.service[104022]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 15:51:22.849822 n-d-846219-13 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 15:51:23.511459 n-d-846219-13 devstack@n-api.service[104023]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 15:51:23.515905 n-d-846219-13 devstack@n-api.service[104024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 15:51:24.592584 n-d-846219-13 devstack@n-api.service[104023]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 15:51:24.592584 n-d-846219-13 devstack@n-api.service[104023]: from cryptography.utils import int_from_bytes Jul 25 15:51:24.593227 n-d-846219-13 devstack@n-api.service[104023]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 15:51:24.593227 n-d-846219-13 devstack@n-api.service[104023]: from cryptography.utils import int_from_bytes Jul 25 15:51:24.596432 n-d-846219-13 devstack@n-api.service[104024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 15:51:24.596432 n-d-846219-13 devstack@n-api.service[104024]: from cryptography.utils import int_from_bytes Jul 25 15:51:24.596943 n-d-846219-13 devstack@n-api.service[104024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 15:51:24.596943 n-d-846219-13 devstack@n-api.service[104024]: from cryptography.utils import int_from_bytes Jul 25 15:51:27.053832 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 15:51:27.054520 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 15:51:27.054878 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 15:51:27.054990 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 15:51:27.055101 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 15:51:27.055186 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 15:51:27.055272 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 15:51:27.055351 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 15:51:27.055437 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 15:51:27.055526 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 15:51:27.055604 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.055681 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.055902 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.055991 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.056220 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.056323 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.056535 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.056632 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.056869 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.056975 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.057187 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.057281 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.057512 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.057606 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.057825 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.057926 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.058148 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.058253 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.058398 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.058486 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.058712 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.058887 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059048 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-13 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059189 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-13 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059334 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059471 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059628 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059785 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.059937 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060099 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060237 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060375 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060524 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060669 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060814 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.060952 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.061582 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062025 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062155 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062288 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062288 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062506 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062625 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062731 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.062731 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063010 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063132 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063226 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063359 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063496 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063619 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063707 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063823 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.063942 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.064132 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.064261 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.064516 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.064703 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.064793 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.064884 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.065161 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-13 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.065311 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-13 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.065521 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.065659 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.065854 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066051 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066140 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066221 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066518 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066672 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066824 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.066943 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067151 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067296 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067386 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067476 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067767 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067906 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.067999 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.068077 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.068351 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.068487 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.068662 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.068782 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.068977 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069072 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069297 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069388 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069597 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069683 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069897 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.069981 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.070202 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.070287 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.070518 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.070615 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.070886 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.070976 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.071179 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.071268 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.071423 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.071513 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.071727 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.071810 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072039 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072138 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072358 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072447 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072673 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072759 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.072921 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073020 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073188 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073277 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073503 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073590 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073818 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.073904 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.074125 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.074216 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.074430 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.074526 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.074737 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075003 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075095 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075329 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075485 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075634 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075798 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.075937 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.076108 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.076240 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.076414 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.076557 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.076719 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.076871 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.077038 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.077215 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.077377 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.077522 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.077697 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.077831 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078003 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078222 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078305 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078471 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078711 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078803 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.078955 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.079100 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.079258 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.079402 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.079591 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.079710 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.079903 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080027 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080207 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080350 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080519 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080653 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080834 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.080957 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.081152 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.081288 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.081455 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.081606 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.081754 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.081939 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082069 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082243 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082401 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082484 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082701 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082793 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.082945 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083067 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083239 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083385 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083538 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083688 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083854 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.083992 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.084159 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.084295 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.084541 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.084719 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.084802 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.084886 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085040 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085199 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085361 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085498 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085666 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085807 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.085966 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.086089 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.086265 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.086417 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.086590 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.086718 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.086893 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087020 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087192 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087318 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087493 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087635 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087791 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.087953 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.088106 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.088258 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.088421 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.088561 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.088724 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.088864 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089025 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089193 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089349 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089510 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089649 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089812 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.089963 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.090116 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.090264 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.090439 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.090566 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.090737 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.090881 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091039 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091180 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091353 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091480 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091658 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091798 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.091963 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.092097 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.092277 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.092401 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.092574 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.092712 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.092874 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093008 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093213 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093315 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093569 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093677 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093819 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.093920 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.094119 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.094219 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.094419 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.094504 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.094783 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.094878 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095009 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095095 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095310 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095395 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095609 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095692 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095905 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.095988 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.096208 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.096292 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.096520 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.096603 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.096828 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.096923 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.097150 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.097240 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.097456 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.097539 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.097757 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.097859 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.098071 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 15:51:27.098155 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.098404 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.098488 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.098730 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.098835 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.099042 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.099125 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.099363 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.099445 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.099691 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.099782 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100007 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100090 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100317 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100399 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100625 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100716 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.100933 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101023 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101268 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101365 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101575 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101658 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101880 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.101963 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.102247 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.102336 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.102562 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.102647 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.102874 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.102967 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.103195 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.103277 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.103506 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.103589 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.103819 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.103902 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.104130 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.104220 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.104434 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.104519 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.104746 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.104878 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.105065 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.105221 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.105385 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.105467 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.105696 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.105780 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106033 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106116 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106355 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106439 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106664 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106745 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.106982 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107074 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107289 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107379 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107592 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107674 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107897 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.107998 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.108201 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.108284 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.108518 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.108601 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.108827 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.108932 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.109164 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.109263 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.109478 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.109560 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.110100 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.110204 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.110406 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.110490 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.110710 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.110792 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111017 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111101 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111323 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111413 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111652 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111735 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.111960 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112043 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112269 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112358 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112575 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112661 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112882 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.112966 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.113212 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.113308 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.113521 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.113639 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.113824 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.113908 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.114126 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.114209 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.114424 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.114515 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.114725 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.114843 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115027 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115117 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115324 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115415 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115639 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115729 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.115947 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116031 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116246 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116336 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116571 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116654 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116869 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.116952 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121150 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121317 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121317 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121454 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121532 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121601 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121676 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121751 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121818 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121883 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.121947 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122011 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122084 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122150 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122225 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122291 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122356 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122425 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122499 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122565 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122630 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122700 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122766 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122841 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122918 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.122985 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123049 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123114 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123178 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123249 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123316 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123386 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123452 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123533 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123598 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123674 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123749 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123822 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123888 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.123952 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124017 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124089 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124155 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124220 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124292 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124364 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124429 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124505 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124572 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124636 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124699 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124764 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.124942 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125029 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125268 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125355 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125577 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125663 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125878 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.125971 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.126179 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.126262 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.126479 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.126563 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.126785 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.126876 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.127083 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.127186 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.127382 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.127477 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.127680 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.127782 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128008 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128143 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128276 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128405 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128606 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128707 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.128955 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129086 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129223 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129304 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129569 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129704 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129831 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.129929 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.130192 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.130347 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.130471 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.130566 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.130835 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.130968 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.131168 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.131316 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.131454 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.131551 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.131815 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.131943 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132071 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132166 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132408 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132539 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132718 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132850 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.132996 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.133158 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.133400 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.133534 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.133713 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.133846 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134009 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134094 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134324 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134457 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134639 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134773 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.134915 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135007 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135237 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135334 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135540 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135637 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135848 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.135946 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.136145 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.136234 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.136458 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.136556 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.136791 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.136885 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.137124 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.137206 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.137440 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.137535 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.137748 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.137838 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138055 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138152 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138360 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138457 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138668 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138765 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.138960 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139092 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139277 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139391 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139581 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139671 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139872 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.139964 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.140235 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.140337 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.140483 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.140569 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.140784 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.140869 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.141159 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.141266 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.141415 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.141499 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.141717 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.141802 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142013 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142109 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142322 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142408 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142646 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142732 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.142958 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143043 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143267 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143360 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143575 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143659 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143881 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.143967 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.144191 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.144285 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.144495 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.144629 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.144797 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.144881 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.145116 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.145251 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.145420 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.145520 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.145724 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.145813 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146031 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146115 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146332 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146431 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146633 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146719 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.146930 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147013 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147237 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147331 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147539 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147623 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147838 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.147930 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.148135 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.148222 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.148439 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.148524 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.148747 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.148861 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.149079 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.149189 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.149415 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.149502 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.149721 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.149805 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150023 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150124 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150321 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150414 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150636 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150729 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.150939 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151024 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151236 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151321 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151536 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151633 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151831 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.151916 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.152166 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.152252 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.152465 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.152557 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.152760 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.152844 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.153068 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.153218 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.153401 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.153499 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.153703 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.153788 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154015 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154098 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154315 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154417 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154618 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154705 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.154934 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155029 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155240 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155379 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155545 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155631 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155849 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.155935 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.156153 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.156247 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.156456 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.156541 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.156759 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.156845 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.157069 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.157254 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.157395 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.157480 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.157701 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.157786 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158002 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158096 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158301 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158385 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158605 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158700 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.158917 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.159192 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.159489 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.159579 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.159824 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.159925 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.160137 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.160222 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.160450 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.160535 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.160765 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.160857 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.161076 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.161194 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.161424 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.161540 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.161749 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.161862 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162053 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162151 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162365 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162459 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162670 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162755 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.162968 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163059 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163268 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163360 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163569 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163676 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163875 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.163975 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.164175 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.164273 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.164523 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.164617 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.164825 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.164927 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.165141 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.165241 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.165448 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.165544 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.165748 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.165840 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166047 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166131 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166349 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166439 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166648 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166732 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.166946 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167028 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167245 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167327 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167556 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167640 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167857 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.167949 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.168155 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.168237 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.168456 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.168548 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.168751 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.168834 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.169085 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.169208 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.169405 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.169498 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.169739 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.169823 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170064 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170155 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170389 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170473 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170692 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170777 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.170991 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171082 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171305 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171389 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171606 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171705 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171906 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.171997 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.172203 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.172285 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.172509 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.172594 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.172809 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.172892 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.173120 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.173207 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.173431 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.173517 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.173737 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.173821 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174043 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174127 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174344 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174436 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174643 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174731 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.174942 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175032 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175235 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175334 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175546 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175642 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175844 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.175936 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.176138 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.176235 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.176434 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.176518 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.176739 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.176823 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177038 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177154 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177362 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177451 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177663 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177746 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.177959 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178050 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178267 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178349 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178565 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178647 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178866 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.178958 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.179167 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.179251 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.179472 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.179554 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.179776 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.179860 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.180100 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.180188 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.180420 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.180511 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.180725 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.180817 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181024 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181129 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181348 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181432 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181653 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181746 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.181955 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182038 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182253 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182338 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182556 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182641 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182871 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.182954 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.183174 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.183272 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.183472 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.183555 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.183771 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.183854 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184068 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184163 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184370 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184501 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184665 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184748 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.184965 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.185064 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.185285 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.185378 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.185590 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.185708 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.185953 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186133 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186232 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186315 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186467 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186561 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186781 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.186875 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187081 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187173 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187378 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187492 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187667 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187753 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.187966 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.188077 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.188297 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.188391 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.188595 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.188688 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.188946 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189046 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189268 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189362 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189578 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189666 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189892 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.189985 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.190198 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.190292 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.190524 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.190641 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.190807 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.190896 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.191106 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.191200 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.191414 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.191498 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.191717 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.191803 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192018 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192118 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192318 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192400 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192615 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192698 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.192929 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.193025 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.193257 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.193341 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.193563 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.193646 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.193883 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194013 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194193 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194276 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194494 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194583 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194798 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.194889 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.195102 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.195186 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.195405 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.195487 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.195757 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.195864 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196064 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196168 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196368 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196483 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196678 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196776 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.196983 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.197075 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.197315 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.197411 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.197617 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.197702 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.197919 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198001 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198217 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198309 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198521 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198604 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198820 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.198901 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.199119 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.199214 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.199515 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.199614 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.199735 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.199821 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200031 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200128 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200333 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200417 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200629 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200713 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.200930 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.201014 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.201249 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.201392 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.201678 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.201762 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.201986 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202073 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202285 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202369 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202581 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202671 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202889 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.202981 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.203191 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.203280 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.203499 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.203590 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.203802 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.203890 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.204098 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.204216 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.204506 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.204589 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.204810 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.204938 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.205130 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.205209 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.205437 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.205526 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.205893 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.205995 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206085 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206160 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206315 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206401 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206633 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206725 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.206933 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207097 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207216 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207334 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207516 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207622 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207827 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.207973 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.208128 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.208229 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.208441 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.208557 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.208849 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.208943 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.209172 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.209270 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.209475 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.209595 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.209885 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.209980 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.210192 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.210288 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.210495 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.210590 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.210810 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.210904 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.211124 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.211220 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.211455 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.211558 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.211764 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.211905 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212057 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212144 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212365 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212451 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212689 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212836 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.212991 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.213078 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.213320 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.213435 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.213620 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.213704 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.213928 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214087 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214248 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214408 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214551 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214673 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214855 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.214988 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.215176 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.215281 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.215575 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.215664 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.215886 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.215999 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.216190 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.216284 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.216507 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.216593 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.216807 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.216893 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.217116 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.217205 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.217421 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.217515 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.217723 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.217817 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218018 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218105 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218318 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218411 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218626 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218717 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.218923 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219016 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219226 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219312 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219530 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219616 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219829 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.219912 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.220123 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.220233 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.220421 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.220513 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.220730 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.220828 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221026 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221168 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221367 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221455 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221674 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221766 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.221989 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.222159 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.222293 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.222400 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.222599 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.222825 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223026 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223180 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223325 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223523 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223523 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223781 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.223913 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224085 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224225 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224366 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224514 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224647 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224861 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.224952 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225020 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225220 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225347 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225470 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225601 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225804 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.225898 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.226141 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.226242 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.226470 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.226573 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.226836 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.226955 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.227257 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.227354 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.227582 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.227669 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.227886 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.227971 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.228189 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.228291 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.228492 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.228580 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.228793 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.228879 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.229116 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.229206 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.229421 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.229507 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.229726 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.229810 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230026 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230111 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230328 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230413 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230631 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230723 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.230945 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231039 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231250 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231335 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231569 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231654 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231874 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.231968 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.232180 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.232306 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.232480 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.232577 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.232792 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.232889 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.233123 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.233221 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.233428 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.233514 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.233764 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.233864 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.234088 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.234174 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.234411 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.234497 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.235058 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.235151 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.235369 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.235506 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.235689 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.235776 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236005 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236092 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236317 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236415 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236628 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236712 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.236938 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.237023 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.237278 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.237384 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.237589 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.237677 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.237904 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238000 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238208 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238294 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238520 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238607 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238831 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.238920 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.239144 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.239239 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.239716 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.239811 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240046 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240140 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240358 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240445 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240670 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240764 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.240980 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.241065 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.241316 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.241406 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.241625 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.241720 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.241932 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242019 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242239 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242372 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242565 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242657 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242877 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.242977 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.243200 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.243294 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.243517 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.243623 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.243848 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.243985 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.244176 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.244266 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.244488 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.244576 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.244800 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.244887 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.245130 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.245259 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.245436 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.245660 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.245793 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.245944 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246086 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246216 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246363 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246491 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246662 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246803 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.246971 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.247102 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.247280 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.247409 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.247587 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.247717 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.247893 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248032 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248203 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248333 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248511 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248639 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248819 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.248953 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.249147 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.249279 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.249460 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.249612 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.249769 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.249898 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.250089 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.250218 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.250421 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.250561 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.250736 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.250865 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.251048 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.251183 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.251356 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.251503 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.251667 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.251802 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.252182 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.252313 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.252495 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.252580 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.252810 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.252904 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.253158 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.253330 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.253487 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.253635 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.253772 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.253905 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.254081 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.254213 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.254434 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.254572 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.254710 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.254866 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255013 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255108 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255272 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255361 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255578 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255679 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255881 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.255990 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.256198 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.256292 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.256505 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.256602 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.256801 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.256898 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.257136 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.257285 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.257444 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.257585 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.257975 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.258125 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.258375 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.258508 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.258689 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.258817 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259012 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259148 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259333 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259463 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259650 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259786 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.259939 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.260078 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.260256 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.260393 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.260560 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.260690 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.260863 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261004 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261196 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261286 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261504 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261592 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261807 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.261894 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.262105 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.262189 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.262413 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.262507 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.262720 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.262814 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263044 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263151 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263324 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263424 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263622 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263708 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.263946 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264037 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264246 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264340 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264548 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264642 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264848 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.264934 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.265175 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.265278 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.265476 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.265571 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.265775 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.265906 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266077 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266167 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266373 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266468 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266683 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266804 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.266982 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267108 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267286 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267395 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267584 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267672 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267889 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.267977 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.268186 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.268272 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.268488 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.268574 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.268834 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.268929 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.269173 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.269430 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.269528 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.269617 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.269761 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.269847 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.270074 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.270259 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.270383 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.270481 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.270704 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.270789 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271009 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271153 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271314 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271410 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271658 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271796 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.271970 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.272100 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.272500 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.272652 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.272832 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.272960 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.273173 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.273290 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.273504 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.273609 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.273882 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.273986 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.274193 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.274288 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.274554 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.274657 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.274855 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.274942 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.275109 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.275197 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.275418 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.275518 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.275725 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.275819 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276035 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276138 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276340 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276426 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276644 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276730 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.276949 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277043 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277282 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277378 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277591 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277676 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277893 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.277986 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.278198 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.278284 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.278504 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.278599 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.278808 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.278902 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.279112 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.279214 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.279422 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.279515 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.279756 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.279842 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.280084 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.280187 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.280383 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.280468 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.280696 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.280783 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281005 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281140 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281335 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281421 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281643 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281730 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.281944 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282030 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282245 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282338 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282556 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282642 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282879 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.282981 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.283186 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.283372 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.283490 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.283601 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.283915 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284020 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284220 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284325 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284533 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284670 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284845 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.284975 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.285168 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.285259 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.285487 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.285573 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.285804 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.285898 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.286120 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.286254 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.286428 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.286515 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.286733 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.286829 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.287058 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.287158 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.287388 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.287485 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.287715 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.287817 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288036 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288123 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288337 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288424 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288636 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288730 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.288935 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289022 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289268 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289405 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289605 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289707 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289912 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.289999 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.290209 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.290294 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.290505 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.290600 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.290807 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.290897 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291104 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291190 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291401 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291488 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291696 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291781 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.291992 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292078 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292293 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292380 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292590 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292675 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292885 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.292970 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.293201 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.293304 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.293500 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.293601 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.293804 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.293957 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.294098 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.294186 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.294403 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.294496 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.294700 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.294794 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295001 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295097 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295297 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295391 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295594 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295693 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295888 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.295973 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.296232 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.296357 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.296542 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.296637 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.296852 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.296945 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.297188 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.297277 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.297495 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.297601 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.297810 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.297897 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.298112 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.298198 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.298427 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.298514 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.298743 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.298829 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299052 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299136 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299354 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299449 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299679 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299764 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.299983 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.300068 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.300288 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.300375 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.300631 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.300732 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.301341 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.301506 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.301599 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.301668 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.301733 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.301967 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302052 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302140 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302264 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302343 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302417 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302503 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302760 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.302905 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.303076 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.303168 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.303341 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.303451 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.303653 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.303742 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304016 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304131 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304288 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304388 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304597 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304695 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304901 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.304988 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.305277 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.305396 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.305593 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.305772 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.305941 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306073 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306205 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306360 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306514 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306598 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306780 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.306867 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.307092 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.307196 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.307404 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.307493 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.307726 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.307820 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308050 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308150 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308354 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308439 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308707 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308819 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.308997 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.309261 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.309497 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.309592 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.309814 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.309900 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.309993 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.310076 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.310396 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.310484 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.310580 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.310808 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.310910 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.311008 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.311180 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.311422 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 15:51:27.311677 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 15:51:27.311839 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 15:51:27.466203 n-d-846219-13 devstack@n-api.service[104023]: INFO dbcounter [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Registered counter for database nova_api Jul 25 15:51:27.466434 n-d-846219-13 devstack@n-api.service[104024]: INFO dbcounter [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Registered counter for database nova_api Jul 25 15:51:27.487649 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_db.sqlalchemy.engines [None req-a0930113-10cd-42af-9bce-42354e994147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.490642 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_db.sqlalchemy.engines [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.495508 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writer thread running {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.497377 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writer thread running {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.551492 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.context [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=104023) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 15:51:27.552728 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.context [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=104024) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 15:51:27.555685 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:51:27.556678 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_concurrency.lockutils [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:51:27.557251 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:51:27.558028 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:51:27.558278 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_concurrency.lockutils [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:51:27.559062 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_concurrency.lockutils [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:51:27.560036 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:51:27.561058 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_concurrency.lockutils [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:51:27.562110 n-d-846219-13 devstack@n-api.service[104023]: INFO dbcounter [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Registered counter for database nova_cell0 Jul 25 15:51:27.563117 n-d-846219-13 devstack@n-api.service[104024]: INFO dbcounter [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Registered counter for database nova_cell0 Jul 25 15:51:27.568021 n-d-846219-13 devstack@n-api.service[104023]: INFO dbcounter [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Registered counter for database nova_cell1 Jul 25 15:51:27.568884 n-d-846219-13 devstack@n-api.service[104024]: INFO dbcounter [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Registered counter for database nova_cell1 Jul 25 15:51:27.576893 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_db.sqlalchemy.engines [None req-a0930113-10cd-42af-9bce-42354e994147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.578376 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_db.sqlalchemy.engines [None req-a0930113-10cd-42af-9bce-42354e994147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.579769 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_db.sqlalchemy.engines [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.581457 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_db.sqlalchemy.engines [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.584225 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writer thread running {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.586175 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writer thread running {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.722156 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writer thread running {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.722396 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writer thread running {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.732670 n-d-846219-13 devstack@n-api.service[104024]: INFO dbcounter [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Registered counter for database nova_cell0 Jul 25 15:51:27.732849 n-d-846219-13 devstack@n-api.service[104023]: INFO dbcounter [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Registered counter for database nova_cell0 Jul 25 15:51:27.741707 n-d-846219-13 devstack@n-api.service[104024]: DEBUG oslo_db.sqlalchemy.engines [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.745306 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_db.sqlalchemy.engines [None req-a0930113-10cd-42af-9bce-42354e994147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 15:51:27.747385 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writer thread running {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:27.750744 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writer thread running {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 15:51:28.078420 n-d-846219-13 devstack@n-api.service[104023]: WARNING keystonemiddleware.auth_token [None req-a0930113-10cd-42af-9bce-42354e994147 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 15:51:28.080108 n-d-846219-13 devstack@n-api.service[104024]: WARNING keystonemiddleware.auth_token [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 15:51:28.085680 n-d-846219-13 devstack@n-api.service[104023]: WARNING keystonemiddleware.auth_token [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 15:51:28.087523 n-d-846219-13 devstack@n-api.service[104024]: WARNING keystonemiddleware.auth_token [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 15:51:28.425610 n-d-846219-13 devstack@n-api.service[104023]: WARNING keystonemiddleware.auth_token [None req-a0930113-10cd-42af-9bce-42354e994147 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 15:51:28.431608 n-d-846219-13 devstack@n-api.service[104023]: WARNING keystonemiddleware.auth_token [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 15:51:28.432560 n-d-846219-13 devstack@n-api.service[104024]: WARNING keystonemiddleware.auth_token [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 15:51:28.436895 n-d-846219-13 devstack@n-api.service[104023]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560d622499c0 pid: 104023 (default app) Jul 25 15:51:28.438577 n-d-846219-13 devstack@n-api.service[104024]: WARNING keystonemiddleware.auth_token [None req-d92cba0e-ba2b-4523-8b2d-267e14f540d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 15:51:28.439133 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:51:28.440310 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-a0930113-10cd-42af-9bce-42354e994147 None None] 10.222.0.105 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001800 Jul 25 15:51:28.440728 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 1/1] 10.222.0.105 () {50 vars in 793 bytes} [Mon Jul 25 15:51:28 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:51:28.444087 n-d-846219-13 devstack@n-api.service[104024]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560d622499c0 pid: 104024 (default app) Jul 25 15:52:49.453328 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:49.454321 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-a0930113-10cd-42af-9bce-42354e994147 None None] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001465 Jul 25 15:52:49.454725 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 2/2] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:52:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:49.470705 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_api:SELECT=3 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:49.472137 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_cell1:SELECT=3 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:49.473179 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_cell0:SELECT=3 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:49.473917 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:50.394279 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-0feb2aa1-cdec-404c-b4c7-02d8c0f21586 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:50.428848 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-0feb2aa1-cdec-404c-b4c7-02d8c0f21586 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.967229 Jul 25 15:52:50.429721 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 1/3] 10.222.0.105 () {60 vars in 1296 bytes} [Mon Jul 25 15:52:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:52.626054 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-a0930113-10cd-42af-9bce-42354e994147 None None] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:52.627852 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-a0930113-10cd-42af-9bce-42354e994147 None None] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003305 Jul 25 15:52:52.628601 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 3/4] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:52:52 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:53.067033 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-b336dbec-3b5e-41b7-a23d-60a34b5aae93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:53.086803 n-d-846219-13 devstack@n-api.service[104024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:52:53.086803 n-d-846219-13 devstack@n-api.service[104024]: warnings.warn(msg) Jul 25 15:52:53.117564 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-b336dbec-3b5e-41b7-a23d-60a34b5aae93 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.482148 Jul 25 15:52:53.125273 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 2/5] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:52:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:52:53.131978 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_api:SELECT=3 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:53.133579 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_cell0:SELECT=3 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:53.134859 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_cell1:SELECT=3 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:53.135660 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:53.338713 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-fea0d4ca-5613-4e6a-961d-d37e95b573cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:53.343144 n-d-846219-13 devstack@n-api.service[104023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:52:53.343144 n-d-846219-13 devstack@n-api.service[104023]: warnings.warn(msg) Jul 25 15:52:53.413572 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-fea0d4ca-5613-4e6a-961d-d37e95b573cb admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286989 Jul 25 15:52:53.414164 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 4/6] 10.222.0.105 () {64 vars in 1340 bytes} [Mon Jul 25 15:52:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:55.708786 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-b336dbec-3b5e-41b7-a23d-60a34b5aae93 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:55.709817 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-b336dbec-3b5e-41b7-a23d-60a34b5aae93 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001582 Jul 25 15:52:55.710673 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 3/7] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:52:55 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:56.542618 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-6a04b720-a218-4fec-bd5e-6b35cbb9d69f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:56.561660 n-d-846219-13 devstack@n-api.service[104023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:52:56.561660 n-d-846219-13 devstack@n-api.service[104023]: warnings.warn(msg) Jul 25 15:52:56.581025 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-6a04b720-a218-4fec-bd5e-6b35cbb9d69f admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.864335 Jul 25 15:52:56.581934 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 5/8] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:52:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:52:56.593465 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-677eea44-c4a9-4367-8693-e75660ff1a73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:56.596674 n-d-846219-13 devstack@n-api.service[104024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:52:56.596674 n-d-846219-13 devstack@n-api.service[104024]: warnings.warn(msg) Jul 25 15:52:56.633074 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-677eea44-c4a9-4367-8693-e75660ff1a73 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043320 Jul 25 15:52:56.633761 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 4/9] 10.222.0.105 () {64 vars in 1340 bytes} [Mon Jul 25 15:52:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:58.912891 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-6a04b720-a218-4fec-bd5e-6b35cbb9d69f admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:58.914218 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-6a04b720-a218-4fec-bd5e-6b35cbb9d69f admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001917 Jul 25 15:52:58.924403 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 6/10] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:52:58 2022] GET /compute/v2.1 => generated 389 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:59.552627 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-f4e1117d-76e0-4f9f-8472-97b7b55b047a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:59.575641 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-f4e1117d-76e0-4f9f-8472-97b7b55b047a admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.654040 Jul 25 15:52:59.584161 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 5/11] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:52:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:52:59.590751 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-7146eb4c-1403-4a79-9ec3-863bd1c5794f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:59.625769 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-7146eb4c-1403-4a79-9ec3-863bd1c5794f admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039644 Jul 25 15:52:59.634218 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 7/12] 10.222.0.105 () {64 vars in 1340 bytes} [Mon Jul 25 15:52:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:02.058097 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-f4e1117d-76e0-4f9f-8472-97b7b55b047a admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:02.059220 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-f4e1117d-76e0-4f9f-8472-97b7b55b047a admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001707 Jul 25 15:53:02.059923 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 6/13] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:02 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:02.483217 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-52afe2a7-89bc-4689-95df-2d47532b0c14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "ram": 2048}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:02.505167 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-52afe2a7-89bc-4689-95df-2d47532b0c14 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.437749 Jul 25 15:53:02.506047 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 8/14] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:02.518641 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-dca7562d-ca77-4deb-a3e8-7c732b218205 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:02.545724 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-dca7562d-ca77-4deb-a3e8-7c732b218205 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030927 Jul 25 15:53:02.546307 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 7/15] 10.222.0.105 () {64 vars in 1340 bytes} [Mon Jul 25 15:53:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:04.808412 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-52afe2a7-89bc-4689-95df-2d47532b0c14 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:04.809450 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-52afe2a7-89bc-4689-95df-2d47532b0c14 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001483 Jul 25 15:53:04.809880 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 9/16] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:05.329324 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-247a4302-99af-4177-a3aa-53a60d4b11a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:05.353654 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-247a4302-99af-4177-a3aa-53a60d4b11a1 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.537365 Jul 25 15:53:05.354588 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 8/17] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:05.367684 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-443a1d21-0fa1-4d03-9dfe-f4617d33a4b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:05.405869 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-443a1d21-0fa1-4d03-9dfe-f4617d33a4b8 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041847 Jul 25 15:53:05.409556 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 10/18] 10.222.0.105 () {64 vars in 1340 bytes} [Mon Jul 25 15:53:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:07.863362 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-247a4302-99af-4177-a3aa-53a60d4b11a1 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:07.865077 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-247a4302-99af-4177-a3aa-53a60d4b11a1 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002151 Jul 25 15:53:07.870120 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 9/19] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:07 2022] GET /compute/v2.1 => generated 389 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:08.346343 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-10f1093e-2059-4ba7-91a5-744fdc7e005d admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:08.379883 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-10f1093e-2059-4ba7-91a5-744fdc7e005d admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.507445 Jul 25 15:53:08.395199 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 11/20] 10.222.0.105 () {60 vars in 1296 bytes} [Mon Jul 25 15:53:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:10.722251 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-247a4302-99af-4177-a3aa-53a60d4b11a1 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:10.723436 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-247a4302-99af-4177-a3aa-53a60d4b11a1 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001637 Jul 25 15:53:10.723905 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 10/21] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:11.185846 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1694d9d6-e25a-42f7-8618-6c35c73edd28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:11.207061 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-1694d9d6-e25a-42f7-8618-6c35c73edd28 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476311 Jul 25 15:53:11.207635 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 12/22] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 15:53:11.219801 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-67ea2e0d-05a1-475f-8c06-9878301895e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:11.259271 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-67ea2e0d-05a1-475f-8c06-9878301895e4 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042931 Jul 25 15:53:11.260203 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 11/23] 10.222.0.105 () {64 vars in 1337 bytes} [Mon Jul 25 15:53:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:53:13.619200 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1694d9d6-e25a-42f7-8618-6c35c73edd28 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:13.620273 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-1694d9d6-e25a-42f7-8618-6c35c73edd28 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001602 Jul 25 15:53:13.620643 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 13/24] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:13 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:53:14.075480 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-282b4715-3ebe-4753-b082-b488f7dae799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "vcpus": 1, "swap": 0, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:14.097929 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-282b4715-3ebe-4753-b082-b488f7dae799 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.470468 Jul 25 15:53:14.098788 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 12/25] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:14.116466 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-e9053107-1dac-44e4-9cba-273a23aa94bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:14.142869 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-e9053107-1dac-44e4-9cba-273a23aa94bc admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030077 Jul 25 15:53:14.143454 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 14/26] 10.222.0.105 () {64 vars in 1337 bytes} [Mon Jul 25 15:53:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:16.445372 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-282b4715-3ebe-4753-b082-b488f7dae799 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:16.446743 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-282b4715-3ebe-4753-b082-b488f7dae799 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002049 Jul 25 15:53:16.447214 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 13/27] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:16 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:16.869968 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-bf15e856-da48-42ae-b3db-11dc580148f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:16.889247 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-bf15e856-da48-42ae-b3db-11dc580148f0 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.435402 Jul 25 15:53:16.889799 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 15/28] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 15:53:16.901790 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-a4155aad-a524-45ef-982b-5827066ec3ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:16.926769 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-a4155aad-a524-45ef-982b-5827066ec3ca admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028646 Jul 25 15:53:16.927364 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 14/29] 10.222.0.105 () {64 vars in 1337 bytes} [Mon Jul 25 15:53:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:19.114535 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-bf15e856-da48-42ae-b3db-11dc580148f0 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:19.116158 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-bf15e856-da48-42ae-b3db-11dc580148f0 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002061 Jul 25 15:53:19.116551 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 16/30] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:19.510720 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-958603f4-ad81-4dcc-814c-5e355f1e7dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:19.517201 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:53:19.536737 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-958603f4-ad81-4dcc-814c-5e355f1e7dfc admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.413921 Jul 25 15:53:19.537328 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 15/31] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:19.549218 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-465971af-29b6-42c1-9d65-f74b5fcfc8b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:19.577516 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-465971af-29b6-42c1-9d65-f74b5fcfc8b2 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031914 Jul 25 15:53:19.578226 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 17/32] 10.222.0.105 () {64 vars in 1337 bytes} [Mon Jul 25 15:53:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:21.858611 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-958603f4-ad81-4dcc-814c-5e355f1e7dfc admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:21.860299 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-958603f4-ad81-4dcc-814c-5e355f1e7dfc admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002137 Jul 25 15:53:21.860701 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 16/33] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:21 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:22.330171 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1e8a6604-13b5-4301-8e47-eb1269d3da5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:22.351201 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-1e8a6604-13b5-4301-8e47-eb1269d3da5d admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.483154 Jul 25 15:53:22.352222 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 18/34] 10.222.0.105 () {64 vars in 1287 bytes} [Mon Jul 25 15:53:21 2022] POST /compute/v2.1/flavors => generated 410 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:22.366463 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-faafc48e-fc1f-43a1-b1bf-9231d626885f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:22.392318 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-faafc48e-fc1f-43a1-b1bf-9231d626885f admin admin] 10.222.0.105 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029548 Jul 25 15:53:22.392901 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 17/35] 10.222.0.105 () {64 vars in 1337 bytes} [Mon Jul 25 15:53:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:53:47.455561 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1e8a6604-13b5-4301-8e47-eb1269d3da5d admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:47.456979 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-1e8a6604-13b5-4301-8e47-eb1269d3da5d admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001889 Jul 25 15:53:47.457545 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 19/36] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:53:47 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:47.476132 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:53:47.928150 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-f8dcd703-a591-4da3-9d19-a22c48c87be1 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:47.949461 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-f8dcd703-a591-4da3-9d19-a22c48c87be1 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.481082 Jul 25 15:53:47.949975 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 18/37] 10.222.0.105 () {60 vars in 1296 bytes} [Mon Jul 25 15:53:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:49.099765 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1e8a6604-13b5-4301-8e47-eb1269d3da5d admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:49.100784 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-1e8a6604-13b5-4301-8e47-eb1269d3da5d admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001497 Jul 25 15:53:49.101200 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 20/38] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:49.684452 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-4e8c3fbf-b775-4dcb-a583-6a44dd3a8d3c admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:49.691285 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.wsgi [None req-4e8c3fbf-b775-4dcb-a583-6a44dd3a8d3c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-4e8c3fbf-b775-4dcb-a583-6a44dd3a8d3c admin admin] Request method failure captured: Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Accept: application/json Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Accept-Encoding: gzip, deflate Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Connection: keep-alive Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Content-Length: 0 Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Host: 10.222.0.105 Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Openstack-Api-Version: compute 2.90 Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: Openstack-System-Scope: None Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: User-Agent: python-novaclient Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Auth-Token: gAAAAABi3ryMkog6IUmTBTth_oZUkd8Qmo4slPRQdmtb7l0nuGKW76hBvU-eyMb36w9nqx6zX0tU5geCgTT8EkA45jJyRv-oS1IJE6fZgK-5p9wAQxel7kIGLG_VNjWun9oagXa6ST4_CrbAYwBVmphhKVrJVkc2NjgdOY6T2Glx1-Meq0Wh7B8 Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Domain-Id: None Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Domain-Name: None Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Identity-Status: Confirmed Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Is-Admin-Project: True Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Domain-Id: default Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Domain-Name: Default Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Name: admin Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Role: member,admin,reader Jul 25 15:53:49.694819 n-d-846219-13 devstack@n-api.service[104024]: X-Roles: member,admin,reader Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_99832ff3355b442bb0a22a57a27d991d"}]}] Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant: admin Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant-Name: admin Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-User: admin Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-User-Domain-Id: default Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-User-Domain-Name: Default Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-User-Id: 003047e3d1f24645a60e058da25210e3 Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: X-User-Name: admin Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: method: > Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: exception: Flavor 42 could not be found. Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: action_args: {'id': '42'} Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:53:49.696549 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:49.698890 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.700266 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-4e8c3fbf-b775-4dcb-a583-6a44dd3a8d3c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:53:49.701714 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-4e8c3fbf-b775-4dcb-a583-6a44dd3a8d3c admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.449959 Jul 25 15:53:49.701714 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 19/39] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 15:53:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 15:53:49.706358 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-3b38e922-40df-49ae-b8cb-39e33914118b admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:49.710656 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:53:49.731346 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-3b38e922-40df-49ae-b8cb-39e33914118b admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028676 Jul 25 15:53:49.731946 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 21/40] 10.222.0.105 () {60 vars in 1215 bytes} [Mon Jul 25 15:53:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:49.742271 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-3bdeb8e3-04fb-49e5-a0d7-71878f716202 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:49.767031 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-3bdeb8e3-04fb-49e5-a0d7-71878f716202 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028487 Jul 25 15:53:49.767599 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 20/41] 10.222.0.105 () {60 vars in 1215 bytes} [Mon Jul 25 15:53:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:49.777738 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1b222916-03e2-44b9-a3aa-36021f38bd76 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:49.787760 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.wsgi [None req-1b222916-03e2-44b9-a3aa-36021f38bd76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1b222916-03e2-44b9-a3aa-36021f38bd76 admin admin] Request method failure captured: Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Accept: application/json Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Accept-Encoding: gzip, deflate Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Connection: keep-alive Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Content-Length: 0 Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Host: 10.222.0.105 Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Openstack-Api-Version: compute 2.90 Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: Openstack-System-Scope: None Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: User-Agent: python-novaclient Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Auth-Token: gAAAAABi3ryMkog6IUmTBTth_oZUkd8Qmo4slPRQdmtb7l0nuGKW76hBvU-eyMb36w9nqx6zX0tU5geCgTT8EkA45jJyRv-oS1IJE6fZgK-5p9wAQxel7kIGLG_VNjWun9oagXa6ST4_CrbAYwBVmphhKVrJVkc2NjgdOY6T2Glx1-Meq0Wh7B8 Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Domain-Id: None Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Domain-Name: None Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Identity-Status: Confirmed Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Is-Admin-Project: True Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Domain-Id: default Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Domain-Name: Default Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Name: admin Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Role: member,admin,reader Jul 25 15:53:49.791582 n-d-846219-13 devstack@n-api.service[104023]: X-Roles: member,admin,reader Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_99832ff3355b442bb0a22a57a27d991d"}]}] Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant: admin Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant-Name: admin Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-User: admin Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-User-Domain-Id: default Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-User-Domain-Name: Default Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-User-Id: 003047e3d1f24645a60e058da25210e3 Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: X-User-Name: admin Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: method: > Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: exception: Flavor 42 could not be found. Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: action_args: {'id': '42'} Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:53:49.793118 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:49.794091 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:49.795414 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-1b222916-03e2-44b9-a3aa-36021f38bd76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:53:49.796489 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-1b222916-03e2-44b9-a3aa-36021f38bd76 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018514 Jul 25 15:53:49.796489 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 22/42] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 15:53:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 15:53:50.820368 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-3bdeb8e3-04fb-49e5-a0d7-71878f716202 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:50.821553 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-3bdeb8e3-04fb-49e5-a0d7-71878f716202 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001661 Jul 25 15:53:50.821961 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 21/43] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:50 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:51.433935 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-cad37779-0a24-4043-8cf3-4c3b79c2a12d admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:51.440262 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.wsgi [None req-cad37779-0a24-4043-8cf3-4c3b79c2a12d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-cad37779-0a24-4043-8cf3-4c3b79c2a12d admin admin] Request method failure captured: Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Accept: application/json Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Accept-Encoding: gzip, deflate Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Connection: keep-alive Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Content-Length: 0 Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Host: 10.222.0.105 Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Openstack-Api-Version: compute 2.90 Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: Openstack-System-Scope: None Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: User-Agent: python-novaclient Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Auth-Token: gAAAAABi3ryOsslQ5OB99EgL0lFPpiY69A_8o7QV4av1NkHW2jIMzxiljMszDIz8JpwUy61-LnvfPvvtRzB0OSJNGPUHXDIrmxgK7Z5Ct_h_goLszuPuFnH5Y3MVjhqAz5Lu1vHzwu8aGcgQkxEgRuQxZ63vBX4-yqKfjFfYBVeDSRRsNmDH4fM Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Domain-Id: None Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Domain-Name: None Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Identity-Status: Confirmed Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Is-Admin-Project: True Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Domain-Id: default Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Domain-Name: Default Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Name: admin Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Role: member,admin,reader Jul 25 15:53:51.441867 n-d-846219-13 devstack@n-api.service[104023]: X-Roles: member,admin,reader Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_99832ff3355b442bb0a22a57a27d991d"}]}] Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant: admin Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant-Name: admin Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-User: admin Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-User-Domain-Id: default Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-User-Domain-Name: Default Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-User-Id: 003047e3d1f24645a60e058da25210e3 Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: X-User-Name: admin Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: method: > Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: exception: Flavor 84 could not be found. Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: action_args: {'id': '84'} Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:53:51.443283 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:51.444147 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.445813 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-cad37779-0a24-4043-8cf3-4c3b79c2a12d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:53:51.446928 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-cad37779-0a24-4043-8cf3-4c3b79c2a12d admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.484487 Jul 25 15:53:51.446928 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 23/44] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 15:53:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 486 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 15:53:51.453563 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-0a1d0e17-2aef-4a5d-92f4-b3b5eb9220a0 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:51.469170 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-0a1d0e17-2aef-4a5d-92f4-b3b5eb9220a0 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019243 Jul 25 15:53:51.470217 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 22/45] 10.222.0.105 () {60 vars in 1215 bytes} [Mon Jul 25 15:53:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 15:53:51.480672 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-e62d41ea-bb86-44e3-a7a5-c47af5954905 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:51.496699 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-e62d41ea-bb86-44e3-a7a5-c47af5954905 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020152 Jul 25 15:53:51.497396 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 24/46] 10.222.0.105 () {60 vars in 1215 bytes} [Mon Jul 25 15:53:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:51.507456 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-44ae1bdd-0e97-4c3b-be13-ee175b6ecdc9 admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:51.513318 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.wsgi [None req-44ae1bdd-0e97-4c3b-be13-ee175b6ecdc9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-44ae1bdd-0e97-4c3b-be13-ee175b6ecdc9 admin admin] Request method failure captured: Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Accept: application/json Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Accept-Encoding: gzip, deflate Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Connection: keep-alive Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Content-Length: 0 Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Host: 10.222.0.105 Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Openstack-Api-Version: compute 2.90 Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: Openstack-System-Scope: None Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: User-Agent: python-novaclient Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Auth-Token: gAAAAABi3ryOsslQ5OB99EgL0lFPpiY69A_8o7QV4av1NkHW2jIMzxiljMszDIz8JpwUy61-LnvfPvvtRzB0OSJNGPUHXDIrmxgK7Z5Ct_h_goLszuPuFnH5Y3MVjhqAz5Lu1vHzwu8aGcgQkxEgRuQxZ63vBX4-yqKfjFfYBVeDSRRsNmDH4fM Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Domain-Id: None Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Domain-Name: None Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Identity-Status: Confirmed Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Is-Admin-Project: True Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Domain-Id: default Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Domain-Name: Default Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Name: admin Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Role: member,admin,reader Jul 25 15:53:51.514844 n-d-846219-13 devstack@n-api.service[104024]: X-Roles: member,admin,reader Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_99832ff3355b442bb0a22a57a27d991d"}]}] Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant: admin Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant-Name: admin Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-User: admin Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-User-Domain-Id: default Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-User-Domain-Name: Default Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-User-Id: 003047e3d1f24645a60e058da25210e3 Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: X-User-Name: admin Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: method: > Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: exception: Flavor 84 could not be found. Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: action_args: {'id': '84'} Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:53:51.516278 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:51.517056 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:51.518186 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-44ae1bdd-0e97-4c3b-be13-ee175b6ecdc9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:53:51.519173 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-44ae1bdd-0e97-4c3b-be13-ee175b6ecdc9 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012422 Jul 25 15:53:51.519173 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 23/47] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 15:53:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 15:53:52.567870 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-e62d41ea-bb86-44e3-a7a5-c47af5954905 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:52.569335 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-e62d41ea-bb86-44e3-a7a5-c47af5954905 admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001756 Jul 25 15:53:52.569876 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 25/48] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:52 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:53.207088 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-f4b011f1-72f6-4a43-acc3-3b8ab60dfd0c admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:53.213728 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.wsgi [None req-f4b011f1-72f6-4a43-acc3-3b8ab60dfd0c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-f4b011f1-72f6-4a43-acc3-3b8ab60dfd0c admin admin] Request method failure captured: Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Accept: application/json Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Accept-Encoding: gzip, deflate Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Connection: keep-alive Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Content-Length: 0 Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Host: 10.222.0.105 Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Openstack-Api-Version: compute 2.90 Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: Openstack-System-Scope: None Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: User-Agent: python-novaclient Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Auth-Token: gAAAAABi3ryQdnuPam9YqBN0JNi-56LhqWfKt5mVnPEnCMVNUgxPWlNwWGkxwhou6f64uJdKsVDZ0iqyos458Qt4dyQfdSRCpVCmBWOsFjtrOXnYx6nE33ru6Cr1lz-Xxt5381eDL6E9-Rrc3OExArX3RVLzkE85A5BlNtWZ7lClK88PSrPSQPM Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Domain-Id: None Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Domain-Name: None Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Identity-Status: Confirmed Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Is-Admin-Project: True Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Domain-Id: default Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Domain-Name: Default Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Project-Name: admin Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Role: member,admin,reader Jul 25 15:53:53.215180 n-d-846219-13 devstack@n-api.service[104024]: X-Roles: member,admin,reader Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_99832ff3355b442bb0a22a57a27d991d"}]}] Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant: admin Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-Tenant-Name: admin Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-User: admin Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-User-Domain-Id: default Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-User-Domain-Name: Default Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-User-Id: 003047e3d1f24645a60e058da25210e3 Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: X-User-Name: admin Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: method: > Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: exception: Flavor 451 could not be found. Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: action_args: {'id': '451'} Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:53:53.216709 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:53.217558 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.218609 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-f4b011f1-72f6-4a43-acc3-3b8ab60dfd0c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:53:53.219762 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-f4b011f1-72f6-4a43-acc3-3b8ab60dfd0c admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.503322 Jul 25 15:53:53.219762 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 24/49] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 15:53:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 15:53:53.228878 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-959b1f02-8e23-4ac5-b8ee-5e6d519d462b admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:53.256277 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-959b1f02-8e23-4ac5-b8ee-5e6d519d462b admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.032802 Jul 25 15:53:53.256862 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 26/50] 10.222.0.105 () {60 vars in 1215 bytes} [Mon Jul 25 15:53:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:53.270328 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:53.286682 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020158 Jul 25 15:53:53.287357 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 25/51] 10.222.0.105 () {60 vars in 1215 bytes} [Mon Jul 25 15:53:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:53:53.297954 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-c96b0cfe-a99a-4444-8d08-e5367b29bd9b admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:53.303764 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.wsgi [None req-c96b0cfe-a99a-4444-8d08-e5367b29bd9b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-c96b0cfe-a99a-4444-8d08-e5367b29bd9b admin admin] Request method failure captured: Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Accept: application/json Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Accept-Encoding: gzip, deflate Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Connection: keep-alive Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Content-Length: 0 Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Host: 10.222.0.105 Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Openstack-Api-Version: compute 2.90 Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: Openstack-System-Scope: None Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: User-Agent: python-novaclient Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Auth-Token: gAAAAABi3ryQdnuPam9YqBN0JNi-56LhqWfKt5mVnPEnCMVNUgxPWlNwWGkxwhou6f64uJdKsVDZ0iqyos458Qt4dyQfdSRCpVCmBWOsFjtrOXnYx6nE33ru6Cr1lz-Xxt5381eDL6E9-Rrc3OExArX3RVLzkE85A5BlNtWZ7lClK88PSrPSQPM Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Domain-Id: None Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Domain-Name: None Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Identity-Status: Confirmed Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Is-Admin-Project: True Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Domain-Id: default Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Domain-Name: Default Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Project-Name: admin Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Role: member,admin,reader Jul 25 15:53:53.305333 n-d-846219-13 devstack@n-api.service[104023]: X-Roles: member,admin,reader Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/99832ff3355b442bb0a22a57a27d991d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_99832ff3355b442bb0a22a57a27d991d"}]}] Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant: admin Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant-Id: 99832ff3355b442bb0a22a57a27d991d Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-Tenant-Name: admin Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-User: admin Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-User-Domain-Id: default Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-User-Domain-Name: Default Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-User-Id: 003047e3d1f24645a60e058da25210e3 Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: X-User-Name: admin Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: method: > Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: exception: Flavor 451 could not be found. Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: action_args: {'id': '451'} Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:53:53.306862 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:53.307974 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: ERROR nova.api.openstack.wsgi Jul 25 15:53:53.309547 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-c96b0cfe-a99a-4444-8d08-e5367b29bd9b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:53:53.310866 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-c96b0cfe-a99a-4444-8d08-e5367b29bd9b admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012671 Jul 25 15:53:53.310866 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 27/52] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 15:53:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 15:53:54.375751 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:54.376783 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001523 Jul 25 15:53:54.377232 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 26/53] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:54.951612 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-b1d3fff6-9645-4e66-b490-1558d4a3ebe3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:54.972729 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-b1d3fff6-9645-4e66-b490-1558d4a3ebe3 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.457298 Jul 25 15:53:54.973323 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 28/54] 10.222.0.105 () {64 vars in 1240 bytes} [Mon Jul 25 15:53:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:56.068451 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:56.069530 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001584 Jul 25 15:53:56.069956 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 27/55] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:56 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:56.715883 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-609f8797-ff53-41a8-8b7b-88b2c8d025f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:56.739443 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-609f8797-ff53-41a8-8b7b-88b2c8d025f6 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.528364 Jul 25 15:53:56.740048 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 29/56] 10.222.0.105 () {64 vars in 1240 bytes} [Mon Jul 25 15:53:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:53:57.857349 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:57.859214 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002323 Jul 25 15:53:57.859949 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 28/57] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:57 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:53:58.505994 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-56674538-6978-47a4-953e-5a048868ff07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:53:58.538273 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-56674538-6978-47a4-953e-5a048868ff07 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.532236 Jul 25 15:53:58.538867 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 30/58] 10.222.0.105 () {64 vars in 1240 bytes} [Mon Jul 25 15:53:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 15:53:59.645295 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:53:59.646984 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001788 Jul 25 15:53:59.648023 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 29/59] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:53:59 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:54:00.322207 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-a007f70a-b467-465e-8f84-f99b235772a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:54:00.355582 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-a007f70a-b467-465e-8f84-f99b235772a8 admin admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.556717 Jul 25 15:54:00.356668 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 31/60] 10.222.0.105 () {64 vars in 1240 bytes} [Mon Jul 25 15:53:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 15:54:01.638405 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:01.640074 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002465 Jul 25 15:54:01.640783 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 30/61] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 15:54:01 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:54:02.287490 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-ce3b2808-169e-4c72-a3fc-dc0e3f9cbe0d admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:02.314250 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-ce3b2808-169e-4c72-a3fc-dc0e3f9cbe0d admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.511565 Jul 25 15:54:02.314826 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 32/62] 10.222.0.105 () {60 vars in 1207 bytes} [Mon Jul 25 15:54:01 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:54:54.920184 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:54.921226 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-33c30e5c-e2f9-472c-896c-e88a87840f6e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001473 Jul 25 15:54:54.921601 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 31/63] 10.222.0.105 () {54 vars in 935 bytes} [Mon Jul 25 15:54:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:54:54.932288 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:54:55.381387 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-b100f981-272b-4a57-a7f3-4f2b51856f55 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:55.403605 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-b100f981-272b-4a57-a7f3-4f2b51856f55 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.475889 Jul 25 15:54:55.404162 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 33/64] 10.222.0.105 () {60 vars in 1296 bytes} [Mon Jul 25 15:54:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:54:55.428004 n-d-846219-13 devstack@n-api.service[104024]: DEBUG dbcounter [-] [104024] Writing DB stats nova_api:SELECT=14 {{(pid=104024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:54:55.432417 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-3df82a93-67ac-4a86-a766-669bba6a202e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:55.440943 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-3df82a93-67ac-4a86-a766-669bba6a202e admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015183 Jul 25 15:54:55.442292 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 32/65] 10.222.0.105 () {60 vars in 1287 bytes} [Mon Jul 25 15:54:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:55.455166 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-2218f75c-4eb5-4173-acbc-38a099ad11ed admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:55.466066 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-2218f75c-4eb5-4173-acbc-38a099ad11ed admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014868 Jul 25 15:54:55.466810 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 34/66] 10.222.0.105 () {60 vars in 1290 bytes} [Mon Jul 25 15:54:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:55.481072 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-eab2483a-d3e9-490d-af85-49c72d0b0d7e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:55.489152 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-eab2483a-d3e9-490d-af85-49c72d0b0d7e admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013364 Jul 25 15:54:55.489728 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 33/67] 10.222.0.105 () {60 vars in 1290 bytes} [Mon Jul 25 15:54:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:55.501808 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-95d8650c-2b0f-4e35-80fe-fd1a72cfe0f8 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:55.509732 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-95d8650c-2b0f-4e35-80fe-fd1a72cfe0f8 admin admin] 10.222.0.105 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011523 Jul 25 15:54:55.510277 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 35/68] 10.222.0.105 () {60 vars in 1287 bytes} [Mon Jul 25 15:54:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:54.784962 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-eab2483a-d3e9-490d-af85-49c72d0b0d7e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:54.786032 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-eab2483a-d3e9-490d-af85-49c72d0b0d7e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001559 Jul 25 16:00:54.786434 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 34/69] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 16:00:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:54.924751 n-d-846219-13 devstack@n-api.service[104023]: DEBUG dbcounter [-] [104023] Writing DB stats nova_api:SELECT=6 {{(pid=104023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:55.079021 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-f67dac86-8820-47b8-a3d2-70c383277844 admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:55.081437 n-d-846219-13 devstack@n-api.service[104023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:00:55.081437 n-d-846219-13 devstack@n-api.service[104023]: warnings.warn(msg) Jul 25 16:00:55.082595 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-f67dac86-8820-47b8-a3d2-70c383277844 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:55.083035 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-f67dac86-8820-47b8-a3d2-70c383277844 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:55.083805 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-f67dac86-8820-47b8-a3d2-70c383277844 admin admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:55.084224 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-f67dac86-8820-47b8-a3d2-70c383277844 admin admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:55.126596 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-f67dac86-8820-47b8-a3d2-70c383277844 admin admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.203307 Jul 25 16:00:55.127200 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 36/70] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 16:00:54 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:00:55.952631 n-d-846219-13 devstack@n-api.service[104024]: DEBUG nova.api.openstack.wsgi [None req-eab2483a-d3e9-490d-af85-49c72d0b0d7e admin admin] Calling method '>' {{(pid=104024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:55.953678 n-d-846219-13 devstack@n-api.service[104024]: INFO nova.api.openstack.requestlog [None req-eab2483a-d3e9-490d-af85-49c72d0b0d7e admin admin] 10.222.0.105 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001507 Jul 25 16:00:55.954071 n-d-846219-13 devstack@n-api.service[104024]: [pid: 104024|app: 0|req: 35/71] 10.222.0.105 () {56 vars in 1079 bytes} [Mon Jul 25 16:00:55 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:56.146255 n-d-846219-13 devstack@n-api.service[104023]: DEBUG nova.api.openstack.wsgi [None req-14d7112d-2e03-4aa9-a974-89f0b5d3ebce admin admin] Calling method '>' {{(pid=104023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:56.148677 n-d-846219-13 devstack@n-api.service[104023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:00:56.148677 n-d-846219-13 devstack@n-api.service[104023]: warnings.warn(msg) Jul 25 16:00:56.149890 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-14d7112d-2e03-4aa9-a974-89f0b5d3ebce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:56.150332 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-14d7112d-2e03-4aa9-a974-89f0b5d3ebce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:56.151623 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-14d7112d-2e03-4aa9-a974-89f0b5d3ebce admin admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:56.152075 n-d-846219-13 devstack@n-api.service[104023]: DEBUG oslo_concurrency.lockutils [None req-14d7112d-2e03-4aa9-a974-89f0b5d3ebce admin admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:56.174506 n-d-846219-13 devstack@n-api.service[104023]: INFO nova.api.openstack.requestlog [None req-14d7112d-2e03-4aa9-a974-89f0b5d3ebce admin admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.083045 Jul 25 16:00:56.175080 n-d-846219-13 devstack@n-api.service[104023]: [pid: 104023|app: 0|req: 37/72] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 16:00:56 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:01:44.764644 n-d-846219-13 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 16:01:44.765277 n-d-846219-13 devstack@n-api.service[104022]: Mon Jul 25 16:01:44 2022 - graceful shutdown triggered... Jul 25 16:01:44.765752 n-d-846219-13 devstack@n-api.service[104024]: Gracefully killing worker 2 (pid: 104024)... Jul 25 16:01:44.766124 n-d-846219-13 devstack@n-api.service[104023]: Gracefully killing worker 1 (pid: 104023)... Jul 25 16:01:45.765323 n-d-846219-13 devstack@n-api.service[104022]: worker 1 buried after 1 seconds Jul 25 16:01:45.765323 n-d-846219-13 devstack@n-api.service[104022]: worker 2 buried after 1 seconds Jul 25 16:01:45.765323 n-d-846219-13 devstack@n-api.service[104022]: goodbye to uWSGI. Jul 25 16:01:45.767018 n-d-846219-13 systemd[1]: devstack@n-api.service: Succeeded. Jul 25 16:01:45.767591 n-d-846219-13 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 16:01:45.770445 n-d-846219-13 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 16:01:45.789584 n-d-846219-13 devstack@n-api.service[119586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 16:01:45 2022] *** Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: nodename: n-d-846219-13 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: machine: x86_64 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: clock source: unix Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: pcre jit disabled Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: detected number of CPU cores: 4 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: current working directory: / Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: detected binary path: /usr/bin/uwsgi-core Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: your processes number limit is 47680 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: your memory page size is 4096 bytes Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: detected max file descriptor number: 2048 Jul 25 16:01:45.887315 n-d-846219-13 devstack@n-api.service[119586]: lock engine: pthread robust mutexes Jul 25 16:01:45.888528 n-d-846219-13 devstack@n-api.service[119586]: thunder lock: enabled Jul 25 16:01:45.888528 n-d-846219-13 devstack@n-api.service[119586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 16:01:45.888528 n-d-846219-13 devstack@n-api.service[119586]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 16:01:45.929918 n-d-846219-13 devstack@n-api.service[119586]: Python main interpreter initialized at 0x5599a1b049c0 Jul 25 16:01:45.929918 n-d-846219-13 devstack@n-api.service[119586]: python threads support enabled Jul 25 16:01:45.929918 n-d-846219-13 devstack@n-api.service[119586]: your server socket listen backlog is limited to 100 connections Jul 25 16:01:45.929918 n-d-846219-13 devstack@n-api.service[119586]: your mercy for graceful operations on workers is 90 seconds Jul 25 16:01:45.930352 n-d-846219-13 devstack@n-api.service[119586]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 16:01:45.930352 n-d-846219-13 devstack@n-api.service[119586]: *** Operational MODE: preforking *** Jul 25 16:01:45.930881 n-d-846219-13 devstack@n-api.service[119586]: *** uWSGI is running in multiple interpreter mode *** Jul 25 16:01:45.930881 n-d-846219-13 devstack@n-api.service[119586]: spawned uWSGI master process (pid: 119586) Jul 25 16:01:45.930848 n-d-846219-13 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 16:01:45.931428 n-d-846219-13 devstack@n-api.service[119586]: spawned uWSGI worker 1 (pid: 119598, cores: 1) Jul 25 16:01:45.931784 n-d-846219-13 devstack@n-api.service[119586]: spawned uWSGI worker 2 (pid: 119599, cores: 1) Jul 25 16:01:45.932584 n-d-846219-13 devstack@n-api.service[119586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 16:01:46.592417 n-d-846219-13 devstack@n-api.service[119599]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 16:01:46.618525 n-d-846219-13 devstack@n-api.service[119598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 16:01:47.789836 n-d-846219-13 devstack@n-api.service[119599]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:01:47.789836 n-d-846219-13 devstack@n-api.service[119599]: from cryptography.utils import int_from_bytes Jul 25 16:01:47.790647 n-d-846219-13 devstack@n-api.service[119599]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:01:47.790647 n-d-846219-13 devstack@n-api.service[119599]: from cryptography.utils import int_from_bytes Jul 25 16:01:47.853123 n-d-846219-13 devstack@n-api.service[119598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:01:47.853123 n-d-846219-13 devstack@n-api.service[119598]: from cryptography.utils import int_from_bytes Jul 25 16:01:47.853748 n-d-846219-13 devstack@n-api.service[119598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:01:47.853748 n-d-846219-13 devstack@n-api.service[119598]: from cryptography.utils import int_from_bytes Jul 25 16:01:50.341827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:01:50.342385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:01:50.342497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:01:50.343006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:01:50.343141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:01:50.343485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.343821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.344148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.344464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.344788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.345117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.345861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.346204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.346575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.346919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.347423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.347813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-13 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.348162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.348634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.348942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.349284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.349589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.349910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.350207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.350950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.353350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.353780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.354193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.354774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.355207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.355730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.356306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.356851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.357379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.357793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.358344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-13 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.358879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.359385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.359707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.360238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.360747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.361320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.361856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.362343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.362958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.363492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.363976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.364452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.364923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.365402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.365864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.366348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.366889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.367360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.367681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.367980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.368364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.368755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.369053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.369417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.369670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.369924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.370277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.370610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.370923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.371233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.371553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.371861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.372169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.372475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.372781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.373115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.373451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.373766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.374087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.374423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.374773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.375168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.375372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.375695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.376033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.376346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.376649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.376963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.377289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.377597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.377898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.378200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.378500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.378846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.379140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.380012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.380012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.380012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.380451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.380625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.380826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.381164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.381453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.381753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.382053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.382356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.382676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.383098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.383254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.383544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.383852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.384166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.384489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.384807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.385159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.385462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.385760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.386130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.386448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.386916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.387110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.387347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.387657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.387958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.388274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.388651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.389238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.389802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.390345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.390897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.391462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.391963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.392499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.393037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.393594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.394129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.394665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.395198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.395733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.396259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.396769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.397319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.397815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.398322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.398853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.399413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.400015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.400593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.401293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.401582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.402137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.402692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.403104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.403495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.404117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.404222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.404503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.404823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.405173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.405734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.406144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.406482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.406801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.407120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.407440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.407760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.408124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.408474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.408777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.409086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.409450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.409797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.410116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.410606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.411939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.411939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.412164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.412423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.412757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.413141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.413437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.413756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.414069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.414381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.414687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.414998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.415334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.415654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.416013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.416269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.416580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.417083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.417532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.417802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.418111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.418415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.418716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.419019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.419327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.419631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.419951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.420279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.420583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.420914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.421275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.421550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.421896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.422144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.422558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.422806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.423043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.423343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.423668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.423973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.424272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.424599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.424902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.425226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.425537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.426052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.426311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.426540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.427852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.427852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.427852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.427852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.429238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.429238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.429238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.429238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.430186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.430186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.430186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.430709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.430709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.430999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.431148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.431378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.431688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.431982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.432280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.432725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.434725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.435013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.435356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.435682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.435997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.436312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.436617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.436925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.437262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.437569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.437874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.438412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.438531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.438837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.439151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.439475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.439789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.440090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.440403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.440701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.441006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.441369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.441700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.442007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.442325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.442631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.442936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.443245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.443651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.443847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.444126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.444437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.444796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.445055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.445385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.445708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.446007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.446321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.446617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.446921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.447247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.447575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.447875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.448179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.448555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.448858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.449187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.449495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.449793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.450090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.450389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.450693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.450993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.451291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.451582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.451889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.452193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.452486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.452782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.453082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.454546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.454546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.454546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.454546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.454898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.454898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.455191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.456028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.456028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.456228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.456355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.456691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.456993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.457315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.457634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.457946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.458248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.458557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.458858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.459027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:01:50.459498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.459638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:01:50.459805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.459805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.460039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:01:50.460124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.460216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:01:50.460310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.460422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:01:50.460618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.460811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.460906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.461159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.461268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.461480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.461579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.461798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.461899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.462114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.462269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.462415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.462506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.462714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.462866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.463015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.463170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.463316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.463453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.463589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.463877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.464048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.464227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-13 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.464325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.464538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.464631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.464851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.464988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.465188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.465321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.465503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.465669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.465860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.465990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.466183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.466276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.466516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.466616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.466822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.467025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.467190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.467343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.467484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.467627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.467760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.467906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.468048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.468233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.468335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.468543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.468641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.468838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.468934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.469161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.469269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.469457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.469562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.469754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.469855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.470048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.470140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.470345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.470449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-13 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.470971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.471085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.471267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.471368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.471569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.471715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.471863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.472095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.472200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.472362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.472483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.472671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.472804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.472987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.473078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.473336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.473449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.473640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.473791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.474038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.474152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.474283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.474409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.474593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.474726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.474908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.475034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.475206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.475336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.475513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.475636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.475818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.475954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.476132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.476272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.476432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.476531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.476730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.476830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.476966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.477160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.477295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.477422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.477614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.477712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.477936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.478036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.478258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.478358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.478508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.478609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.478757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.478886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.479572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.480051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.480153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.480297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.480400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.480537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.480537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.480701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.480785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.480867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.481128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.481244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.481504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.481603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.481814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.481964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.482108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.482301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.482491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.482633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.482767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.482894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.483033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.483158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.483282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.483449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.483586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.483756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.483908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.484168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.484272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.484475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.484651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.105 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.484787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.105 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.484881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.485044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.485260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.485396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.485487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.485720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.485812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.486019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.486118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.486316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.486457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.486636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.486730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.486903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.486994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.487199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.487343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.487502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.487603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.487830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.487985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.488141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.489072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.489848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.489970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.490058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.490141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.490238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.490332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.490444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.490545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.490640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.490773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.490907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.491047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.491180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.491314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.491439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.491572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.491706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.491823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.491951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.492075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.492170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.492262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.492403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.492520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.492612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.492702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.492786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.492786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.492962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.493048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.493314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.493447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.493604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.493731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.493829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.493963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.494049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.494130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.494238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.494471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.494607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.494735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.494863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.494958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.495078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.495200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.495360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.495517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.495668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.495815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.495989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.496122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.496307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.496430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.496609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.496710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.496929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.497028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.497259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.497363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.497566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.497665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.497932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.498052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.498191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.498282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.498498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.498591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.498810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.498909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.499105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.499208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.499410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.499509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.499708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.499834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.500014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.500177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.500332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.500486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.500634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.500781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.500934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.501171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.501269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.501353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.501499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.501617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.501806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.501967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.502110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.502265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.502396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.502529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.502685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.502844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.502985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.503192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.503282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.503502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.503601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.503812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.503918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.504129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.504229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.504448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.504595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:01:50.504730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.504857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.505020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.505133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.505353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.505514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.505730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.505832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.506964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.507064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.507267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.507359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.507575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.507781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.507928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.508933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.509176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.509271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.509488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.509633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.509820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.509923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.510234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.510339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.510476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.510571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.510699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.510799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.511970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.512100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.512288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.512440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.512580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.512743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.512873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.513021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.513329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.513436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.513963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.514646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.515278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.515417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.515605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.515701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.515882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.515983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.516984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.517065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.517226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.517309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.517381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.517965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.518927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.519142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.519242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.519453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.519582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.519826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.519960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.520115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.520905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.521878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.522104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.522185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.522404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.522485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.522746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.522890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.523932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.524034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.524237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.524395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.524596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.524770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.524960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.525960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.526057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.526182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.526327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.526520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.526772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.527121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.527416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.527738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.528062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.528377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.528683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.528916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.529024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.529266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.529360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.529598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.529691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.529916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.530938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.531167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.531264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.531466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.531609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.531772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.531913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.532074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.532204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.532376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.532506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.532680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.532775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.533978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.534973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.535181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.535284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.535480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.535619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.535779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.535888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.536075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.536177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.536374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.536528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.536729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.536867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.537993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.538164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.538325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.538642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.538787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.538932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.539933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.540065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.540252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.540385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.540571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.540704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.540886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.541072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.541234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.541417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.541524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.541740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.541838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.542142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.542265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.542503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.542639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.542813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.543130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.543278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.543442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.543702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.543815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.544024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.544309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.544399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.544628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.544887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.544985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.545256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.545584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.545826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.546063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.546730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.546730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.547848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.548031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.548261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.548439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.548523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.548942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.549174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.549376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.549561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.549729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.549858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.550008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.550101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.550430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.550617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.550719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.550989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.551135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.551320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.551414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.551677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.551769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.551996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.552174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.552342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.552573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.552719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.552832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.553033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.553300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.553461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.553667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.553855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.553988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.554310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.554512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.554639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.554802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.554931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.555038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.555189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.555493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.555664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.555819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.555967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.556082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.556423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.556581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.556765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.556980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.557082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.557397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.557604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.557762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.558171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.558318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.558498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.558600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.558833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.558958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.559153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.559265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.559471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.559580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.559837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.560995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.561996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.562259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.562399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.562562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.562722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.562825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.562920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.563156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.563307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.563409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.563508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.563815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.563952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.564166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.564317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.564460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.564620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.564719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.564912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.565068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.565253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.565434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.565538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.565743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.565846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.566060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.566156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.566380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.566476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.566691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.566797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.567906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.568013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.568235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.568378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.568559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.568744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.568902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.569214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.569424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.569534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.569666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.569778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.569904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.570898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.571197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.571300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.571496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.571707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.571844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.572078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.572182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.572382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.572674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.572981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.573139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.573272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.573643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.573944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.574241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.574347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.574590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.574837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.574941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.575192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.575417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.575540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.575816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.575990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.576211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.576566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.576667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.576942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.577171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.577282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.577623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.577784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.577931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.578418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.578577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.578823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.579027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.579164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.579490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.579662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.579861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.579990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.584525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.584641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.584789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.584886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.584996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.585139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.585242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.585337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.585472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.586899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.587944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.588972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.589668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.592928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.593781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.594918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.595134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.595278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.595368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.595452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.595871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.596900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.597069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.597255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.597427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.597585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.597737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.597909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.598904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.599927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.600193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.600339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.600494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.600655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.600655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.600932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.601073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.601073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.601447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.601656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.601656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.602044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.602240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.602240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.604445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.604669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.604669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.604962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.605200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.605200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.605509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.605673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.605835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.605979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.606133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.607313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.607467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.607586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.607709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.607848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.607848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.608913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.609935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.610611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.612980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.613967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.614917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.615971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.616071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.616071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.640120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.640545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.640734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.640903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.641055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.641256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.642060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.642382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.642591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.642956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.643421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.645185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.645358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.648346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.648845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.649363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.649679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.650295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.650803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.652155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.652443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.652638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.652841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.653073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.653501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.653659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.654121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.655224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.655283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.655409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.655551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.655686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.655946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.656901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.657839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.658725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.659936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.660910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.661941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.662488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.663002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.663481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.663923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.664367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.664799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.665263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.665721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.666132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.666638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.667054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.667487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.667916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.668336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.668759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.669225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.669632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.670057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.670470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.670874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.671281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.671695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.672200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.672611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.673216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.673628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.674902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.674902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.675271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.675699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.676112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.676528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.676954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.677419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.677832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.678242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.678642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.679043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.679444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.679849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.680255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.680654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.681054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.681520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.681923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.682392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.682867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.683369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.683872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.684281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.684725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.685181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.685644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.686069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.686487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.686913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.687320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.687750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.688164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.688575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.688831 n-d-846219-13 devstack@n-api.service[119599]: INFO dbcounter [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Registered counter for database nova_api Jul 25 16:01:50.689066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.689515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.689980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.690398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.690810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.691217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.691632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.692043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.692515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.693226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.693775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.694244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.694651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.695069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.695481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.695891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.696298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.696704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.697147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.697562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.698009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.698457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.698882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.699318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.699731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.700148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.700551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.700961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.701453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.701865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.702276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.702685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.703097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.703659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.704043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.704677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.707932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.707932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.708401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.708856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.709347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.709771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.710214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.710681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.710887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_db.sqlalchemy.engines [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.711204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.711623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.712069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.712486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.713207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.713675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.714666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.715143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.715706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.716188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.716608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.717032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.717482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.717894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.718310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.718715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.718861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writer thread running {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:50.719172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.719622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.720044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.720448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.721250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.721658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.722326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.722770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.723194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.723648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.724070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.724601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.725010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.725494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.725906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.726310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.726720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.727128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.727529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.727934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.728366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.728791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.729240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.729689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.730088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.730529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.730929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.731358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.731808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.732217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.732618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.733025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.733458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.733857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.734261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.734771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.735246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.735717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.736125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.736524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.736928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.737397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.737828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.738227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.738630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.739071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.739569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.740319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.740875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.741383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.741912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.742329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.743004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.743436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.743967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.744893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.745152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.745689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.746137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.746611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.747087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.747501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.747956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.748372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.748784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.749369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.749844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.750314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.750861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.751265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.751695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.752147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.752556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.752987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.753457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.754032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.754516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.755138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.755551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.756100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.756556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.757053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.757509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.757918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.758409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.758838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.759394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.759800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.760337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.760760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.761248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.762018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.762427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.762887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.763350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.763892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.764327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.764906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.765587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.766082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.766507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.766928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.767331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.767732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.768162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.768576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.769006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.769712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.770275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.771046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.771366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.776085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.context [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=119599) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 16:01:50.778953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.779345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.779656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.779992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.780329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.780419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:01:50.780655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.780979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.781329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.781745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.781967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.782047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:01:50.782283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.782603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.782781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:01:50.782917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.783234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.783548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.783862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.784256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.784610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.784783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:01:50.784953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.785302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.785633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.785957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.786302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.786616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.786836 n-d-846219-13 devstack@n-api.service[119599]: INFO dbcounter [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Registered counter for database nova_cell0 Jul 25 16:01:50.786926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.787252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.787574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.787892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.788229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.788545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.788863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.789321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.789644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.789989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.790302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.790635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.790967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.791092 n-d-846219-13 devstack@n-api.service[119599]: INFO dbcounter [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Registered counter for database nova_cell1 Jul 25 16:01:50.791278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.791609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.791912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.792312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.792629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.793005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.793403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.793927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.794124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.794300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.794632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.794933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.795395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.795577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.795892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.796214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.796538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.796874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.797297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.797549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.797900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.798225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.798585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.798755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_db.sqlalchemy.engines [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.799099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.799427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.799580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.799950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.800174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.800474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_db.sqlalchemy.engines [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.800564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:01:50.800709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:01:50.806589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writer thread running {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:50.807927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writer thread running {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:50.863000 n-d-846219-13 devstack@n-api.service[119598]: INFO dbcounter [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Registered counter for database nova_api Jul 25 16:01:50.883599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_db.sqlalchemy.engines [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.890783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writer thread running {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:50.946770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.context [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=119598) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 16:01:50.950793 n-d-846219-13 devstack@n-api.service[119599]: INFO dbcounter [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Registered counter for database nova_cell0 Jul 25 16:01:50.951021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:01:50.952640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:01:50.953568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:01:50.955611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:01:50.957759 n-d-846219-13 devstack@n-api.service[119598]: INFO dbcounter [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Registered counter for database nova_cell0 Jul 25 16:01:50.958215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_db.sqlalchemy.engines [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.962241 n-d-846219-13 devstack@n-api.service[119598]: INFO dbcounter [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Registered counter for database nova_cell1 Jul 25 16:01:50.964929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writer thread running {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:50.969766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_db.sqlalchemy.engines [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.972367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_db.sqlalchemy.engines [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:50.979386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writer thread running {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:50.979752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writer thread running {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:51.130476 n-d-846219-13 devstack@n-api.service[119598]: INFO dbcounter [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Registered counter for database nova_cell0 Jul 25 16:01:51.138158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_db.sqlalchemy.engines [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:01:51.143069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writer thread running {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:01:51.295146 n-d-846219-13 devstack@n-api.service[119599]: WARNING keystonemiddleware.auth_token [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:01:51.302519 n-d-846219-13 devstack@n-api.service[119599]: WARNING keystonemiddleware.auth_token [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:01:51.463838 n-d-846219-13 devstack@n-api.service[119598]: WARNING keystonemiddleware.auth_token [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:01:51.471783 n-d-846219-13 devstack@n-api.service[119598]: WARNING keystonemiddleware.auth_token [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:01:51.654759 n-d-846219-13 devstack@n-api.service[119599]: WARNING keystonemiddleware.auth_token [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:01:51.661269 n-d-846219-13 devstack@n-api.service[119599]: WARNING keystonemiddleware.auth_token [None req-c40a70a2-c533-44f1-8bac-aa941aeadc83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:01:51.667155 n-d-846219-13 devstack@n-api.service[119599]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599a1b049c0 pid: 119599 (default app) Jul 25 16:01:51.816074 n-d-846219-13 devstack@n-api.service[119598]: WARNING keystonemiddleware.auth_token [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:01:51.822185 n-d-846219-13 devstack@n-api.service[119598]: WARNING keystonemiddleware.auth_token [None req-91d03dae-c535-4109-821f-fe32cb842552 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:01:51.827706 n-d-846219-13 devstack@n-api.service[119598]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599a1b049c0 pid: 119598 (default app) Jul 25 16:02:36.962851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:36.963883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:36.964823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:36.966206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:38.756516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e606bbe6-ffb1-4226-9a1d-51a4b924e541 tempest-AZAdminNegativeTestJSON-1109282496 tempest-AZAdminNegativeTestJSON-1109282496-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:38.760389 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:38.760389 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:38.762642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e606bbe6-ffb1-4226-9a1d-51a4b924e541 tempest-AZAdminNegativeTestJSON-1109282496 tempest-AZAdminNegativeTestJSON-1109282496-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ecf27a69ec654df29c892ca5c287ed69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa27ddcfbebc407d89c301fbf39c16d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e606bbe6-ffb1-4226-9a1d-51a4b924e541 tempest-AZAdminNegativeTestJSON-1109282496 tempest-AZAdminNegativeTestJSON-1109282496-project] Request method failure captured: Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6aMCYpYNFSAZS0wCcKZcArOmXIClVqAsndZhjX1yOhq2O5NoA00gYxRXCiadJ7bZv_X7j2rLOB99egoK-jrnzaXs2cgSUBFr0P4VlH--JEvseB_NyUYs1l_vAns5apQ3MAyyy_UmOIyhVXWN4Y-cuBn0JCks1zDuPqA34egqgxmyI Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fa27ddcfbebc407d89c301fbf39c16d2 Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1109282496 Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:02:38.768552 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fa27ddcfbebc407d89c301fbf39c16d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fa27ddcfbebc407d89c301fbf39c16d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fa27ddcfbebc407d89c301fbf39c16d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fa27ddcfbebc407d89c301fbf39c16d2"}]}] Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AZAdminNegativeTestJSON-1109282496 Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fa27ddcfbebc407d89c301fbf39c16d2 Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1109282496 Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AZAdminNegativeTestJSON-1109282496-project Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ecf27a69ec654df29c892ca5c287ed69 Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AZAdminNegativeTestJSON-1109282496-project Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 16:02:38.771036 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:02:38.772434 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 16:02:38.774622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:38.777881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e606bbe6-ffb1-4226-9a1d-51a4b924e541 tempest-AZAdminNegativeTestJSON-1109282496 tempest-AZAdminNegativeTestJSON-1109282496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:38.780232 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e606bbe6-ffb1-4226-9a1d-51a4b924e541 tempest-AZAdminNegativeTestJSON-1109282496 tempest-AZAdminNegativeTestJSON-1109282496-project] 10.222.0.105 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.827953 Jul 25 16:02:38.791428 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1/1] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:02:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1841 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:02:41.302315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:41.303304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:41.305902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:41.307411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:42.185670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '.version_select at 0x7f9da2132700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:42.186528 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:42.186528 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:42.214130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=119599) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 16:02:42.215186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:42.216888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:42.278265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:42.278765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:42.301614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:42.302155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:42.324295 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4e70601-1bda-4a38-b7d9-76847a04ad1c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.734133 Jul 25 16:02:42.329212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2/2] 10.222.0.105 () {58 vars in 1172 bytes} [Mon Jul 25 16:02:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:02:42.971888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Calling method '.version_select at 0x7f9da2132c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:42.981220 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:42.981220 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:42.983060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:42.983673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.049222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.050036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.113429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.116889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.143834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b1c11c1-f797-4e74-ad35-b8c8f75e08f7 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1428 microversion: 2.41 time: 0.816996 Jul 25 16:02:43.148537 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3/3] 10.222.0.105 () {60 vars in 1213 bytes} [Mon Jul 25 16:02:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1428 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:02:43.201395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0e969711-5475-4559-9835-3a2ef4ea39db tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:43.203969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e969711-5475-4559-9835-3a2ef4ea39db tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.204693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e969711-5475-4559-9835-3a2ef4ea39db tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.205686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e969711-5475-4559-9835-3a2ef4ea39db tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.206298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e969711-5475-4559-9835-3a2ef4ea39db tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.258782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0e969711-5475-4559-9835-3a2ef4ea39db tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] 10.222.0.105 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.963952 Jul 25 16:02:43.268334 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1/4] 10.222.0.105 () {58 vars in 1169 bytes} [Mon Jul 25 16:02:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:43.441644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acc8378e-2a72-4b00-942d-725a192b1f03 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-563745080", "ram": 512, "vcpus": 1, "disk": 10, "id": 2039184677, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:43.468884 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:43.468884 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:43.522335 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-acc8378e-2a72-4b00-942d-725a192b1f03 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.372118 Jul 25 16:02:43.523147 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 4/5] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:43 2022] POST /compute/v2.1/flavors => generated 417 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:43.538626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1ff8f66-0fd1-4af7-a7ad-87a4c107ea2a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-941611663", "name": "tempest-test_aggregate-194278488"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:43.569060 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:43.569060 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:43.570561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-c1ff8f66-0fd1-4af7-a7ad-87a4c107ea2a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid cab13aab-cb5e-4df4-a2f7-ea0e72d01d1e for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:02:43.719264 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1ff8f66-0fd1-4af7-a7ad-87a4c107ea2a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.184910 Jul 25 16:02:43.721386 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 5/6] 10.222.0.105 () {60 vars in 1170 bytes} [Mon Jul 25 16:02:43 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:43.727069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e323dde4-0f07-4b4e-8b0d-5e021363c4f8 tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:43.729314 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:43.729314 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:43.730775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e323dde4-0f07-4b4e-8b0d-5e021363c4f8 tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.731134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e323dde4-0f07-4b4e-8b0d-5e021363c4f8 tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.732012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e323dde4-0f07-4b4e-8b0d-5e021363c4f8 tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.732513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e323dde4-0f07-4b4e-8b0d-5e021363c4f8 tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.811432 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e323dde4-0f07-4b4e-8b0d-5e021363c4f8 tempest-AZAdminV2TestJSON-69671729 tempest-AZAdminV2TestJSON-69671729-project-admin] 10.222.0.105 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.088896 Jul 25 16:02:43.812330 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 6/7] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:02:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:43.824380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3181ab5a-2b46-4868-98fe-77363c845a41 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:43.827608 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:43.827608 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:43.895295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b6827928-444a-443e-8858-e6905e6620bc tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da212ee50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:43.895991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3181ab5a-2b46-4868-98fe-77363c845a41 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.077395 Jul 25 16:02:43.898981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 7/8] 10.222.0.105 () {60 vars in 1229 bytes} [Mon Jul 25 16:02:43 2022] POST /compute/v2.1/flavors/2039184677/os-extra_specs => generated 66 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:43.901393 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:43.901393 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:43.905226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6827928-444a-443e-8858-e6905e6620bc tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.908438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6827928-444a-443e-8858-e6905e6620bc tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.911077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6827928-444a-443e-8858-e6905e6620bc tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:43.912780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6827928-444a-443e-8858-e6905e6620bc tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:43.912937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4c53db2-efce-4b2f-8efe-c1f76ae446c7 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:43.916342 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:43.916342 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:43.946040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4c53db2-efce-4b2f-8efe-c1f76ae446c7 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.045077 Jul 25 16:02:43.946700 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 8/9] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:02:43 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:43.987462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b6827928-444a-443e-8858-e6905e6620bc tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.717185 Jul 25 16:02:43.988060 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2/10] 10.222.0.105 () {58 vars in 1133 bytes} [Mon Jul 25 16:02:43 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:44.002180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cca9877f-c55f-47c7-8d37-75c776b19783 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:44.008538 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.008538 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:44.085288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cca9877f-c55f-47c7-8d37-75c776b19783 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:44.086090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cca9877f-c55f-47c7-8d37-75c776b19783 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:44.339919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d08aedc6-c187-4371-ab3e-93aebc7ed91d tempest-FlavorsExtraSpecsTestJSON-751035337 tempest-FlavorsExtraSpecsTestJSON-751035337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.389796 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d08aedc6-c187-4371-ab3e-93aebc7ed91d tempest-FlavorsExtraSpecsTestJSON-751035337 tempest-FlavorsExtraSpecsTestJSON-751035337-project] 10.222.0.105 "GET /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.441927 Jul 25 16:02:44.391914 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 9/11] 10.222.0.105 () {58 vars in 1208 bytes} [Mon Jul 25 16:02:43 2022] GET /compute/v2.1/flavors/2039184677/os-extra_specs => generated 66 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.404298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d9df72df-d838-456c-83de-b42c34acb243 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da183fd30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.407799 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.407799 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:44.409970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9df72df-d838-456c-83de-b42c34acb243 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:44.410610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9df72df-d838-456c-83de-b42c34acb243 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:44.411837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9df72df-d838-456c-83de-b42c34acb243 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:44.413162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9df72df-d838-456c-83de-b42c34acb243 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:44.477755 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d9df72df-d838-456c-83de-b42c34acb243 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 402 microversion: 2.1 time: 0.078990 Jul 25 16:02:44.479420 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 10/12] 10.222.0.105 () {58 vars in 1144 bytes} [Mon Jul 25 16:02:44 2022] GET /compute/v2.1/os-hosts?zone= => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:44.485542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-227a2431-c1da-44fd-b238-19788a6886de tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:44.488482 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.488482 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:44.527041 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-227a2431-c1da-44fd-b238-19788a6886de tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046360 Jul 25 16:02:44.528140 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 11/13] 10.222.0.105 () {60 vars in 1229 bytes} [Mon Jul 25 16:02:44 2022] POST /compute/v2.1/flavors/2039184677/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.541954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c35a0a79-b250-4e21-8460-97dd35123b2d tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da07c3160>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.545040 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.545040 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:44.546726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35a0a79-b250-4e21-8460-97dd35123b2d tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:44.547368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35a0a79-b250-4e21-8460-97dd35123b2d tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:44.548341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35a0a79-b250-4e21-8460-97dd35123b2d tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:44.548925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35a0a79-b250-4e21-8460-97dd35123b2d tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:44.595738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c35a0a79-b250-4e21-8460-97dd35123b2d tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.066324 Jul 25 16:02:44.596828 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 12/14] 10.222.0.105 () {58 vars in 1150 bytes} [Mon Jul 25 16:02:44 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.601288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d858911-1cb1-44e9-bea6-85d75cd95b6b tempest-FlavorsExtraSpecsTestJSON-751035337 tempest-FlavorsExtraSpecsTestJSON-751035337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.614341 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d858911-1cb1-44e9-bea6-85d75cd95b6b tempest-FlavorsExtraSpecsTestJSON-751035337 tempest-FlavorsExtraSpecsTestJSON-751035337-project] 10.222.0.105 "GET /compute/v2.1/flavors/2039184677/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016525 Jul 25 16:02:44.615329 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 13/15] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:02:44 2022] GET /compute/v2.1/flavors/2039184677/os-extra_specs/hw:numa_nodes => generated 22 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.627865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-55bc7f10-3e1d-4485-9a61-c1f39030e1c3 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:44.634083 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.634083 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:44.680797 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-55bc7f10-3e1d-4485-9a61-c1f39030e1c3 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058428 Jul 25 16:02:44.684658 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 14/16] 10.222.0.105 () {60 vars in 1229 bytes} [Mon Jul 25 16:02:44 2022] POST /compute/v2.1/flavors/2039184677/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.700202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b92198d9-3fda-41d7-8937-7a6e87806156 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.716881 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b92198d9-3fda-41d7-8937-7a6e87806156 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023906 Jul 25 16:02:44.727126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 15/17] 10.222.0.105 () {58 vars in 1208 bytes} [Mon Jul 25 16:02:44 2022] GET /compute/v2.1/flavors/2039184677/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.742136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca00dfd7-ab14-42b1-b4e8-c0bbeeffa066 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:44.745794 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.745794 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:44.863159 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca00dfd7-ab14-42b1-b4e8-c0bbeeffa066 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "PUT /compute/v2.1/flavors/2039184677/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.131745 Jul 25 16:02:44.869998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 16/18] 10.222.0.105 () {60 vars in 1270 bytes} [Mon Jul 25 16:02:44 2022] PUT /compute/v2.1/flavors/2039184677/os-extra_specs/hw:numa_nodes => generated 22 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.889638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6605f907-23ac-48e9-a68b-84d531e2e570 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.922506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6605f907-23ac-48e9-a68b-84d531e2e570 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046440 Jul 25 16:02:44.931329 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 17/19] 10.222.0.105 () {58 vars in 1208 bytes} [Mon Jul 25 16:02:44 2022] GET /compute/v2.1/flavors/2039184677/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:44.939930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-001af17c-f627-4418-91d5-4cbd5711a943 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:44.946354 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:44.946354 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:45.041578 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-001af17c-f627-4418-91d5-4cbd5711a943 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/2039184677/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.108344 Jul 25 16:02:45.045179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 18/20] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:02:44 2022] DELETE /compute/v2.1/flavors/2039184677/os-extra_specs/hw:numa_nodes => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:02:45.051957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2d25edfc-bda8-4739-8796-c9c0c76768f2 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:45.074907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:45.123015 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2d25edfc-bda8-4739-8796-c9c0c76768f2 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/2039184677/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.067045 Jul 25 16:02:45.127056 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 19/21] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:02:45 2022] DELETE /compute/v2.1/flavors/2039184677/os-extra_specs/hw:cpu_policy => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:02:45.135969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fdabebd5-5c26-4805-a772-e4300f1f42fa tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:45.153238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fdabebd5-5c26-4805-a772-e4300f1f42fa tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/2039184677/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021829 Jul 25 16:02:45.153936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 20/22] 10.222.0.105 () {58 vars in 1208 bytes} [Mon Jul 25 16:02:45 2022] GET /compute/v2.1/flavors/2039184677/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:45.170940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c050f61f-782f-4899-9daf-b72ab3cbb8db tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:45.171769 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:45.171769 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:45.232111 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c050f61f-782f-4899-9daf-b72ab3cbb8db tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/2039184677" status: 202 len: 0 microversion: 2.1 time: 0.069577 Jul 25 16:02:45.235467 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 21/23] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:02:45 2022] DELETE /compute/v2.1/flavors/2039184677 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:02:45.251216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db477e4b-55fc-46bf-8ce3-5c4952eef3a2 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:45.300460 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db477e4b-55fc-46bf-8ce3-5c4952eef3a2 tempest-FlavorsExtraSpecsTestJSON-701348777 tempest-FlavorsExtraSpecsTestJSON-701348777-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.058536 Jul 25 16:02:45.314013 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 22/24] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:45 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:45.526320 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cca9877f-c55f-47c7-8d37-75c776b19783 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.537020 Jul 25 16:02:45.528197 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3/25] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:02:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:46.459160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1233325371", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "availability_zone": "tempest-test_az-941611663"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:46.473527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:46.474228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:46.475550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:46.476408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:47.689043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:02:48.223753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:02:48.224893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:02:48.225586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:02:48.226179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:02:48.226991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:02:48.253701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:48.254841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:48.258165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:48.259204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:48.325277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Getting quotas for project 901a456f4900427f9722785029268fc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:02:48.338381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Getting quotas for user cf9c8e2e0e224c08b971ddfaf27ac13a and project 901a456f4900427f9722785029268fc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:02:48.362059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:02:48.369997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:02:48.478133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a91615e-dbfd-4ee2-96fd-a18aa8a3ffdf tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.463761 Jul 25 16:02:48.484432 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 23/26] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:02:48.485304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b93f52f3-472f-4637-9ac5-95b46feb72b9 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:48.486997 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:48.486997 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:48.491504 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b93f52f3-472f-4637-9ac5-95b46feb72b9 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 25 16:02:48.504797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-edaa6abb-e61f-46bf-b90c-e5bcd7b682ef tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:48.509543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-edaa6abb-e61f-46bf-b90c-e5bcd7b682ef tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b93f52f3-472f-4637-9ac5-95b46feb72b9 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin] Request method failure captured: Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6nmO9VI_6_ob9BCT8015LsYIJSK1Ehyk9KtUDs7ZLB1JuSZLG3WFU_BRZ8JlZepwQduRFNFZ7g-CQM2vmmwekaxHOuJe88bdFXfzlZPs-kMXhgaxXgnlV1xNsPAbajOyMeNL9_Plo_zduuV-js5E9ICo61oaQIUInJtOuUMxceu-U Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 40afbc7aae7946218b315b0c50073e15 Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:02:48.512433 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/40afbc7aae7946218b315b0c50073e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/40afbc7aae7946218b315b0c50073e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/40afbc7aae7946218b315b0c50073e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_40afbc7aae7946218b315b0c50073e15"}]}] Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 40afbc7aae7946218b315b0c50073e15 Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 50e0ea8781b448dfb67a3df07cea604d Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:02:48.513845 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid timestamp for date invalid_time Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'invalid_time'} Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:48.514573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b93f52f3-472f-4637-9ac5-95b46feb72b9 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:48.515819 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b93f52f3-472f-4637-9ac5-95b46feb72b9 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887 tempest-InstanceUsageAuditLogNegativeTestJSON-169173887-project-admin] 10.222.0.105 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.889272 Jul 25 16:02:48.519699 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 4/27] 10.222.0.105 () {58 vars in 1229 bytes} [Mon Jul 25 16:02:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 896 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:02:48.700039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-edaa6abb-e61f-46bf-b90c-e5bcd7b682ef tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:48.732772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-edaa6abb-e61f-46bf-b90c-e5bcd7b682ef tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1246 microversion: 2.1 time: 0.240546 Jul 25 16:02:48.736249 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 24/28] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:48 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1246 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:49.040584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03c9814f-801e-4646-85e5-344a6ae57844 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:49.041520 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:49.041520 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:49.042764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03c9814f-801e-4646-85e5-344a6ae57844 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'e2c340fb37144816aee7d1a6042f0979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333753e38eaf422f8df455c15ebc8b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03c9814f-801e-4646-85e5-344a6ae57844 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Request method failure captured: Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6lgiNpIyMzttq9u2KFt33KQ7HqIWiaokKb1JNoag7tAlCswbDLn1_kb5Lf7-ePF1HPYzbuEaTujIsINsxNO8ibo0UX9aRvYQAeSQZskif0Z03JOeJj6TIx4D0kLift2AnflLoLcg21oBo_V7VBeQ8hqxLuOrmYpe-9XCSJfyPPwR8 Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 333753e38eaf422f8df455c15ebc8b8d Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:02:49.048417 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/333753e38eaf422f8df455c15ebc8b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/333753e38eaf422f8df455c15ebc8b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/333753e38eaf422f8df455c15ebc8b8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_333753e38eaf422f8df455c15ebc8b8d"}]}] Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 333753e38eaf422f8df455c15ebc8b8d Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: e2c340fb37144816aee7d1a6042f0979 Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project Jul 25 16:02:49.049600 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: action_args: {} Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:02:49.050111 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 16:02:49.051040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:49.051926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03c9814f-801e-4646-85e5-344a6ae57844 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:49.052816 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03c9814f-801e-4646-85e5-344a6ae57844 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] 10.222.0.105 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.531537 Jul 25 16:02:49.057221 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 5/29] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:02:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 537 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:02:49.065917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ad1d3e5-ec91-49e3-81ad-d020d572fda5 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:49.066766 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:49.066766 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:49.068504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4ad1d3e5-ec91-49e3-81ad-d020d572fda5 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'e2c340fb37144816aee7d1a6042f0979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333753e38eaf422f8df455c15ebc8b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ad1d3e5-ec91-49e3-81ad-d020d572fda5 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Request method failure captured: Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2016:02:49 HTTP/1.1 Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6lgiNpIyMzttq9u2KFt33KQ7HqIWiaokKb1JNoag7tAlCswbDLn1_kb5Lf7-ePF1HPYzbuEaTujIsINsxNO8ibo0UX9aRvYQAeSQZskif0Z03JOeJj6TIx4D0kLift2AnflLoLcg21oBo_V7VBeQ8hqxLuOrmYpe-9XCSJfyPPwR8 Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 333753e38eaf422f8df455c15ebc8b8d Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:02:49.071654 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/333753e38eaf422f8df455c15ebc8b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/333753e38eaf422f8df455c15ebc8b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/333753e38eaf422f8df455c15ebc8b8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_333753e38eaf422f8df455c15ebc8b8d"}]}] Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 333753e38eaf422f8df455c15ebc8b8d Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e2c340fb37144816aee7d1a6042f0979 Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project Jul 25 16:02:49.072863 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '2022-07-25 16:02:49'} Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:02:49.073389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 16:02:49.074343 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:49.078090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ad1d3e5-ec91-49e3-81ad-d020d572fda5 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:49.079138 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ad1d3e5-ec91-49e3-81ad-d020d572fda5 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313 tempest-InstanceUsageAuditLogNegativeTestJSON-354616313-project] 10.222.0.105 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 16:02:49" status: 403 len: 128 microversion: 2.1 time: 0.017129 Jul 25 16:02:49.082680 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 25/30] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:02:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2016%3A02%3A49 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:02:49.758835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38360e90-113e-4d81-b596-81ee158a324c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:49.759966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38360e90-113e-4d81-b596-81ee158a324c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:49.763014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78af38cb-6467-4e8a-811e-3bd2c9bff951 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1056581021", "id": 1757915324, "os-flavor-access:is_public": "False"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:49.839350 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:49.839350 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:49.880564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38360e90-113e-4d81-b596-81ee158a324c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:49.897467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38360e90-113e-4d81-b596-81ee158a324c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1246 microversion: 2.1 time: 0.142957 Jul 25 16:02:49.898482 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 26/31] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:49 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:49.931316 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78af38cb-6467-4e8a-811e-3bd2c9bff951 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.675901 Jul 25 16:02:49.946953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7593c3b6-32cf-4f24-8fc9-a6d9431ebd0b tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3ba57c2c2e4f44359acf666d45e3cc89"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:49.949673 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:49.949673 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:49.953000 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 6/32] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:49 2022] POST /compute/v2.1/flavors => generated 433 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:50.692313 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7593c3b6-32cf-4f24-8fc9-a6d9431ebd0b tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/1757915324/action" status: 200 len: 97 microversion: 2.1 time: 0.748986 Jul 25 16:02:50.697006 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 27/33] 10.222.0.105 () {60 vars in 1205 bytes} [Mon Jul 25 16:02:49 2022] POST /compute/v2.1/flavors/1757915324/action => generated 97 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:50.926925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:50.933156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:50.968473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:50.970651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:50.973390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:50.975994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:51.224070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:51.254957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-43ee57f6-fe9b-4a7f-a9eb-4211ae62eec8 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1238 microversion: 2.1 time: 0.339566 Jul 25 16:02:51.257265 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 28/34] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:50 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1238 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:51.528863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-195e41d5-2b65-4907-b5db-3bbff817cddd tempest-FlavorsAccessTestJSON-412951864 tempest-FlavorsAccessTestJSON-412951864-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:51.696534 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-195e41d5-2b65-4907-b5db-3bbff817cddd tempest-FlavorsAccessTestJSON-412951864 tempest-FlavorsAccessTestJSON-412951864-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5442 microversion: 2.1 time: 0.992437 Jul 25 16:02:51.697328 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 7/35] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:50 2022] GET /compute/v2.1/flavors/detail => generated 5442 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:02:51.734706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48787d51-1c0d-47e9-86c2-b3972d9220ad tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3ba57c2c2e4f44359acf666d45e3cc89"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:51.739069 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:51.739069 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:52.284450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:52.285986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:52.324227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:52.324789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:52.339604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:52.354661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:52.905142 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48787d51-1c0d-47e9-86c2-b3972d9220ad tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/1757915324/action" status: 200 len: 21 microversion: 2.1 time: 1.172570 Jul 25 16:02:52.907794 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 29/36] 10.222.0.105 () {60 vars in 1205 bytes} [Mon Jul 25 16:02:51 2022] POST /compute/v2.1/flavors/1757915324/action => generated 21 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 16:02:52.927845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de57435e-3eeb-4a12-8fef-d7e7e8fbe12d tempest-FlavorsAccessTestJSON-412951864 tempest-FlavorsAccessTestJSON-412951864-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:53.026119 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de57435e-3eeb-4a12-8fef-d7e7e8fbe12d tempest-FlavorsAccessTestJSON-412951864 tempest-FlavorsAccessTestJSON-412951864-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.112130 Jul 25 16:02:53.029805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 30/37] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:52 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:53.045990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2f7fe64-4e21-4a49-9d96-04946d7789d9 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:53.047034 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:53.047034 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:53.091906 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2f7fe64-4e21-4a49-9d96-04946d7789d9 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/1757915324" status: 202 len: 0 microversion: 2.1 time: 0.049652 Jul 25 16:02:53.092953 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 31/38] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:02:53 2022] DELETE /compute/v2.1/flavors/1757915324 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:02:53.102399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ce2d7ed-b8eb-49a8-bb7d-92eb53eb543b tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:53.182705 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ce2d7ed-b8eb-49a8-bb7d-92eb53eb543b tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.082302 Jul 25 16:02:53.197962 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 32/39] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:53 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:53.206758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-60c9e104-db0b-4e68-9a00-f17d710fe87e tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-850658840", "id": 940731444, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:53.215135 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:53.215135 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:53.254315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-60c9e104-db0b-4e68-9a00-f17d710fe87e tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.049704 Jul 25 16:02:53.257354 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 33/40] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:53 2022] POST /compute/v2.1/flavors => generated 429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:53.278355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7968aed7-0827-476e-a5d6-b2e62caffb8b tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:53.279899 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:53.279899 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:53.317898 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7968aed7-0827-476e-a5d6-b2e62caffb8b tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/940731444/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.051118 Jul 25 16:02:53.319552 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 34/41] 10.222.0.105 () {58 vars in 1211 bytes} [Mon Jul 25 16:02:53 2022] GET /compute/v2.1/flavors/940731444/os-flavor-access => generated 21 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:53.336795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e40ef1b-1be0-40a4-8821-a027f12ad863 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:53.380935 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e40ef1b-1be0-40a4-8821-a027f12ad863 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/940731444" status: 202 len: 0 microversion: 2.1 time: 0.054307 Jul 25 16:02:53.385440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 35/42] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:02:53 2022] DELETE /compute/v2.1/flavors/940731444 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:02:53.406027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26ff1eb7-8a97-40e3-b395-68444564eb17 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:53.445781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26ff1eb7-8a97-40e3-b395-68444564eb17 tempest-FlavorsAccessTestJSON-316436354 tempest-FlavorsAccessTestJSON-316436354-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.058874 Jul 25 16:02:53.447085 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 36/43] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:53 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:53.945298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:54.738302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:54.798846 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4cf68347-6926-47a7-aa59-babf4390e7a6 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1300 microversion: 2.1 time: 2.521556 Jul 25 16:02:54.837030 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 8/44] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:52 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1300 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:02:55.413281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2038642634", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:55.598756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:02:55.847577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:55.850162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:55.893614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:55.894238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:55.897762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:55.898510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:56.905288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:56.935356 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bdb4ab0c-408a-46ab-af87-c48958c73fc3 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 1.113948 Jul 25 16:02:56.948460 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 9/45] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:55 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:56.953838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:02:56.955581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:02:56.956271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:02:56.956880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:02:56.957522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:02:56.981600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:56.982466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:56.983672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:56.984512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.032067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Getting quotas for project 7f2be2f7e5c543b091248379de7069dc. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:02:57.037813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Getting quotas for user bc0b370cb44b4beabe9b9cee8e8b16cf and project 7f2be2f7e5c543b091248379de7069dc. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:02:57.084677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:02:57.099848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:02:57.213869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:57.274612 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2abb9711-e5c3-48d4-8316-d5a53d60dd3b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.597736 Jul 25 16:02:57.284261 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 37/46] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 3610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:02:57.290970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c756627-d6c5-4582-89c5-e30c43b02f11 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:57.291982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c756627-d6c5-4582-89c5-e30c43b02f11 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:57.427791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c756627-d6c5-4582-89c5-e30c43b02f11 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:57.442838 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c756627-d6c5-4582-89c5-e30c43b02f11 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1224 microversion: 2.1 time: 0.156357 Jul 25 16:02:57.447171 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 38/47] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:57 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:57.568510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da06e6040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:57.569624 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:57.569624 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:57.591044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=119598) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 16:02:57.594031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.594811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.690426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.691048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.750538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.751489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.761995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c05d497d-be08-40bb-9225-be0c57587cf8 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.812122 Jul 25 16:02:57.762849 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 10/48] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:57.783978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da0701280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:57.784882 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:57.784882 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:57.786389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.786831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.842092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.842556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.878320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.878893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:57.915920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75ae0d9a-2c83-4412-9d7c-571c8ab8c187 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.139180 Jul 25 16:02:57.918773 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 11/49] 10.222.0.105 () {58 vars in 1172 bytes} [Mon Jul 25 16:02:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:57.934908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da0800ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:57.936054 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:57.936054 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:57.942254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:57.943409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.004320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:58.016388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.068443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:58.069236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.078457 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a004c33-689a-43a5-9cb0-44ff2c76e083 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.147058 Jul 25 16:02:58.080293 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 12/50] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:02:58.086774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:58.087793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:58.112490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:58.113581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.114969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:58.115775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.296662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eaeb7323-f097-4b19-a64c-85de8eae9542 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:58.315956 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eaeb7323-f097-4b19-a64c-85de8eae9542 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.763658 Jul 25 16:02:58.317520 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 39/51] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:02:57 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:02:58.503690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a30ea8e3-2abf-4f12-af6f-2b0e780b4b24 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Calling method '.version_select at 0x7f9da0620430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:58.561213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a30ea8e3-2abf-4f12-af6f-2b0e780b4b24 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] HTTP exception thrown: Image not found. Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a30ea8e3-2abf-4f12-af6f-2b0e780b4b24 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Request method failure captured: Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/images/70c4687a-3589-4f0b-8cc3-930649fedc28/metadata/os_distro HTTP/1.1 Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6xutjWgmqlKvYrl7zVtFDqDMH39RWGXZpsav4T1qi4r0Qr2tOocs0RadEg2HUKDblwOidy47BUqDVLKkKtMkcBg3qRKHRG5smhxB1fRYKzl_yiGz5DWq-soNH0c3to-voYezQ0pCoXxMlUe4Dufmdnn66ExcvAv8JqKBjJ-8rigIQ Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:02:58.570003 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_968e567f2cbd400faede7470e2d377bb"}]}] Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 62ceda9f555b4697a07c1d2285696c8a Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'image_id': '70c4687a-3589-4f0b-8cc3-930649fedc28', 'id': 'os_distro'} Jul 25 16:02:58.572331 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:58.573760 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 70c4687a-3589-4f0b-8cc3-930649fedc28 Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:58.574901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70c4687a-3589-4f0b-8cc3-930649fedc28 could not be found. Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:02:58.575917 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:02:58.577289 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:58.583915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a30ea8e3-2abf-4f12-af6f-2b0e780b4b24 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:58.589330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a30ea8e3-2abf-4f12-af6f-2b0e780b4b24 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] 10.222.0.105 "DELETE /compute/v2.1/images/70c4687a-3589-4f0b-8cc3-930649fedc28/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.269942 Jul 25 16:02:58.595172 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 40/52] 10.222.0.105 () {58 vars in 1298 bytes} [Mon Jul 25 16:02:58 2022] DELETE /compute/v2.1/images/70c4687a-3589-4f0b-8cc3-930649fedc28/metadata/os_distro => generated 62 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:02:58.617408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8a0a9c4-d337-4fda-b82f-00385ca097b5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da0620dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:58.629282 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:58.629282 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:58.633214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9c4-d337-4fda-b82f-00385ca097b5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:58.634270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9c4-d337-4fda-b82f-00385ca097b5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.677571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9c4-d337-4fda-b82f-00385ca097b5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:58.679115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9c4-d337-4fda-b82f-00385ca097b5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:58.703700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8a0a9c4-d337-4fda-b82f-00385ca097b5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 761 microversion: 2.1 time: 0.106483 Jul 25 16:02:58.721122 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 41/53] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:02:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 761 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:58.771934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:58.780651 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e088682-d192-4f0d-aae2-7710cbd9d4ac tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.698780 Jul 25 16:02:58.781268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 13/54] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:58 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:58.804912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5badc7a-977f-4f04-a400-cf4a9bb4b27e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:58.810726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5badc7a-977f-4f04-a400-cf4a9bb4b27e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:58.958407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5badc7a-977f-4f04-a400-cf4a9bb4b27e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:58.982089 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5badc7a-977f-4f04-a400-cf4a9bb4b27e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1224 microversion: 2.1 time: 0.180864 Jul 25 16:02:58.985788 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 14/55] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:58 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:59.007314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41a88a7c-ca67-407f-8446-6b69a2c3307e tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Calling method '.version_select at 0x7f9da06b45e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.070988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-41a88a7c-ca67-407f-8446-6b69a2c3307e tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] HTTP exception thrown: Image not found. Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41a88a7c-ca67-407f-8446-6b69a2c3307e tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Request method failure captured: Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/images/63639183-8d61-4804-9bda-8a2a7c2a9e23/metadata/os_version HTTP/1.1 Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6xutjWgmqlKvYrl7zVtFDqDMH39RWGXZpsav4T1qi4r0Qr2tOocs0RadEg2HUKDblwOidy47BUqDVLKkKtMkcBg3qRKHRG5smhxB1fRYKzl_yiGz5DWq-soNH0c3to-voYezQ0pCoXxMlUe4Dufmdnn66ExcvAv8JqKBjJ-8rigIQ Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:02:59.082156 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_968e567f2cbd400faede7470e2d377bb"}]}] Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 62ceda9f555b4697a07c1d2285696c8a Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'image_id': '63639183-8d61-4804-9bda-8a2a7c2a9e23', 'id': 'os_version'} Jul 25 16:02:59.083698 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.084413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63639183-8d61-4804-9bda-8a2a7c2a9e23 Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.085412 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63639183-8d61-4804-9bda-8a2a7c2a9e23 could not be found. Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:02:59.087101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:02:59.088481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.094725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41a88a7c-ca67-407f-8446-6b69a2c3307e tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:59.096222 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41a88a7c-ca67-407f-8446-6b69a2c3307e tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] 10.222.0.105 "GET /compute/v2.1/images/63639183-8d61-4804-9bda-8a2a7c2a9e23/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.109106 Jul 25 16:02:59.100137 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 15/56] 10.222.0.105 () {58 vars in 1298 bytes} [Mon Jul 25 16:02:58 2022] GET /compute/v2.1/images/63639183-8d61-4804-9bda-8a2a7c2a9e23/metadata/os_version => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:02:59.124144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d0afc85-a296-4e65-ba25-fe36fae82b9d tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da06aa790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.125378 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:59.125378 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:59.126988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d0afc85-a296-4e65-ba25-fe36fae82b9d tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.127657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d0afc85-a296-4e65-ba25-fe36fae82b9d tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.209059 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d0afc85-a296-4e65-ba25-fe36fae82b9d tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.107122 Jul 25 16:02:59.216302 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 16/57] 10.222.0.105 () {58 vars in 1184 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:59.229974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19b76cee-e44e-4027-b979-e636a0065656 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Calling method '.version_select at 0x7f9da066f5e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.281199 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-19b76cee-e44e-4027-b979-e636a0065656 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] HTTP exception thrown: Image not found. Jul 25 16:02:59.282239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f79fd366-fc47-47d8-ae8c-2f63ba276f26 tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1286814407", "id": 1050889106, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19b76cee-e44e-4027-b979-e636a0065656 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Request method failure captured: Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/images/0276562f-264a-44b9-87f2-5947f3a301c3/metadata HTTP/1.1 Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6xutjWgmqlKvYrl7zVtFDqDMH39RWGXZpsav4T1qi4r0Qr2tOocs0RadEg2HUKDblwOidy47BUqDVLKkKtMkcBg3qRKHRG5smhxB1fRYKzl_yiGz5DWq-soNH0c3to-voYezQ0pCoXxMlUe4Dufmdnn66ExcvAv8JqKBjJ-8rigIQ Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:02:59.283286 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_968e567f2cbd400faede7470e2d377bb"}]}] Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 62ceda9f555b4697a07c1d2285696c8a Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'image_id': '0276562f-264a-44b9-87f2-5947f3a301c3'} Jul 25 16:02:59.284775 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.285573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0276562f-264a-44b9-87f2-5947f3a301c3 Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.286654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0276562f-264a-44b9-87f2-5947f3a301c3 could not be found. Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:02:59.287929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.288955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19b76cee-e44e-4027-b979-e636a0065656 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:59.289903 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:59.289903 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:59.290028 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-19b76cee-e44e-4027-b979-e636a0065656 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] 10.222.0.105 "GET /compute/v2.1/images/0276562f-264a-44b9-87f2-5947f3a301c3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066781 Jul 25 16:02:59.292901 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 17/58] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/images/0276562f-264a-44b9-87f2-5947f3a301c3/metadata => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:02:59.303621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da066fdc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.304883 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:59.304883 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:59.306724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.309311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.325849 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f79fd366-fc47-47d8-ae8c-2f63ba276f26 tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.609430 Jul 25 16:02:59.339284 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 42/59] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:58 2022] POST /compute/v2.1/flavors => generated 427 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:59.364295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.365693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.378106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d24a290-5d36-42ea-b9a0-adccf80e0c05 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Action: 'update_all', calling method: .version_select at 0x7f9da06e5f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:59.430032 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-6d24a290-5d36-42ea-b9a0-adccf80e0c05 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] HTTP exception thrown: Image not found. Jul 25 16:02:59.435602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.437886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d24a290-5d36-42ea-b9a0-adccf80e0c05 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Request method failure captured: Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/images/91d94d86-4589-45b3-843f-186116187368/metadata HTTP/1.1 Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 57 Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6xutjWgmqlKvYrl7zVtFDqDMH39RWGXZpsav4T1qi4r0Qr2tOocs0RadEg2HUKDblwOidy47BUqDVLKkKtMkcBg3qRKHRG5smhxB1fRYKzl_yiGz5DWq-soNH0c3to-voYezQ0pCoXxMlUe4Dufmdnn66ExcvAv8JqKBjJ-8rigIQ Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:02:59.441140 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_968e567f2cbd400faede7470e2d377bb"}]}] Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 62ceda9f555b4697a07c1d2285696c8a Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:02:59.442337 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'image_id': '91d94d86-4589-45b3-843f-186116187368', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.443022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 91d94d86-4589-45b3-843f-186116187368 Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.443986 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91d94d86-4589-45b3-843f-186116187368 could not be found. Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:59.445497 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:02:59.446650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.447754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d24a290-5d36-42ea-b9a0-adccf80e0c05 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:59.459419 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d24a290-5d36-42ea-b9a0-adccf80e0c05 tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] 10.222.0.105 "PUT /compute/v2.1/images/91d94d86-4589-45b3-843f-186116187368/metadata" status: 404 len: 62 microversion: 2.1 time: 0.108945 Jul 25 16:02:59.459419 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 43/60] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:02:59 2022] PUT /compute/v2.1/images/91d94d86-4589-45b3-843f-186116187368/metadata => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:02:59.459756 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b7b0e93a-a628-4c43-bdea-166a3edea393 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.161814 Jul 25 16:02:59.459910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d915190c-8658-4706-9fcd-d9de3dfda8ba tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.464407 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 18/61] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:59.480280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea61dee1-ed6c-4013-90e7-812ceb6766de tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Action: 'update', calling method: .version_select at 0x7f9da0800ca0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:59.484544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d915190c-8658-4706-9fcd-d9de3dfda8ba tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031175 Jul 25 16:02:59.486788 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 44/62] 10.222.0.105 () {58 vars in 1187 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:59.498077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02f244ef-d9fe-4811-8d79-25afa97a24e5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da05fca60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.502068 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:59.502068 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:02:59.526794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02f244ef-d9fe-4811-8d79-25afa97a24e5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.527344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02f244ef-d9fe-4811-8d79-25afa97a24e5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.555633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ea61dee1-ed6c-4013-90e7-812ceb6766de tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] HTTP exception thrown: Image not found. Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea61dee1-ed6c-4013-90e7-812ceb6766de tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Request method failure captured: Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/images/5e99db3b-1efa-474e-b6a8-f48f855d870d/metadata/os_distro HTTP/1.1 Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 30 Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6xutjWgmqlKvYrl7zVtFDqDMH39RWGXZpsav4T1qi4r0Qr2tOocs0RadEg2HUKDblwOidy47BUqDVLKkKtMkcBg3qRKHRG5smhxB1fRYKzl_yiGz5DWq-soNH0c3to-voYezQ0pCoXxMlUe4Dufmdnn66ExcvAv8JqKBjJ-8rigIQ Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:02:59.558188 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_968e567f2cbd400faede7470e2d377bb"}]}] Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 62ceda9f555b4697a07c1d2285696c8a Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: {"meta": {"os_distro": "alt"}} Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:02:59.560648 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'image_id': '5e99db3b-1efa-474e-b6a8-f48f855d870d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.561878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e99db3b-1efa-474e-b6a8-f48f855d870d Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.562768 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e99db3b-1efa-474e-b6a8-f48f855d870d could not be found. Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:59.563865 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:02:59.564984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.568396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea61dee1-ed6c-4013-90e7-812ceb6766de tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:59.568396 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea61dee1-ed6c-4013-90e7-812ceb6766de tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] 10.222.0.105 "PUT /compute/v2.1/images/5e99db3b-1efa-474e-b6a8-f48f855d870d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.093115 Jul 25 16:02:59.568396 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 19/63] 10.222.0.105 () {60 vars in 1315 bytes} [Mon Jul 25 16:02:59 2022] PUT /compute/v2.1/images/5e99db3b-1efa-474e-b6a8-f48f855d870d/metadata/os_distro => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:02:59.568396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24a619af-075e-4501-bff0-5e86178c9eaa tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1201136526", "id": 1529827593, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:59.620869 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:59.620869 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:59.630787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02f244ef-d9fe-4811-8d79-25afa97a24e5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.657790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02f244ef-d9fe-4811-8d79-25afa97a24e5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.691980 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02f244ef-d9fe-4811-8d79-25afa97a24e5 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 761 microversion: 2.1 time: 0.203796 Jul 25 16:02:59.700505 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 45/64] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 761 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:59.706317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4b4aa15-1b50-4a25-90a8-af7facae48bb tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Action: 'create', calling method: .version_select at 0x7f9da05fc790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:59.731256 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24a619af-075e-4501-bff0-5e86178c9eaa tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.138518 Jul 25 16:02:59.734874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 20/65] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:02:59 2022] POST /compute/v2.1/flavors => generated 427 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:59.779488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f08feda1-7576-4b09-ae39-a4bfac556c2f tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da06aa790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.793713 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:02:59.793713 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:02:59.794789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08feda1-7576-4b09-ae39-a4bfac556c2f tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.795393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08feda1-7576-4b09-ae39-a4bfac556c2f tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.837575 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a4b4aa15-1b50-4a25-90a8-af7facae48bb tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] HTTP exception thrown: Image not found. Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4b4aa15-1b50-4a25-90a8-af7facae48bb tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Request method failure captured: Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/images/ec581408-80f5-45d8-b0d9-e835af1c807d/metadata HTTP/1.1 Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 57 Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6xutjWgmqlKvYrl7zVtFDqDMH39RWGXZpsav4T1qi4r0Qr2tOocs0RadEg2HUKDblwOidy47BUqDVLKkKtMkcBg3qRKHRG5smhxB1fRYKzl_yiGz5DWq-soNH0c3to-voYezQ0pCoXxMlUe4Dufmdnn66ExcvAv8JqKBjJ-8rigIQ Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:02:59.840542 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/968e567f2cbd400faede7470e2d377bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_968e567f2cbd400faede7470e2d377bb"}]}] Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 968e567f2cbd400faede7470e2d377bb Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852 Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 62ceda9f555b4697a07c1d2285696c8a Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2073124852-project Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:02:59.841866 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'image_id': 'ec581408-80f5-45d8-b0d9-e835af1c807d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.842652 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ec581408-80f5-45d8-b0d9-e835af1c807d Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:02:59.843686 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec581408-80f5-45d8-b0d9-e835af1c807d could not be found. Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:59.845134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:02:59.847326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:02:59.853123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4b4aa15-1b50-4a25-90a8-af7facae48bb tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:59.853123 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4b4aa15-1b50-4a25-90a8-af7facae48bb tempest-ImagesMetadataNegativeTestJSON-2073124852 tempest-ImagesMetadataNegativeTestJSON-2073124852-project] 10.222.0.105 "POST /compute/v2.1/images/ec581408-80f5-45d8-b0d9-e835af1c807d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.147862 Jul 25 16:02:59.853123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 46/66] 10.222.0.105 () {60 vars in 1286 bytes} [Mon Jul 25 16:02:59 2022] POST /compute/v2.1/images/ec581408-80f5-45d8-b0d9-e835af1c807d/metadata => generated 62 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:02:59.897319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3e1b1c8-d9ad-4179-8608-05d8178a41f4 tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:59.923254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08feda1-7576-4b09-ae39-a4bfac556c2f tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:59.926265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08feda1-7576-4b09-ae39-a4bfac556c2f tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:59.948135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3e1b1c8-d9ad-4179-8608-05d8178a41f4 tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.096357 Jul 25 16:02:59.963017 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 47/67] 10.222.0.105 () {58 vars in 1187 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:02:59.963676 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f08feda1-7576-4b09-ae39-a4bfac556c2f tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.218807 Jul 25 16:02:59.967998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 21/68] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:59.984386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6ae7c6a-dd3e-455b-bf22-f13042514192 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Action: 'create', calling method: .version_select at 0x7f9da06aa3a0>, body: {"keypair": {"name": "tempest-keypair-2032354285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9ujw0rGHkYwKlbF/EIwMgHD967Qu9xCFPhBtBLJfjTxZWVITSkZEzT0HZAookX1ZDolsU/UTBpET2OgRJfbV9/DAfpYZ+DyaeDm2RL+So+8Z6krsZavr5NnVF+UmAxLw=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:00.000049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:00.001066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:00.021553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.022241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.026963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.028895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.137791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a6ae7c6a-dd3e-455b-bf22-f13042514192 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Getting quotas for project b189f6c36b0c4f6792d9a3e354f535a6. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:00.186578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a6ae7c6a-dd3e-455b-bf22-f13042514192 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Getting quotas for user 36d8a0c9ba5a40759ee0838c7ef265cb and project b189f6c36b0c4f6792d9a3e354f535a6. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:00.270634 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6ae7c6a-dd3e-455b-bf22-f13042514192 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.301054 Jul 25 16:03:00.286155 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 22/69] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:02:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:00.296152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Calling method '.version_select at 0x7f9da059b9d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:00.302803 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:00.302803 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:00.304272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.304804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.369986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.370767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.417399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.419466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.452397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a036c6c0-2af7-4b5a-a8db-6f16162975f0 tempest-HypervisorAdminTestJSON-218119559 tempest-HypervisorAdminTestJSON-218119559-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:03:00.468753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.470112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.471249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.471957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.493747 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.rpcapi [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 16:03:00.498611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] Releasing lock "compute-rpcapi-router" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:03:00.639109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1327d227-563f-4836-a5a3-28630cf16727 None None] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.351083 Jul 25 16:03:00.640229 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 23/70] 10.222.0.105 () {58 vars in 1178 bytes} [Mon Jul 25 16:03:00 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:00.662164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:00.668551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:00.704293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.706148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:00.710011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:00.713765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:01.499141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:01.536018 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f604fc3c-b88c-44fe-b503-f769f352d154 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1284 microversion: 2.1 time: 0.893724 Jul 25 16:03:01.542289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 24/71] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:00 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1284 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:02.328349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7844db40-7a1a-4ed0-bfa1-6cd96ff31fc1 req-9fd871d0-b0a9-4747-9f85-2f45896c5b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf225920-15fb-4099-8324-7c7198595d32", "tag": "aed0bb92-d706-42bf-8639-df872ddf03e2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:02.389778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:02.422523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7844db40-7a1a-4ed0-bfa1-6cd96ff31fc1 req-9fd871d0-b0a9-4747-9f85-2f45896c5b5b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:02.423015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7844db40-7a1a-4ed0-bfa1-6cd96ff31fc1 req-9fd871d0-b0a9-4747-9f85-2f45896c5b5b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:02.436457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11731e68-3ec9-4e48-aeab-41645198971c tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 2.466659 Jul 25 16:03:02.445981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 48/72] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:02:59 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:02.525556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7844db40-7a1a-4ed0-bfa1-6cd96ff31fc1 req-9fd871d0-b0a9-4747-9f85-2f45896c5b5b service nova] Creating event network-changed:aed0bb92-d706-42bf-8639-df872ddf03e2 for instance bf225920-15fb-4099-8324-7c7198595d32 on n-h2-846219-13 Jul 25 16:03:02.564076 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7844db40-7a1a-4ed0-bfa1-6cd96ff31fc1 req-9fd871d0-b0a9-4747-9f85-2f45896c5b5b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.444386 Jul 25 16:03:02.577679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:02.578893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:02.579444 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 25/73] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:02.607082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:02.617771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:02.618873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:02.619434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:03.039648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:03.057762 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4f8056a-3196-43eb-ad78-bd2b5a582668 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1282 microversion: 2.1 time: 0.484069 Jul 25 16:03:03.061662 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 49/74] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:02 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1282 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:03.471095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:03.473300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:03.508497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:03.513446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:03.517473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:03.525855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:04.098800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:04.100333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:04.117462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:04.118421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:04.119726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:04.120473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:04.409992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:04.419566 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a5d21336-6572-4916-aa8d-6fa0fe0c5755 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1282 microversion: 2.1 time: 0.325429 Jul 25 16:03:04.433487 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 50/75] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:04 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:04.575121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:04.606761 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7efa5c3f-bb0f-4d17-b52c-2313b229ba1f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 1.129272 Jul 25 16:03:04.608375 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 26/76] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:03 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:05.473334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:05.474773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:05.510979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:05.515181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:05.517977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:05.519956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:05.638214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:05.642950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:05.686528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:05.690502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:05.692974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:05.696436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:06.999744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:07.432870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:07.844766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:07.884575 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c504c5a-a37b-462c-aae9-28fad1bb993b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 2.255944 Jul 25 16:03:07.892318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 27/77] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:05 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:08.094692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:08.097946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=61 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:08.119132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2ce592a-57a2-4895-8476-a77f0373660a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 2.652546 Jul 25 16:03:08.128893 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 51/78] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:05 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:08.940303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:08.941527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:08.957490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:08.959351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:08.962107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:08.962870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:09.004871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Calling method '.version_select at 0x7f9da0559820>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:09.008455 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:09.008455 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:09.015702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:09.022280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:09.124499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:09.125285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:09.176244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:09.189222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:09.223652 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d87a00b1-f132-4aa1-9361-c9fb126ee382 tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.328788 Jul 25 16:03:09.225679 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 28/79] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:09.284535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:09.290758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:09.330658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:09.332785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:09.336113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:09.337231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:10.224934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:10.481076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:10.570910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:10.620462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-46252ebe-fd5a-4c4c-ac92-f8b9a0632af1 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 1.379181 Jul 25 16:03:10.622416 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 29/80] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:09 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:10.649777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Calling method '.version_select at 0x7f9da0559310>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:10.661871 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:10.661871 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:10.668430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:10.671439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:10.803899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:10.806655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:10.907160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:10.930240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:10.931513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:10.950897 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa8d61b5-224f-4b76-a43d-a84c07f4e89e tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/n-h2-846219-13/servers" status: 200 len: 197 microversion: 2.1 time: 0.325361 Jul 25 16:03:10.954515 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 30/81] 10.222.0.105 () {58 vars in 1220 bytes} [Mon Jul 25 16:03:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-846219-13/servers => generated 197 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:11.233075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:11.243304 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9365c82e-69ab-4588-844f-c6f4a9afb91f tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 2.309019 Jul 25 16:03:11.250583 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 52/82] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:08 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:11.276528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Calling method '.version_select at 0x7f9da05fc310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:11.281627 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:11.281627 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:11.285023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.295982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.358688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.360915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.399968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.401156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.424846 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-410cbeaa-7d15-4182-a9a9-9dbe9691290a tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.170187 Jul 25 16:03:11.428568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-614eb718-dcb2-4f81-af25-62de5d4faa28 req-1b3741b4-b02d-4548-9194-6c87594d5e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a2c288-eaf1-4498-94b6-14855dc886f4", "tag": "96dc584e-b3fb-4942-91b2-6a343237d23f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:11.433532 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 53/83] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:11.443341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ede120c9-15ec-46f2-b919-2b0eda3cd6cd tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Calling method '.version_select at 0x7f9da05fc9d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:11.445849 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:11.445849 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:11.447593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ede120c9-15ec-46f2-b919-2b0eda3cd6cd tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.448812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ede120c9-15ec-46f2-b919-2b0eda3cd6cd tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.451628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:11.458911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-614eb718-dcb2-4f81-af25-62de5d4faa28 req-1b3741b4-b02d-4548-9194-6c87594d5e5c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.460545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-614eb718-dcb2-4f81-af25-62de5d4faa28 req-1b3741b4-b02d-4548-9194-6c87594d5e5c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.494035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ede120c9-15ec-46f2-b919-2b0eda3cd6cd tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.495224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ede120c9-15ec-46f2-b919-2b0eda3cd6cd tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.512679 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-614eb718-dcb2-4f81-af25-62de5d4faa28 req-1b3741b4-b02d-4548-9194-6c87594d5e5c service nova] Creating event network-changed:96dc584e-b3fb-4942-91b2-6a343237d23f for instance 13a2c288-eaf1-4498-94b6-14855dc886f4 on n-h1-846219-13 Jul 25 16:03:11.516028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ede120c9-15ec-46f2-b919-2b0eda3cd6cd tempest-HypervisorAdminUnderV252Test-1621304665 tempest-HypervisorAdminUnderV252Test-1621304665-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/n-h2-846219-13/search" status: 200 len: 105 microversion: 2.1 time: 0.079727 Jul 25 16:03:11.527807 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 54/84] 10.222.0.105 () {58 vars in 1217 bytes} [Mon Jul 25 16:03:11 2022] GET /compute/v2.1/os-hypervisors/n-h2-846219-13/search => generated 105 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:11.548727 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-614eb718-dcb2-4f81-af25-62de5d4faa28 req-1b3741b4-b02d-4548-9194-6c87594d5e5c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591884 Jul 25 16:03:11.549782 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 31/85] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:11.666084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:11.667562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:11.681874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.684028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:11.688018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:11.689193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:12.279201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:12.280465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:12.297616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:12.304051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:12.305281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:12.319159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:12.348440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:12.393641 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-77b9e3e2-cfa5-41c3-9a60-6eeee9dfbbf6 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.705418 Jul 25 16:03:12.401162 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 55/86] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:11 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:13.033990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:13.058002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f51e9f5a-3683-4931-b243-d9b49e6d5490 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.785445 Jul 25 16:03:13.074470 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 32/87] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:12 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:13.096122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-896929482", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "1529827593", "adminPass": "***", "networks": [{"uuid": "64159bf9-3631-4b00-a2a2-65fc3ccd367f"}], "security_groups": [{"name": "tempest-securitygroup--307858072"}], "key_name": "tempest-keypair-2032354285", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:13.229114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Calling method '.version_select at 0x7f9da0546c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:13.230211 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:13.230211 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:13.231415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:13.231910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:13.248873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:13.249649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:13.262687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:13.263491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:13.271124 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b70ec3a-c69d-41f8-bf89-df723adcb9d2 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.261827 Jul 25 16:03:13.272492 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 56/88] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:13.505622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cb9c7f97-6b23-462f-b8bc-8fd99ae5458a tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Calling method '.version_select at 0x7f9da0546940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:13.507631 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:13.507631 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:13.509217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cb9c7f97-6b23-462f-b8bc-8fd99ae5458a tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3d5af02f41e145d4940c5470ef4b11e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775ed5a78d414ce5891e319beb50c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cb9c7f97-6b23-462f-b8bc-8fd99ae5458a tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Request method failure captured: Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/n-h2-846219-13/search HTTP/1.1 Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6-fS8iUE-0Ru3P-1VaOLCOgWkkl439c4Jt2IUVSHVE0sZN6GKSana174jpA8LLx1e6O-_aezH0bCrNvo-L5mY38ggiiHYuhCdbvij4SJRPfoqtiZv47EdEB-sj4uMNpOMLfP__PUswyi6A9VCv1lxmTUcHU_GWqLbyjA4CGGYMK_U Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 775ed5a78d414ce5891e319beb50c461 Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-920676483 Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:13.518948 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/775ed5a78d414ce5891e319beb50c461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/775ed5a78d414ce5891e319beb50c461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/775ed5a78d414ce5891e319beb50c461"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_775ed5a78d414ce5891e319beb50c461"}]}] Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-920676483 Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 775ed5a78d414ce5891e319beb50c461 Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-920676483 Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-920676483-project Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 3d5af02f41e145d4940c5470ef4b11e0 Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-920676483-project Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 16:03:13.520269 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-h2-846219-13'} Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:13.520980 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 16:03:13.523295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:13.525624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cb9c7f97-6b23-462f-b8bc-8fd99ae5458a tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:13.533767 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cb9c7f97-6b23-462f-b8bc-8fd99ae5458a tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/n-h2-846219-13/search" status: 403 len: 117 microversion: 2.1 time: 0.252307 Jul 25 16:03:13.535935 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 57/89] 10.222.0.105 () {58 vars in 1217 bytes} [Mon Jul 25 16:03:13 2022] GET /compute/v2.1/os-hypervisors/n-h2-846219-13/search => generated 117 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:13.560152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:13.560800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:13.579290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:13.580158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:13.581283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:13.581968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.144212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:14.169213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb9b6b74-18ff-4014-b2c1-20458a0efb7f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.631812 Jul 25 16:03:14.173461 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 58/90] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:13 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:14.209290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Calling method '.version_select at 0x7f9da0620670>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:14.210541 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:14.210541 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:14.212213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.212941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.233435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Request method failure captured: Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7A4LFbmM81Dl6ZTbspvqlcc7MEapE8Kw9n6RHoHvYLT7n7_YXfi5dcD3JNR7k7PSZXeK7J3CzYWeaYWcW1gSiKgeEHYA6MG0Fzak30y75wMgAKK4EOx_UBxioG__n1Ry34CNUPJ3EQ5sEmtUw60IdlkW8DVluQj42GLUTv6t71ew8 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0a8dd4e1d72a4084b22d3999f6e55b29 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-391235029 Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:14.235073 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0a8dd4e1d72a4084b22d3999f6e55b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0a8dd4e1d72a4084b22d3999f6e55b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0a8dd4e1d72a4084b22d3999f6e55b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0a8dd4e1d72a4084b22d3999f6e55b29"}]}] Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-391235029 Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0a8dd4e1d72a4084b22d3999f6e55b29 Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-391235029 Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 95e10ee3cb784f058bfd2250dd451627 Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 16:03:14.236507 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:14.237362 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:14.238631 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:14.238631 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:14.238631 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:14.238631 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 16:03:14.238631 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.243442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:14.244514 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9d1ccc7b-fdab-4b57-9ebe-352e0ac65328 tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.069883 Jul 25 16:03:14.245249 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 59/91] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:03:14 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:14.255144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:14.258051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:14.269604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.270045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.270827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.271253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.745555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:14.774674 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-280e2dbb-2508-4083-b4dc-c3af78ef6582 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.522579 Jul 25 16:03:14.797499 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 60/92] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:14 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:14.804121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Calling method '.version_select at 0x7f9da20f7a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:14.805323 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:14.805323 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:14.806886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.807566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.832202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.833002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.854253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.854768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.874717 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f1e3766-cfe3-4201-bd80-657186e52a7a tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.075629 Jul 25 16:03:14.875353 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 61/93] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:14.889690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70917e96-eef0-4338-a40c-84c47e121e7b tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Calling method '.version_select at 0x7f9da05fc700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:14.890524 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:14.890524 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:14.891637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-70917e96-eef0-4338-a40c-84c47e121e7b tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3d5af02f41e145d4940c5470ef4b11e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775ed5a78d414ce5891e319beb50c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70917e96-eef0-4338-a40c-84c47e121e7b tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Request method failure captured: Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6-fS8iUE-0Ru3P-1VaOLCOgWkkl439c4Jt2IUVSHVE0sZN6GKSana174jpA8LLx1e6O-_aezH0bCrNvo-L5mY38ggiiHYuhCdbvij4SJRPfoqtiZv47EdEB-sj4uMNpOMLfP__PUswyi6A9VCv1lxmTUcHU_GWqLbyjA4CGGYMK_U Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 775ed5a78d414ce5891e319beb50c461 Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-920676483 Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:14.893608 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/775ed5a78d414ce5891e319beb50c461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/775ed5a78d414ce5891e319beb50c461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/775ed5a78d414ce5891e319beb50c461"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_775ed5a78d414ce5891e319beb50c461"}]}] Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-920676483 Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 775ed5a78d414ce5891e319beb50c461 Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-920676483 Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-920676483-project Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 3d5af02f41e145d4940c5470ef4b11e0 Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-920676483-project Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 16:03:14.894767 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1'} Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:14.895405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 16:03:14.896457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.898731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70917e96-eef0-4338-a40c-84c47e121e7b tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:14.899921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-70917e96-eef0-4338-a40c-84c47e121e7b tempest-HypervisorAdminNegativeUnderV252Test-920676483 tempest-HypervisorAdminNegativeUnderV252Test-920676483-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015441 Jul 25 16:03:14.905955 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 62/94] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:03:14 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:14.921391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Calling method '.version_select at 0x7f9da06e51f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:14.926060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:14.928012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:14.944547 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] HTTP exception thrown: No hypervisor matching '2e811024-9700-48ae-9bf1-cd0cd683743a' could be found. Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Request method failure captured: Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/2e811024-9700-48ae-9bf1-cd0cd683743a/servers HTTP/1.1 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7A4LFbmM81Dl6ZTbspvqlcc7MEapE8Kw9n6RHoHvYLT7n7_YXfi5dcD3JNR7k7PSZXeK7J3CzYWeaYWcW1gSiKgeEHYA6MG0Fzak30y75wMgAKK4EOx_UBxioG__n1Ry34CNUPJ3EQ5sEmtUw60IdlkW8DVluQj42GLUTv6t71ew8 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0a8dd4e1d72a4084b22d3999f6e55b29 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-391235029 Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:14.946830 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0a8dd4e1d72a4084b22d3999f6e55b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0a8dd4e1d72a4084b22d3999f6e55b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0a8dd4e1d72a4084b22d3999f6e55b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0a8dd4e1d72a4084b22d3999f6e55b29"}]}] Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-391235029 Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0a8dd4e1d72a4084b22d3999f6e55b29 Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-391235029 Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 95e10ee3cb784f058bfd2250dd451627 Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: exception: No hypervisor matching '2e811024-9700-48ae-9bf1-cd0cd683743a' could be found. Jul 25 16:03:14.947986 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '2e811024-9700-48ae-9bf1-cd0cd683743a'} Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2e811024-9700-48ae-9bf1-cd0cd683743a' could be found. Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.948835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2e811024-9700-48ae-9bf1-cd0cd683743a' could be found. Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] Returning 404 to user: No hypervisor matching '2e811024-9700-48ae-9bf1-cd0cd683743a' could be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-095866c5-2560-414d-bf04-bcf4ebc53a5d tempest-HypervisorAdminNegativeUnderV252Test-391235029 tempest-HypervisorAdminNegativeUnderV252Test-391235029-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/2e811024-9700-48ae-9bf1-cd0cd683743a/servers" status: 404 len: 123 microversion: 2.1 time: 0.041291 Jul 25 16:03:14.954447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 63/95] 10.222.0.105 () {58 vars in 1286 bytes} [Mon Jul 25 16:03:14 2022] GET /compute/v2.1/os-hypervisors/2e811024-9700-48ae-9bf1-cd0cd683743a/servers => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:15.198666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:15.199283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:15.214975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:15.215423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:15.224496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:15.226901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:15.564959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:15.586968 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b925ab5-31e9-4f93-bfc0-7e5c306ff9bb tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.396684 Jul 25 16:03:15.594067 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 64/96] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:15 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:15.812145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:15.813206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:15.831181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:15.831640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:15.832479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:15.844560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:16.091522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] validate_networks() for [('64159bf9-3631-4b00-a2a2-65fc3ccd367f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:03:16.660605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:16.687029 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-44b79e5f-2d3d-4442-a67e-dcd33c4d9b17 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.880666 Jul 25 16:03:16.705930 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 65/97] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:15 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:16.713775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:16.720057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:16.736309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:16.737251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:16.742126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:16.742906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:17.426751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:17.443061 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ab9569f-5c5c-4d49-bdd4-d6c22f14389e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.733086 Jul 25 16:03:17.457564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 66/98] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:16 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:17.708770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:17.709350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:17.720674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:17.724271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:17.726704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:17.729638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:18.256620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:18.285537 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37582657-8d91-40cc-a730-0d38938cac34 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.580839 Jul 25 16:03:18.286931 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 67/99] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:17 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:18.472627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:18.479602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:18.511775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:18.512496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:18.513985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:18.514742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:18.553483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:03:18.554339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:03:18.554872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:03:18.555402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:03:18.556055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:03:18.570488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:18.571090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:18.572001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:18.572998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:18.609540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Getting quotas for project b189f6c36b0c4f6792d9a3e354f535a6. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:18.615743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Getting quotas for user 36d8a0c9ba5a40759ee0838c7ef265cb and project b189f6c36b0c4f6792d9a3e354f535a6. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:18.631315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:03:18.635837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:03:18.709471 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68376275-3c52-4770-86b8-54839bb228d2 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 5.619284 Jul 25 16:03:18.710892 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 33/100] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:03:13 2022] POST /compute/v2.1/servers => generated 403 bytes in 5622 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:03:18.883562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:18.894687 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5801f8a4-304d-4bfe-99f4-46b0fdb5ac51 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.432165 Jul 25 16:03:18.895286 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 68/101] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:18 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:18.919088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ef3d03d-516c-4bbb-b89b-855f9e185631 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:18.920432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ef3d03d-516c-4bbb-b89b-855f9e185631 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:18.999997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6ef3d03d-516c-4bbb-b89b-855f9e185631 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:19.009314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ef3d03d-516c-4bbb-b89b-855f9e185631 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1268 microversion: 2.1 time: 0.112865 Jul 25 16:03:19.021366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74983ca1-3bcc-4900-ac0a-df7da20b51fd tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] Calling method '.version_select at 0x7f9da05569d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:19.021366 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:19.021366 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:19.022685 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 69/102] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:18 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1268 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:19.047759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74983ca1-3bcc-4900-ac0a-df7da20b51fd tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.335290 Jul 25 16:03:19.048535 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 34/103] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:03:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:19.061089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-def8dbb4-e507-4eca-8da7-4b91b12019a3 tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] Action: 'update', calling method: .version_select at 0x7f9da04fc550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:19.064387 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:19.064387 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:19.322224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:19.323027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:19.341456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:19.344472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:19.348424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:19.361489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:19.641835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:19.832531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:19.849683 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49a6113f-8020-4b3f-bd72-0b1118ed7bba tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.535592 Jul 25 16:03:19.852365 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 35/104] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:19 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:19.916131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:19.918078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:19.931701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:19.932778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:19.934962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:19.936542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:19.989441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-def8dbb4-e507-4eca-8da7-4b91b12019a3 tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.932699 Jul 25 16:03:19.998276 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 70/105] 10.222.0.105 () {60 vars in 1211 bytes} [Mon Jul 25 16:03:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:20.017891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-20c7f208-ad30-4b34-8dd2-555227e56675 tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] Calling method '.version_select at 0x7f9da0620af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:20.023729 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:20.023729 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:20.052471 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-20c7f208-ad30-4b34-8dd2-555227e56675 tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.044982 Jul 25 16:03:20.053701 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 71/106] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:03:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:20.060447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:20.060447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:20.068574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:20.069178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:20.070197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:20.070969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:20.180487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:20.193474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-afafd2e6-e20f-409b-9d4f-7d3b8dc4aaa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1272 microversion: 2.1 time: 0.136035 Jul 25 16:03:20.193474 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 72/107] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:20 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:20.211719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25673b5a-54e8-43e3-a1d9-eceea24f6664 tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] Action: 'update', calling method: .version_select at 0x7f9da0546d30>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:20.238282 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:20.238282 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:20.304730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:20.317186 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c116047-c19e-426f-a5af-98513b3b62d8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.405856 Jul 25 16:03:20.317795 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 36/108] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:19 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:20.468202 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25673b5a-54e8-43e3-a1d9-eceea24f6664 tempest-QuotaClassesAdminTestJSON-145270763 tempest-QuotaClassesAdminTestJSON-145270763-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.267082 Jul 25 16:03:20.470126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 73/109] 10.222.0.105 () {60 vars in 1211 bytes} [Mon Jul 25 16:03:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:20.875356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:20.876106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:20.888774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:20.889284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:20.890103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:20.890564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:21.211376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:21.217068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:21.217963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:21.225443 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eff64519-8800-42d9-bd71-df72ef73ba4d tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.353950 Jul 25 16:03:21.228268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 37/110] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:20 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:21.231007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:21.231451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:21.232230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:21.232654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:21.339160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:21.340084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:21.350750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:21.351541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:21.352511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:21.353300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:21.469920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:21.486279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b722f00e-ece3-4bbf-b351-bbe168b0a366 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1272 microversion: 2.1 time: 0.275574 Jul 25 16:03:21.487420 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 74/111] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:21 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:21.718156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:21.735654 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6aaeff0-0518-4873-8fb4-556a1a43b83a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.400331 Jul 25 16:03:21.737851 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 38/112] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:21 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:21.879407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-437892981", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:21.971762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:03:22.369150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:03:22.370832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:03:22.371890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:03:22.372921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:03:22.374220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:03:22.390148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:22.390683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:22.391576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:22.392049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:22.419499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Getting quotas for project bc2c79a32ab54379a23d47dbae32fd63. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:22.427536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Getting quotas for user 029d1b74748a45a7aac98e73d7f89fb4 and project bc2c79a32ab54379a23d47dbae32fd63. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:22.449058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-44404737-32be-45ab-b2e0-ed09dffc6f0e req-5d92cc56-48a7-41b0-9189-d788fee17bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf225920-15fb-4099-8324-7c7198595d32", "name": "network-vif-plugged", "status": "completed", "tag": "aed0bb92-d706-42bf-8639-df872ddf03e2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:22.449584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:03:22.457363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:03:22.488994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-44404737-32be-45ab-b2e0-ed09dffc6f0e req-5d92cc56-48a7-41b0-9189-d788fee17bcf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:22.495427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-44404737-32be-45ab-b2e0-ed09dffc6f0e req-5d92cc56-48a7-41b0-9189-d788fee17bcf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:22.524796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-44404737-32be-45ab-b2e0-ed09dffc6f0e req-5d92cc56-48a7-41b0-9189-d788fee17bcf service nova] Creating event network-vif-plugged:aed0bb92-d706-42bf-8639-df872ddf03e2 for instance bf225920-15fb-4099-8324-7c7198595d32 on n-h2-846219-13 Jul 25 16:03:22.541034 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-44404737-32be-45ab-b2e0-ed09dffc6f0e req-5d92cc56-48a7-41b0-9189-d788fee17bcf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.428730 Jul 25 16:03:22.542933 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 39/113] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:22.554343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:22.555081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:22.571688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:22.572431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:22.573385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:22.573500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-62feb110-c5af-46c6-9cfe-debb237715bf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.956127 Jul 25 16:03:22.574058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:22.574164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 75/114] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:03:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:03:23.078225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1694814737", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "29236b2a-0a01-4dc1-874d-893614dd0b6b"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:23.132697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:23.159295 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bbe007ad-4a85-4cd4-bbe3-7f37365622f9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.613893 Jul 25 16:03:23.165419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 40/115] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:22 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:23.202427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:23.204696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:23.223696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:23.224166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:23.224992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:23.225524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:23.281695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] validate_networks() for [('29236b2a-0a01-4dc1-874d-893614dd0b6b', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:03:23.706519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:23.714650 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3499e268-3a23-40c0-a1be-0e66e0bc0ecc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1320 microversion: 2.1 time: 0.547187 Jul 25 16:03:23.715259 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 41/116] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:23 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:23.734837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:23.735541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:23.750878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:23.766057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:23.773871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:23.776147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:24.091799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:24.100179 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a9b060d-a9f9-43b0-9341-860e90ee4f54 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1230 microversion: 2.1 time: 0.379746 Jul 25 16:03:24.106203 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 42/117] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:23 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1230 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:24.122817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:24.123966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:24.147000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:24.148834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:24.153503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:24.156722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:24.483338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:24.516811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56ce5f93-f4a8-4007-8fe6-61fd54d62365 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.408795 Jul 25 16:03:24.542031 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 43/118] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:24 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:24.564219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:24.564881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:24.597429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:24.598665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:24.599843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:24.600572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:24.845367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:24.855510 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8120761-84c4-4789-9d16-47616ee2710b tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.311610 Jul 25 16:03:24.857600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 44/119] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:24 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:24.868081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:24.869268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:24.902110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:24.902784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:24.903400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:24.903840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.107742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:25.119584 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0270a7c1-305c-4994-8d3e-e6ba5f072a2c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1326 microversion: 2.1 time: 0.257472 Jul 25 16:03:25.138767 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 45/120] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:24 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1326 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:25.143842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:25.157738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:25.171965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.172415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.173229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.173841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.233687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:03:25.234300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:03:25.234300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:03:25.234657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:03:25.235239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:03:25.256280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.257009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.258037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.258630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.299181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:25.315197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for user f16ea8cc8a304280a0988dbac8aa1433 and project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:25.340727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:03:25.347709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:03:25.511837 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da709ced-d5a8-4d51-95db-370925d1fba7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.929363 Jul 25 16:03:25.512595 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 76/121] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:03:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:03:25.525405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a9544769-ae91-4bf3-8261-e24adbd8d1e8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:25.526274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a9544769-ae91-4bf3-8261-e24adbd8d1e8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:25.549814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:25.565928 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f2844d7-58d1-45c6-9645-a8e6bb349cc9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1286 microversion: 2.1 time: 0.425946 Jul 25 16:03:25.578199 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 46/122] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:25 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1286 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:25.589826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:25.590912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:25.605530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.606400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.607505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.609293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.824881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9544769-ae91-4bf3-8261-e24adbd8d1e8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:25.832768 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a9544769-ae91-4bf3-8261-e24adbd8d1e8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1229 microversion: 2.1 time: 0.311625 Jul 25 16:03:25.838513 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 77/123] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:25 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1229 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:25.879938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:25.880567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:25.904634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.904899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.910767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:25.911852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:25.963801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:26.304598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:26.319823 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4554e1c-c64b-4413-a025-03567b0ebe8e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.734245 Jul 25 16:03:26.329915 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 47/124] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:25 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:26.354012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:26.355442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:26.372559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:26.373056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:26.374295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:26.379225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:26.778781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:26.792360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a9890d5-58c1-4ae6-a466-9e98f6898a08 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1342 microversion: 2.1 time: 0.916225 Jul 25 16:03:26.794664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 78/125] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:25 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1342 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:26.920885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:26.941759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0afdeeb5-09bd-49e6-a660-a61cd160681d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.607475 Jul 25 16:03:26.942397 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 48/126] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:26 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:26.947476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:26.955135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:26.972766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:26.973758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:26.974771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:26.979318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.110404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-335068e1-b695-49ca-9305-6a5f3bcb37bb tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '.version_select at 0x7f9da20f7a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:27.210549 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-335068e1-b695-49ca-9305-6a5f3bcb37bb tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1" status: 200 len: 371 microversion: 2.1 time: 0.402391 Jul 25 16:03:27.211466 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 79/127] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:03:26 2022] GET /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1 => generated 371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:27.217257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-71299e63-1a0e-4f3e-8002-b3984602f5f0 req-8317e801-ef0d-429e-8797-3d5839e98620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122ea2ba-aba9-48e7-86c2-1d88fa0a2df2", "tag": "b8187b51-cec4-423e-809a-7fc8ea7e739d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:27.229409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=11,nova_api:UPDATE=16 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:27.235690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-71299e63-1a0e-4f3e-8002-b3984602f5f0 req-8317e801-ef0d-429e-8797-3d5839e98620 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.236388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-71299e63-1a0e-4f3e-8002-b3984602f5f0 req-8317e801-ef0d-429e-8797-3d5839e98620 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.258754 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-71299e63-1a0e-4f3e-8002-b3984602f5f0 req-8317e801-ef0d-429e-8797-3d5839e98620 service nova] Creating event network-changed:b8187b51-cec4-423e-809a-7fc8ea7e739d for instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 on n-h1-846219-13 Jul 25 16:03:27.259624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-71299e63-1a0e-4f3e-8002-b3984602f5f0 req-8317e801-ef0d-429e-8797-3d5839e98620 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:03:27.261779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b050f159-ad06-432d-880b-53d907e08307 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.262448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b050f159-ad06-432d-880b-53d907e08307 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.263459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b050f159-ad06-432d-880b-53d907e08307 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.264112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b050f159-ad06-432d-880b-53d907e08307 None None] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.292691 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.compute.rpcapi [None req-b050f159-ad06-432d-880b-53d907e08307 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 16:03:27.294615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b050f159-ad06-432d-880b-53d907e08307 None None] Releasing lock "compute-rpcapi-router" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:03:27.309404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:27.317877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:27.320568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b050f159-ad06-432d-880b-53d907e08307 None None] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107289 Jul 25 16:03:27.322094 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 80/128] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:27.327536 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de88ef6f-9277-49d8-8146-700444dbace9 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1284 microversion: 2.1 time: 0.380979 Jul 25 16:03:27.332959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:27.345628 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 49/129] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:26 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1284 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:27.346492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:27.354157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e84616df-fe2c-495d-85e8-d70b10bcf8f4 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Action: 'update', calling method: .version_select at 0x7f9da05bdd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:27.358312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.363566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.364660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.367532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.466949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e84616df-fe2c-495d-85e8-d70b10bcf8f4 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.467427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e84616df-fe2c-495d-85e8-d70b10bcf8f4 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.468289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e84616df-fe2c-495d-85e8-d70b10bcf8f4 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.469034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e84616df-fe2c-495d-85e8-d70b10bcf8f4 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.601218 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e84616df-fe2c-495d-85e8-d70b10bcf8f4 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1" status: 200 len: 328 microversion: 2.1 time: 0.254163 Jul 25 16:03:27.602005 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 50/130] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:03:27 2022] PUT /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1 => generated 328 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:27.608545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:27.609748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:27.621176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.621449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:27.622256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.623226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.625125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.638581 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f1f2d80-e698-4460-a0bc-4be0f1f8714b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1310 microversion: 2.1 time: 0.312248 Jul 25 16:03:27.641840 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 81/131] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:27 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1310 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:27.665077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51f4e20f-c9b5-4f2c-a8f1-3d362e62a50a tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:27.696442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51f4e20f-c9b5-4f2c-a8f1-3d362e62a50a tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1" status: 202 len: 0 microversion: 2.1 time: 0.053284 Jul 25 16:03:27.697034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 82/132] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:03:27 2022] DELETE /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:03:27.707379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65b24961-2143-42a4-b4d4-97b762bbc291 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '.version_select at 0x7f9da04ce430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:27.812269 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65b24961-2143-42a4-b4d4-97b762bbc291 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1" status: 200 len: 371 microversion: 2.1 time: 0.109902 Jul 25 16:03:27.823316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 83/133] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:03:27 2022] GET /compute/v2.1/os-quota-sets/74d496b42a1b47f8b6d4cb9dc2171dd1 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:27.830729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:27.831581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:27.848089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.849020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:27.851493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:27.852205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.066787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:28.076534 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ed36e70-84e9-44b7-aefa-307db1393323 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.473153 Jul 25 16:03:28.077794 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 51/134] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:27 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:28.101009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:28.101708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:28.113452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.114205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.116457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.117978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.261738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:28.272375 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-32ef7f4a-b010-4c8a-ac62-8e4039eec4a1 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1492 microversion: 2.1 time: 0.447269 Jul 25 16:03:28.273079 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 84/135] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:27 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1492 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:28.277887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ef52cf1-f320-48a4-9331-b8490b083f5c tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '.version_select at 0x7f9da0620790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:28.476709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:28.486935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5dc17cdd-015a-4552-ba5e-29251e4d54ef tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.407254 Jul 25 16:03:28.488161 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 52/136] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:28 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:28.496112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:28.497048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:28.505181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.506480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.507468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.508308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.528457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ef52cf1-f320-48a4-9331-b8490b083f5c tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead/defaults" status: 200 len: 371 microversion: 2.1 time: 0.253442 Jul 25 16:03:28.529120 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 85/137] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:03:28 2022] GET /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead/defaults => generated 371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:28.536212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:28.536832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:28.551624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.552071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.552854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.553377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.856264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:28.868020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e57e763-bd9c-4551-b4d6-10011a5ab964 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.337384 Jul 25 16:03:28.869131 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 86/138] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:28 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:28.874597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:28.875258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:28.882397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.883184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:28.884196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:28.884844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.230241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:29.242249 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0fa752be-7a7f-49ee-a91f-fbe21aeded51 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1350 microversion: 2.1 time: 0.371134 Jul 25 16:03:29.243425 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 87/139] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:28 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1350 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:29.272253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c06fc7c-0712-4fb2-9168-ef3980e168b6 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Action: 'update', calling method: .version_select at 0x7f9da0521550>, body: {"quota_set": {"ram": "5120"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:29.288708 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e196a00-252e-4095-9e77-e8d31b596514 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1645 microversion: 2.1 time: 0.798787 Jul 25 16:03:29.291504 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 53/140] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:28 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1645 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:29.298274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:29.299126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:29.307443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.309853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.312413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.313516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.483263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c06fc7c-0712-4fb2-9168-ef3980e168b6 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.484712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c06fc7c-0712-4fb2-9168-ef3980e168b6 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.485562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c06fc7c-0712-4fb2-9168-ef3980e168b6 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.486580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c06fc7c-0712-4fb2-9168-ef3980e168b6 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.571387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c06fc7c-0712-4fb2-9168-ef3980e168b6 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722" status: 200 len: 328 microversion: 2.1 time: 0.315991 Jul 25 16:03:29.571928 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 88/141] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:03:29 2022] PUT /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722 => generated 328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:29.576884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:29.577420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:29.584757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.585348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.586354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.586354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.616784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:03:29.770589 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d90e048-99c1-4d79-936f-1d97f0f6c6c7 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "DELETE /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 204 len: 0 microversion: 2.1 time: 0.196835 Jul 25 16:03:29.772146 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 89/142] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:03:29 2022] DELETE /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:03:29.782356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-dc132d52-5b62-4e53-b288-475f660c0384 req-8f77aac2-58dc-4271-9850-f3938d07aa9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a2c288-eaf1-4498-94b6-14855dc886f4", "name": "network-vif-plugged", "status": "completed", "tag": "96dc584e-b3fb-4942-91b2-6a343237d23f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:29.794414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-dc132d52-5b62-4e53-b288-475f660c0384 req-8f77aac2-58dc-4271-9850-f3938d07aa9a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.797523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-dc132d52-5b62-4e53-b288-475f660c0384 req-8f77aac2-58dc-4271-9850-f3938d07aa9a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.807357 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-dc132d52-5b62-4e53-b288-475f660c0384 req-8f77aac2-58dc-4271-9850-f3938d07aa9a service nova] Creating event network-vif-plugged:96dc584e-b3fb-4942-91b2-6a343237d23f for instance 13a2c288-eaf1-4498-94b6-14855dc886f4 on n-h1-846219-13 Jul 25 16:03:29.812785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-dc132d52-5b62-4e53-b288-475f660c0384 req-8f77aac2-58dc-4271-9850-f3938d07aa9a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038738 Jul 25 16:03:29.813628 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 90/143] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:29.818653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:29.820023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:29.821650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:29.827385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.828155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.829877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.830524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.835585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb22fbb0-530b-44f6-a1d6-af7750bd609b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.542176 Jul 25 16:03:29.837645 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 54/144] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:29 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:29.853482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4269b31b-2556-4eff-9d70-507788f9f276 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '.version_select at 0x7f9da050b9d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:29.939297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4269b31b-2556-4eff-9d70-507788f9f276 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.939737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4269b31b-2556-4eff-9d70-507788f9f276 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.940532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4269b31b-2556-4eff-9d70-507788f9f276 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.940987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4269b31b-2556-4eff-9d70-507788f9f276 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.963616 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4269b31b-2556-4eff-9d70-507788f9f276 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722/detail" status: 200 len: 916 microversion: 2.1 time: 0.123711 Jul 25 16:03:29.964462 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 55/145] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:03:29 2022] GET /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722/detail => generated 916 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:29.969721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:29.970629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:29.978456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.979342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:29.980483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:29.981059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.095073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:30.111457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b4d71a9-d4ae-4fe4-b0ad-0b057a9fe897 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.296489 Jul 25 16:03:30.129969 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 91/146] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:29 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:30.138578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:30.139293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:30.150575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.151381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.152718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.153462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.313755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:30.326040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a949e97-b6a3-4b73-93a0-6311912f6e26 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1498 microversion: 2.1 time: 0.360581 Jul 25 16:03:30.328091 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 56/147] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:29 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1498 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:30.332994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Action: 'update', calling method: .version_select at 0x7f9da041aca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:30.432172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.433467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.434564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.435258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.450125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:30.462408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ffd3cf8-d217-49c7-8307-6207bf4ab7cf tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.340961 Jul 25 16:03:30.464151 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 92/148] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:30 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:30.469976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:30.471060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:30.478158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.478883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.479837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.480453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.485443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.485894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.486713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.487147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.744161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:30.775211 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aef578be-abf0-448f-a39f-b545ca179cfa tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722?user_id=b7b66a5842d44f4dad60d55d9b0e5643" status: 200 len: 328 microversion: 2.1 time: 0.445844 Jul 25 16:03:30.776031 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 57/149] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:03:30 2022] PUT /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722?user_id=b7b66a5842d44f4dad60d55d9b0e5643 => generated 328 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:30.789135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-550b8492-7055-4d99-b0d9-16df16e2255b req-97c373e2-fbcb-4e9d-8c8c-ef3eaec5170a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9666ce6e-2178-4ea2-9a81-1f11241a5961", "tag": "324b8800-0f74-4988-a345-007ca19ae3ac"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:30.800267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-550b8492-7055-4d99-b0d9-16df16e2255b req-97c373e2-fbcb-4e9d-8c8c-ef3eaec5170a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.800698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-550b8492-7055-4d99-b0d9-16df16e2255b req-97c373e2-fbcb-4e9d-8c8c-ef3eaec5170a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.812023 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-550b8492-7055-4d99-b0d9-16df16e2255b req-97c373e2-fbcb-4e9d-8c8c-ef3eaec5170a service nova] Creating event network-changed:324b8800-0f74-4988-a345-007ca19ae3ac for instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 on n-h2-846219-13 Jul 25 16:03:30.817281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-550b8492-7055-4d99-b0d9-16df16e2255b req-97c373e2-fbcb-4e9d-8c8c-ef3eaec5170a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039715 Jul 25 16:03:30.817877 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 58/150] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:30.823088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8de7ec47-e63e-46c3-b4f4-d1895852c8b5 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '.version_select at 0x7f9da0483940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:30.852254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:30.863251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cd8c67a3-17fe-453b-8831-eb4eb3cd7480 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1350 microversion: 2.1 time: 0.397758 Jul 25 16:03:30.863967 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 93/151] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:30 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1350 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:30.873314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:30.874442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:30.881404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.881972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.882757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:30.883221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:30.946801 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8de7ec47-e63e-46c3-b4f4-d1895852c8b5 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722?user_id=b7b66a5842d44f4dad60d55d9b0e5643" status: 200 len: 370 microversion: 2.1 time: 0.127438 Jul 25 16:03:30.947403 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 59/152] 10.222.0.105 () {58 vars in 1328 bytes} [Mon Jul 25 16:03:30 2022] GET /compute/v2.1/os-quota-sets/8c8ead2b34934689918539c6bee77722?user_id=b7b66a5842d44f4dad60d55d9b0e5643 => generated 370 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:31.142556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:31.143352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:31.159719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:31.164395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:31.164395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:31.164395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:31.480594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:31.490700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-80960540-a1cf-427a-b327-be949720e85c tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.622004 Jul 25 16:03:31.491627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 94/153] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:30 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:31.497264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:31.498111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:31.511351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:31.511973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:31.512775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:31.513892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:31.974672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:31.984308 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3422a232-bc32-4b63-b0ca-7662dd30a6f1 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.846133 Jul 25 16:03:31.986021 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 60/154] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:31 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:31.997132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37d1ade2-7cba-4c44-a9fc-cae0a0520c3d tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Calling method '.version_select at 0x7f9da051f940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:32.309444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9c8e2e0e224c08b971ddfaf27ac13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901a456f4900427f9722785029268fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:32.317779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37d1ade2-7cba-4c44-a9fc-cae0a0520c3d tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead/defaults" status: 200 len: 371 microversion: 2.1 time: 0.330603 Jul 25 16:03:32.318484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 61/155] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:03:31 2022] GET /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead/defaults => generated 371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:32.319766 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-316c33e4-bfc4-4e3a-8a83-48147202d051 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 200 len: 1498 microversion: 2.1 time: 0.827051 Jul 25 16:03:32.320589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 95/156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:31 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 1498 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:32.335570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:32.335570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:32.337269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:32.337927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:32.340130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:32.340130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:32.351293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:32.352414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:32.362336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:32.363174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:32.364395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:32.365158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:32.921902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:32.932910 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-986b9487-22f0-42c2-8a28-7ee1f40b97d6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.611208 Jul 25 16:03:32.933663 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 62/157] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:32 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:32.939454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2876fdf9-25ff-49fe-bb69-c7f9dfe417c7 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Action: 'update', calling method: .version_select at 0x7f9da050bb80>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:33.018437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2876fdf9-25ff-49fe-bb69-c7f9dfe417c7 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.019037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2876fdf9-25ff-49fe-bb69-c7f9dfe417c7 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.019651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2876fdf9-25ff-49fe-bb69-c7f9dfe417c7 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.020191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2876fdf9-25ff-49fe-bb69-c7f9dfe417c7 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.040895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:33.056056 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-745a6890-f84f-4b4a-a423-89c4cc4d79c1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1350 microversion: 2.1 time: 0.709634 Jul 25 16:03:33.070507 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 96/158] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:32 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1350 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:33.077809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:33.078925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:33.086155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.086947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.087981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.088717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.402579 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2876fdf9-25ff-49fe-bb69-c7f9dfe417c7 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead" status: 200 len: 329 microversion: 2.1 time: 0.467432 Jul 25 16:03:33.411215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 63/159] 10.222.0.105 () {60 vars in 1268 bytes} [Mon Jul 25 16:03:32 2022] PUT /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead => generated 329 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:33.415692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fc4638d2-9f96-48b8-910c-a27e02af9412 req-a7f3df2b-7a4a-456b-b60e-307160c36343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf225920-15fb-4099-8324-7c7198595d32", "name": "network-vif-deleted", "tag": "aed0bb92-d706-42bf-8639-df872ddf03e2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:33.427592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fc4638d2-9f96-48b8-910c-a27e02af9412 req-a7f3df2b-7a4a-456b-b60e-307160c36343 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.428430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fc4638d2-9f96-48b8-910c-a27e02af9412 req-a7f3df2b-7a4a-456b-b60e-307160c36343 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.437246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:33.443194 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fc4638d2-9f96-48b8-910c-a27e02af9412 req-a7f3df2b-7a4a-456b-b60e-307160c36343 service nova] Creating event network-vif-deleted:aed0bb92-d706-42bf-8639-df872ddf03e2 for instance bf225920-15fb-4099-8324-7c7198595d32 on n-h2-846219-13 Jul 25 16:03:33.449429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fc4638d2-9f96-48b8-910c-a27e02af9412 req-a7f3df2b-7a4a-456b-b60e-307160c36343 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037717 Jul 25 16:03:33.450209 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 64/160] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:33.455998 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2ee42fa-a240-4d1f-abc2-f0ccc06c5519 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1324 microversion: 2.1 time: 0.383584 Jul 25 16:03:33.457347 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 97/161] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:33 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:33.460453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a62b20f4-6460-4807-a334-34388165a78a req-6d6c5afb-9b23-41ae-8800-2f8d9d41bc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3482326-8c40-4c1d-870e-47cb4e38b790", "tag": "62f5650a-a00b-43bd-97b7-7c9bb030b2f7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:33.464009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:33.464924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:33.478187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.478889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.479884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.480646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a62b20f4-6460-4807-a334-34388165a78a req-6d6c5afb-9b23-41ae-8800-2f8d9d41bc7d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.480773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.481314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a62b20f4-6460-4807-a334-34388165a78a req-6d6c5afb-9b23-41ae-8800-2f8d9d41bc7d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.496093 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a62b20f4-6460-4807-a334-34388165a78a req-6d6c5afb-9b23-41ae-8800-2f8d9d41bc7d service nova] Creating event network-changed:62f5650a-a00b-43bd-97b7-7c9bb030b2f7 for instance b3482326-8c40-4c1d-870e-47cb4e38b790 on n-h1-846219-13 Jul 25 16:03:33.503654 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a62b20f4-6460-4807-a334-34388165a78a req-6d6c5afb-9b23-41ae-8800-2f8d9d41bc7d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047894 Jul 25 16:03:33.504634 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 65/162] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:33.511880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:33.513174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:33.520025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.520624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.521769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.522395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.542742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] HTTP exception thrown: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Request method failure captured: Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 HTTP/1.1 Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6dehDFlR81XtHOk7jLtPy0hu3mOqFpIsTD-TmOQFG0pUFv2bl_vIgc6kKhZoyj-OviEs0C3NiFfUKIjfGClfnKItpovZ_yFF9I-B9rWJSiDkgm0sFRq9cXJKZbMOQdddWYzgoUSBQRbgHEm2oD86MDMIARkBdx9qU53Y7m1y3K4pw Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 901a456f4900427f9722785029268fc7 Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:33.548204 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/901a456f4900427f9722785029268fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/901a456f4900427f9722785029268fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/901a456f4900427f9722785029268fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_901a456f4900427f9722785029268fc7"}]}] Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 901a456f4900427f9722785029268fc7 Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminTestJSON-1667635507-project Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: cf9c8e2e0e224c08b971ddfaf27ac13a Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminTestJSON-1667635507-project Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:33.550034 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'bf225920-15fb-4099-8324-7c7198595d32'} Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:33.550819 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:33.552089 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:33.553316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Returning 404 to user: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:33.556381 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ab93b4e-83dd-446d-94f5-b86de6ce46e9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 404 len: 111 microversion: 2.1 time: 0.046617 Jul 25 16:03:33.556381 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 66/163] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:33 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:33.560159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc4c86ea-c933-438f-a18e-9d28b8af67b8 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Action: 'update', calling method: .version_select at 0x7f9da02a11f0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:33.657531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc4c86ea-c933-438f-a18e-9d28b8af67b8 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.658451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc4c86ea-c933-438f-a18e-9d28b8af67b8 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.659676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc4c86ea-c933-438f-a18e-9d28b8af67b8 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.660406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc4c86ea-c933-438f-a18e-9d28b8af67b8 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.769046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:33.780841 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc301c4c-4077-4d24-8957-bb5db5b69c03 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.322274 Jul 25 16:03:33.781707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 98/164] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:33 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:33.786696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd6524db-cc70-4a0c-9b15-c5dea383156a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:33.789482 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:33.789482 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:33.804030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd6524db-cc70-4a0c-9b15-c5dea383156a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:33.805208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd6524db-cc70-4a0c-9b15-c5dea383156a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:33.809851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:33.891369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=21,nova_api:UPDATE=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:34.078404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:34.128479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc4c86ea-c933-438f-a18e-9d28b8af67b8 tempest-QuotasAdminTestJSON-1968728061 tempest-QuotasAdminTestJSON-1968728061-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead" status: 200 len: 329 microversion: 2.1 time: 0.572011 Jul 25 16:03:34.129206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 67/165] 10.222.0.105 () {60 vars in 1268 bytes} [Mon Jul 25 16:03:33 2022] PUT /compute/v2.1/os-quota-sets/d9818311d6394620bb5f8fa48dce2ead => generated 329 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:34.135148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.135757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:34.143966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.144442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.145362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.145799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.254587 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd6524db-cc70-4a0c-9b15-c5dea383156a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.471476 Jul 25 16:03:34.256466 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 99/166] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:34.262074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.262266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:34.269284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.269284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.270012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.270445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.307670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:34.317676 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2456b182-fdd0-46e8-a372-adf0d18707c4 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.187141 Jul 25 16:03:34.318428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 68/167] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:34 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:34.324299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0de662b-53ab-4774-8a45-7160b3a2ee4d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.325389 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:34.325389 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:34.357621 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b0de662b-53ab-4774-8a45-7160b3a2ee4d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.037715 Jul 25 16:03:34.358400 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 69/168] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:34 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:34.370773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3690d6d1-b57d-4a73-9735-6e597c282519 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2059939260"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:34.374761 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:34.374761 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:34.375696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-3690d6d1-b57d-4a73-9735-6e597c282519 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid 325d4afb-b77c-4911-a50e-be4be3489cbc for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:34.417028 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3690d6d1-b57d-4a73-9735-6e597c282519 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050314 Jul 25 16:03:34.419080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 70/169] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:34.431988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:34.433289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed24f6ef-0cc2-4d48-a51a-ac8cd2875f9e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:34.436641 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:34.436641 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:34.440510 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dfe5f0a7-f7af-45e6-a6f0-75489d4ae72a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1329 microversion: 2.1 time: 0.183779 Jul 25 16:03:34.445150 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 100/170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:34 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1329 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:34.447555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed24f6ef-0cc2-4d48-a51a-ac8cd2875f9e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.448159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed24f6ef-0cc2-4d48-a51a-ac8cd2875f9e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.479809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.481190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:34.500993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.501476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.502308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.502676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.586466 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed24f6ef-0cc2-4d48-a51a-ac8cd2875f9e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.158887 Jul 25 16:03:34.586906 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 71/171] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:34.598620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-764a5831-2be6-4670-851c-4c99c5f4e296 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.599387 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:34.599387 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:34.613172 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-764a5831-2be6-4670-851c-4c99c5f4e296 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.018143 Jul 25 16:03:34.613990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 72/172] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:03:34 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:34.625223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-730be9f2-fc73-4512-a790-64c6455992aa tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:34.627778 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:34.627778 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:34.637864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-730be9f2-fc73-4512-a790-64c6455992aa tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.639074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-730be9f2-fc73-4512-a790-64c6455992aa tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.688786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:34.698060 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ca22c3a-9235-4506-a037-9829ce7dc086 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1474 microversion: 2.1 time: 0.222104 Jul 25 16:03:34.698824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 101/173] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:34 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:34.777963 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-730be9f2-fc73-4512-a790-64c6455992aa tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.156266 Jul 25 16:03:34.779079 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 73/174] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:34.790204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49bc358b-9902-4b74-ad05-2a436b2ef58e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.791190 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:34.791190 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:34.818400 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49bc358b-9902-4b74-ad05-2a436b2ef58e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.032222 Jul 25 16:03:34.825662 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 74/175] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:34 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 16:03:34.825662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.825662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:34.832728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.833306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.834252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.835331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.969497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:34.970094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:34.977383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.978099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:34.978888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:34.979311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.010862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:35.021633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-06fbf01e-650a-46be-ad96-9bff9174d9dc tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.201166 Jul 25 16:03:35.022714 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 75/176] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:34 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:35.031509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed171f55-0bc0-41b6-aee1-ba40311164a8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1279719706"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:35.034477 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.034477 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:35.035715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-ed171f55-0bc0-41b6-aee1-ba40311164a8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid 74e907d9-626b-49fd-987d-25f7131f0055 for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:35.071118 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed171f55-0bc0-41b6-aee1-ba40311164a8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043551 Jul 25 16:03:35.072236 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 76/177] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:35.088139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2dc31ab-a7e3-4d16-a937-741256f33db8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:35.090896 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.090896 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:35.095161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:03:35.108272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2dc31ab-a7e3-4d16-a937-741256f33db8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.108735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2dc31ab-a7e3-4d16-a937-741256f33db8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.251281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2dc31ab-a7e3-4d16-a937-741256f33db8 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.168025 Jul 25 16:03:35.252327 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 77/178] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:35.266252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-13e9c440-e77c-4417-ac98-a1a921ce6242 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:35.267662 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.267662 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:35.283576 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-13e9c440-e77c-4417-ac98-a1a921ce6242 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.022498 Jul 25 16:03:35.284587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 78/179] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:03:35 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:35.296073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f467442a-31a9-49d3-ba38-eff55846e98a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:35.299158 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.299158 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:35.308254 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ff69d66-8962-41be-a083-62a69934804a tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] 10.222.0.105 "DELETE /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 204 len: 0 microversion: 2.1 time: 0.591414 Jul 25 16:03:35.308820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f467442a-31a9-49d3-ba38-eff55846e98a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.309249 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 102/180] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:03:34 2022] DELETE /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:03:35.312292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f467442a-31a9-49d3-ba38-eff55846e98a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.318719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:35.319695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:35.327854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.328527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.330309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.331924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.462867 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f467442a-31a9-49d3-ba38-eff55846e98a tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.170375 Jul 25 16:03:35.472954 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 79/181] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:35.482268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:35.483128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:35.493263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.493690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.494779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.495148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.513125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:35.522207 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-625923e8-502c-493d-ac39-f8a3172506b8 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1480 microversion: 2.1 time: 0.208462 Jul 25 16:03:35.522805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 103/182] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:35 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1480 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:35.528059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-85b13fa4-0a08-47fe-b3b8-5e7b52f5b7f4 req-7e19b11d-9a8f-4d0d-8414-30c6e6bf8e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122ea2ba-aba9-48e7-86c2-1d88fa0a2df2", "name": "network-vif-plugged", "status": "completed", "tag": "b8187b51-cec4-423e-809a-7fc8ea7e739d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:35.538312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-85b13fa4-0a08-47fe-b3b8-5e7b52f5b7f4 req-7e19b11d-9a8f-4d0d-8414-30c6e6bf8e47 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.538965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-85b13fa4-0a08-47fe-b3b8-5e7b52f5b7f4 req-7e19b11d-9a8f-4d0d-8414-30c6e6bf8e47 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.553125 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-85b13fa4-0a08-47fe-b3b8-5e7b52f5b7f4 req-7e19b11d-9a8f-4d0d-8414-30c6e6bf8e47 service nova] Creating event network-vif-plugged:b8187b51-cec4-423e-809a-7fc8ea7e739d for instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 on n-h1-846219-13 Jul 25 16:03:35.559251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-85b13fa4-0a08-47fe-b3b8-5e7b52f5b7f4 req-7e19b11d-9a8f-4d0d-8414-30c6e6bf8e47 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034976 Jul 25 16:03:35.560357 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 104/183] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:35.566526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:35.567601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:35.582157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.583195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.584865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.585681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:35.721492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:35.737136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-293dc070-df58-4d37-90ea-2b9334e654e3 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.261921 Jul 25 16:03:35.749293 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 80/184] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:35 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:35.753470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0333e38b-a762-417d-9527-af82b30e5073 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:35.754443 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.754443 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:35.780512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:35.791166 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b3dcb9f4-747e-4981-9ced-f10a7dfb3e2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1329 microversion: 2.1 time: 0.229357 Jul 25 16:03:35.792026 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0333e38b-a762-417d-9527-af82b30e5073 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.050996 Jul 25 16:03:35.792982 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 81/185] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:35 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:35.800318 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 105/186] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:35 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:35.804889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a525c97a-1dba-4ff2-a308-e43affdcb1dd tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1470075503"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:35.808666 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.808666 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:35.810047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-a525c97a-1dba-4ff2-a308-e43affdcb1dd tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid 1cf66744-f48f-48be-b40d-46b3591a20ea for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:35.819456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=8,nova_api:INSERT=12,nova_api:DELETE=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:35.841770 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a525c97a-1dba-4ff2-a308-e43affdcb1dd tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041005 Jul 25 16:03:35.843949 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 82/187] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:35.857455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d279ede7-2f7b-425b-9461-4b40a9fc23c3 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:35.862198 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:35.862198 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:35.871894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d279ede7-2f7b-425b-9461-4b40a9fc23c3 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:35.872360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d279ede7-2f7b-425b-9461-4b40a9fc23c3 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.031148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d279ede7-2f7b-425b-9461-4b40a9fc23c3 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.179460 Jul 25 16:03:36.032027 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 106/188] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:35 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.044694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.045359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:36.048281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe032d13-2995-44bd-a84d-2fe041c9ba9d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.051627 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.051627 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.052833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.053524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.054304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.054742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.067932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe032d13-2995-44bd-a84d-2fe041c9ba9d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.068551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe032d13-2995-44bd-a84d-2fe041c9ba9d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.073610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:36.183582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:36.206016 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe032d13-2995-44bd-a84d-2fe041c9ba9d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.161336 Jul 25 16:03:36.206632 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 107/189] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.218603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a6f6c72-e14c-4e3b-8462-5e73a8f27c8d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.219348 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.219348 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.221961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:36.230496 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c56d3ba0-dfd0-447f-bf9b-20efead19349 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.190533 Jul 25 16:03:36.231090 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 83/190] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:36.243397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a6f6c72-e14c-4e3b-8462-5e73a8f27c8d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.029327 Jul 25 16:03:36.243981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 108/191] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:36 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 16:03:36.254609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-95eb9f07-74dc-4197-b6b1-cfae6528a283 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1147364377"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.257672 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.257672 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.258699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-95eb9f07-74dc-4197-b6b1-cfae6528a283 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid 1b9a090f-f806-45eb-8b08-e889cfcc7680 for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:36.263865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68929356-82e6-4b59-9db9-c9ae38205ea2 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1026854593"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.266571 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.266571 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.267482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-68929356-82e6-4b59-9db9-c9ae38205ea2 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Generated uuid f859ea74-deee-4ff4-9671-bf2c54a0dd7c for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:36.283552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-95eb9f07-74dc-4197-b6b1-cfae6528a283 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033292 Jul 25 16:03:36.286203 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 84/192] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.289715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68929356-82e6-4b59-9db9-c9ae38205ea2 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.036789 Jul 25 16:03:36.291005 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 109/193] 10.222.0.105 () {62 vars in 1210 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:03:36.299103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e46f4223-42b0-4e64-ba0c-ad80458a7982 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.300121 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.300121 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.304165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-455ad705-414a-4c1e-982b-fbb4aab9877f tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-260781139"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.326160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e46f4223-42b0-4e64-ba0c-ad80458a7982 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.032016 Jul 25 16:03:36.326907 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 85/194] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:36 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:36.335070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f1dd07e-f3d5-4061-a7a7-6aa9750b7fef tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.336003 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.336003 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.342524 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-0f1dd07e-f3d5-4061-a7a7-6aa9750b7fef tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f1dd07e-f3d5-4061-a7a7-6aa9750b7fef tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Request method failure captured: Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6hbqVdoss0Mqie1YOpGyQnbwrQEK-x3ivvAY-wxtlHAPWuINg1dXDl6wvX9R37c96zGNX2Q3Io8ZhlCYkstF4d9lXcJBuLF35___rE7jh3BLrNDdN68YvQ2dOydM4k_Dr-o31Wsj9ZkpGO_OkbpEjZDn9qiuURUqv5sDO36h7a28A Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:36.353057 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cc5918427a114d079dd67272de689702"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cc5918427a114d079dd67272de689702"}]}] Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 929acceed0854c8b82de7af04a07eb92 Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: exception: Aggregate 5 could not be found. Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5'} Jul 25 16:03:36.354550 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.355423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 25 16:03:36.356575 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.357776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f1dd07e-f3d5-4061-a7a7-6aa9750b7fef tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:36.357776 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f1dd07e-f3d5-4061-a7a7-6aa9750b7fef tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.023873 Jul 25 16:03:36.357776 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 86/195] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 16:03:36.365042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b703de5d-ad0a-484b-8af5-54dc8366cd8b tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.366107 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.366107 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.385748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b703de5d-ad0a-484b-8af5-54dc8366cd8b tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b703de5d-ad0a-484b-8af5-54dc8366cd8b tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Request method failure captured: Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6hbqVdoss0Mqie1YOpGyQnbwrQEK-x3ivvAY-wxtlHAPWuINg1dXDl6wvX9R37c96zGNX2Q3Io8ZhlCYkstF4d9lXcJBuLF35___rE7jh3BLrNDdN68YvQ2dOydM4k_Dr-o31Wsj9ZkpGO_OkbpEjZDn9qiuURUqv5sDO36h7a28A Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:36.387697 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cc5918427a114d079dd67272de689702"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cc5918427a114d079dd67272de689702"}]}] Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 929acceed0854c8b82de7af04a07eb92 Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: exception: Aggregate 5 could not be found. Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5'} Jul 25 16:03:36.388819 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:36.389585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.390566 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b703de5d-ad0a-484b-8af5-54dc8366cd8b tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b703de5d-ad0a-484b-8af5-54dc8366cd8b tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.029002 Jul 25 16:03:36.391741 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 87/196] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:36 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 16:03:36.394960 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.394960 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.400481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0659ec3c-e336-49bc-b7bf-9afeacf95a7f tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-122054557", "name": "tempest-test_aggregate-30098458"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.420792 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-455ad705-414a-4c1e-982b-fbb4aab9877f tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.122596 Jul 25 16:03:36.421695 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 110/197] 10.222.0.105 () {62 vars in 1215 bytes} [Mon Jul 25 16:03:36 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:03:36.421839 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.421839 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.422901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-0659ec3c-e336-49bc-b7bf-9afeacf95a7f tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid afb6bdf6-3c18-4d8e-b749-199c0f78a009 for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:36.433809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3c4302f-fe9d-4674-ab35-5a44a162d415 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.434644 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.434644 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.443244 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3c4302f-fe9d-4674-ab35-5a44a162d415 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.013635 Jul 25 16:03:36.444048 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 111/198] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:03:36.453446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0659ec3c-e336-49bc-b7bf-9afeacf95a7f tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.056435 Jul 25 16:03:36.454043 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 88/199] 10.222.0.105 () {60 vars in 1170 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.456727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a55b279a-1e24-43d4-a3b6-d8dda67f38dd tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.459439 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.459439 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.464740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8424ff9e-b4e0-4b98-b4da-21628be08228 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.465169 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.465169 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.468404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a55b279a-1e24-43d4-a3b6-d8dda67f38dd tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.469041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a55b279a-1e24-43d4-a3b6-d8dda67f38dd tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.487366 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8424ff9e-b4e0-4b98-b4da-21628be08228 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.026405 Jul 25 16:03:36.487953 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 89/200] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:36 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 16:03:36.495868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d880360c-ea7b-4556-90ce-90fef85bc338 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.496615 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.496615 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.503733 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d880360c-ea7b-4556-90ce-90fef85bc338 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d880360c-ea7b-4556-90ce-90fef85bc338 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Request method failure captured: Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6hbqVdoss0Mqie1YOpGyQnbwrQEK-x3ivvAY-wxtlHAPWuINg1dXDl6wvX9R37c96zGNX2Q3Io8ZhlCYkstF4d9lXcJBuLF35___rE7jh3BLrNDdN68YvQ2dOydM4k_Dr-o31Wsj9ZkpGO_OkbpEjZDn9qiuURUqv5sDO36h7a28A Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:36.505316 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cc5918427a114d079dd67272de689702"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cc5918427a114d079dd67272de689702"}]}] Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 929acceed0854c8b82de7af04a07eb92 Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: exception: Aggregate 7 could not be found. Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7'} Jul 25 16:03:36.507013 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.507828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 25 16:03:36.509019 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.510200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d880360c-ea7b-4556-90ce-90fef85bc338 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:36.510200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d880360c-ea7b-4556-90ce-90fef85bc338 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.014427 Jul 25 16:03:36.510200 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 90/201] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:36.515435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e714df48-9d6d-41de-a095-3c336d1d5093 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.516416 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.516416 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.532796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e714df48-9d6d-41de-a095-3c336d1d5093 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e714df48-9d6d-41de-a095-3c336d1d5093 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Request method failure captured: Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6hbqVdoss0Mqie1YOpGyQnbwrQEK-x3ivvAY-wxtlHAPWuINg1dXDl6wvX9R37c96zGNX2Q3Io8ZhlCYkstF4d9lXcJBuLF35___rE7jh3BLrNDdN68YvQ2dOydM4k_Dr-o31Wsj9ZkpGO_OkbpEjZDn9qiuURUqv5sDO36h7a28A Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:36.534337 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cc5918427a114d079dd67272de689702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cc5918427a114d079dd67272de689702"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cc5918427a114d079dd67272de689702"}]}] Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cc5918427a114d079dd67272de689702 Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1409156221 Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 929acceed0854c8b82de7af04a07eb92 Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminTestJSON-1409156221-project-admin Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: exception: Aggregate 7 could not be found. Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7'} Jul 25 16:03:36.535794 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:36.536642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:36.538124 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e714df48-9d6d-41de-a095-3c336d1d5093 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:36.539461 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e714df48-9d6d-41de-a095-3c336d1d5093 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.023791 Jul 25 16:03:36.542464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 91/202] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:36 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:36.549427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.550050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:36.558327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.558882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.559659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.560085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.597864 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a55b279a-1e24-43d4-a3b6-d8dda67f38dd tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.145352 Jul 25 16:03:36.598527 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 112/203] 10.222.0.105 () {62 vars in 1237 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:03:36.606735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acb564ff-58fd-4c6f-9930-e3e47db75a29 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1794463572"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.609483 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.609483 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.610629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-acb564ff-58fd-4c6f-9930-e3e47db75a29 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid e1886d00-8316-453a-a3ca-564ae833aa64 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:36.638344 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-acb564ff-58fd-4c6f-9930-e3e47db75a29 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038511 Jul 25 16:03:36.646133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 113/204] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.651944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06439e05-bcef-4c77-819b-503d7a561234 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.655840 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.655840 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.673224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06439e05-bcef-4c77-819b-503d7a561234 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.674033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06439e05-bcef-4c77-819b-503d7a561234 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.752556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:36.761957 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a475e438-0a15-4e70-a6c6-42d6a600298f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1480 microversion: 2.1 time: 0.217523 Jul 25 16:03:36.762616 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 92/205] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1480 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:36.767062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e625f518-8966-497a-a524-56f221aa7eb5 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.768027 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.768027 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:36.775094 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e625f518-8966-497a-a524-56f221aa7eb5 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.011307 Jul 25 16:03:36.775753 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 93/206] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.786553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.787304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:36.793503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.794185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.795003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.795492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.825610 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06439e05-bcef-4c77-819b-503d7a561234 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.177945 Jul 25 16:03:36.826579 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 114/207] 10.222.0.105 () {62 vars in 1237 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:03:36.832388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3760d56e-5115-48d3-be35-f11fbd7fd06e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:36.835643 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:36.835643 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:36.868437 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3760d56e-5115-48d3-be35-f11fbd7fd06e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.040521 Jul 25 16:03:36.870060 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 115/208] 10.222.0.105 () {60 vars in 1196 bytes} [Mon Jul 25 16:03:36 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:36.880173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:36.881769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:36.890914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.891687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:36.893244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:36.893756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.003118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:37.012530 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3fb6cff7-9a01-43d4-8238-03a9f547b627 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.229370 Jul 25 16:03:37.013171 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 94/209] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:37.018463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-df7fd32b-dc38-4d6e-a8b4-d1bdc2b57b77 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.019341 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.019341 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:37.051411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-df7fd32b-dc38-4d6e-a8b4-d1bdc2b57b77 tempest-AggregatesAdminTestV241-1923493176 tempest-AggregatesAdminTestV241-1923493176-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.037126 Jul 25 16:03:37.052600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 95/210] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 16:03:37 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.063570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-618bbdbc-6fb8-4e05-a8e9-18c683289ee4 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.064526 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.064526 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:37.074286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:37.078030 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-618bbdbc-6fb8-4e05-a8e9-18c683289ee4 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.016234 Jul 25 16:03:37.079963 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 96/211] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.083863 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99bdd254-c6ce-478b-885b-670191f8b5a8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1329 microversion: 2.1 time: 0.212564 Jul 25 16:03:37.097121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1118bbb-35bb-4633-aac4-9d592f787082 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da02beca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.097121 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.097121 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:37.097121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1118bbb-35bb-4633-aac4-9d592f787082 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.097121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1118bbb-35bb-4633-aac4-9d592f787082 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.097669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1118bbb-35bb-4633-aac4-9d592f787082 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.097669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1118bbb-35bb-4633-aac4-9d592f787082 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.100242 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 116/212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:36 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1329 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:37.105279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c53edaf-2c85-4cf7-bbda-54ff61d1f634 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.106379 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.106379 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.126393 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1118bbb-35bb-4633-aac4-9d592f787082 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.044710 Jul 25 16:03:37.133975 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 97/213] 10.222.0.105 () {58 vars in 1133 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.137795 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c53edaf-2c85-4cf7-bbda-54ff61d1f634 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.036053 Jul 25 16:03:37.138740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 117/214] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:37.143123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b67fbef-4800-45c9-b715-795ade87933c tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da02beee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.143123 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.143123 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:37.144251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b67fbef-4800-45c9-b715-795ade87933c tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.144753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b67fbef-4800-45c9-b715-795ade87933c tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.146312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b67fbef-4800-45c9-b715-795ade87933c tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.146930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b67fbef-4800-45c9-b715-795ade87933c tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.150013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc06a4e2-b39f-425f-9172-89943e2a2f4d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-906586945", "availability_zone": "tempest-test_az-897866293"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:37.153643 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.153643 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.154882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-dc06a4e2-b39f-425f-9172-89943e2a2f4d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid 41209062-f8d3-4c32-9133-ae307848cd21 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:37.173258 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b67fbef-4800-45c9-b715-795ade87933c tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.038049 Jul 25 16:03:37.173885 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 98/215] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.188240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9da3678d-1ecf-42b3-8d4e-4abdc55a6155 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da02be0d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.189155 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc06a4e2-b39f-425f-9172-89943e2a2f4d tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.043212 Jul 25 16:03:37.190697 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.190697 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:37.192724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9da3678d-1ecf-42b3-8d4e-4abdc55a6155 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.192724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9da3678d-1ecf-42b3-8d4e-4abdc55a6155 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.193404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9da3678d-1ecf-42b3-8d4e-4abdc55a6155 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.193871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9da3678d-1ecf-42b3-8d4e-4abdc55a6155 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.197677 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 118/216] 10.222.0.105 () {60 vars in 1170 bytes} [Mon Jul 25 16:03:37 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.203898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c8044cb-b74f-40c2-9071-1ad06008beff tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-906586945_new", "availability_zone": "tempest-test_az-897866293_new"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:37.208173 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.208173 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.220443 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9da3678d-1ecf-42b3-8d4e-4abdc55a6155 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.035843 Jul 25 16:03:37.221067 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 99/217] 10.222.0.105 () {58 vars in 1133 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.231926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38debee4-296e-4065-bac8-8fb30200163b tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da03f4dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.232822 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.232822 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:37.239966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38debee4-296e-4065-bac8-8fb30200163b tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.240534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38debee4-296e-4065-bac8-8fb30200163b tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.247873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c8044cb-b74f-40c2-9071-1ad06008beff tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.248323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c8044cb-b74f-40c2-9071-1ad06008beff tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.256570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38debee4-296e-4065-bac8-8fb30200163b tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.257713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38debee4-296e-4065-bac8-8fb30200163b tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.277589 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38debee4-296e-4065-bac8-8fb30200163b tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts/n-h2-846219-13" status: 200 len: 471 microversion: 2.1 time: 0.049034 Jul 25 16:03:37.278633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 100/218] 10.222.0.105 () {58 vars in 1178 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-hosts/n-h2-846219-13 => generated 471 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:37.283973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.284588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:37.292586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.293041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.296676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c8044cb-b74f-40c2-9071-1ad06008beff tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.097011 Jul 25 16:03:37.297428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.297812 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 119/219] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:03:37 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.305151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fae14b33-4b25-4b23-a5e2-10d2287eb327 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Calling method '.version_select at 0x7f9da05461f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.306054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.306599 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.306599 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.317349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fae14b33-4b25-4b23-a5e2-10d2287eb327 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.318076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fae14b33-4b25-4b23-a5e2-10d2287eb327 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.339046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fae14b33-4b25-4b23-a5e2-10d2287eb327 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.339762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fae14b33-4b25-4b23-a5e2-10d2287eb327 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.384746 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fae14b33-4b25-4b23-a5e2-10d2287eb327 tempest-HostsAdminTestJSON-415190057 tempest-HostsAdminTestJSON-415190057-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts/n-h1-846219-13" status: 200 len: 735 microversion: 2.1 time: 0.085690 Jul 25 16:03:37.385756 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 120/220] 10.222.0.105 () {58 vars in 1178 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-hosts/n-h1-846219-13 => generated 735 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.391185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-131ef8ba-34be-4563-b0dc-18726c0086ee tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.392014 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.392014 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.400844 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-131ef8ba-34be-4563-b0dc-18726c0086ee tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.013671 Jul 25 16:03:37.402123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 121/221] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.418446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c09ea938-571a-44b4-8d02-3ab68fd64cbc tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.419366 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.419366 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.454070 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c09ea938-571a-44b4-8d02-3ab68fd64cbc tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.040212 Jul 25 16:03:37.454816 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 122/222] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:37 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 16:03:37.464362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb42f8a7-1330-4728-bf42-a5edd4494b3e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-692385281"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:37.468613 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.468613 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.470113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-eb42f8a7-1330-4728-bf42-a5edd4494b3e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Generated uuid f23a23aa-2959-425e-a1e5-be22644b2c72 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:37.496216 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb42f8a7-1330-4728-bf42-a5edd4494b3e tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035958 Jul 25 16:03:37.503187 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 123/223] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.508374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be8efc62-be9a-4abb-9ac0-5edf9bc80b2c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.509643 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.509643 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.515645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:37.518103 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be8efc62-be9a-4abb-9ac0-5edf9bc80b2c tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.013630 Jul 25 16:03:37.525916 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 124/224] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:37.526627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5d51151f-c6cc-42b1-8371-2fcc1a077420 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.246813 Jul 25 16:03:37.527310 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 101/225] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:37.531056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92040d65-2770-449a-b7c1-0e45a824de76 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.532034 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:37.532034 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:37.567646 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92040d65-2770-449a-b7c1-0e45a824de76 tempest-AggregatesAdminTestJSON-1409156221 tempest-AggregatesAdminTestJSON-1409156221-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.039224 Jul 25 16:03:37.568880 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 125/226] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:37 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:37.579194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.580198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:37.589842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.590764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.591579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.592005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.623927 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] HTTP exception thrown: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Request method failure captured: Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 HTTP/1.1 Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6dehDFlR81XtHOk7jLtPy0hu3mOqFpIsTD-TmOQFG0pUFv2bl_vIgc6kKhZoyj-OviEs0C3NiFfUKIjfGClfnKItpovZ_yFF9I-B9rWJSiDkgm0sFRq9cXJKZbMOQdddWYzgoUSBQRbgHEm2oD86MDMIARkBdx9qU53Y7m1y3K4pw Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 901a456f4900427f9722785029268fc7 Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:37.625853 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/901a456f4900427f9722785029268fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/901a456f4900427f9722785029268fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/901a456f4900427f9722785029268fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_901a456f4900427f9722785029268fc7"}]}] Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 901a456f4900427f9722785029268fc7 Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminTestJSON-1667635507-project Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: cf9c8e2e0e224c08b971ddfaf27ac13a Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminTestJSON-1667635507-project Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.627252 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'bf225920-15fb-4099-8324-7c7198595d32'} Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:37.628055 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.629289 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.630566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Returning 404 to user: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:37.630566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d537539e-daba-467e-b232-a6a77857a1f4 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "DELETE /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 404 len: 111 microversion: 2.1 time: 0.052648 Jul 25 16:03:37.630566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 102/227] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:03:37 2022] DELETE /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:37.637655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.638437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] [instance: bf225920-15fb-4099-8324-7c7198595d32] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:37.646719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.647175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.648100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.648545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.675162 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] HTTP exception thrown: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Request method failure captured: Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 HTTP/1.1 Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6dehDFlR81XtHOk7jLtPy0hu3mOqFpIsTD-TmOQFG0pUFv2bl_vIgc6kKhZoyj-OviEs0C3NiFfUKIjfGClfnKItpovZ_yFF9I-B9rWJSiDkgm0sFRq9cXJKZbMOQdddWYzgoUSBQRbgHEm2oD86MDMIARkBdx9qU53Y7m1y3K4pw Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 901a456f4900427f9722785029268fc7 Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:37.680334 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/901a456f4900427f9722785029268fc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/901a456f4900427f9722785029268fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/901a456f4900427f9722785029268fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_901a456f4900427f9722785029268fc7"}]}] Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 901a456f4900427f9722785029268fc7 Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1667635507 Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminTestJSON-1667635507-project Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: cf9c8e2e0e224c08b971ddfaf27ac13a Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminTestJSON-1667635507-project Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.681595 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'bf225920-15fb-4099-8324-7c7198595d32'} Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:37.682239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. Jul 25 16:03:37.683407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:37.684437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] Returning 404 to user: Instance bf225920-15fb-4099-8324-7c7198595d32 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:37.684437 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3b51ced-009e-46f9-b4cc-fe1a63b2cda9 tempest-AggregatesAdminTestJSON-1667635507 tempest-AggregatesAdminTestJSON-1667635507-project] 10.222.0.105 "GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32" status: 404 len: 111 microversion: 2.1 time: 0.049757 Jul 25 16:03:37.684437 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 126/228] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/servers/bf225920-15fb-4099-8324-7c7198595d32 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:37.791120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:37.792304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:37.799441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.800116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:37.801243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:37.801849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.034843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:38.035527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:38.052516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.053341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.054358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.054944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.077563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:38.089029 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aaf95288-d9a3-4a4c-9c3e-d4610e5e7152 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1480 microversion: 2.1 time: 0.302198 Jul 25 16:03:38.092511 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 103/229] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:37 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1480 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:38.119096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:38.119938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:38.138814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.138995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.142706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.144931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.494789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:38.512601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8fe82cc-1ffc-49a1-9271-5a6a0b016eb6 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.481891 Jul 25 16:03:38.526903 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 127/230] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:38 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:38.639776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:38.650687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-811a2ace-82ae-4c41-87ae-28fc4da4785c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1329 microversion: 2.1 time: 0.543931 Jul 25 16:03:38.657499 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 104/231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:38 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1329 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:38.667875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:38.668552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:38.678713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.679173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.680038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.680483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.982779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Action: 'update', calling method: .version_select at 0x7f9da01c9ee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:38.985535 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:38.985535 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:38.986865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.987556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:38.997383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:38.997860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.007174 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] HTTP exception thrown: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Request method failure captured: Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20 HTTP/1.1 Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 56 Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7ajsRzmLs0W05AYVlOiwEvzUNQFZHoGBOH3RKm72V30QG_a0sPQZcB-z04T3kaak0qSkcJ_8sehggXSYexOOhHQ3IN6OHqaUc6U6MHfMttO32EPds052OuM0wVX-xDxZHXX4XmZAiSwLjK1pPLRQXLufHscw9NoW490OPcvEhp26s Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: e0e4be97751e4c7792220146027bfeca Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:39.009392 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e0e4be97751e4c7792220146027bfeca"}]}] Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: e0e4be97751e4c7792220146027bfeca Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 124a53f259ad4383b63f5f34a6b9f05d Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:39.010708 n-d-846219-13 devstack@n-api.service[119599]: exception: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '72915422-51e3-420d-b2e8-4b0ea8ebcb20', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.016953 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:39.018520 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:39.020393 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:39.020393 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.020393 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.020393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Returning 404 to user: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:39.020393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c52d151-b10a-4b24-a6c5-b740d315de26 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20" status: 404 len: 110 microversion: 2.53 time: 0.482477 Jul 25 16:03:39.020393 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 128/232] 10.222.0.105 () {62 vars in 1314 bytes} [Mon Jul 25 16:03:38 2022] PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20 => generated 110 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:39.024558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Action: 'update', calling method: .version_select at 0x7f9da016ed30>, body: {"status": "disabled"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:39.029953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.029953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.042560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.042998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.048883 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] HTTP exception thrown: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Request method failure captured: Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20 HTTP/1.1 Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 22 Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7ajsRzmLs0W05AYVlOiwEvzUNQFZHoGBOH3RKm72V30QG_a0sPQZcB-z04T3kaak0qSkcJ_8sehggXSYexOOhHQ3IN6OHqaUc6U6MHfMttO32EPds052OuM0wVX-xDxZHXX4XmZAiSwLjK1pPLRQXLufHscw9NoW490OPcvEhp26s Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: e0e4be97751e4c7792220146027bfeca Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:39.051039 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e0e4be97751e4c7792220146027bfeca"}]}] Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: e0e4be97751e4c7792220146027bfeca Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 124a53f259ad4383b63f5f34a6b9f05d Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: {"status": "disabled"} Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: exception: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.053790 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '72915422-51e3-420d-b2e8-4b0ea8ebcb20', 'body': {'status': 'disabled'}} Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.055356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:39.059387 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:39.062954 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.062954 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.062954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Returning 404 to user: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:39.062954 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e7a4c96-ca0b-49ea-9de7-b21ad6efb700 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20" status: 404 len: 110 microversion: 2.53 time: 0.032905 Jul 25 16:03:39.062954 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 129/233] 10.222.0.105 () {62 vars in 1314 bytes} [Mon Jul 25 16:03:39 2022] PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20 => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:39.070473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Action: 'update', calling method: .version_select at 0x7f9da017b8b0>, body: {"status": "enabled"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:39.074892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.075446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.082268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.082804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.089892 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] HTTP exception thrown: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Request method failure captured: Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20 HTTP/1.1 Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 21 Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7ajsRzmLs0W05AYVlOiwEvzUNQFZHoGBOH3RKm72V30QG_a0sPQZcB-z04T3kaak0qSkcJ_8sehggXSYexOOhHQ3IN6OHqaUc6U6MHfMttO32EPds052OuM0wVX-xDxZHXX4XmZAiSwLjK1pPLRQXLufHscw9NoW490OPcvEhp26s Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: e0e4be97751e4c7792220146027bfeca Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:39.091873 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e0e4be97751e4c7792220146027bfeca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e0e4be97751e4c7792220146027bfeca"}]}] Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: e0e4be97751e4c7792220146027bfeca Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707 Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 124a53f259ad4383b63f5f34a6b9f05d Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: {"status": "enabled"} Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: exception: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.093464 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '72915422-51e3-420d-b2e8-4b0ea8ebcb20', 'body': {'status': 'enabled'}} Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.094380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:39.095651 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:39.096779 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. Jul 25 16:03:39.096779 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:39.097355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Returning 404 to user: Service 72915422-51e3-420d-b2e8-4b0ea8ebcb20 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:39.098304 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-138db950-7193-4fab-9bc6-26b8c8740a3d tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20" status: 404 len: 110 microversion: 2.53 time: 0.032264 Jul 25 16:03:39.104195 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 130/234] 10.222.0.105 () {62 vars in 1314 bytes} [Mon Jul 25 16:03:39 2022] PUT /compute/v2.1/os-services/72915422-51e3-420d-b2e8-4b0ea8ebcb20 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:39.110682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bcf8ddcf-386e-4844-ac2f-37210b4851eb tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.112604 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:39.112604 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:39.114115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcf8ddcf-386e-4844-ac2f-37210b4851eb tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.114739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcf8ddcf-386e-4844-ac2f-37210b4851eb tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.115755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcf8ddcf-386e-4844-ac2f-37210b4851eb tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.116338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcf8ddcf-386e-4844-ac2f-37210b4851eb tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.134582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=10,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:39.145601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bcf8ddcf-386e-4844-ac2f-37210b4851eb tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039755 Jul 25 16:03:39.146130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 131/235] 10.222.0.105 () {60 vars in 1183 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:03:39.163615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.164522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:39.173131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.173875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.174910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.175926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.304284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:39.320765 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8cfb41ba-c5cd-4a36-8267-3460f6a7c608 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1393 microversion: 2.1 time: 0.661715 Jul 25 16:03:39.332338 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 105/236] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:38 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1393 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:39.338306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec889e24-72be-4479-baa6-4cae71964a5c tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.341445 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:39.341445 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:39.343478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec889e24-72be-4479-baa6-4cae71964a5c tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.344076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec889e24-72be-4479-baa6-4cae71964a5c tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.345206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec889e24-72be-4479-baa6-4cae71964a5c tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.345773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec889e24-72be-4479-baa6-4cae71964a5c tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.400830 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec889e24-72be-4479-baa6-4cae71964a5c tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.067061 Jul 25 16:03:39.409824 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 106/237] 10.222.0.105 () {60 vars in 1216 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:03:39.414812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbf75c6a-945a-4215-bad7-aac6b4686145 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.417617 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:39.417617 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:39.419608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbf75c6a-945a-4215-bad7-aac6b4686145 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.420275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbf75c6a-945a-4215-bad7-aac6b4686145 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.421287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbf75c6a-945a-4215-bad7-aac6b4686145 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.421900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbf75c6a-945a-4215-bad7-aac6b4686145 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.448981 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cbf75c6a-945a-4215-bad7-aac6b4686145 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037773 Jul 25 16:03:39.457175 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 107/238] 10.222.0.105 () {60 vars in 1183 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:03:39.462212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-edb28e94-b5b1-4168-9de4-fdde2f206354 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.465128 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:39.465128 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:39.466723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edb28e94-b5b1-4168-9de4-fdde2f206354 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.467329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edb28e94-b5b1-4168-9de4-fdde2f206354 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.468748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edb28e94-b5b1-4168-9de4-fdde2f206354 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.469376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edb28e94-b5b1-4168-9de4-fdde2f206354 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.494937 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-edb28e94-b5b1-4168-9de4-fdde2f206354 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?host=n-d-846219-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.036284 Jul 25 16:03:39.495826 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 108/239] 10.222.0.105 () {60 vars in 1242 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services?host=n-d-846219-13&binary=xxx => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:39.507976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0375931-0fa3-4bf4-93e1-3ca7b665d839 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.510549 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:39.510549 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:39.511904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0375931-0fa3-4bf4-93e1-3ca7b665d839 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.512357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0375931-0fa3-4bf4-93e1-3ca7b665d839 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.513214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0375931-0fa3-4bf4-93e1-3ca7b665d839 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.513649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0375931-0fa3-4bf4-93e1-3ca7b665d839 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.539527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0375931-0fa3-4bf4-93e1-3ca7b665d839 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.035378 Jul 25 16:03:39.540265 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 109/240] 10.222.0.105 () {60 vars in 1183 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:03:39.554694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-898057f7-a7f0-4f18-8e72-934e51d3da13 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.557746 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:39.557746 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:39.559562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-898057f7-a7f0-4f18-8e72-934e51d3da13 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.560183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-898057f7-a7f0-4f18-8e72-934e51d3da13 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.561845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-898057f7-a7f0-4f18-8e72-934e51d3da13 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.562550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-898057f7-a7f0-4f18-8e72-934e51d3da13 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.563510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=70,nova_cell0:UPDATE=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:39.590805 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-898057f7-a7f0-4f18-8e72-934e51d3da13 tempest-ServicesAdminNegativeV253TestJSON-2023413707 tempest-ServicesAdminNegativeV253TestJSON-2023413707-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040068 Jul 25 16:03:39.591857 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 110/241] 10.222.0.105 () {60 vars in 1244 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:39.602864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:39.604501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:39.612126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.612887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.613982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:39.614528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:39.822675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:39.835688 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78465984-d90f-4fa3-97ee-578d2cbf0baa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1480 microversion: 2.1 time: 0.681676 Jul 25 16:03:39.837202 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 132/242] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1480 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:40.065510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:40.077820 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6aee3ca4-6f6c-416f-bab5-726426b3fc52 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.483549 Jul 25 16:03:40.078273 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 111/243] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:40.116465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:40.129266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:40.136567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:40.142285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.142664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.143457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.143891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.220147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3540859-9a8f-487e-ba21-fa4709eebd36 tempest-ServicesAdminNegativeV253TestJSON-628641057 tempest-ServicesAdminNegativeV253TestJSON-628641057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:40.223464 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:40.223464 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:40.225395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e3540859-9a8f-487e-ba21-fa4709eebd36 tempest-ServicesAdminNegativeV253TestJSON-628641057 tempest-ServicesAdminNegativeV253TestJSON-628641057-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b18bfcfd9b904b3a95ce629860dabc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5b8523b44a468f84db6a8ada1f93f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3540859-9a8f-487e-ba21-fa4709eebd36 tempest-ServicesAdminNegativeV253TestJSON-628641057 tempest-ServicesAdminNegativeV253TestJSON-628641057-project] Request method failure captured: Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7YFvOOASzF5DbHi29mY7UgM5YiFGEScktqY4A9dJBsFOyzjm06O9gg8iT3LhvImvxxL2rCgEjdywj1ER3EWNrwJ2QNCjJ-w_0k-ylE2RtlFkHXd1ne2ZJUK-QrIPcmXsLvAIFgnXjrtdygAIKAo8Gef-BJYOqCRkZFHDp_BCRVzwU Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: ba5b8523b44a468f84db6a8ada1f93f1 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-628641057 Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:40.229913 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ba5b8523b44a468f84db6a8ada1f93f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ba5b8523b44a468f84db6a8ada1f93f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ba5b8523b44a468f84db6a8ada1f93f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ba5b8523b44a468f84db6a8ada1f93f1"}]}] Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-628641057 Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: ba5b8523b44a468f84db6a8ada1f93f1 Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-628641057 Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServicesAdminNegativeV253TestJSON-628641057-project Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b18bfcfd9b904b3a95ce629860dabc40 Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-628641057-project Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 16:03:40.231133 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:40.231783 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 16:03:40.237643 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:40.238785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3540859-9a8f-487e-ba21-fa4709eebd36 tempest-ServicesAdminNegativeV253TestJSON-628641057 tempest-ServicesAdminNegativeV253TestJSON-628641057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:40.238785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e3540859-9a8f-487e-ba21-fa4709eebd36 tempest-ServicesAdminNegativeV253TestJSON-628641057 tempest-ServicesAdminNegativeV253TestJSON-628641057-project] 10.222.0.105 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.392495 Jul 25 16:03:40.238785 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 133/244] 10.222.0.105 () {60 vars in 1183 bytes} [Mon Jul 25 16:03:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 398 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:40.242286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5e8fa102-019f-4ddd-a160-c84d22f0d32a req-999ec300-6474-4d04-b643-0105f92a3f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9666ce6e-2178-4ea2-9a81-1f11241a5961", "name": "network-vif-plugged", "status": "completed", "tag": "324b8800-0f74-4988-a345-007ca19ae3ac"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:40.271530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5e8fa102-019f-4ddd-a160-c84d22f0d32a req-999ec300-6474-4d04-b643-0105f92a3f66 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.273203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5e8fa102-019f-4ddd-a160-c84d22f0d32a req-999ec300-6474-4d04-b643-0105f92a3f66 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.291211 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5e8fa102-019f-4ddd-a160-c84d22f0d32a req-999ec300-6474-4d04-b643-0105f92a3f66 service nova] Creating event network-vif-plugged:324b8800-0f74-4988-a345-007ca19ae3ac for instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 on n-h2-846219-13 Jul 25 16:03:40.303132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5e8fa102-019f-4ddd-a160-c84d22f0d32a req-999ec300-6474-4d04-b643-0105f92a3f66 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064887 Jul 25 16:03:40.303756 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 134/245] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:40.327022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4233fba8-fb8f-4161-99b0-89f0e6d85b2b req-2d5da249-b3f3-47c6-8e21-e89b0851f821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a2c288-eaf1-4498-94b6-14855dc886f4", "name": "network-vif-deleted", "tag": "96dc584e-b3fb-4942-91b2-6a343237d23f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:40.358123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4233fba8-fb8f-4161-99b0-89f0e6d85b2b req-2d5da249-b3f3-47c6-8e21-e89b0851f821 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.358827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4233fba8-fb8f-4161-99b0-89f0e6d85b2b req-2d5da249-b3f3-47c6-8e21-e89b0851f821 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.365000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:40.381913 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4233fba8-fb8f-4161-99b0-89f0e6d85b2b req-2d5da249-b3f3-47c6-8e21-e89b0851f821 service nova] Creating event network-vif-deleted:96dc584e-b3fb-4942-91b2-6a343237d23f for instance 13a2c288-eaf1-4498-94b6-14855dc886f4 on n-h1-846219-13 Jul 25 16:03:40.389796 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4233fba8-fb8f-4161-99b0-89f0e6d85b2b req-2d5da249-b3f3-47c6-8e21-e89b0851f821 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082843 Jul 25 16:03:40.394000 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 135/246] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:40.414369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:40.415909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:40.434698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.436008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.438219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.439885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.501412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:40.514203 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d3908ae5-bb31-40a0-9ad1-4d12f9591100 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1329 microversion: 2.1 time: 0.415730 Jul 25 16:03:40.514890 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 112/247] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:40 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1329 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:40.653766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:40.661942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-740562fe-1d5b-4492-80f3-80420f349db8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1592 microversion: 2.1 time: 0.264575 Jul 25 16:03:40.662618 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 136/248] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:40 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1592 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:40.700694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:40.701364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:40.756809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.757221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.760778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.761251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.863986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:40.865420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:40.872696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.873713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.874888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.875633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.948343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:40.949043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:40.949806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lazy-loading 'fault' on Instance uuid 13a2c288-eaf1-4498-94b6-14855dc886f4 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:03:41.099246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:41.121573 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b086c51c-00b1-4d9b-9735-f77ef5c6a924 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 200 len: 1314 microversion: 2.1 time: 0.265336 Jul 25 16:03:41.136758 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 137/249] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:40 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:41.152393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:41.153019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:41.156035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7bbcff7b-4886-460f-bf6e-e63729d38242 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.468358 Jul 25 16:03:41.158457 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 113/250] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:03:40 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2/os-interface => generated 284 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:41.163999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:41.164546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:41.173946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:41.180323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:41.537079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:41.537726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:41.550121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:41.550575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:41.555575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:41.557887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:41.967242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:41.977252 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-772473bb-303a-406c-8adb-ba12397aefd8 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.837138 Jul 25 16:03:41.977872 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 138/251] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:41 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:42.152378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:42.153669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:42.166108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:42.166891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:42.168310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:42.168758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:42.201787 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] HTTP exception thrown: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:03:42.211405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Request method failure captured: Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 HTTP/1.1 Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6qsV2Yl2JhNL6ISGb9BtU6-FCA_C0O1O1z3sCUhf3i4wZBeGh23yxb7aTiI3FDWYvQtEsl9eanX8SxMXNOkIphr6j2XpKZin8wMHQ8xr96kMzfurIIpEqK-5eaQJuOzLtKtelYWqc-VbKQ2OFpjDz3lCj0XGRi25OKhsTTL69LMug Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:42.212412 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7f2be2f7e5c543b091248379de7069dc"}]}] Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: bc0b370cb44b4beabe9b9cee8e8b16cf Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:03:42.213696 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '13a2c288-eaf1-4498-94b6-14855dc886f4'} Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:42.214401 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:03:42.215518 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:42.218515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Returning 404 to user: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:42.218515 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-77ae9bf0-58c1-4a04-b5e1-f1b2922c0781 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 404 len: 111 microversion: 2.1 time: 0.065897 Jul 25 16:03:42.218515 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 139/252] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:42 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:42.254818 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bade7ac0-f047-49be-90fa-ec78d6467037 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1329 microversion: 2.1 time: 0.722022 Jul 25 16:03:42.257007 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 114/253] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:41 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1329 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:42.330212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-22b3ca81-e39e-4a69-8915-1ff879034129 req-b50defa9-ce11-4ea4-93a5-4e8e25ef0a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3482326-8c40-4c1d-870e-47cb4e38b790", "name": "network-vif-plugged", "status": "completed", "tag": "62f5650a-a00b-43bd-97b7-7c9bb030b2f7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:42.378991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-22b3ca81-e39e-4a69-8915-1ff879034129 req-b50defa9-ce11-4ea4-93a5-4e8e25ef0a8a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:42.380903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-22b3ca81-e39e-4a69-8915-1ff879034129 req-b50defa9-ce11-4ea4-93a5-4e8e25ef0a8a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:42.403996 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-22b3ca81-e39e-4a69-8915-1ff879034129 req-b50defa9-ce11-4ea4-93a5-4e8e25ef0a8a service nova] Creating event network-vif-plugged:62f5650a-a00b-43bd-97b7-7c9bb030b2f7 for instance b3482326-8c40-4c1d-870e-47cb4e38b790 on n-h1-846219-13 Jul 25 16:03:42.410289 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-22b3ca81-e39e-4a69-8915-1ff879034129 req-b50defa9-ce11-4ea4-93a5-4e8e25ef0a8a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087354 Jul 25 16:03:42.416043 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 140/254] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:42.460088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-398446096", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:42.546413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:03:42.999999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:43.001586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:43.009946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.010706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.012269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.013189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.046611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:03:43.047011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:03:43.047498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:03:43.047913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:03:43.048326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:03:43.065412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.065882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.066702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.067143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.089612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=32 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:43.125445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Getting quotas for project 7f2be2f7e5c543b091248379de7069dc. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:43.131451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Getting quotas for user bc0b370cb44b4beabe9b9cee8e8b16cf and project 7f2be2f7e5c543b091248379de7069dc. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:43.159448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:03:43.166581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:03:43.259150 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-47507721-3759-40d3-8ab7-cf7ce2fc8e59 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.802981 Jul 25 16:03:43.260183 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 115/255] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:03:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:03:43.271047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bf3c7e88-66e6-44c1-9c60-e98ef18dff27 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:43.271819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bf3c7e88-66e6-44c1-9c60-e98ef18dff27 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:43.496455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bf3c7e88-66e6-44c1-9c60-e98ef18dff27 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:43.529519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:43.534956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bf3c7e88-66e6-44c1-9c60-e98ef18dff27 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1223 microversion: 2.1 time: 0.259454 Jul 25 16:03:43.536105 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 116/256] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:43 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1223 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:43.546098 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c73cf5f-8dbf-4e7c-83d8-e74a6e469abb tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1326 microversion: 2.1 time: 0.552008 Jul 25 16:03:43.546876 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 141/257] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:42 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1326 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:43.562917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:43.565964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:43.583557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.584460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.586211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.586885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.805192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:43.814249 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87b547f5-c2a2-4a03-b4a0-729fed426ec3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.272344 Jul 25 16:03:43.815177 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 117/258] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:43 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:43.843792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:43.844372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:43.853732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.854074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:43.855252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:43.856533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.077426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:44.078374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:44.112497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.114607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.116960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.117678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.149702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:44.160664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb8aa425-bc25-450a-bc73-13697da1fcf3 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.321251 Jul 25 16:03:44.177123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 142/259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:43 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:44.189131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4c0da196-ee55-42a3-8f24-0b1b345c537a req-3adbd393-0400-4bda-80d7-621494e3435c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122ea2ba-aba9-48e7-86c2-1d88fa0a2df2", "tag": "b8187b51-cec4-423e-809a-7fc8ea7e739d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:44.222513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4c0da196-ee55-42a3-8f24-0b1b345c537a req-3adbd393-0400-4bda-80d7-621494e3435c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.223293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4c0da196-ee55-42a3-8f24-0b1b345c537a req-3adbd393-0400-4bda-80d7-621494e3435c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.242921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4c0da196-ee55-42a3-8f24-0b1b345c537a req-3adbd393-0400-4bda-80d7-621494e3435c service nova] Creating event network-changed:b8187b51-cec4-423e-809a-7fc8ea7e739d for instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 on n-h1-846219-13 Jul 25 16:03:44.249221 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4c0da196-ee55-42a3-8f24-0b1b345c537a req-3adbd393-0400-4bda-80d7-621494e3435c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072927 Jul 25 16:03:44.250284 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 143/260] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:44.255982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eba3c000-e59e-4f6f-9248-3ffd22ef003c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-48901402", "metadata": {"": ""}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eba3c000-e59e-4f6f-9248-3ffd22ef003c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action HTTP/1.1 Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 105 Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:44.268807 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-48901402", "metadata": {"": ""}}} Jul 25 16:03:44.270352 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-48901402', 'metadata': {'': ''}}}} Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'': ''} Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:44.275323 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.276513 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eba3c000-e59e-4f6f-9248-3ffd22ef003c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eba3c000-e59e-4f6f-9248-3ffd22ef003c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action" status: 400 len: 170 microversion: 2.1 time: 0.018919 Jul 25 16:03:44.277660 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 144/261] 10.222.0.105 () {60 vars in 1284 bytes} [Mon Jul 25 16:03:44 2022] POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:44.296955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:44.298120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:44.317786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:44.318519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.318946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.319734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.320175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.338803 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83afe3ef-c609-48fa-a7c4-008f70ffbe24 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 200 len: 1592 microversion: 2.1 time: 0.269029 Jul 25 16:03:44.341694 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 118/262] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:44 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 1592 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:44.606633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:44.620076 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6cd85734-20b4-4ff8-ab4a-9dc65ffe0e7f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.343962 Jul 25 16:03:44.623118 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 145/263] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:44 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:44.630294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:44.635439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:44.651848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.652304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.655289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.655737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.787742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:44.796129 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc918c3f-9bee-4fc0-90d4-3386c54b93f5 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1275 microversion: 2.1 time: 0.170875 Jul 25 16:03:44.797967 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 146/264] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:44 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:44.811136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:44.820719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:44.835000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.839265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:44.840271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:44.841409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.051529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4353e47-8c14-4e16-bfee-48de14feb581 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:45.055197 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:45.055197 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:45.067724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4353e47-8c14-4e16-bfee-48de14feb581 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.069601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4353e47-8c14-4e16-bfee-48de14feb581 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.070846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4353e47-8c14-4e16-bfee-48de14feb581 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.071444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4353e47-8c14-4e16-bfee-48de14feb581 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.098721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:45.118768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4353e47-8c14-4e16-bfee-48de14feb581 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.675107 Jul 25 16:03:45.129307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 119/265] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:03:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:45.134238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:45.135175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:45.142300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.142900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.143808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.144635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.514824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:45.524262 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7cee3377-3638-4c8e-a55a-7661aa8f5a2f tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1476 microversion: 2.1 time: 0.721246 Jul 25 16:03:45.531696 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 147/266] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:44 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1476 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:45.536640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-80ac856b-fa77-4f63-9098-4d20595ec54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-960404265"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:45.545191 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:45.545191 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:45.546251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-80ac856b-fa77-4f63-9098-4d20595ec54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 7e34f433-0ff0-4c55-9e56-c56395a74c00 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:45.585127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-80ac856b-fa77-4f63-9098-4d20595ec54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051620 Jul 25 16:03:45.586927 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 148/267] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:45.606196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:45.606721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:45.619474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.619929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.620961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.621418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.653567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Request method failure captured: Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790/diagnostics HTTP/1.1 Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7HTRU4aFVkuaa_Bt03hXRWJdjEHJT0R9H1VWdBQ6c4y-ER66TiNfllz45Q73M73TBq0-8L5SB-dzv8c19kn2kG5XOeUx-hkJDaUlH-XPgyJ2f_4KQXnPakdIut9-PTNggp_G86v01o22wf2F4n42Zg-K1EAmPil8OlENgru9myCrY Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bc2c79a32ab54379a23d47dbae32fd63 Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1600778819 Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:45.656425 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bc2c79a32ab54379a23d47dbae32fd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bc2c79a32ab54379a23d47dbae32fd63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bc2c79a32ab54379a23d47dbae32fd63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bc2c79a32ab54379a23d47dbae32fd63"}]}] Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1600778819 Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bc2c79a32ab54379a23d47dbae32fd63 Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1600778819 Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerDiagnosticsNegativeTest-1600778819-project Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 029d1b74748a45a7aac98e73d7f89fb4 Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1600778819-project Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:45.657919 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': 'b3482326-8c40-4c1d-870e-47cb4e38b790'} Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:45.658736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 16:03:45.660073 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:45.662829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:45.664372 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ac7e07e-7004-4d92-a00d-fee35e126830 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.075564 Jul 25 16:03:45.665623 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 149/268] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:03:45 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790/diagnostics => generated 117 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:45.676998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-280f2f02-bdc0-422f-b392-58e449653141 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:45.679784 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:45.679784 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:45.695489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-280f2f02-bdc0-422f-b392-58e449653141 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:45.696309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-280f2f02-bdc0-422f-b392-58e449653141 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:45.903664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-280f2f02-bdc0-422f-b392-58e449653141 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.231983 Jul 25 16:03:45.904597 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 150/269] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:45 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:45.978272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:45.991056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c679a6d-7556-4337-a0af-34436503ea7c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.866971 Jul 25 16:03:45.991698 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 120/270] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:45 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:46.009587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.010112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:46.025324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.026138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.027249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.030417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.067178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:03:46.232882 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-147f3f9c-1db4-4cbf-96f3-23de8bb6ff32 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 204 len: 0 microversion: 2.1 time: 0.235665 Jul 25 16:03:46.237279 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 121/271] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:03:45 2022] DELETE /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:03:46.245265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.249809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:46.274247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.275036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.276787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.279861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.382578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1bfc8ad5-eba1-46ae-a30b-848ab89e2e0f tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Calling method '.version_select at 0x7f9da01c9af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.383684 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:46.383684 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:46.385200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1bfc8ad5-eba1-46ae-a30b-848ab89e2e0f tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '9ab7255526d74ae7a03b971eba5306ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4583f3e1db46b1959ce9df4388c151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1bfc8ad5-eba1-46ae-a30b-848ab89e2e0f tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Request method failure captured: Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7fePDKQMTGV5SSioub1i1jLaJRvf1xSa9VYCx4krxDhmFBoHAR78Q2akF0_y0OISzGkYsPazq-yPhzNGs9yD-3hIIH5JtS6H_KC7dLsNfmln88_xW7h5rHvKWz60ZJleM6N2W0MvI-SU0iqbk64IcMHhOA_QWVZ_415olUY8Y0dn0 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:46.387260 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_4c4583f3e1db46b1959ce9df4388c151"}]}] Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9ab7255526d74ae7a03b971eba5306ef Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:03:46.388903 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:46.389906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 16:03:46.391176 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.395175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1bfc8ad5-eba1-46ae-a30b-848ab89e2e0f tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:46.398150 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1bfc8ad5-eba1-46ae-a30b-848ab89e2e0f tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.491096 Jul 25 16:03:46.400286 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 151/272] 10.222.0.105 () {58 vars in 1172 bytes} [Mon Jul 25 16:03:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 495 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:46.403845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:46.410389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:46.412231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b2679d86-af58-43e5-b5fb-909bb1d82764 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1281 microversion: 2.1 time: 0.173362 Jul 25 16:03:46.412833 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 122/273] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:46.418678 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:46.418678 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:46.418988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2377dbd-01e4-4d07-8222-89fed991e3b5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-647086965", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2377dbd-01e4-4d07-8222-89fed991e3b5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action HTTP/1.1 Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 618 Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:46.431355 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:46.432756 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:03:46.433474 n-d-846219-13 devstack@n-api.service[119598]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-647086965", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 25 16:03:46.433474 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:46.433474 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-647086965', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 16:03:46.433746 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:46.434504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.435458 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.436179 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.436179 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.436179 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:46.436179 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:46.436179 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:03:46.436179 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.436693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2377dbd-01e4-4d07-8222-89fed991e3b5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:46.436693 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f2377dbd-01e4-4d07-8222-89fed991e3b5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action" status: 400 len: 938 microversion: 2.1 time: 0.018364 Jul 25 16:03:46.436693 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 123/274] 10.222.0.105 () {60 vars in 1284 bytes} [Mon Jul 25 16:03:46 2022] POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:46.442073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.443072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.448434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.449048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:46.467154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.469943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.470237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.471181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.476248 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-846219-13. Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 40 Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:46.499359 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: {"add_host": {"host": "n-h2-846219-13"}} Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:46.500717 n-d-846219-13 devstack@n-api.service[119599]: exception: Aggregate 11 already has host n-h2-846219-13. Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-846219-13'}}} Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result.read() Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:03:46.501541 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-846219-13-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 16:03:46.502650 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 16:03:46.503744 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:03:46.504793 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result.read() Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-846219-13-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 16, 3, 46, 462032), 'updated_at': None, 'host': 'n-h2-846219-13', 'aggregate_id': 11}] Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.505896 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-846219-13. Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.506812 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-846219-13. Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:46.507994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:46.513472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-846219-13. Jul 25 16:03:46.513472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.513472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-846219-13. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:46.513472 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1731c02-f334-4e27-a4ad-c4b7618d8cf1 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.098270 Jul 25 16:03:46.513472 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 152/275] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:46 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 25 16:03:46.564509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a1cf8fc-c1ee-41b0-ac38-591e1a89f8ed tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Calling method '.version_select at 0x7f9d93ed3ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.569777 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:46.569777 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:46.571316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a1cf8fc-c1ee-41b0-ac38-591e1a89f8ed tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.571802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a1cf8fc-c1ee-41b0-ac38-591e1a89f8ed tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.572609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a1cf8fc-c1ee-41b0-ac38-591e1a89f8ed tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.573043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a1cf8fc-c1ee-41b0-ac38-591e1a89f8ed tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.597607 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a1cf8fc-c1ee-41b0-ac38-591e1a89f8ed tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.094859 Jul 25 16:03:46.598212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 153/276] 10.222.0.105 () {58 vars in 1133 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:46.603082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-612f54de-44b5-4409-bf16-b5f245a9a5d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Calling method '.version_select at 0x7f9da0127040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.604116 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:46.604116 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:46.605485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-612f54de-44b5-4409-bf16-b5f245a9a5d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '9ab7255526d74ae7a03b971eba5306ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4583f3e1db46b1959ce9df4388c151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-612f54de-44b5-4409-bf16-b5f245a9a5d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Request method failure captured: Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7fePDKQMTGV5SSioub1i1jLaJRvf1xSa9VYCx4krxDhmFBoHAR78Q2akF0_y0OISzGkYsPazq-yPhzNGs9yD-3hIIH5JtS6H_KC7dLsNfmln88_xW7h5rHvKWz60ZJleM6N2W0MvI-SU0iqbk64IcMHhOA_QWVZ_415olUY8Y0dn0 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:46.607318 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_4c4583f3e1db46b1959ce9df4388c151"}]}] Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9ab7255526d74ae7a03b971eba5306ef Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:03:46.608871 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:46.609769 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 16:03:46.611096 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:46.614503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-612f54de-44b5-4409-bf16-b5f245a9a5d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:46.614503 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-612f54de-44b5-4409-bf16-b5f245a9a5d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009492 Jul 25 16:03:46.614503 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 154/277] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:46.618825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.619447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:46.627342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.627820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.628630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.629005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.766152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:46.777194 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb057c5b-43f4-4cb9-ab7b-0bd65236e080 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1482 microversion: 2.1 time: 0.334917 Jul 25 16:03:46.797690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 124/278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1482 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:46.803070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38cd6900-78bd-4d7b-80b3-13312feae6dd tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:46.806573 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:46.806573 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:46.817190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38cd6900-78bd-4d7b-80b3-13312feae6dd tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:46.817925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38cd6900-78bd-4d7b-80b3-13312feae6dd tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:46.913655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:46.926730 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee8a07fc-eee1-4e72-a3bf-67084137b85e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.311745 Jul 25 16:03:46.929130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 155/279] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:46.971201 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38cd6900-78bd-4d7b-80b3-13312feae6dd tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.172096 Jul 25 16:03:46.971904 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 125/280] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:46 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:46.996249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-087667b3-8cca-49cc-8043-1b83cc0399d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Calling method '.version_select at 0x7f9da01150d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:46.999007 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:46.999007 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:47.000615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-087667b3-8cca-49cc-8043-1b83cc0399d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '9ab7255526d74ae7a03b971eba5306ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4583f3e1db46b1959ce9df4388c151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-087667b3-8cca-49cc-8043-1b83cc0399d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Request method failure captured: Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7fePDKQMTGV5SSioub1i1jLaJRvf1xSa9VYCx4krxDhmFBoHAR78Q2akF0_y0OISzGkYsPazq-yPhzNGs9yD-3hIIH5JtS6H_KC7dLsNfmln88_xW7h5rHvKWz60ZJleM6N2W0MvI-SU0iqbk64IcMHhOA_QWVZ_415olUY8Y0dn0 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:47.002180 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_4c4583f3e1db46b1959ce9df4388c151"}]}] Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9ab7255526d74ae7a03b971eba5306ef Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: action_args: {} Jul 25 16:03:47.003679 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.004656 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 16:03:47.006037 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.007187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-087667b3-8cca-49cc-8043-1b83cc0399d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.007187 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-087667b3-8cca-49cc-8043-1b83cc0399d8 tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.030835 Jul 25 16:03:47.007187 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 126/281] 10.222.0.105 () {58 vars in 1184 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:47.009510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.009717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:47.018252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.018692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.019470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.019897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.143517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0474f572-6f60-4568-b2ff-1720a963522b tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Calling method '.version_select at 0x7f9d93ed3940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.146730 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.146730 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:47.148474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0474f572-6f60-4568-b2ff-1720a963522b tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '98e3dabd752541eaa2dcf78382e3d9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa46f8d76b4191b882ad2d0593514d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0474f572-6f60-4568-b2ff-1720a963522b tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Request method failure captured: Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gHcj7Uhdoxf7TUFAdRijK0hYYi1htlHmaU0Iuv3v8f1fw17TIUshqCkFwxF7Ewf61wNxZPsqBCQ-V_QH_BHYsAIT3wQmIq7foJZo7INSmpLTrGTMBpg3g5ZuRPuzf-UxWUdF0cEm5qHf4YLWkB4pCHBf7JKjSodaXG4wKeRhQTVs Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:47.155041 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_adaa46f8d76b4191b882ad2d0593514d"}]}] Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 98e3dabd752541eaa2dcf78382e3d9f8 Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:03:47.156323 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.157138 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 16:03:47.158180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.162928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0474f572-6f60-4568-b2ff-1720a963522b tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.167340 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0474f572-6f60-4568-b2ff-1720a963522b tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] 10.222.0.105 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.234749 Jul 25 16:03:47.168112 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 156/282] 10.222.0.105 () {58 vars in 1133 bytes} [Mon Jul 25 16:03:46 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:47.180670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6e6a02c-0c45-4757-bb32-af7ee5a9c112 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.184084 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.184084 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:47.223083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6e6a02c-0c45-4757-bb32-af7ee5a9c112 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.051897 Jul 25 16:03:47.231567 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 157/283] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:47 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:47.304747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.315215 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2eb2b37-132e-45e1-b80a-6cb4ea94d183 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.310084 Jul 25 16:03:47.318081 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 127/284] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:47.333587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-722d5420-91e7-4636-94e9-98cf8615397c tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Calling method '.version_select at 0x7f9da0115670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.339279 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.339279 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:47.340678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-722d5420-91e7-4636-94e9-98cf8615397c tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '98e3dabd752541eaa2dcf78382e3d9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa46f8d76b4191b882ad2d0593514d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-722d5420-91e7-4636-94e9-98cf8615397c tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Request method failure captured: Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-hosts/n-d-846219-13/reboot HTTP/1.1 Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7gHcj7Uhdoxf7TUFAdRijK0hYYi1htlHmaU0Iuv3v8f1fw17TIUshqCkFwxF7Ewf61wNxZPsqBCQ-V_QH_BHYsAIT3wQmIq7foJZo7INSmpLTrGTMBpg3g5ZuRPuzf-UxWUdF0cEm5qHf4YLWkB4pCHBf7JKjSodaXG4wKeRhQTVs Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:47.342618 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_adaa46f8d76b4191b882ad2d0593514d"}]}] Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 98e3dabd752541eaa2dcf78382e3d9f8 Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'n-d-846219-13'} Jul 25 16:03:47.344347 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.345223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 16:03:47.346433 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.349450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-722d5420-91e7-4636-94e9-98cf8615397c tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.350484 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-722d5420-91e7-4636-94e9-98cf8615397c tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] 10.222.0.105 "GET /compute/v2.1/os-hosts/n-d-846219-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.030616 Jul 25 16:03:47.351510 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 128/285] 10.222.0.105 () {58 vars in 1196 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/os-hosts/n-d-846219-13/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:47.356103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-523ba625-e45b-45cd-9d26-1ba9e4cd56b7 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-550953015"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:47.359126 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.359126 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:47.360434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-523ba625-e45b-45cd-9d26-1ba9e4cd56b7 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid aa7317ab-d055-47a3-85d4-4891f7da918d for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:47.388940 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-523ba625-e45b-45cd-9d26-1ba9e4cd56b7 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036141 Jul 25 16:03:47.390599 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 129/286] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:47.397198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23997fd7-d5c3-4d33-b781-11c599204ecb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23997fd7-d5c3-4d33-b781-11c599204ecb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action HTTP/1.1 Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 285 Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:47.402129 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:03:47.403497 n-d-846219-13 devstack@n-api.service[119598]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:47.404317 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:47.404985 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:47.407046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:47.408478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:47.408478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.408723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Calling method '.version_select at 0x7f9da2948820>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.408723 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.408723 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:47.408723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.408723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.410849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23997fd7-d5c3-4d33-b781-11c599204ecb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.412062 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23997fd7-d5c3-4d33-b781-11c599204ecb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action" status: 400 len: 619 microversion: 2.1 time: 0.020199 Jul 25 16:03:47.413155 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 130/287] 10.222.0.105 () {60 vars in 1284 bytes} [Mon Jul 25 16:03:47 2022] POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:47.418223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca731f30-9899-4206-a5fb-da8270ab71f8 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Calling method '.version_select at 0x7f9da01ca430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.420301 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.420301 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:47.430063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.430997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.432930 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ca731f30-9899-4206-a5fb-da8270ab71f8 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca731f30-9899-4206-a5fb-da8270ab71f8 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:47.435372 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'nonexistent_hostname'} Jul 25 16:03:47.436670 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:47.437504 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 16:03:47.438699 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:47.439754 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.442434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca731f30-9899-4206-a5fb-da8270ab71f8 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.444318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca731f30-9899-4206-a5fb-da8270ab71f8 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.029825 Jul 25 16:03:47.452434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.453295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.461399 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 131/288] 10.222.0.105 () {58 vars in 1217 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:47.462590 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d33617e9-11d0-4c10-adf2-b49a905f271e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.229224 Jul 25 16:03:47.469708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 158/289] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:47.480889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.483307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:47.494489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.505509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.508404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.509024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.666154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-170552e2-1335-46c4-a9e3-ceeb5145117c tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:47.675027 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.675027 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:47.681215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-170552e2-1335-46c4-a9e3-ceeb5145117c tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'e5bacfa7de0449088728e60d9a2cb307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e899321742088efa0bc3943ccfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-170552e2-1335-46c4-a9e3-ceeb5145117c tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Request method failure captured: Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 40 Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7eOf5M-fWSF7T9uKr1cOnH4tNPJnCk4ul_IeZaMN-MEb8gW4Co8Y1v0-QUWe4g_Ddlyt--qX__QxGXVwFs2E1XHYlV3uJsKvtft0Nmi2xxW_mbwwUcaq2tEtvfRZsRYnuJ8V_Xwd_aI3CHCQyFbVJFycKMHIm1uLYIqdlmizYdgjs Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:47.689955 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5705e899321742088efa0bc3943ccfa1"}]}] Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: e5bacfa7de0449088728e60d9a2cb307 Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: {"add_host": {"host": "n-h2-846219-13"}} Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:47.691533 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-846219-13'}}} Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.692602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 16:03:47.693796 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.694895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-170552e2-1335-46c4-a9e3-ceeb5145117c tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.695525 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-170552e2-1335-46c4-a9e3-ceeb5145117c tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] 10.222.0.105 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.230715 Jul 25 16:03:47.696343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 132/290] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:47 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 234 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:47.704897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.705887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:47.721748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.722921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.725477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:47.727416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:47.784549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.798962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e008128-5f39-43db-9d66-50c241be7a2b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.325105 Jul 25 16:03:47.800707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 159/291] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:47.821299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7690bdf1-fa3a-4acb-9f8e-8c1bde9cc284 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Calling method '.version_select at 0x7f9d93ed3a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.823803 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.823803 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:47.828271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7690bdf1-fa3a-4acb-9f8e-8c1bde9cc284 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '98e3dabd752541eaa2dcf78382e3d9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa46f8d76b4191b882ad2d0593514d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7690bdf1-fa3a-4acb-9f8e-8c1bde9cc284 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Request method failure captured: Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hosts/n-d-846219-13 HTTP/1.1 Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gHcj7Uhdoxf7TUFAdRijK0hYYi1htlHmaU0Iuv3v8f1fw17TIUshqCkFwxF7Ewf61wNxZPsqBCQ-V_QH_BHYsAIT3wQmIq7foJZo7INSmpLTrGTMBpg3g5ZuRPuzf-UxWUdF0cEm5qHf4YLWkB4pCHBf7JKjSodaXG4wKeRhQTVs Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:47.832544 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_adaa46f8d76b4191b882ad2d0593514d"}]}] Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 98e3dabd752541eaa2dcf78382e3d9f8 Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-d-846219-13'} Jul 25 16:03:47.834028 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.834715 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 16:03:47.835754 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.837879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7690bdf1-fa3a-4acb-9f8e-8c1bde9cc284 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.839140 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7690bdf1-fa3a-4acb-9f8e-8c1bde9cc284 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] 10.222.0.105 "GET /compute/v2.1/os-hosts/n-d-846219-13" status: 403 len: 109 microversion: 2.1 time: 0.034955 Jul 25 16:03:47.840163 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 160/292] 10.222.0.105 () {58 vars in 1175 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/os-hosts/n-d-846219-13 => generated 109 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:47.853406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-917fcdcb-4ec5-41bf-86ff-6e1c30f44eeb tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Calling method '.version_select at 0x7f9da016e1f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.858374 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.858374 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:47.861518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-917fcdcb-4ec5-41bf-86ff-6e1c30f44eeb tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '9ab7255526d74ae7a03b971eba5306ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4583f3e1db46b1959ce9df4388c151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-917fcdcb-4ec5-41bf-86ff-6e1c30f44eeb tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Request method failure captured: Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7fePDKQMTGV5SSioub1i1jLaJRvf1xSa9VYCx4krxDhmFBoHAR78Q2akF0_y0OISzGkYsPazq-yPhzNGs9yD-3hIIH5JtS6H_KC7dLsNfmln88_xW7h5rHvKWz60ZJleM6N2W0MvI-SU0iqbk64IcMHhOA_QWVZ_415olUY8Y0dn0 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:47.868808 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_4c4583f3e1db46b1959ce9df4388c151"}]}] Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9ab7255526d74ae7a03b971eba5306ef Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1'} Jul 25 16:03:47.872058 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:47.873700 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 16:03:47.876918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:47.882672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-917fcdcb-4ec5-41bf-86ff-6e1c30f44eeb tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:47.883873 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-917fcdcb-4ec5-41bf-86ff-6e1c30f44eeb tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.042625 Jul 25 16:03:47.884954 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 161/293] 10.222.0.105 () {58 vars in 1178 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:47.894341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b19a780-5f93-4c8b-829e-5933ae5187a2 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:47.895800 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:47.895800 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:47.994235 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b19a780-5f93-4c8b-829e-5933ae5187a2 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.106460 Jul 25 16:03:47.995689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 162/294] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:47 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:48.004334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.005300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:48.026262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.026712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.027503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.029612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.155566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:48.169796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fed230b-5b3e-4dde-8a91-90bb49403cac tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.471077 Jul 25 16:03:48.171458 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 133/295] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:48.191357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.194277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:48.210461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.210988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.220841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.221913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.538816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:48.548797 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b04a6ccf-1eb3-48dd-b7d4-ca131ef71616 tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1482 microversion: 2.1 time: 0.551723 Jul 25 16:03:48.563394 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 163/296] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:47 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1482 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:48.570059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d564edd-708f-4f6e-a5e4-4eae9d93b10f tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Calling method '.version_select at 0x7f9d93ee3820>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.571289 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.571289 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.577820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-5d564edd-708f-4f6e-a5e4-4eae9d93b10f tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d564edd-708f-4f6e-a5e4-4eae9d93b10f tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:48.580779 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'nonexistent_hostname'} Jul 25 16:03:48.582096 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.582883 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.583994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.586684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d564edd-708f-4f6e-a5e4-4eae9d93b10f tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:48.587805 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d564edd-708f-4f6e-a5e4-4eae9d93b10f tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023163 Jul 25 16:03:48.588604 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 164/297] 10.222.0.105 () {58 vars in 1196 bytes} [Mon Jul 25 16:03:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:48.596182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f5c002b-0d88-4060-a272-7597ad2e605d tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Calling method '.version_select at 0x7f9da016e430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.597240 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.597240 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.598512 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0f5c002b-0d88-4060-a272-7597ad2e605d tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] HTTP exception thrown: Hypervisor with ID '0ef9ab6d-758a-4fe7-9aa1-840479e193d1' could not be found. Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f5c002b-0d88-4060-a272-7597ad2e605d tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Request method failure captured: Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/0ef9ab6d-758a-4fe7-9aa1-840479e193d1/uptime HTTP/1.1 Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7hyTrEy5RqooB730lTyCWZ_JvDBhMQGWIvZVCRshpTomQ_gr0iqCH6pWYEjIdTHBqtNv7xOQtSwckIf2LwSQnaK-PRamMK7AbnlQhC4jrGaNtza2ACqqsq6Rs18Wvg_oPQHVP2ggFlkrcCR3TQIZyN34dvkc5jWRV4JRnCJlM6cjM Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f79583438f8e42e896909dd0b90d442d Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1568108253 Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:48.611640 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f79583438f8e42e896909dd0b90d442d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f79583438f8e42e896909dd0b90d442d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f79583438f8e42e896909dd0b90d442d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f79583438f8e42e896909dd0b90d442d"}]}] Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1568108253 Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f79583438f8e42e896909dd0b90d442d Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1568108253 Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 3ae78ee9fdad434c984a5efecb771bf6 Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: exception: Hypervisor with ID '0ef9ab6d-758a-4fe7-9aa1-840479e193d1' could not be found. Jul 25 16:03:48.612996 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0ef9ab6d-758a-4fe7-9aa1-840479e193d1'} Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0ef9ab6d-758a-4fe7-9aa1-840479e193d1' Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 16:03:48.613891 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0ef9ab6d-758a-4fe7-9aa1-840479e193d1' could not be found. Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.615133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0ef9ab6d-758a-4fe7-9aa1-840479e193d1' could not be found. Jul 25 16:03:48.616282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.620292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f5c002b-0d88-4060-a272-7597ad2e605d tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Returning 404 to user: Hypervisor with ID '0ef9ab6d-758a-4fe7-9aa1-840479e193d1' could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:48.621500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0f5c002b-0d88-4060-a272-7597ad2e605d tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/0ef9ab6d-758a-4fe7-9aa1-840479e193d1/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031636 Jul 25 16:03:48.622686 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 165/298] 10.222.0.105 () {58 vars in 1283 bytes} [Mon Jul 25 16:03:48 2022] GET /compute/v2.1/os-hypervisors/0ef9ab6d-758a-4fe7-9aa1-840479e193d1/uptime => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:48.639758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a791fd8e-12fc-4557-8a55-9d38677a6e4e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2037269822"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:48.644338 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.644338 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.645515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-a791fd8e-12fc-4557-8a55-9d38677a6e4e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 06ea46cd-5e51-4533-9f27-580838ec1c1d for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:48.677015 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a791fd8e-12fc-4557-8a55-9d38677a6e4e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052637 Jul 25 16:03:48.679602 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 166/299] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:48 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:48.685402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bb42656-6d58-4629-99ce-dc792b2e49c2 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Calling method '.version_select at 0x7f9d93ed3ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.687814 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.687814 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.690630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7bb42656-6d58-4629-99ce-dc792b2e49c2 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '98e3dabd752541eaa2dcf78382e3d9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa46f8d76b4191b882ad2d0593514d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bb42656-6d58-4629-99ce-dc792b2e49c2 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Request method failure captured: Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hosts/n-d-846219-13/shutdown HTTP/1.1 Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gHcj7Uhdoxf7TUFAdRijK0hYYi1htlHmaU0Iuv3v8f1fw17TIUshqCkFwxF7Ewf61wNxZPsqBCQ-V_QH_BHYsAIT3wQmIq7foJZo7INSmpLTrGTMBpg3g5ZuRPuzf-UxWUdF0cEm5qHf4YLWkB4pCHBf7JKjSodaXG4wKeRhQTVs Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:48.693129 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_adaa46f8d76b4191b882ad2d0593514d"}]}] Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 98e3dabd752541eaa2dcf78382e3d9f8 Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-d-846219-13'} Jul 25 16:03:48.694621 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:48.695490 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 16:03:48.696727 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.700558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bb42656-6d58-4629-99ce-dc792b2e49c2 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:48.702072 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7bb42656-6d58-4629-99ce-dc792b2e49c2 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] 10.222.0.105 "GET /compute/v2.1/os-hosts/n-d-846219-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020746 Jul 25 16:03:48.708049 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 167/300] 10.222.0.105 () {58 vars in 1202 bytes} [Mon Jul 25 16:03:48 2022] GET /compute/v2.1/os-hosts/n-d-846219-13/shutdown => generated 113 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:48.719582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Calling method '.version_select at 0x7f9da028d1f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.720945 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.720945 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.723146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.724155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.759834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.760338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.802820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.804623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.814419 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac8f1738-4dc4-4094-b6de-feffe1cc809e tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.103820 Jul 25 16:03:48.815570 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 168/301] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:03:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:48.827195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-994789499"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:48.835449 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.835449 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.853071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.853631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.862066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=19 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:48.867257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.867688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.870653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:48.881948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-994789499 could not be found. Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 57 Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:48.891914 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: {"add_host": {"host": "tempest-nonexist_host-994789499"}} Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:48.893268 n-d-846219-13 devstack@n-api.service[119599]: exception: Compute host tempest-nonexist_host-994789499 could not be found. Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-994789499'}}} Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-994789499' is not mapped to any cell Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.893965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 25 16:03:48.894995 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-994789499 could not be found. Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-994789499 could not be found. Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.897200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-994789499 could not be found. Jul 25 16:03:48.905380 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.906454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:48.918266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-994789499 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:48.918932 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-261a8ca6-d92c-4383-82c1-6d36bfb60274 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.744747 Jul 25 16:03:48.922987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9cc56cef-0fc4-4404-a993-67fe071d48b4 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.105069 Jul 25 16:03:48.923574 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 169/302] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:48 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:48.940206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 134/303] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:48 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:48.949785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ea7cf89a-50b7-4b02-87e9-e615f27fd336 req-bf869947-b555-420f-9f3f-0267dbb11c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6404f1c-c16a-4b83-9c7e-8f3c5bd35885", "tag": "d26ef8ae-6043-4985-9a90-517f4b7c2015"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:48.952065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-289a596c-6f60-490d-87ab-f5921a9d4a64 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Calling method '.version_select at 0x7f9d93ed3ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:48.952980 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:48.952980 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:48.963611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:48.965438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ea7cf89a-50b7-4b02-87e9-e615f27fd336 req-bf869947-b555-420f-9f3f-0267dbb11c0f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:48.969250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ea7cf89a-50b7-4b02-87e9-e615f27fd336 req-bf869947-b555-420f-9f3f-0267dbb11c0f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:48.983966 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-289a596c-6f60-490d-87ab-f5921a9d4a64 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-289a596c-6f60-490d-87ab-f5921a9d4a64 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:48.989195 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'nonexistent_hostname'} Jul 25 16:03:48.990487 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:48.991230 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 16:03:48.992248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:48.994190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.001954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-289a596c-6f60-490d-87ab-f5921a9d4a64 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.006130 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-289a596c-6f60-490d-87ab-f5921a9d4a64 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.071312 Jul 25 16:03:49.007496 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 170/304] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:03:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:49.013827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ea7cf89a-50b7-4b02-87e9-e615f27fd336 req-bf869947-b555-420f-9f3f-0267dbb11c0f service nova] Creating event network-changed:d26ef8ae-6043-4985-9a90-517f4b7c2015 for instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 on n-h2-846219-13 Jul 25 16:03:49.025284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da744af9-49df-4b10-9958-09a302a2082e tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Calling method '.version_select at 0x7f9d93ee9430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.030124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ea7cf89a-50b7-4b02-87e9-e615f27fd336 req-bf869947-b555-420f-9f3f-0267dbb11c0f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088320 Jul 25 16:03:49.030672 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:49.030672 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:49.032335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da744af9-49df-4b10-9958-09a302a2082e tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '9ab7255526d74ae7a03b971eba5306ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4583f3e1db46b1959ce9df4388c151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:49.044272 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 135/305] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da744af9-49df-4b10-9958-09a302a2082e tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Request method failure captured: Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7fePDKQMTGV5SSioub1i1jLaJRvf1xSa9VYCx4krxDhmFBoHAR78Q2akF0_y0OISzGkYsPazq-yPhzNGs9yD-3hIIH5JtS6H_KC7dLsNfmln88_xW7h5rHvKWz60ZJleM6N2W0MvI-SU0iqbk64IcMHhOA_QWVZ_415olUY8Y0dn0 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:49.051878 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/4c4583f3e1db46b1959ce9df4388c151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_4c4583f3e1db46b1959ce9df4388c151"}]}] Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 4c4583f3e1db46b1959ce9df4388c151 Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541 Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9ab7255526d74ae7a03b971eba5306ef Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1127638541-project Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1'} Jul 25 16:03:49.053266 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:49.053971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 16:03:49.055007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.055994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da744af9-49df-4b10-9958-09a302a2082e tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.055994 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da744af9-49df-4b10-9958-09a302a2082e tempest-HypervisorAdminNegativeTestJSON-1127638541 tempest-HypervisorAdminNegativeTestJSON-1127638541-project] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.044014 Jul 25 16:03:49.061474 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 171/306] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:49.064480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-76471a90-82fa-407f-beff-10efea7de766 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.065576 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:49.065576 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:49.071674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1289291567"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.079221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:49.092206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.093657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.095522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.096918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.105343 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-76471a90-82fa-407f-beff-10efea7de766 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.059808 Jul 25 16:03:49.111499 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 136/307] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:49.127160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdbb3f03-b647-4f14-bd18-fe4b9bfad6cc tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Calling method '.version_select at 0x7f9da0115310>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.128341 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:49.128341 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:49.130272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fdbb3f03-b647-4f14-bd18-fe4b9bfad6cc tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '98e3dabd752541eaa2dcf78382e3d9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa46f8d76b4191b882ad2d0593514d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdbb3f03-b647-4f14-bd18-fe4b9bfad6cc tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Request method failure captured: Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-hosts/n-d-846219-13/startup HTTP/1.1 Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7gHcj7Uhdoxf7TUFAdRijK0hYYi1htlHmaU0Iuv3v8f1fw17TIUshqCkFwxF7Ewf61wNxZPsqBCQ-V_QH_BHYsAIT3wQmIq7foJZo7INSmpLTrGTMBpg3g5ZuRPuzf-UxWUdF0cEm5qHf4YLWkB4pCHBf7JKjSodaXG4wKeRhQTVs Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:49.132340 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_adaa46f8d76b4191b882ad2d0593514d"}]}] Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 98e3dabd752541eaa2dcf78382e3d9f8 Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'n-d-846219-13'} Jul 25 16:03:49.133685 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:49.134428 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 16:03:49.135418 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.138206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdbb3f03-b647-4f14-bd18-fe4b9bfad6cc tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.139290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fdbb3f03-b647-4f14-bd18-fe4b9bfad6cc tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] 10.222.0.105 "GET /compute/v2.1/os-hosts/n-d-846219-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.026508 Jul 25 16:03:49.140392 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 137/308] 10.222.0.105 () {58 vars in 1199 bytes} [Mon Jul 25 16:03:49 2022] GET /compute/v2.1/os-hosts/n-d-846219-13/startup => generated 110 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:49.146113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50233292-225c-4ecf-8bed-525fb7d08817 tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Calling method '.version_select at 0x7f9da011faf0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.147634 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:49.147634 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:49.149777 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-50233292-225c-4ecf-8bed-525fb7d08817 tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] HTTP exception thrown: Hypervisor with ID '95c56441-8b5c-4042-83eb-6eb5f0adc7b1' could not be found. Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50233292-225c-4ecf-8bed-525fb7d08817 tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Request method failure captured: Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-hypervisors/95c56441-8b5c-4042-83eb-6eb5f0adc7b1 HTTP/1.1 Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7hyTrEy5RqooB730lTyCWZ_JvDBhMQGWIvZVCRshpTomQ_gr0iqCH6pWYEjIdTHBqtNv7xOQtSwckIf2LwSQnaK-PRamMK7AbnlQhC4jrGaNtza2ACqqsq6Rs18Wvg_oPQHVP2ggFlkrcCR3TQIZyN34dvkc5jWRV4JRnCJlM6cjM Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f79583438f8e42e896909dd0b90d442d Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1568108253 Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:49.152536 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f79583438f8e42e896909dd0b90d442d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f79583438f8e42e896909dd0b90d442d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f79583438f8e42e896909dd0b90d442d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f79583438f8e42e896909dd0b90d442d"}]}] Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1568108253 Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f79583438f8e42e896909dd0b90d442d Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1568108253 Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 3ae78ee9fdad434c984a5efecb771bf6 Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: exception: Hypervisor with ID '95c56441-8b5c-4042-83eb-6eb5f0adc7b1' could not be found. Jul 25 16:03:49.153759 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '95c56441-8b5c-4042-83eb-6eb5f0adc7b1'} Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '95c56441-8b5c-4042-83eb-6eb5f0adc7b1' Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 16:03:49.154438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:03:49.155560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '95c56441-8b5c-4042-83eb-6eb5f0adc7b1' could not be found. Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '95c56441-8b5c-4042-83eb-6eb5f0adc7b1' could not be found. Jul 25 16:03:49.157054 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.160385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50233292-225c-4ecf-8bed-525fb7d08817 tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] Returning 404 to user: Hypervisor with ID '95c56441-8b5c-4042-83eb-6eb5f0adc7b1' could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.161793 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-50233292-225c-4ecf-8bed-525fb7d08817 tempest-HypervisorAdminNegativeTestJSON-1568108253 tempest-HypervisorAdminNegativeTestJSON-1568108253-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/95c56441-8b5c-4042-83eb-6eb5f0adc7b1" status: 404 len: 123 microversion: 2.1 time: 0.019937 Jul 25 16:03:49.162933 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 138/309] 10.222.0.105 () {58 vars in 1262 bytes} [Mon Jul 25 16:03:49 2022] GET /compute/v2.1/os-hypervisors/95c56441-8b5c-4042-83eb-6eb5f0adc7b1 => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:49.167986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3949bbbf-956f-4d2c-8182-016ef3aa5e2b tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3949bbbf-956f-4d2c-8182-016ef3aa5e2b tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 283 Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:49.174243 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:49.175541 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:49.176718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.177506 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.178424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.179336 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:49.179336 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:49.179336 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:03:49.179336 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.182498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3949bbbf-956f-4d2c-8182-016ef3aa5e2b tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.183433 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3949bbbf-956f-4d2c-8182-016ef3aa5e2b tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.019313 Jul 25 16:03:49.184027 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 139/310] 10.222.0.105 () {60 vars in 1170 bytes} [Mon Jul 25 16:03:49 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:49.189267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1582b565-d14e-4509-9e24-6f8dec4c3349 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Calling method '.version_select at 0x7f9da01ca5e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.200994 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-1582b565-d14e-4509-9e24-6f8dec4c3349 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1582b565-d14e-4509-9e24-6f8dec4c3349 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:49.203154 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'nonexistent_hostname'} Jul 25 16:03:49.204378 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:49.205074 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 16:03:49.207101 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:49.208215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.209407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1582b565-d14e-4509-9e24-6f8dec4c3349 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.218642 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1582b565-d14e-4509-9e24-6f8dec4c3349 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.026299 Jul 25 16:03:49.218642 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 140/311] 10.222.0.105 () {58 vars in 1220 bytes} [Mon Jul 25 16:03:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:49.235685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.239816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:49.254985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.255676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.259396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.260279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.480749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-758a2601-59b9-4d33-bdd1-5a8d029e6312 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action" status: 202 len: 0 microversion: 2.1 time: 0.415531 Jul 25 16:03:49.481471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 172/312] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:03:49 2022] POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:03:49.496974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3421e7e5-4c3a-4239-8276-a80652bb7abb tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3421e7e5-4c3a-4239-8276-a80652bb7abb tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 27 Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:49.506808 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: {"aggregate": {"name": ""}} Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:49.508031 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '' Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.508766 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:03:49.510035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.511112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3421e7e5-4c3a-4239-8276-a80652bb7abb tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.511112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3421e7e5-4c3a-4239-8276-a80652bb7abb tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.024352 Jul 25 16:03:49.515557 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 173/313] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:49 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:49.521759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c13a03ba-5556-4dd4-bf0c-046f4605e26c tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Action: 'update', calling method: .version_select at 0x7f9da0634ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c13a03ba-5556-4dd4-bf0c-046f4605e26c tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-hosts/n-d-846219-13 HTTP/1.1 Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 51 Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:49.529322 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: {"status": "enable", "maintenance_mode": "invalid"} Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:49.530763 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-d-846219-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance: Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.531633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.533089 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c13a03ba-5556-4dd4-bf0c-046f4605e26c tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c13a03ba-5556-4dd4-bf0c-046f4605e26c tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-hosts/n-d-846219-13" status: 400 len: 199 microversion: 2.1 time: 0.014360 Jul 25 16:03:49.534847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 174/314] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 16:03:49 2022] PUT /compute/v2.1/os-hosts/n-d-846219-13 => generated 199 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:49.539834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-818075660"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.542488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:49.553687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.554134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.554914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.555347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.604811 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Cannot 'createImage' instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 while it is in task_state image_snapshot_pending Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action HTTP/1.1 Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 84 Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:49.607749 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-818075660"}} Jul 25 16:03:49.609209 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'createImage' instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 while it is in task_state image_snapshot_pending Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-818075660'}}} Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.610103 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 while it is in task_state image_snapshot_pending Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 while it is in task_state image_snapshot_pending Jul 25 16:03:49.611126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.614205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 409 to user: Cannot 'createImage' instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 while it is in task_state image_snapshot_pending {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.614205 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13f52535-067d-4858-9e41-b9e56e251ad2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action" status: 409 len: 167 microversion: 2.1 time: 0.076440 Jul 25 16:03:49.616464 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 175/315] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:03:49 2022] POST /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961/action => generated 167 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:49.624687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab09233-67a7-47c2-8c8a-7dec90e4e7f2 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-237380190"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.637981 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:49.637981 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:49.639462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1ab09233-67a7-47c2-8c8a-7dec90e4e7f2 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'e5bacfa7de0449088728e60d9a2cb307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e899321742088efa0bc3943ccfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab09233-67a7-47c2-8c8a-7dec90e4e7f2 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Request method failure captured: Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 59 Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7eOf5M-fWSF7T9uKr1cOnH4tNPJnCk4ul_IeZaMN-MEb8gW4Co8Y1v0-QUWe4g_Ddlyt--qX__QxGXVwFs2E1XHYlV3uJsKvtft0Nmi2xxW_mbwwUcaq2tEtvfRZsRYnuJ8V_Xwd_aI3CHCQyFbVJFycKMHIm1uLYIqdlmizYdgjs Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:49.642999 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5705e899321742088efa0bc3943ccfa1"}]}] Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e5bacfa7de0449088728e60d9a2cb307 Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: {"aggregate": {"name": "tempest-test_aggregate-237380190"}} Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:49.644360 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-237380190'}}} Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:49.645074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:49.646578 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 16:03:49.647621 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.648905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab09233-67a7-47c2-8c8a-7dec90e4e7f2 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.650000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ab09233-67a7-47c2-8c8a-7dec90e4e7f2 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032441 Jul 25 16:03:49.652580 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 176/316] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:49 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:49.662330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c85333dc-47da-4f84-babe-7aa52f2bb1c6 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Action: 'update', calling method: .version_select at 0x7f9da0138d30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c85333dc-47da-4f84-babe-7aa52f2bb1c6 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-hosts/n-d-846219-13 HTTP/1.1 Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 51 Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:49.668390 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: {"status": "invalid", "maintenance_mode": "enable"} Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:49.669683 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-d-846219-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance: Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.670428 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:49.671730 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:49.676159 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:49.676159 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:49.676159 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:49.676159 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 16:03:49.676159 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:49.680980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c85333dc-47da-4f84-babe-7aa52f2bb1c6 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:49.682212 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c85333dc-47da-4f84-babe-7aa52f2bb1c6 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-hosts/n-d-846219-13" status: 400 len: 189 microversion: 2.1 time: 0.028252 Jul 25 16:03:49.685226 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 177/317] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 16:03:49 2022] PUT /compute/v2.1/os-hosts/n-d-846219-13 => generated 189 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:49.694153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:49.695240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:49.705614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.706375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.707396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:49.708545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:49.976257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:49.984506 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03f2c3f8-d7ee-4249-966d-842c8806df74 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.770192 Jul 25 16:03:49.998114 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 141/318] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:49 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:50.005218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-01c5a406-466f-47d1-a9f7-cf47cceb4158 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '.version_select at 0x7f9da0161af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.284909 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-01c5a406-466f-47d1-a9f7-cf47cceb4158 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/images/2ee085bd-f93a-4be5-a797-c770ee4438bc" status: 204 len: 0 microversion: 2.1 time: 0.285326 Jul 25 16:03:50.285607 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 142/319] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:49 2022] DELETE /compute/v2.1/images/2ee085bd-f93a-4be5-a797-c770ee4438bc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:03:50.290716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cdb13443-2511-4808-9f77-ba0f7f5a6d36 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073064037"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.296868 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.296868 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:50.298521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-cdb13443-2511-4808-9f77-ba0f7f5a6d36 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 245f40e1-6b77-45cb-87f0-fbcc6511c6c6 for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:50.302431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029d1b74748a45a7aac98e73d7f89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c79a32ab54379a23d47dbae32fd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:50.331426 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-343174eb-b34b-4fa4-9d22-8c9c5159ec7b tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 200 len: 1482 microversion: 2.1 time: 0.644439 Jul 25 16:03:50.332440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 178/320] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:49 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 1482 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:50.341204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88a9ded9-bcbf-4f74-8ed2-ae6d16b4fa00 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Action: 'update', calling method: .version_select at 0x7f9d93e98430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.352841 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cdb13443-2511-4808-9f77-ba0f7f5a6d36 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065871 Jul 25 16:03:50.353618 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 143/321] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:50.357746 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.357746 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.359012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-88a9ded9-bcbf-4f74-8ed2-ae6d16b4fa00 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '98e3dabd752541eaa2dcf78382e3d9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa46f8d76b4191b882ad2d0593514d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:50.359697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.360806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88a9ded9-bcbf-4f74-8ed2-ae6d16b4fa00 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Request method failure captured: Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-hosts/n-d-846219-13 HTTP/1.1 Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 50 Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gHcj7Uhdoxf7TUFAdRijK0hYYi1htlHmaU0Iuv3v8f1fw17TIUshqCkFwxF7Ewf61wNxZPsqBCQ-V_QH_BHYsAIT3wQmIq7foJZo7INSmpLTrGTMBpg3g5ZuRPuzf-UxWUdF0cEm5qHf4YLWkB4pCHBf7JKjSodaXG4wKeRhQTVs Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:50.366662 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/adaa46f8d76b4191b882ad2d0593514d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_adaa46f8d76b4191b882ad2d0593514d"}]}] Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: adaa46f8d76b4191b882ad2d0593514d Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260778601 Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 98e3dabd752541eaa2dcf78382e3d9f8 Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260778601-project Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 16:03:50.368015 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-d-846219-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.368815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 16:03:50.374798 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.375865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88a9ded9-bcbf-4f74-8ed2-ae6d16b4fa00 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.375865 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-88a9ded9-bcbf-4f74-8ed2-ae6d16b4fa00 tempest-HostsAdminNegativeTestJSON-1260778601 tempest-HostsAdminNegativeTestJSON-1260778601-project] 10.222.0.105 "PUT /compute/v2.1/os-hosts/n-d-846219-13" status: 403 len: 111 microversion: 2.1 time: 0.031983 Jul 25 16:03:50.376009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:50.376108 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 179/322] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 16:03:50 2022] PUT /compute/v2.1/os-hosts/n-d-846219-13 => generated 111 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:50.376184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:50.376184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:50.376184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:50.381558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82a3141e-27e4-46fa-bc59-5ccabd60a54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073064037"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.384398 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.384398 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.390778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-82a3141e-27e4-46fa-bc59-5ccabd60a54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 1e6c8b3f-1042-4b10-a926-5e89ade52cc4 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:50.418650 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-82a3141e-27e4-46fa-bc59-5ccabd60a54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2073064037 already exists. Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82a3141e-27e4-46fa-bc59-5ccabd60a54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 60 Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:50.423956 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: {"aggregate": {"name": "tempest-test_aggregate-2073064037"}} Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:50.425511 n-d-846219-13 devstack@n-api.service[119599]: exception: Aggregate tempest-test_aggregate-2073064037 already exists. Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2073064037'}}} Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 25 16:03:50.426344 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2073064037 already exists. Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:50.427463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2073064037 already exists. Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2073064037 already exists. Jul 25 16:03:50.428610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.431415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82a3141e-27e4-46fa-bc59-5ccabd60a54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2073064037 already exists. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.433169 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82a3141e-27e4-46fa-bc59-5ccabd60a54e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.061456 Jul 25 16:03:50.434546 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 180/323] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:50 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:50.442540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83c79952-ac41-4075-abf8-a853cf3f479a tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Action: 'update', calling method: .version_select at 0x7f9d93e603a0>, body: {"status": null, "maintenance_mode": null} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83c79952-ac41-4075-abf8-a853cf3f479a tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-hosts/n-d-846219-13 HTTP/1.1 Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 42 Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:50.449389 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: {"status": null, "maintenance_mode": null} Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 16:03:50.450910 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'n-d-846219-13', 'body': {'status': None, 'maintenance_mode': None}} Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance: Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi None Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.451778 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.454074 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.455372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:03:50.455372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:03:50.455372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 16:03:50.455372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.470161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83c79952-ac41-4075-abf8-a853cf3f479a tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.473321 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-83c79952-ac41-4075-abf8-a853cf3f479a tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-hosts/n-d-846219-13" status: 400 len: 127 microversion: 2.1 time: 0.036575 Jul 25 16:03:50.475087 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 181/324] 10.222.0.105 () {60 vars in 1195 bytes} [Mon Jul 25 16:03:50 2022] PUT /compute/v2.1/os-hosts/n-d-846219-13 => generated 127 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:03:50.481506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b2001eab-92e3-433e-b1e2-e1361a6280d5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.488012 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.488012 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.519536 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b2001eab-92e3-433e-b1e2-e1361a6280d5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.043018 Jul 25 16:03:50.520808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 182/325] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:50 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:50.529116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eab545e2-d251-4b5f-97e7-21745c4a9008 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Action: 'update', calling method: .version_select at 0x7f9d93e98430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.532953 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.532953 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.534121 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.hosts [None req-eab545e2-d251-4b5f-97e7-21745c4a9008 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Enabling host nonexistent_hostname. Jul 25 16:03:50.545734 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-eab545e2-d251-4b5f-97e7-21745c4a9008 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eab545e2-d251-4b5f-97e7-21745c4a9008 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Request method failure captured: Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 50 Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7i74u1qejXBB3funrz7C26u2NlXTlA5DW-riykwT1FIWHzpGpKWEWHBWwFobr3aopNjnza6Qt69Y9TtZFJerkrWZwMQtY5HkFVZLe569MTb8vruKWuwsd1BUVV7aeh3oay3_NkpNEeu1bVSx3dVb25qyw0d8d_Ybzh5UNiEHJ-vOI Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:50.549606 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8387479e5c149ec8ab9bd5400a152db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8387479e5c149ec8ab9bd5400a152db"}]}] Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8387479e5c149ec8ab9bd5400a152db Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-796206247 Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 5d6352863c724763b2b8b1dd16d8157b Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-HostsAdminNegativeTestJSON-796206247-project-admin Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:50.550887 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:50.551671 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:50.552669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.556085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eab545e2-d251-4b5f-97e7-21745c4a9008 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.558218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eab545e2-d251-4b5f-97e7-21745c4a9008 tempest-HostsAdminNegativeTestJSON-796206247 tempest-HostsAdminNegativeTestJSON-796206247-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029770 Jul 25 16:03:50.558218 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 183/326] 10.222.0.105 () {60 vars in 1216 bytes} [Mon Jul 25 16:03:50 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:50.563901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bebcae6c-e600-46e3-858b-86e60f1fb43d tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2132063785"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.567038 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.567038 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.568272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-bebcae6c-e600-46e3-858b-86e60f1fb43d tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 8884533a-d718-4f1e-9959-59e3ba7aeef7 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:50.606050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bebcae6c-e600-46e3-858b-86e60f1fb43d tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046133 Jul 25 16:03:50.607772 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 184/327] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:50.620647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5b003b08-bf53-4191-bf68-38d97ed43c9b tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.621958 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.621958 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.623490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5b003b08-bf53-4191-bf68-38d97ed43c9b tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'e5bacfa7de0449088728e60d9a2cb307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e899321742088efa0bc3943ccfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5b003b08-bf53-4191-bf68-38d97ed43c9b tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Request method failure captured: Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7eOf5M-fWSF7T9uKr1cOnH4tNPJnCk4ul_IeZaMN-MEb8gW4Co8Y1v0-QUWe4g_Ddlyt--qX__QxGXVwFs2E1XHYlV3uJsKvtft0Nmi2xxW_mbwwUcaq2tEtvfRZsRYnuJ8V_Xwd_aI3CHCQyFbVJFycKMHIm1uLYIqdlmizYdgjs Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:50.625710 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5705e899321742088efa0bc3943ccfa1"}]}] Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e5bacfa7de0449088728e60d9a2cb307 Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 16:03:50.626921 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '15'} Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.627589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 16:03:50.628819 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.637797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5b003b08-bf53-4191-bf68-38d97ed43c9b tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.639170 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5b003b08-bf53-4191-bf68-38d97ed43c9b tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.024657 Jul 25 16:03:50.640871 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 185/328] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:50.654782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65c98be0-fe70-4278-9b9a-4f674cfe6a7f tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.730710 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65c98be0-fe70-4278-9b9a-4f674cfe6a7f tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.085531 Jul 25 16:03:50.740608 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 186/329] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 16:03:50.746191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6f99d43-57dd-4b36-9e95-0ebff720c137 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.754282 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.754282 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.771847 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f6f99d43-57dd-4b36-9e95-0ebff720c137 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6f99d43-57dd-4b36-9e95-0ebff720c137 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:50.774057 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: exception: Aggregate -1 could not be found. Jul 25 16:03:50.775611 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '-1'} Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 16:03:50.776295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.777417 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6f99d43-57dd-4b36-9e95-0ebff720c137 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6f99d43-57dd-4b36-9e95-0ebff720c137 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032943 Jul 25 16:03:50.778627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 187/330] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:50 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:50.789391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41cb0355-ce7f-4528-abab-182118958655 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1757584805"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:50.792076 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.792076 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.796100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-41cb0355-ce7f-4528-abab-182118958655 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 225422ec-e946-4222-998a-c535c031f79a for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:50.819146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:50.843453 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e472577e-a672-45e9-947c-77379a703a07 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1538 microversion: 2.1 time: 0.488448 Jul 25 16:03:50.844010 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41cb0355-ce7f-4528-abab-182118958655 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058381 Jul 25 16:03:50.845422 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 144/331] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:50 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1538 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:50.852701 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 188/332] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:50.866354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4732f33a-496e-4827-9c02-f601b3a1a3f7 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.867172 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.867172 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:50.868502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4732f33a-496e-4827-9c02-f601b3a1a3f7 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'e5bacfa7de0449088728e60d9a2cb307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e899321742088efa0bc3943ccfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4732f33a-496e-4827-9c02-f601b3a1a3f7 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Request method failure captured: Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7eOf5M-fWSF7T9uKr1cOnH4tNPJnCk4ul_IeZaMN-MEb8gW4Co8Y1v0-QUWe4g_Ddlyt--qX__QxGXVwFs2E1XHYlV3uJsKvtft0Nmi2xxW_mbwwUcaq2tEtvfRZsRYnuJ8V_Xwd_aI3CHCQyFbVJFycKMHIm1uLYIqdlmizYdgjs Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:50.870391 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5705e899321742088efa0bc3943ccfa1"}]}] Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: e5bacfa7de0449088728e60d9a2cb307 Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 16:03:50.871592 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '16'} Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.872259 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 16:03:50.873602 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.876006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4732f33a-496e-4827-9c02-f601b3a1a3f7 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.877053 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4732f33a-496e-4827-9c02-f601b3a1a3f7 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] 10.222.0.105 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015351 Jul 25 16:03:50.878203 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 145/333] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:50 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:50.890793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-084662dc-043c-403c-a60f-65ca51a14391 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.894250 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.894250 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.943432 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-084662dc-043c-403c-a60f-65ca51a14391 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.058937 Jul 25 16:03:50.946272 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 189/334] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:50 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:50.954052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c351a36-5986-444b-a574-3eb5a2cd18f5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.959303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:50.968920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9c351a36-5986-444b-a574-3eb5a2cd18f5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c351a36-5986-444b-a574-3eb5a2cd18f5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:03:50.975444 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: exception: Aggregate -1 could not be found. Jul 25 16:03:50.981997 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '-1'} Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.982664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 16:03:50.983747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.984852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c351a36-5986-444b-a574-3eb5a2cd18f5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.984852 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c351a36-5986-444b-a574-3eb5a2cd18f5 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027045 Jul 25 16:03:50.987231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2066f393-d749-4575-8292-f306358cab82 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:50.988494 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:50.988494 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:50.990063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2066f393-d749-4575-8292-f306358cab82 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'e5bacfa7de0449088728e60d9a2cb307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e899321742088efa0bc3943ccfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2066f393-d749-4575-8292-f306358cab82 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Request method failure captured: Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7eOf5M-fWSF7T9uKr1cOnH4tNPJnCk4ul_IeZaMN-MEb8gW4Co8Y1v0-QUWe4g_Ddlyt--qX__QxGXVwFs2E1XHYlV3uJsKvtft0Nmi2xxW_mbwwUcaq2tEtvfRZsRYnuJ8V_Xwd_aI3CHCQyFbVJFycKMHIm1uLYIqdlmizYdgjs Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:50.991914 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5705e899321742088efa0bc3943ccfa1"}]}] Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e5bacfa7de0449088728e60d9a2cb307 Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 16:03:50.993087 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:50.993890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 16:03:50.994920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:50.997999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2066f393-d749-4575-8292-f306358cab82 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:50.998478 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 146/335] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:03:50 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:51.003024 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2066f393-d749-4575-8292-f306358cab82 tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] 10.222.0.105 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020005 Jul 25 16:03:51.004195 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 190/336] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:03:50 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:51.020243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88791b4e-2a9b-4c97-b73b-a0f72f585b9e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1349280320"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:51.022289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:51.028819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:51.050339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.050766 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:51.050766 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:51.052936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-88791b4e-2a9b-4c97-b73b-a0f72f585b9e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid c8d67d5a-8d10-44ea-ab98-8e95122edf3c for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:51.055017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.055866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.056300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.120088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-88791b4e-2a9b-4c97-b73b-a0f72f585b9e tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.106669 Jul 25 16:03:51.122569 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 191/337] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:51.133359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fcf4ec3d-3a3e-45de-aee6-101e334064cf tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:51.144704 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:51.144704 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:51.173526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcf4ec3d-3a3e-45de-aee6-101e334064cf tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.174570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcf4ec3d-3a3e-45de-aee6-101e334064cf tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.462373 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fcf4ec3d-3a3e-45de-aee6-101e334064cf tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.333407 Jul 25 16:03:51.470336 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 192/338] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:51 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:51.474282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:51.475039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] [instance: b3482326-8c40-4c1d-870e-47cb4e38b790] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:51.484836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.486621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.487548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.489032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.524769 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] HTTP exception thrown: Instance b3482326-8c40-4c1d-870e-47cb4e38b790 could not be found. Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Request method failure captured: Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 HTTP/1.1 Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7HTRU4aFVkuaa_Bt03hXRWJdjEHJT0R9H1VWdBQ6c4y-ER66TiNfllz45Q73M73TBq0-8L5SB-dzv8c19kn2kG5XOeUx-hkJDaUlH-XPgyJ2f_4KQXnPakdIut9-PTNggp_G86v01o22wf2F4n42Zg-K1EAmPil8OlENgru9myCrY Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bc2c79a32ab54379a23d47dbae32fd63 Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1600778819 Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:51.533492 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bc2c79a32ab54379a23d47dbae32fd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bc2c79a32ab54379a23d47dbae32fd63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bc2c79a32ab54379a23d47dbae32fd63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bc2c79a32ab54379a23d47dbae32fd63"}]}] Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1600778819 Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bc2c79a32ab54379a23d47dbae32fd63 Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1600778819 Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerDiagnosticsNegativeTest-1600778819-project Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 029d1b74748a45a7aac98e73d7f89fb4 Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1600778819-project Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b3482326-8c40-4c1d-870e-47cb4e38b790 could not be found. Jul 25 16:03:51.535156 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b3482326-8c40-4c1d-870e-47cb4e38b790'} Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3482326-8c40-4c1d-870e-47cb4e38b790 could not be found. Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:51.536025 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3482326-8c40-4c1d-870e-47cb4e38b790 could not be found. Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3482326-8c40-4c1d-870e-47cb4e38b790 could not be found. Jul 25 16:03:51.538381 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.542518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] Returning 404 to user: Instance b3482326-8c40-4c1d-870e-47cb4e38b790 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:51.544804 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e1de8ad-ec01-4701-a934-605cd0e5db1a tempest-ServerDiagnosticsNegativeTest-1600778819 tempest-ServerDiagnosticsNegativeTest-1600778819-project] 10.222.0.105 "GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790" status: 404 len: 111 microversion: 2.1 time: 0.079268 Jul 25 16:03:51.546593 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 193/339] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:51 2022] GET /compute/v2.1/servers/b3482326-8c40-4c1d-870e-47cb4e38b790 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:51.558187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f8c8775-5221-4690-9268-ff793a86acfe tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:51.568888 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:51.568888 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:51.569390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:51.572106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f8c8775-5221-4690-9268-ff793a86acfe tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'e5bacfa7de0449088728e60d9a2cb307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5705e899321742088efa0bc3943ccfa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f8c8775-5221-4690-9268-ff793a86acfe tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Request method failure captured: Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 43 Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7eOf5M-fWSF7T9uKr1cOnH4tNPJnCk4ul_IeZaMN-MEb8gW4Co8Y1v0-QUWe4g_Ddlyt--qX__QxGXVwFs2E1XHYlV3uJsKvtft0Nmi2xxW_mbwwUcaq2tEtvfRZsRYnuJ8V_Xwd_aI3CHCQyFbVJFycKMHIm1uLYIqdlmizYdgjs Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:03:51.574197 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5705e899321742088efa0bc3943ccfa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5705e899321742088efa0bc3943ccfa1"}]}] Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5705e899321742088efa0bc3943ccfa1 Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-767398850 Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e5bacfa7de0449088728e60d9a2cb307 Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-767398850-project Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: {"remove_host": {"host": "n-h2-846219-13"}} Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:51.575658 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-846219-13'}}} Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:51.576675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 16:03:51.578156 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:51.582849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f8c8775-5221-4690-9268-ff793a86acfe tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:51.585035 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f8c8775-5221-4690-9268-ff793a86acfe tempest-AggregatesAdminNegativeTestJSON-767398850 tempest-AggregatesAdminNegativeTestJSON-767398850-project] 10.222.0.105 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.033593 Jul 25 16:03:51.585779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-15900676-5c62-424e-9ce3-69eb6c500b6d tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.576376 Jul 25 16:03:51.587570 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 194/340] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:51 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:51.594420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f7f8c9ec-d0cd-410e-b380-3a1dc6df6b18 req-21a6fc21-4c56-42c0-8256-76161331ab65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3482326-8c40-4c1d-870e-47cb4e38b790", "name": "network-vif-deleted", "tag": "62f5650a-a00b-43bd-97b7-7c9bb030b2f7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:51.604134 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 147/341] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:51 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:51.617365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d072aecf-c71c-48b2-af1e-a4169c31b348 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:51.619801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f7f8c9ec-d0cd-410e-b380-3a1dc6df6b18 req-21a6fc21-4c56-42c0-8256-76161331ab65 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.621616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f7f8c9ec-d0cd-410e-b380-3a1dc6df6b18 req-21a6fc21-4c56-42c0-8256-76161331ab65 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.632499 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:51.632499 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:03:51.641124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d072aecf-c71c-48b2-af1e-a4169c31b348 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.641736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d072aecf-c71c-48b2-af1e-a4169c31b348 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.644491 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f7f8c9ec-d0cd-410e-b380-3a1dc6df6b18 req-21a6fc21-4c56-42c0-8256-76161331ab65 service nova] Creating event network-vif-deleted:62f5650a-a00b-43bd-97b7-7c9bb030b2f7 for instance b3482326-8c40-4c1d-870e-47cb4e38b790 on n-h1-846219-13 Jul 25 16:03:51.656684 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f7f8c9ec-d0cd-410e-b380-3a1dc6df6b18 req-21a6fc21-4c56-42c0-8256-76161331ab65 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067702 Jul 25 16:03:51.660595 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 195/342] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:51.840354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d072aecf-c71c-48b2-af1e-a4169c31b348 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.229554 Jul 25 16:03:51.843002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 148/343] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:51 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:03:51.854006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c0cef8f-9dd4-45c4-8989-3ae61d952b00 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:51.855286 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:51.855286 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:51.870852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:51.875784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:51.902330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.902781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.903562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:51.904017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:51.929406 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c0cef8f-9dd4-45c4-8989-3ae61d952b00 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.079199 Jul 25 16:03:51.939678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 196/344] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:51 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:51.947453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89a86f69-1a3e-4719-b2a9-46f59923f32a tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2064208525"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:51.953320 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:51.953320 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:51.954434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.aggregate [None req-89a86f69-1a3e-4719-b2a9-46f59923f32a tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Generated uuid 87f925ac-2635-4301-a79c-8fecbaf70f31 for aggregate {{(pid=119599) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:03:51.999931 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89a86f69-1a3e-4719-b2a9-46f59923f32a tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.057462 Jul 25 16:03:52.001962 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 197/345] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:03:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:52.019131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:52.022896 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:52.022896 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:52.052815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:52.053990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:52.071198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:52.071668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:52.085083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.compute.aggregates [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 16:03:52.085971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Request method failure captured: Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 42 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7gjiKD48KzuR2mpsaB08cKfCoxh0VFr6uDlRdJ948fxCQFWheoBzSJrW9E7gS5F1DQHSEr1y67UjLpp3AUZF7dmF_2NvRmOT0mGiBOsZ1FZPacqAuPWuc7RnIHWx15OJ2xTZP0DWQErH4WH3adTnIYrZ2g66K4K7g9YluZUHG0QHQ Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:03:52.088399 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cb3bc15016e7421abfacff9d9f0748b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cb3bc15016e7421abfacff9d9f0748b7"}]}] Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cb3bc15016e7421abfacff9d9f0748b7 Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-161063967 Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccc45d1243504c37863750e44e806aa4 Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: {"remove_host": {"host": "nonexist_host"}} Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:03:52.089899 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 16:03:52.090731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 25 16:03:52.092037 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.093729 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:52.094911 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11de50e4-4132-43e6-abb2-bd35b45bd1a6 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.079632 Jul 25 16:03:52.095398 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 198/346] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:03:52 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:52.101486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d43f0fcd-e527-4191-a947-f4702410fae2 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:52.102403 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:03:52.102403 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:03:52.154259 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d43f0fcd-e527-4191-a947-f4702410fae2 tempest-AggregatesAdminNegativeTestJSON-161063967 tempest-AggregatesAdminNegativeTestJSON-161063967-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.057741 Jul 25 16:03:52.154865 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 199/347] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:03:52 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:03:52.555747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:52.577816 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aae701c1-aa8b-48b0-b05c-61dbe15753a9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1544 microversion: 2.1 time: 0.712870 Jul 25 16:03:52.594668 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 149/348] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:51 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1544 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:52.609072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:52.610702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:52.626249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:52.627639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:52.631286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:52.631987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:53.451143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:53.462225 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3457111c-40c9-45b5-bba6-56a7590148fd tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.857315 Jul 25 16:03:53.472441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 200/349] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:52 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:53.597667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:53.610718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:53.612290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:53.632162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:53.632671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:53.643428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:53.650112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:54.411921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:54.421001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cc696747-92f3-4217-ad65-95531436b426 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1539 microversion: 2.1 time: 0.824774 Jul 25 16:03:54.425608 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 150/350] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:53 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1539 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:54.492327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:54.493320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:54.503104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:54.507654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:54.508862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:54.520310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:55.014937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:55.023008 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9f0db9a-dc64-4418-bb25-074985a7dd50 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.534806 Jul 25 16:03:55.045644 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 201/351] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:54 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:55.447833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:55.448270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:55.456977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:55.463634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:55.464091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:55.466436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:55.471747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:55.717024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:55.731962 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cf6d0938-1065-4f12-ad7c-faa5fca3c661 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1526 microversion: 2.1 time: 0.288471 Jul 25 16:03:55.732566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 151/352] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:55 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:55.757325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:55.757863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:55.795693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:55.795693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:55.796190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:55.796630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:55.898020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:03:56.048924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:56.049583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:56.071439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:56.072928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:56.076274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:56.077088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:56.080797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:56.158512 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5ffa9e6-ffce-4fda-8ee5-034921e70d7a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 204 len: 0 microversion: 2.1 time: 0.404835 Jul 25 16:03:56.159125 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 202/353] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:03:55 2022] DELETE /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:03:56.173962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:56.174720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:56.195930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:56.196391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:56.198299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:56.199525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:56.451675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:56.469252 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a99914af-e6e7-44f6-8018-a1c2a892ef14 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.427323 Jul 25 16:03:56.470539 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 152/354] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:56 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:56.507268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:56.515798 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e44450d-b9bc-4aad-a45b-6b7a5f5e41b1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1532 microversion: 2.1 time: 0.351924 Jul 25 16:03:56.517220 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 203/355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:56 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1532 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:56.984521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ddae3f4-9daa-433b-bf02-3df3b8b398f8 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Calling method '.version_select at 0x7f9da0127d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.010253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdc65f78-a7f9-4c2c-a298-a618caaf5b91 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Action: 'create', calling method: .version_select at 0x7f9da074af70>, body: {"keypair": {"name": "tempest-keypair-616112653", "type": "ssh", "user_id": "8cc4eb2790af4c29a15e4470a1e83e12", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsPB2jIH4o97h/m+xKRDb7BMEZ18BzEuSLjuoSL9fNjm1Z1wzyPfJckX43nnhiXqZeygfC/5sVHQvurjYhqc4gOrYRJIWTDV47/z/6vSVh+dqo3WEN81cJZ1oDWVzqEgQ=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:57.058261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-fdc65f78-a7f9-4c2c-a298-a618caaf5b91 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Getting quotas for project f4f99d9c01ac472d967e19b256117edb. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:57.066179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-fdc65f78-a7f9-4c2c-a298-a618caaf5b91 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Getting quotas for user d403ba28c47e4738b4fc0193ad736f38 and project f4f99d9c01ac472d967e19b256117edb. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:57.116620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ddae3f4-9daa-433b-bf02-3df3b8b398f8 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.318526 Jul 25 16:03:57.117673 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fdc65f78-a7f9-4c2c-a298-a618caaf5b91 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.461046 Jul 25 16:03:57.121254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 153/356] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:03:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 466 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:03:57.129903 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 204/357] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:03:56 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:03:57.135739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48c0408e-5c63-4a25-a497-248ac12c0f60 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Action: 'create', calling method: .version_select at 0x7f9da013b3a0>, body: {"pool": "non_exist_pool"} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:57.140865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b82678fd-4f6e-4986-8ec5-9df4a83865cd tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Action: 'create', calling method: .version_select at 0x7f9d93ed3dc0>, body: {"keypair": {"name": "tempest-keypair-966560626", "type": "ssh", "user_id": "8cc4eb2790af4c29a15e4470a1e83e12", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Y/IrP90rWm2FHWTOciBCSzkTgyP+vlMsyT7KncRDu12UqN+c5umHvtWCj5b8F8OMlKKdHQssiLQLITq6tfsgxeGtmU4mdF5tn6YGzDVJ6V7WuO0ccgm4+v6Re0fWTSg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:57.188418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b82678fd-4f6e-4986-8ec5-9df4a83865cd tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Getting quotas for project f4f99d9c01ac472d967e19b256117edb. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:57.195228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b82678fd-4f6e-4986-8ec5-9df4a83865cd tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Getting quotas for user d403ba28c47e4738b4fc0193ad736f38 and project f4f99d9c01ac472d967e19b256117edb. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:57.226646 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-48c0408e-5c63-4a25-a497-248ac12c0f60 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] HTTP exception thrown: Floating IP pool not found. Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48c0408e-5c63-4a25-a497-248ac12c0f60 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Request method failure captured: Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 26 Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7sz9gygLU7OF4A5sW3Hk1FPK_EZgtzpS3arxTJVdIL827QWZEb4qeF50Y8nqI4Gz6jLUuBcQ5V9PLCMZOr1jy9etN88TueMwmzigwgV_AJXbSZbdHucvtOzIS0GXQADvTI_SM2BAIYpYBgkb6CVet-_zrdZgsQmHhTjivkCOnQhK0 Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b3dc576dc1e0467eb553c54895dc29dd Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1501789510 Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:57.230248 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b3dc576dc1e0467eb553c54895dc29dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b3dc576dc1e0467eb553c54895dc29dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b3dc576dc1e0467eb553c54895dc29dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b3dc576dc1e0467eb553c54895dc29dd"}]}] Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1501789510 Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b3dc576dc1e0467eb553c54895dc29dd Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1501789510 Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsNegativeTestJSON-1501789510-project Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 82c83619a99042b7930dccca2a80c361 Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1501789510-project Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: {"pool": "non_exist_pool"} Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: exception: Floating IP pool not found. Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 25 16:03:57.232428 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:57.233570 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48c0408e-5c63-4a25-a497-248ac12c0f60 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Returning 404 to user: Floating IP pool not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:57.234878 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48c0408e-5c63-4a25-a497-248ac12c0f60 tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.107177 Jul 25 16:03:57.238431 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 154/358] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:03:57 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:03:57.241207 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b82678fd-4f6e-4986-8ec5-9df4a83865cd tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.102596 Jul 25 16:03:57.244531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9f982c8f-c6d5-4415-872e-4dd9743f664a tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Calling method '.version_select at 0x7f9da0069dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.251464 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 205/359] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:03:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:03:57.258180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad7f49eb-6e6d-42e5-af4d-63d406f25cc1 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Calling method '.version_select at 0x7f9da01278b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.265742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:03:57.281445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad7f49eb-6e6d-42e5-af4d-63d406f25cc1 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "GET /compute/v2.1/os-keypairs/tempest-keypair-616112653?user_id=8cc4eb2790af4c29a15e4470a1e83e12" status: 200 len: 511 microversion: 2.10 time: 0.028387 Jul 25 16:03:57.292791 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 206/360] 10.222.0.105 () {60 vars in 1342 bytes} [Mon Jul 25 16:03:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-616112653?user_id=8cc4eb2790af4c29a15e4470a1e83e12 => generated 511 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:03:57.298964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-9f982c8f-c6d5-4415-872e-4dd9743f664a tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b53791e7-1373-460e-81c9-90545b108530 could not be found", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:03:57.299529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37ceb3c8-441b-4641-9fe7-a035185f6424 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Action: 'create', calling method: .version_select at 0x7f9d93ee35e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-142435104", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBToTa4uO1GTEsShLAmf9+lKQWbgmYYlcWHGxNG9mnNpch3uXY/eKutz0QteFMxT52uK+w7SmH6b64xC0Vf8b0Gx/UucDMG5Y7jb7w312VajehYgqR1WCOfkc5MNMul2Ow=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:57.300085 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9f982c8f-c6d5-4415-872e-4dd9743f664a tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] HTTP exception thrown: Floating IP not found for ID b53791e7-1373-460e-81c9-90545b108530 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9f982c8f-c6d5-4415-872e-4dd9743f664a tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Request method failure captured: Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-floating-ips/b53791e7-1373-460e-81c9-90545b108530 HTTP/1.1 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7sz9gygLU7OF4A5sW3Hk1FPK_EZgtzpS3arxTJVdIL827QWZEb4qeF50Y8nqI4Gz6jLUuBcQ5V9PLCMZOr1jy9etN88TueMwmzigwgV_AJXbSZbdHucvtOzIS0GXQADvTI_SM2BAIYpYBgkb6CVet-_zrdZgsQmHhTjivkCOnQhK0 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b3dc576dc1e0467eb553c54895dc29dd Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1501789510 Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:03:57.310510 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b3dc576dc1e0467eb553c54895dc29dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b3dc576dc1e0467eb553c54895dc29dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b3dc576dc1e0467eb553c54895dc29dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b3dc576dc1e0467eb553c54895dc29dd"}]}] Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1501789510 Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b3dc576dc1e0467eb553c54895dc29dd Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1501789510 Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsNegativeTestJSON-1501789510-project Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 82c83619a99042b7930dccca2a80c361 Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1501789510-project Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: exception: Floating IP not found for ID b53791e7-1373-460e-81c9-90545b108530 Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b53791e7-1373-460e-81c9-90545b108530'} Jul 25 16:03:57.311986 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:03:57.312857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b53791e7-1373-460e-81c9-90545b108530 could not be found Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3f6a077-b5bf-4e00-8d1c-88ce82be367b'] Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b53791e7-1373-460e-81c9-90545b108530. Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:57.314022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b53791e7-1373-460e-81c9-90545b108530 Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:03:57.315970 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:03:57.319701 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b53791e7-1373-460e-81c9-90545b108530 Jul 25 16:03:57.319701 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:03:57.319701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9f982c8f-c6d5-4415-872e-4dd9743f664a tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] Returning 404 to user: Floating IP not found for ID b53791e7-1373-460e-81c9-90545b108530 {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:03:57.319701 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9f982c8f-c6d5-4415-872e-4dd9743f664a tempest-FloatingIPsNegativeTestJSON-1501789510 tempest-FloatingIPsNegativeTestJSON-1501789510-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/b53791e7-1373-460e-81c9-90545b108530" status: 404 len: 111 microversion: 2.1 time: 0.075294 Jul 25 16:03:57.332763 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 155/361] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:03:57 2022] DELETE /compute/v2.1/os-floating-ips/b53791e7-1373-460e-81c9-90545b108530 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:03:57.338828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-37ceb3c8-441b-4641-9fe7-a035185f6424 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Getting quotas for project f4f99d9c01ac472d967e19b256117edb. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:03:57.351474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-37ceb3c8-441b-4641-9fe7-a035185f6424 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Getting quotas for user d403ba28c47e4738b4fc0193ad736f38 and project f4f99d9c01ac472d967e19b256117edb. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:03:57.392833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37ceb3c8-441b-4641-9fe7-a035185f6424 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.098453 Jul 25 16:03:57.393549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 207/362] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:03:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:03:57.404242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb6170d0-648e-4bd7-b472-e895b45f3fd6 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Calling method '.version_select at 0x7f9da0115160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.408548 n-d-846219-13 devstack@n-api.service[119598]: WARNING oslo_db.sqlalchemy.utils [None req-bb6170d0-648e-4bd7-b472-e895b45f3fd6 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 16:03:57.417046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb6170d0-648e-4bd7-b472-e895b45f3fd6 tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "GET /compute/v2.1/os-keypairs?user_id=8cc4eb2790af4c29a15e4470a1e83e12" status: 200 len: 724 microversion: 2.10 time: 0.016601 Jul 25 16:03:57.417977 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 156/363] 10.222.0.105 () {60 vars in 1264 bytes} [Mon Jul 25 16:03:57 2022] GET /compute/v2.1/os-keypairs?user_id=8cc4eb2790af4c29a15e4470a1e83e12 => generated 724 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:03:57.429121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c58f865b-28aa-4f98-83cb-bee8138f012d tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Calling method '.version_select at 0x7f9d93ee9430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.454802 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c58f865b-28aa-4f98-83cb-bee8138f012d tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-142435104" status: 204 len: 0 microversion: 2.10 time: 0.029153 Jul 25 16:03:57.456018 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 208/364] 10.222.0.105 () {60 vars in 1327 bytes} [Mon Jul 25 16:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-142435104 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:03:57.464910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98a398dc-1ee6-4a74-a58e-b3a1ac1ba6ab tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Calling method '.version_select at 0x7f9da013ba60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.496355 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98a398dc-1ee6-4a74-a58e-b3a1ac1ba6ab tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966560626?user_id=8cc4eb2790af4c29a15e4470a1e83e12" status: 204 len: 0 microversion: 2.10 time: 0.035656 Jul 25 16:03:57.497531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 157/365] 10.222.0.105 () {60 vars in 1345 bytes} [Mon Jul 25 16:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966560626?user_id=8cc4eb2790af4c29a15e4470a1e83e12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:03:57.508335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.509260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ddc6a0d3-c05e-48c5-a2dc-d55a462ec2ff tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] Calling method '.version_select at 0x7f9da00324c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.509804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:57.535110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:57.537692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:57.538709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:57.541692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:57.542253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ddc6a0d3-c05e-48c5-a2dc-d55a462ec2ff tempest-KeyPairsV210TestJSON-1977632228 tempest-KeyPairsV210TestJSON-1977632228-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616112653?user_id=8cc4eb2790af4c29a15e4470a1e83e12" status: 204 len: 0 microversion: 2.10 time: 0.037095 Jul 25 16:03:57.550263 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 158/366] 10.222.0.105 () {60 vars in 1345 bytes} [Mon Jul 25 16:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616112653?user_id=8cc4eb2790af4c29a15e4470a1e83e12 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:03:57.555638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:57.557750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:57.567838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:57.569020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:57.570360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:57.571416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:57.964787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:57.968400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:57.977433 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7bcc06b-411b-4b9b-b6e1-b2d555f0b82a tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.489357 Jul 25 16:03:57.982270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f256655-28bc-444b-aa26-913e792a15a7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1532 microversion: 2.1 time: 0.430737 Jul 25 16:03:57.992369 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 209/367] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:57 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:03:58.001175 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 159/368] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:57 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1532 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:58.271530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-139d3de1-48ab-4af0-8493-31e0fff09d48 req-77d3cc9d-2c52-4583-ad89-156764c52d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6404f1c-c16a-4b83-9c7e-8f3c5bd35885", "name": "network-vif-plugged", "status": "completed", "tag": "d26ef8ae-6043-4985-9a90-517f4b7c2015"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:03:58.303017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-139d3de1-48ab-4af0-8493-31e0fff09d48 req-77d3cc9d-2c52-4583-ad89-156764c52d3e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:58.305027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-139d3de1-48ab-4af0-8493-31e0fff09d48 req-77d3cc9d-2c52-4583-ad89-156764c52d3e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:58.336482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-139d3de1-48ab-4af0-8493-31e0fff09d48 req-77d3cc9d-2c52-4583-ad89-156764c52d3e service nova] Creating event network-vif-plugged:d26ef8ae-6043-4985-9a90-517f4b7c2015 for instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 on n-h2-846219-13 Jul 25 16:03:58.352614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-139d3de1-48ab-4af0-8493-31e0fff09d48 req-77d3cc9d-2c52-4583-ad89-156764c52d3e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081739 Jul 25 16:03:58.354761 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 210/369] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:03:59.001256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:59.002512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:59.008113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:03:59.008826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:03:59.015202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:59.016432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:59.016889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:59.017621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:59.017738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:59.018115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:59.024828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:03:59.025836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:03:59.646990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:59.666025 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-524e8ba8-96d5-42e5-911f-da92ae38fb1b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1323 microversion: 2.1 time: 0.670828 Jul 25 16:03:59.670102 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 160/370] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:58 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:03:59.703715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:03:59.715122 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bf6ff00a-fff2-4ff8-9491-8992a430abbb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 200 len: 1532 microversion: 2.1 time: 0.711866 Jul 25 16:03:59.731575 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 211/371] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:03:59 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 1532 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:00.057733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8fcfe276-5ea7-4cbe-acf9-0f57aa4befcb req-98aa1bcb-92bd-48b9-87f2-c9919d2f89f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9666ce6e-2178-4ea2-9a81-1f11241a5961", "name": "network-vif-deleted", "tag": "324b8800-0f74-4988-a345-007ca19ae3ac"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:00.095453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8fcfe276-5ea7-4cbe-acf9-0f57aa4befcb req-98aa1bcb-92bd-48b9-87f2-c9919d2f89f2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.096168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8fcfe276-5ea7-4cbe-acf9-0f57aa4befcb req-98aa1bcb-92bd-48b9-87f2-c9919d2f89f2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.152022 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8fcfe276-5ea7-4cbe-acf9-0f57aa4befcb req-98aa1bcb-92bd-48b9-87f2-c9919d2f89f2 service nova] Creating event network-vif-deleted:324b8800-0f74-4988-a345-007ca19ae3ac for instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 on n-h2-846219-13 Jul 25 16:04:00.190456 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8fcfe276-5ea7-4cbe-acf9-0f57aa4befcb req-98aa1bcb-92bd-48b9-87f2-c9919d2f89f2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137116 Jul 25 16:04:00.191380 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 212/372] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:04:00.576154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Calling method '.version_select at 0x7f9da01614c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:00.579310 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:00.579310 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:00.580682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.582336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.596629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d706ba02-55b3-4d73-ae8d-64714f28a836 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:00.599618 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:00.599618 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:00.601613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d706ba02-55b3-4d73-ae8d-64714f28a836 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.602307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d706ba02-55b3-4d73-ae8d-64714f28a836 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.603497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d706ba02-55b3-4d73-ae8d-64714f28a836 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.604101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d706ba02-55b3-4d73-ae8d-64714f28a836 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.642868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.646955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.678495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d706ba02-55b3-4d73-ae8d-64714f28a836 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.464860 Jul 25 16:04:00.680020 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 213/373] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:04:00 2022] GET /compute/v2.1/os-services => generated 949 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:00.686647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.687328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.688542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0cb1f091-dc0c-47c7-9b56-e8e3c22c984f req-95aea16b-2254-4a74-ae1d-57de2eed6502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9666ce6e-2178-4ea2-9a81-1f11241a5961", "name": "network-vif-plugged", "status": "completed", "tag": "324b8800-0f74-4988-a345-007ca19ae3ac"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:00.702550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.703260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.728852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.729629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.741832 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b0dbde9-00bc-4475-8d1f-028d0f600dfa tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1841 microversion: 2.53 time: 0.933777 Jul 25 16:04:00.742757 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 161/374] 10.222.0.105 () {60 vars in 1248 bytes} [Mon Jul 25 16:03:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1841 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:04:00.747886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:00.748771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0cb1f091-dc0c-47c7-9b56-e8e3c22c984f req-95aea16b-2254-4a74-ae1d-57de2eed6502 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.748994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:00.753355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0cb1f091-dc0c-47c7-9b56-e8e3c22c984f req-95aea16b-2254-4a74-ae1d-57de2eed6502 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.760525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.761349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.762370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.762957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.784114 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0cb1f091-dc0c-47c7-9b56-e8e3c22c984f req-95aea16b-2254-4a74-ae1d-57de2eed6502 service nova] Creating event network-vif-plugged:324b8800-0f74-4988-a345-007ca19ae3ac for instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 on n-h2-846219-13 Jul 25 16:04:00.789619 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0cb1f091-dc0c-47c7-9b56-e8e3c22c984f req-95aea16b-2254-4a74-ae1d-57de2eed6502 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108219 Jul 25 16:04:00.790551 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 214/375] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:00.819021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-757427da-eefa-4d8b-b547-15f2f871ca1d tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:00.825934 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:00.825934 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:00.834683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-757427da-eefa-4d8b-b547-15f2f871ca1d tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.835176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-757427da-eefa-4d8b-b547-15f2f871ca1d tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.835993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-757427da-eefa-4d8b-b547-15f2f871ca1d tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.836427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-757427da-eefa-4d8b-b547-15f2f871ca1d tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.903038 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-757427da-eefa-4d8b-b547-15f2f871ca1d tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?host=n-d-846219-13" status: 200 len: 581 microversion: 2.1 time: 0.108055 Jul 25 16:04:00.904371 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 215/376] 10.222.0.105 () {58 vars in 1179 bytes} [Mon Jul 25 16:04:00 2022] GET /compute/v2.1/os-services?host=n-d-846219-13 => generated 581 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:00.916951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:00.917761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:00.943577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.955236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:00.957123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:00.960308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.005604 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 HTTP/1.1 Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:01.007693 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:04:01.009044 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961'} Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:01.009810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:04:01.010964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:01.012376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:01.013773 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-961a3bb8-75e7-456c-aab9-4acc49eefbb5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 404 len: 111 microversion: 2.1 time: 0.106722 Jul 25 16:04:01.014197 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 216/377] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:00 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:01.024203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Calling method '.version_select at 0x7f9d93ed3790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.037746 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:01.037746 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:01.039599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.040351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.078244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.079689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.099226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:01.108681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.109881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.125314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.126008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.148686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.149436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.157228 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-abe47a78-a018-4bc0-ae82-ad9bc3d8dbd6 tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.141014 Jul 25 16:04:01.158307 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 217/378] 10.222.0.105 () {60 vars in 1227 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:01.164077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a1aa276-7682-4204-8401-b5f45d43a424 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.167038 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:01.167038 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:01.169549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1aa276-7682-4204-8401-b5f45d43a424 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.169987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1aa276-7682-4204-8401-b5f45d43a424 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.171034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1aa276-7682-4204-8401-b5f45d43a424 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.171469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1aa276-7682-4204-8401-b5f45d43a424 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.185332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:01.199796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fcc33f8-f79a-4dc5-90a8-3134d4978f2e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1472 microversion: 2.1 time: 0.455785 Jul 25 16:04:01.200668 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 162/379] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:00 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:01.214806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4a1aa276-7682-4204-8401-b5f45d43a424 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.054976 Jul 25 16:04:01.215308 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 218/380] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:01.218547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41c18ca7-dc76-4120-9d12-fb8bedbd991d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'create', calling method: .version_select at 0x7f9da0031f70>, body: {"keypair": {"name": "tempest-keypair-846220243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO22ESqV2g30dpHenKDyDSitWKlgtanvUHAJemo7hn1Q6FXY3w23fCizGR/eja7EnI8bf/Kywde+3KwqsTBWApoknXjIkr8h4HbAjWV1JK4re54c8Sr1OvuD2xq0vKE5Ag=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:01.274206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-41c18ca7-dc76-4120-9d12-fb8bedbd991d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:04:01.284186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-41c18ca7-dc76-4120-9d12-fb8bedbd991d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for user f16ea8cc8a304280a0988dbac8aa1433 and project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:04:01.344370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41c18ca7-dc76-4120-9d12-fb8bedbd991d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142286 Jul 25 16:04:01.345506 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 163/381] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:04:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:01.354328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb102d2a-c5c3-484a-aca4-0f6d064e146c tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Calling method '.version_select at 0x7f9da0032040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.357688 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:01.357688 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:01.361366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb102d2a-c5c3-484a-aca4-0f6d064e146c tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.361894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb102d2a-c5c3-484a-aca4-0f6d064e146c tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.385144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb102d2a-c5c3-484a-aca4-0f6d064e146c tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.385746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb102d2a-c5c3-484a-aca4-0f6d064e146c tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.395591 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb102d2a-c5c3-484a-aca4-0f6d064e146c tempest-HypervisorAdminV253TestBase-801974838 tempest-HypervisorAdminV253TestBase-801974838-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/70fe917f-0878-457b-bc7a-20bf6a847160" status: 200 len: 795 microversion: 2.53 time: 0.048311 Jul 25 16:04:01.408461 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 164/382] 10.222.0.105 () {60 vars in 1303 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/os-hypervisors/70fe917f-0878-457b-bc7a-20bf6a847160 => generated 795 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:01.414639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:01.417846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:01.426612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.427303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.429505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.430140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.610806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0ae6023-6d14-403b-9531-5ded86b5d263 tempest-DeleteServersAdminTestJSON-164164927 tempest-DeleteServersAdminTestJSON-164164927-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885/action" status: 202 len: 0 microversion: 2.1 time: 0.201156 Jul 25 16:04:01.618746 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 165/383] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:04:01 2022] POST /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:01.634964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3ea391b8-20ec-4622-a822-abe8bedc5260 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.645469 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:01.645469 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:01.646919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ea391b8-20ec-4622-a822-abe8bedc5260 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.647360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ea391b8-20ec-4622-a822-abe8bedc5260 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.650349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ea391b8-20ec-4622-a822-abe8bedc5260 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.654213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ea391b8-20ec-4622-a822-abe8bedc5260 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.714216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3ea391b8-20ec-4622-a822-abe8bedc5260 tempest-ServicesAdminTestJSON-1672687236 tempest-ServicesAdminTestJSON-1672687236-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.094259 Jul 25 16:04:01.718953 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 166/384] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/os-services => generated 949 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:01.726702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.730065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:01.746410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.748081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.749412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.754816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.811232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Calling method '.version_select at 0x7f9da01271f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.813047 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:01.813047 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:01.815439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.816265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.852554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.854697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.856427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lazy-loading 'fault' on Instance uuid a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:04:01.874560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.875537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.912501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.917670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.928024 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c35ee425-6fb7-4086-9b4d-26a85b61d004 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.707863 Jul 25 16:04:01.929522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 219/385] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:01.943270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65f3f169-2a81-4b52-b99a-5041cf1e8998 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Calling method '.version_select at 0x7f9da03cd280>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:01.950896 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:01.950896 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:01.962080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f3f169-2a81-4b52-b99a-5041cf1e8998 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.962770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f3f169-2a81-4b52-b99a-5041cf1e8998 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:01.990883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f3f169-2a81-4b52-b99a-5041cf1e8998 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:01.993045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f3f169-2a81-4b52-b99a-5041cf1e8998 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:02.019417 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65f3f169-2a81-4b52-b99a-5041cf1e8998 tempest-HypervisorAdminV228Test-1448138032 tempest-HypervisorAdminV228Test-1448138032-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 721 microversion: 2.28 time: 0.079942 Jul 25 16:04:02.021517 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 220/386] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 721 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:02.348075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:02.358518 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1f11f4f9-e4a4-4366-84e5-3bbc7c35fcaa tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1455 microversion: 2.1 time: 0.637135 Jul 25 16:04:02.376402 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 167/387] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:01 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1455 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:02.397841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:02.401901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:02.412253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:02.413585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:02.414594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:02.415233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:02.471714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:04:02.648362 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ff0c2bd-f100-41c9-a6cd-88cefc51954f tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 204 len: 0 microversion: 2.1 time: 0.260706 Jul 25 16:04:02.649196 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 221/388] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:04:02 2022] DELETE /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:02.659301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:02.660056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:02.669138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:02.669849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:02.671099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:02.671721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:02.753447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:02.754307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:02.755159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lazy-loading 'fault' on Instance uuid a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:04:03.039291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:03.049054 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23c1a9ed-5282-4968-8b97-c64c862fd935 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1461 microversion: 2.1 time: 0.395056 Jul 25 16:04:03.053630 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 168/389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:02 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1461 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:04.074913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:04.076199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:04.100014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:04.106260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:04.107790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:04.108600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:04.170985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:04.171823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:04.172939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lazy-loading 'fault' on Instance uuid a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:04:04.541482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:04.551153 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4c7bbfb-67eb-4b22-a6de-b890744b9535 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1461 microversion: 2.1 time: 0.480339 Jul 25 16:04:04.578075 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 222/390] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:04 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1461 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:04.923845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-220922976", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:05.020855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] validate_networks() for [('29236b2a-0a01-4dc1-874d-893614dd0b6b', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:04:05.583142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:05.583837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:05.601368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:05.601849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:05.602777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:05.603382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:05.677987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:05.678456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:05.681562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lazy-loading 'fault' on Instance uuid a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:04:05.774362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:05.784096 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e4e937b-144f-4e81-9004-b5ab76c79a9b tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1419 microversion: 2.1 time: 0.204885 Jul 25 16:04:05.799010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 223/391] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:05 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1419 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:06.323479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1665904816", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:06.442426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:04:06.462909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:04:06.464025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:04:06.464626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:04:06.465031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:04:06.465650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:04:06.482572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.485163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:06.486208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.488656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:06.537665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:04:06.548863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for user f16ea8cc8a304280a0988dbac8aa1433 and project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:04:06.576272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.583928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:04:06.592994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:04:06.660893 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ea7497f-aad0-42c2-b671-357dd9c7d9e4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.741783 Jul 25 16:04:06.661981 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 169/392] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:04 2022] POST /compute/v2.1/servers => generated 385 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:04:06.667440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2d54e6c3-a4e1-4918-8435-a3011dae1878 req-578f3f22-f8b7-4c51-a089-90df28f4e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6404f1c-c16a-4b83-9c7e-8f3c5bd35885", "name": "network-vif-deleted", "tag": "d26ef8ae-6043-4985-9a90-517f4b7c2015"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:06.684293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2d54e6c3-a4e1-4918-8435-a3011dae1878 req-578f3f22-f8b7-4c51-a089-90df28f4e465 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.685066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2d54e6c3-a4e1-4918-8435-a3011dae1878 req-578f3f22-f8b7-4c51-a089-90df28f4e465 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:06.716102 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2d54e6c3-a4e1-4918-8435-a3011dae1878 req-578f3f22-f8b7-4c51-a089-90df28f4e465 service nova] Creating event network-vif-deleted:d26ef8ae-6043-4985-9a90-517f4b7c2015 for instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 on n-h2-846219-13 Jul 25 16:04:06.741909 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2d54e6c3-a4e1-4918-8435-a3011dae1878 req-578f3f22-f8b7-4c51-a089-90df28f4e465 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078387 Jul 25 16:04:06.744830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 170/393] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:06.751899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cb1205aa-5b38-41e1-a3da-85006dd29110 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:06.754662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb1205aa-5b38-41e1-a3da-85006dd29110 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:06.795287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:04:06.796342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:04:06.797066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:04:06.797725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:04:06.798351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:04:06.808969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.810031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:06.811014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.811587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:06.866069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:04:06.877198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for user 797cc3e401c3492187cd37395c534d3c and project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:04:06.909529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:04:06.911891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:04:06.920256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cb1205aa-5b38-41e1-a3da-85006dd29110 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:06.929418 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cb1205aa-5b38-41e1-a3da-85006dd29110 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1228 microversion: 2.1 time: 0.181830 Jul 25 16:04:06.931031 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 171/394] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:06 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:06.939189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:06.940397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:06.950960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.953010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:06.955003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:06.955796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:07.018029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:07.018658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:07.019644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lazy-loading 'fault' on Instance uuid a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:04:07.020854 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6c6162e-37c3-486d-b977-5252b75f7ebd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.217630 Jul 25 16:04:07.022198 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 224/395] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:04:07.048239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fba3e95d-a410-46dd-9d18-e46adb2dcf76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:07.049386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fba3e95d-a410-46dd-9d18-e46adb2dcf76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:07.160488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0b370cb44b4beabe9b9cee8e8b16cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2be2f7e5c543b091248379de7069dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:07.169480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-47d009df-cdf8-415e-9cdc-7dbad0198364 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 200 len: 1313 microversion: 2.1 time: 0.236558 Jul 25 16:04:07.171671 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 172/396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:06 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:07.193520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fba3e95d-a410-46dd-9d18-e46adb2dcf76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:07.200852 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fba3e95d-a410-46dd-9d18-e46adb2dcf76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1217 microversion: 2.1 time: 0.170957 Jul 25 16:04:07.201669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 225/397] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:07 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:07.954348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:07.955697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:07.964144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:07.964670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:07.965548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:07.966088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.045858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:08.055208 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-770a820f-714f-4379-a9c3-1e389b4b255e tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1280 microversion: 2.1 time: 0.104685 Jul 25 16:04:08.065778 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 173/398] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:07 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:08.193268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:08.193870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:08.204293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.208445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.209427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.210065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.232214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:08.233327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:08.250812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.251611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.257049 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] HTTP exception thrown: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.258834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.261940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Request method failure captured: Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 HTTP/1.1 Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6qsV2Yl2JhNL6ISGb9BtU6-FCA_C0O1O1z3sCUhf3i4wZBeGh23yxb7aTiI3FDWYvQtEsl9eanX8SxMXNOkIphr6j2XpKZin8wMHQ8xr96kMzfurIIpEqK-5eaQJuOzLtKtelYWqc-VbKQ2OFpjDz3lCj0XGRi25OKhsTTL69LMug Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:08.273062 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7f2be2f7e5c543b091248379de7069dc"}]}] Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: bc0b370cb44b4beabe9b9cee8e8b16cf Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.274421 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'a6404f1c-c16a-4b83-9c7e-8f3c5bd35885'} Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:08.276454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.277823 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.280067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Returning 404 to user: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:08.281253 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1d7ff3f-efdd-4499-be67-56306ca7883e tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 404 len: 111 microversion: 2.1 time: 0.093268 Jul 25 16:04:08.283525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 226/399] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:08 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:08.295240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:08.296012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:08.305204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.306065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.307901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.308658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.328054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] HTTP exception thrown: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Request method failure captured: Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 HTTP/1.1 Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6qsV2Yl2JhNL6ISGb9BtU6-FCA_C0O1O1z3sCUhf3i4wZBeGh23yxb7aTiI3FDWYvQtEsl9eanX8SxMXNOkIphr6j2XpKZin8wMHQ8xr96kMzfurIIpEqK-5eaQJuOzLtKtelYWqc-VbKQ2OFpjDz3lCj0XGRi25OKhsTTL69LMug Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:08.330224 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7f2be2f7e5c543b091248379de7069dc"}]}] Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: bc0b370cb44b4beabe9b9cee8e8b16cf Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.331439 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'a6404f1c-c16a-4b83-9c7e-8f3c5bd35885'} Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:08.332097 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.333268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.336547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Returning 404 to user: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:08.337518 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b0dbce8-ee14-4c0e-b537-256dd9bd24d2 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 404 len: 111 microversion: 2.1 time: 0.046869 Jul 25 16:04:08.338206 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 227/400] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:04:08 2022] DELETE /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:08.349298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:08.350359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: a6404f1c-c16a-4b83-9c7e-8f3c5bd35885] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:08.359670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.360585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.361809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.362532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.383350 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] HTTP exception thrown: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Request method failure captured: Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 HTTP/1.1 Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6qsV2Yl2JhNL6ISGb9BtU6-FCA_C0O1O1z3sCUhf3i4wZBeGh23yxb7aTiI3FDWYvQtEsl9eanX8SxMXNOkIphr6j2XpKZin8wMHQ8xr96kMzfurIIpEqK-5eaQJuOzLtKtelYWqc-VbKQ2OFpjDz3lCj0XGRi25OKhsTTL69LMug Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:08.385965 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7f2be2f7e5c543b091248379de7069dc"}]}] Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: bc0b370cb44b4beabe9b9cee8e8b16cf Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.387179 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'a6404f1c-c16a-4b83-9c7e-8f3c5bd35885'} Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:08.387929 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. Jul 25 16:04:08.389013 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.391443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Returning 404 to user: Instance a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:08.393262 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0dee326b-ded2-40d2-bcf4-5934cf2fdd15 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885" status: 404 len: 111 microversion: 2.1 time: 0.050150 Jul 25 16:04:08.395212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 228/401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:08 2022] GET /compute/v2.1/servers/a6404f1c-c16a-4b83-9c7e-8f3c5bd35885 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:08.406481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:08.407732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:08.413712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:08.415324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.416115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.416748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.417581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.427071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:08.437066 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9cde5f6f-e5b0-4b5f-baa7-ed70e5d3e85e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1269 microversion: 2.1 time: 0.209567 Jul 25 16:04:08.438940 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 174/402] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:08 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1269 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:08.454706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] HTTP exception thrown: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Request method failure captured: Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 HTTP/1.1 Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6qsV2Yl2JhNL6ISGb9BtU6-FCA_C0O1O1z3sCUhf3i4wZBeGh23yxb7aTiI3FDWYvQtEsl9eanX8SxMXNOkIphr6j2XpKZin8wMHQ8xr96kMzfurIIpEqK-5eaQJuOzLtKtelYWqc-VbKQ2OFpjDz3lCj0XGRi25OKhsTTL69LMug Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:08.456396 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7f2be2f7e5c543b091248379de7069dc"}]}] Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: bc0b370cb44b4beabe9b9cee8e8b16cf Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.458917 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '13a2c288-eaf1-4498-94b6-14855dc886f4'} Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:08.461611 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.464094 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.468772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Returning 404 to user: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:08.468772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c91fcae2-8fbd-4e9f-bf48-95df536c83b9 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "DELETE /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 404 len: 111 microversion: 2.1 time: 0.057287 Jul 25 16:04:08.468772 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 229/403] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:04:08 2022] DELETE /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:08.469534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:08.470002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] [instance: 13a2c288-eaf1-4498-94b6-14855dc886f4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:08.487762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.488886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.508222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:08.508679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:08.543566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:08.588591 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] HTTP exception thrown: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Request method failure captured: Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 HTTP/1.1 Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6qsV2Yl2JhNL6ISGb9BtU6-FCA_C0O1O1z3sCUhf3i4wZBeGh23yxb7aTiI3FDWYvQtEsl9eanX8SxMXNOkIphr6j2XpKZin8wMHQ8xr96kMzfurIIpEqK-5eaQJuOzLtKtelYWqc-VbKQ2OFpjDz3lCj0XGRi25OKhsTTL69LMug Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:04:08.601866 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7f2be2f7e5c543b091248379de7069dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7f2be2f7e5c543b091248379de7069dc"}]}] Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7f2be2f7e5c543b091248379de7069dc Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1516832225 Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: bc0b370cb44b4beabe9b9cee8e8b16cf Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersAdminTestJSON-1516832225-project Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.604379 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '13a2c288-eaf1-4498-94b6-14855dc886f4'} Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:08.605470 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. Jul 25 16:04:08.608437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:08.610627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] Returning 404 to user: Instance 13a2c288-eaf1-4498-94b6-14855dc886f4 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:08.610627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51ffc357-802c-4a65-bdd5-a97c9bd5a500 tempest-DeleteServersAdminTestJSON-1516832225 tempest-DeleteServersAdminTestJSON-1516832225-project] 10.222.0.105 "GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4" status: 404 len: 111 microversion: 2.1 time: 0.141548 Jul 25 16:04:08.619163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 175/404] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:08 2022] GET /compute/v2.1/servers/13a2c288-eaf1-4498-94b6-14855dc886f4 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:09.077579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:09.078725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:09.104203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:09.104698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:09.110307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:09.111137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:09.344285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:09.356905 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c4dad8ba-8fc8-4a7e-9acb-12ba2f41f824 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1286 microversion: 2.1 time: 0.283512 Jul 25 16:04:09.361341 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 230/405] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:09 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1286 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:09.471196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:09.475126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:09.499194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:09.500589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:09.504491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:09.508053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:09.712386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:09.740728 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e8f0a8f-8dd2-4b0a-ab4e-7e90e9d6e033 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1275 microversion: 2.1 time: 0.276422 Jul 25 16:04:09.742002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 231/406] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:09 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:10.128659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-362f52e1-bace-4097-bb87-86cef0a78dee tempest-AZV2TestJSON-238560528 tempest-AZV2TestJSON-238560528-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:10.130522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-362f52e1-bace-4097-bb87-86cef0a78dee tempest-AZV2TestJSON-238560528 tempest-AZV2TestJSON-238560528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:10.130966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-362f52e1-bace-4097-bb87-86cef0a78dee tempest-AZV2TestJSON-238560528 tempest-AZV2TestJSON-238560528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:10.131772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-362f52e1-bace-4097-bb87-86cef0a78dee tempest-AZV2TestJSON-238560528 tempest-AZV2TestJSON-238560528-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:10.132203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-362f52e1-bace-4097-bb87-86cef0a78dee tempest-AZV2TestJSON-238560528 tempest-AZV2TestJSON-238560528-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:10.223480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-362f52e1-bace-4097-bb87-86cef0a78dee tempest-AZV2TestJSON-238560528 tempest-AZV2TestJSON-238560528-project] 10.222.0.105 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.899466 Jul 25 16:04:10.235296 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 176/407] 10.222.0.105 () {58 vars in 1169 bytes} [Mon Jul 25 16:04:09 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:04:10.386726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:10.387394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:10.396895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:10.397390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:10.398171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:10.406620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:10.926210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05c9e2bb-30f8-4857-aade-927211151c2a tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] Calling method '.version_select at 0x7f9da011faf0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:10.927369 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:10.927369 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:10.955613 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-05c9e2bb-30f8-4857-aade-927211151c2a tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.490473 Jul 25 16:04:10.968016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 177/408] 10.222.0.105 () {60 vars in 1231 bytes} [Mon Jul 25 16:04:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:10.974005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:10.975705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:10.984468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:10.985340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:10.987092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:10.987777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:11.746829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:11.761603 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c35bb33-e320-4576-9bcb-e6cdc54f412a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 1.377849 Jul 25 16:04:11.768055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 232/409] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:10 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:11.780146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3eae081e-758f-4df4-a0d9-2a8a3cdc786c tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] Action: 'update', calling method: .version_select at 0x7f9da01c9a60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:11.791558 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:11.791558 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:11.966673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:11.994388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3eae081e-758f-4df4-a0d9-2a8a3cdc786c tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.224673 Jul 25 16:04:11.996818 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 233/410] 10.222.0.105 () {62 vars in 1252 bytes} [Mon Jul 25 16:04:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:12.014527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4a027ea7-40e5-4731-99bc-da7df10cf92d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1317 microversion: 2.1 time: 1.045047 Jul 25 16:04:12.020683 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 178/411] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:10 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1317 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:12.037626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cdaa2ca2-4b54-44fa-89ab-961b1e660f72 req-5e701c20-3555-40cf-b07e-7ca55155f3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfbc09e-4c5b-48c5-9422-1c12520e3386", "tag": "bfac8b30-b4a5-49c8-bf39-2782f7de06de"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:12.073299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cdaa2ca2-4b54-44fa-89ab-961b1e660f72 req-5e701c20-3555-40cf-b07e-7ca55155f3fc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:12.074083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cdaa2ca2-4b54-44fa-89ab-961b1e660f72 req-5e701c20-3555-40cf-b07e-7ca55155f3fc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:12.089569 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cdaa2ca2-4b54-44fa-89ab-961b1e660f72 req-5e701c20-3555-40cf-b07e-7ca55155f3fc service nova] Creating event network-changed:bfac8b30-b4a5-49c8-bf39-2782f7de06de for instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 on n-h2-846219-13 Jul 25 16:04:12.100116 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cdaa2ca2-4b54-44fa-89ab-961b1e660f72 req-5e701c20-3555-40cf-b07e-7ca55155f3fc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076480 Jul 25 16:04:12.101680 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 179/412] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:12.114296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99ea5d92-1b89-4488-a6b5-339fb4aac78a tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] Calling method '.version_select at 0x7f9d93f98430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:12.115643 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:12.115643 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:12.131864 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99ea5d92-1b89-4488-a6b5-339fb4aac78a tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027762 Jul 25 16:04:12.132928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 180/413] 10.222.0.105 () {60 vars in 1231 bytes} [Mon Jul 25 16:04:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:12.152380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1faf5f7-ad8f-4740-8b0a-e3b9c48ea728 tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] Action: 'update', calling method: .version_select at 0x7f9d93f98dc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:12.155973 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:12.155973 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:12.286917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1faf5f7-ad8f-4740-8b0a-e3b9c48ea728 tempest-QuotaClassesAdmin257Test-1695565647 tempest-QuotaClassesAdmin257Test-1695565647-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.145296 Jul 25 16:04:12.288331 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 181/414] 10.222.0.105 () {62 vars in 1252 bytes} [Mon Jul 25 16:04:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:12.329652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1fd0189-72d9-4f07-b7a8-e37dc35828a8 tempest-InstanceUsageAuditLogTestJSON-1400342359 tempest-InstanceUsageAuditLogTestJSON-1400342359-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:12.330828 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:12.330828 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:12.376398 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1fd0189-72d9-4f07-b7a8-e37dc35828a8 tempest-InstanceUsageAuditLogTestJSON-1400342359 tempest-InstanceUsageAuditLogTestJSON-1400342359-project-admin] 10.222.0.105 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 16:04:11" status: 200 len: 318 microversion: 2.1 time: 0.378113 Jul 25 16:04:12.381583 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 234/415] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:04:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2016%3A04%3A11 => generated 318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:12.402016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b588d4e-1d34-4276-a358-3340c98ad732 tempest-InstanceUsageAuditLogTestJSON-1400342359 tempest-InstanceUsageAuditLogTestJSON-1400342359-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:12.403088 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:12.403088 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:12.441361 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b588d4e-1d34-4276-a358-3340c98ad732 tempest-InstanceUsageAuditLogTestJSON-1400342359 tempest-InstanceUsageAuditLogTestJSON-1400342359-project-admin] 10.222.0.105 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.049782 Jul 25 16:04:12.451387 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 182/416] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:04:12 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:12.805823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:12.807925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:12.836363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:12.837204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:12.838433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:12.839148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:13.047278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:13.048145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:13.092427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:13.093647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:13.108955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:13.109573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:13.516023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:13.533519 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7edf4129-2f84-4ece-966e-b7545c532a33 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1317 microversion: 2.1 time: 0.491709 Jul 25 16:04:13.536183 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 183/417] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:13 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:13.554838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7406a446-c317-4ba1-abe5-6f768ee7e0aa req-f575e1ce-d6de-4e49-8895-65abd6ee5e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1341b3d5-e51a-41b0-af6e-bf8b1f770eab", "tag": "6593d937-1908-4ca6-81f4-4a4ce8f65ef0"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:13.568521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7406a446-c317-4ba1-abe5-6f768ee7e0aa req-f575e1ce-d6de-4e49-8895-65abd6ee5e0b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:13.571999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7406a446-c317-4ba1-abe5-6f768ee7e0aa req-f575e1ce-d6de-4e49-8895-65abd6ee5e0b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:13.618333 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7406a446-c317-4ba1-abe5-6f768ee7e0aa req-f575e1ce-d6de-4e49-8895-65abd6ee5e0b service nova] Creating event network-changed:6593d937-1908-4ca6-81f4-4a4ce8f65ef0 for instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab on n-h2-846219-13 Jul 25 16:04:13.626271 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7406a446-c317-4ba1-abe5-6f768ee7e0aa req-f575e1ce-d6de-4e49-8895-65abd6ee5e0b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087563 Jul 25 16:04:13.628469 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 184/418] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:13.630186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:13.638996 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bf9ddb9f-a37d-4842-bcb6-d9128d1288ab tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 0.841745 Jul 25 16:04:13.660024 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 235/419] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:12 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:14.564971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:14.565755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:14.584457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:14.586530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:14.591046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:14.592100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:14.662688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:14.665371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:14.677460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:14.678589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:14.681629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:14.682574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:15.225645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:15.235126 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-15a7e453-f9af-45be-a278-fe1d420b7b9e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1317 microversion: 2.1 time: 0.676265 Jul 25 16:04:15.239251 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 185/420] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:14 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:15.270562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:15.283853 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-47d313d6-87df-44db-b7d0-e184aec7f0ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 0.626447 Jul 25 16:04:15.284456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 236/421] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:14 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:16.274052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:16.282403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:16.311289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:16.312435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:16.337689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:16.339289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:16.347436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:16.349493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:16.364861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:16.369245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:16.373668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:16.380401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:16.840824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=11 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:17.436024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:17.455573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:17.456559 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80ec74a8-98d8-4255-95a1-eea9ece77838 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1317 microversion: 2.1 time: 1.198644 Jul 25 16:04:17.470063 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 186/422] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:16 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1317 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:17.488598 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-476e4c27-9b2c-44b7-81f5-61963f0465c8 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 1.185704 Jul 25 16:04:17.489482 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 237/423] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:16 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:18.224825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44761cf5-429e-43ff-868d-42dee7620b0e tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-955247878", "id": 434159706, "os-flavor-access:is_public": "True"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:18.230194 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:18.230194 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:18.271545 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-44761cf5-429e-43ff-868d-42dee7620b0e tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.780906 Jul 25 16:04:18.272195 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 187/424] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:17 2022] POST /compute/v2.1/flavors => generated 428 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:18.288675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5471f6d3-40d8-459e-8e0a-a99b785f4190 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:18.298713 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:18.298713 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:18.355214 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5471f6d3-40d8-459e-8e0a-a99b785f4190 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/434159706" status: 202 len: 0 microversion: 2.1 time: 0.073261 Jul 25 16:04:18.362115 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 238/425] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:18 2022] DELETE /compute/v2.1/flavors/434159706 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:18.368844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51f8613b-93e7-4ca6-8132-5e21e9f1a513 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:18.443019 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51f8613b-93e7-4ca6-8132-5e21e9f1a513 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.079595 Jul 25 16:04:18.458275 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 188/426] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:18 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:18.470992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a9487ee-0ddb-4345-82f9-58543b3864ff tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-67469435", "id": 2086551449, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:18.478900 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:18.478900 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:18.489829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:18.490595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:18.501967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:18.503850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:18.507592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:18.508359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:18.557965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a9487ee-0ddb-4345-82f9-58543b3864ff tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.094322 Jul 25 16:04:18.559447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 239/427] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:18 2022] POST /compute/v2.1/flavors => generated 417 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:18.579803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:18.581439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:18.603388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:18.603727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:18.604538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:18.604964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:18.660820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:19.307641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:19.322590 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f6e7a8f-a1b3-43eb-95b9-3454ba51404c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 0.759274 Jul 25 16:04:19.333353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:19.338891 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 240/428] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:18 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:19.355398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-449c8ec3-651d-4bee-a07a-a42029fbd610 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:19.380804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2e6ff01-f43b-41ba-82e3-516abd1b7fa4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1317 microversion: 2.1 time: 0.876886 Jul 25 16:04:19.393152 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 189/429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:18 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1317 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:19.413315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-449c8ec3-651d-4bee-a07a-a42029fbd610 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6260 microversion: 2.1 time: 0.070464 Jul 25 16:04:19.427192 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 241/430] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:19 2022] GET /compute/v2.1/flavors/detail => generated 6260 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:19.436746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dbc7af4-4778-4da1-b29f-32b8ab37fbcb tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:19.440526 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:19.440526 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:19.596923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2dbc7af4-4778-4da1-b29f-32b8ab37fbcb tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/2086551449" status: 202 len: 0 microversion: 2.1 time: 0.151539 Jul 25 16:04:19.619516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9faa5dd-6d0e-4919-8a48-d621b23bc8c2 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:19.629568 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 190/431] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:04:19 2022] DELETE /compute/v2.1/flavors/2086551449 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:19.683457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9faa5dd-6d0e-4919-8a48-d621b23bc8c2 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.076407 Jul 25 16:04:19.684893 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 242/432] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:19 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:19.706381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09dfc965-2e4a-4ab6-bed6-eae4849758a0 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2123252988", "id": 995263122, "os-flavor-access:is_public": "True"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:19.711568 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:19.711568 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:19.747760 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09dfc965-2e4a-4ab6-bed6-eae4849758a0 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.046025 Jul 25 16:04:19.767584 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 191/433] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:19 2022] POST /compute/v2.1/flavors => generated 428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:19.770284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50fe7122-3b08-43c4-803c-370691b39124 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:19.771252 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:19.771252 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:19.814828 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50fe7122-3b08-43c4-803c-370691b39124 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/995263122" status: 202 len: 0 microversion: 2.1 time: 0.049066 Jul 25 16:04:19.816758 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 243/434] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:19 2022] DELETE /compute/v2.1/flavors/995263122 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:19.830505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6364b143-ede8-40c9-af97-b433607cb26e tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:19.862494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ebe55aeb-305c-45b4-9376-17e65e48f5fa req-a1caf9d0-d6bf-4c93-9660-9814b0473109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfbc09e-4c5b-48c5-9422-1c12520e3386", "name": "network-vif-plugged", "status": "completed", "tag": "bfac8b30-b4a5-49c8-bf39-2782f7de06de"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:19.907612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ebe55aeb-305c-45b4-9376-17e65e48f5fa req-a1caf9d0-d6bf-4c93-9660-9814b0473109 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:19.908308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ebe55aeb-305c-45b4-9376-17e65e48f5fa req-a1caf9d0-d6bf-4c93-9660-9814b0473109 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:19.932676 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6364b143-ede8-40c9-af97-b433607cb26e tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.109644 Jul 25 16:04:19.933312 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 192/435] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:19 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:19.955860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4525ff2e-5b29-4641-9794-8e29dc7c3248 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-446506222", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:19.963435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ebe55aeb-305c-45b4-9376-17e65e48f5fa req-a1caf9d0-d6bf-4c93-9660-9814b0473109 service nova] Creating event network-vif-plugged:bfac8b30-b4a5-49c8-bf39-2782f7de06de for instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 on n-h2-846219-13 Jul 25 16:04:19.971707 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ebe55aeb-305c-45b4-9376-17e65e48f5fa req-a1caf9d0-d6bf-4c93-9660-9814b0473109 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113530 Jul 25 16:04:19.972612 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 244/436] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:04:19.985619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4525ff2e-5b29-4641-9794-8e29dc7c3248 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 508 microversion: 2.1 time: 0.033155 Jul 25 16:04:19.994726 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 193/437] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:19 2022] POST /compute/v2.1/flavors => generated 508 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:04:20.001342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a52b0dc-9f06-49b2-ba68-dd7e62701692 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.002228 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:20.002228 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:20.040127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a52b0dc-9f06-49b2-ba68-dd7e62701692 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/380a68d5-f620-4dff-bf7e-b3f5ce267470" status: 202 len: 0 microversion: 2.1 time: 0.043159 Jul 25 16:04:20.042509 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 245/438] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:04:19 2022] DELETE /compute/v2.1/flavors/380a68d5-f620-4dff-bf7e-b3f5ce267470 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:20.071102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37386537-da30-4315-b438-f67bec01712b tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.174701 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37386537-da30-4315-b438-f67bec01712b tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.128104 Jul 25 16:04:20.176006 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 194/439] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:20 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:20.205550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1c32367f-dd8f-4515-81ce-bb73b45244bd tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-997095162", "id": "56d65387-b48b-4a41-8fd2-3b1c709927a1", "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:20.212399 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:20.212399 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:20.277454 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1c32367f-dd8f-4515-81ce-bb73b45244bd tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 508 microversion: 2.1 time: 0.081699 Jul 25 16:04:20.285677 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 246/440] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:20 2022] POST /compute/v2.1/flavors => generated 508 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:20.292589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a47c0e8a-24e1-44e7-95c8-037397b2d821 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.297343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:20.344668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.345527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:20.356142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a47c0e8a-24e1-44e7-95c8-037397b2d821 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/56d65387-b48b-4a41-8fd2-3b1c709927a1" status: 202 len: 0 microversion: 2.1 time: 0.066118 Jul 25 16:04:20.358324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:20.358789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:20.359368 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 195/441] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:04:20 2022] DELETE /compute/v2.1/flavors/56d65387-b48b-4a41-8fd2-3b1c709927a1 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:20.360080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:20.360509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:20.376995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2a56fcb2-be98-40a6-99e4-201991b03c20 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.426479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2a56fcb2-be98-40a6-99e4-201991b03c20 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.062104 Jul 25 16:04:20.440800 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 196/442] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:20 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:20.457944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.458868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:20.468381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:20.472392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:20.478362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:20.479074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:20.792251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:20.824145 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-84be06fc-4f75-4ea0-ad61-354cdaea6319 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 0.478053 Jul 25 16:04:20.827525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 247/443] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:20 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:20.834610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:20.845298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-516f2e15-07c0-4beb-82c8-0df80974121d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1317 microversion: 2.1 time: 0.403073 Jul 25 16:04:20.846122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-873535eb-54cc-4e08-b515-0f69586df4b1 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1058387500", "id": 1495674999, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:20.850746 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:20.850746 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:20.864075 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 197/444] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:20 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:20.893379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-873535eb-54cc-4e08-b515-0f69586df4b1 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.062945 Jul 25 16:04:20.903835 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 248/445] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:20 2022] POST /compute/v2.1/flavors => generated 416 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:20.908356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eca9c083-ea0c-4066-95cf-c9b6ffd5a87f tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:20.939827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eca9c083-ea0c-4066-95cf-c9b6ffd5a87f tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/1495674999" status: 200 len: 416 microversion: 2.1 time: 0.036240 Jul 25 16:04:20.943410 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 198/446] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:20 2022] GET /compute/v2.1/flavors/1495674999 => generated 416 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:04:21.401604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-256a5917-4749-4a15-9034-cf7f8b4ec9ce tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:21.478951 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-256a5917-4749-4a15-9034-cf7f8b4ec9ce tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6259 microversion: 2.1 time: 0.522822 Jul 25 16:04:21.481318 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 249/447] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:20 2022] GET /compute/v2.1/flavors/detail => generated 6259 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:21.504355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e293cdb0-195e-46f2-935a-25d150270ee5 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:21.505650 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:21.505650 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:21.556461 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e293cdb0-195e-46f2-935a-25d150270ee5 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/1495674999" status: 202 len: 0 microversion: 2.1 time: 0.055440 Jul 25 16:04:21.557931 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 250/448] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:04:21 2022] DELETE /compute/v2.1/flavors/1495674999 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:04:21.588613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79814a8e-e40d-45d8-96e6-d44cce4199e9 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:21.639885 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-79814a8e-e40d-45d8-96e6-d44cce4199e9 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.063545 Jul 25 16:04:21.640549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 251/449] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:21 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:21.716194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8696ba5-c19e-49c2-906e-6eb3e151e7c8 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Action: 'update', calling method: .version_select at 0x7f9da0183550>, body: {"quota_set": {"ram": "5120"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:21.734413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f123710e-2b71-4f92-be03-c82f1e9a6cb6 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Action: 'create', calling method: .version_select at 0x7f9da0032550>, body: {"pool": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:21.843949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.863917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8696ba5-c19e-49c2-906e-6eb3e151e7c8 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:21.873170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8696ba5-c19e-49c2-906e-6eb3e151e7c8 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:21.889472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8696ba5-c19e-49c2-906e-6eb3e151e7c8 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:21.890566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8696ba5-c19e-49c2-906e-6eb3e151e7c8 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:22.243530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=7,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.328785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8696ba5-c19e-49c2-906e-6eb3e151e7c8 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f" status: 200 len: 148 microversion: 2.57 time: 0.679975 Jul 25 16:04:22.340182 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 252/450] 10.222.0.105 () {62 vars in 1308 bytes} [Mon Jul 25 16:04:21 2022] PUT /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f => generated 148 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:22.387463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de4ce576-2067-45bb-9e4c-432020652bcd tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1034888666", "id": 1352780191, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:22.442333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=26 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.491646 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de4ce576-2067-45bb-9e4c-432020652bcd tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.148891 Jul 25 16:04:22.501262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 253/451] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:22 2022] POST /compute/v2.1/flavors => generated 432 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:22.522032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:22.522674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:22.556936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:22.564438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:22.590154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:22.591038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:23.526761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:23.550890 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8497e343-33fa-4697-a7da-82b47ae63313 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 1.047728 Jul 25 16:04:23.557774 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 254/452] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:22 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:23.580299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:23.589627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:23.621258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:23.626357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:23.632542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:23.635465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:24.191282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:24.199442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a18feaa-8028-4db0-8eed-f117749c100e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1466 microversion: 2.1 time: 0.639820 Jul 25 16:04:24.211537 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 255/453] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:23 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1466 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:24.232636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4a771ca-ffaa-439e-b1fb-1d7c191d0a60 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Calling method '.version_select at 0x7f9da01271f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:24.352974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4a771ca-ffaa-439e-b1fb-1d7c191d0a60 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:24.353681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4a771ca-ffaa-439e-b1fb-1d7c191d0a60 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:24.358289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4a771ca-ffaa-439e-b1fb-1d7c191d0a60 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:24.359838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4a771ca-ffaa-439e-b1fb-1d7c191d0a60 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:24.409483 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4a771ca-ffaa-439e-b1fb-1d7c191d0a60 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f/detail" status: 200 len: 463 microversion: 2.57 time: 0.186261 Jul 25 16:04:24.412538 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 256/454] 10.222.0.105 () {60 vars in 1309 bytes} [Mon Jul 25 16:04:24 2022] GET /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f/detail => generated 463 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:24.429901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc098c0e-9811-40f9-bbbf-b86ce7c93305 tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "1352780191"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:24.477379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-cc098c0e-9811-40f9-bbbf-b86ce7c93305 tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] HTTP exception thrown: Flavor 1352780191 could not be found. Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc098c0e-9811-40f9-bbbf-b86ce7c93305 tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] Request method failure captured: Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 107 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7_aog6LSFAlwTeNl-Jwt3Q1UQbqhfhL0ee7Trn1Ev1rRZt-HGX9d7cDH691_lFOf5yW_lriRwvgsMhIp2iV-BtIp-DkaL_zwu6wJWWWLVxAA2pQRjtWXW8bS2HYXn0HtasojrvxkKHYNQk2SGPDNZS_ZLf5r2M1EbIx7vGZ4CKmn8 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a0a5a005bff6423788f6f1f649a4b8c3 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FlavorsAdminTestJSON-924120583 Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:24.481371 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a0a5a005bff6423788f6f1f649a4b8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a0a5a005bff6423788f6f1f649a4b8c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a0a5a005bff6423788f6f1f649a4b8c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a0a5a005bff6423788f6f1f649a4b8c3"}]}] Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FlavorsAdminTestJSON-924120583 Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a0a5a005bff6423788f6f1f649a4b8c3 Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-924120583 Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FlavorsAdminTestJSON-924120583-project Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ed58c53d9130495aa4dfd7eab66cba20 Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FlavorsAdminTestJSON-924120583-project Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "test", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "1352780191"}} Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:24.483011 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor 1352780191 could not be found. Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '1352780191'}}} Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1352780191 could not be found. Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:24.484004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1352780191 could not be found. Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:24.485575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:24.487039 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:24.487039 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:24.487039 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:24.487039 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1352780191 could not be found. Jul 25 16:04:24.487039 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:24.488817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc098c0e-9811-40f9-bbbf-b86ce7c93305 tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] Returning 400 to user: Flavor 1352780191 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:24.492622 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc098c0e-9811-40f9-bbbf-b86ce7c93305 tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.069811 Jul 25 16:04:24.494237 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 257/455] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:24 2022] POST /compute/v2.1/servers => generated 81 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:04:24.503122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9570b166-7fa2-4704-b868-6ace0ad8e076 req-01d41c58-3e9f-430b-abd8-22065fc96bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1341b3d5-e51a-41b0-af6e-bf8b1f770eab", "name": "network-vif-plugged", "status": "completed", "tag": "6593d937-1908-4ca6-81f4-4a4ce8f65ef0"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:24.528488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9570b166-7fa2-4704-b868-6ace0ad8e076 req-01d41c58-3e9f-430b-abd8-22065fc96bfc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:24.529155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9570b166-7fa2-4704-b868-6ace0ad8e076 req-01d41c58-3e9f-430b-abd8-22065fc96bfc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:24.543749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9570b166-7fa2-4704-b868-6ace0ad8e076 req-01d41c58-3e9f-430b-abd8-22065fc96bfc service nova] Creating event network-vif-plugged:6593d937-1908-4ca6-81f4-4a4ce8f65ef0 for instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab on n-h2-846219-13 Jul 25 16:04:24.551338 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9570b166-7fa2-4704-b868-6ace0ad8e076 req-01d41c58-3e9f-430b-abd8-22065fc96bfc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052611 Jul 25 16:04:24.560602 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 258/456] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:24.912281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:24.913134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:24.934306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:24.937265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:24.938215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:24.938724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:25.667385 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f123710e-2b71-4f92-be03-c82f1e9a6cb6 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.440954 Jul 25 16:04:25.669032 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 199/457] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:04:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:04:25.679660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8cddc5a-cddb-4822-897b-f6ea0983fb73 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:25.680811 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:25.680811 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:25.708131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=7,nova_api:DELETE=7 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:25.721491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8cddc5a-cddb-4822-897b-f6ea0983fb73 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/1352780191" status: 202 len: 0 microversion: 2.1 time: 0.051034 Jul 25 16:04:25.726432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 200/458] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:04:25 2022] DELETE /compute/v2.1/flavors/1352780191 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:25.735584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:25.736212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:25.751218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:25.751667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:25.752454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:25.752888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:25.814967 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cfa9ba98-e739-4745-916b-5bcb359d3484 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1619 microversion: 2.1 time: 1.252707 Jul 25 16:04:25.818954 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 259/459] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:24 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1619 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:25.829942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Action: 'update', calling method: .version_select at 0x7f9d93e609d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:25.933415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:25.933687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:25.934493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:25.936325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:26.003521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:26.004388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:26.005646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:26.007073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:26.073638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:26.084787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8411bfb5-3f46-489b-bc1a-a2cdcf9912ea tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1328 microversion: 2.1 time: 0.357118 Jul 25 16:04:26.088088 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 201/460] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:25 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1328 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:26.094554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03ff51e9-0f64-4fe8-9a9d-9cec35a709f3 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Action: 'create', calling method: .version_select at 0x7f9d93fba040>, body: {"pool": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:26.122990 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dab07ab9-1b36-4a78-a223-c41bc6baa3b4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f?user_id=61c146f4b79d48cfbbf0c0c0b4abda41" status: 200 len: 148 microversion: 2.57 time: 0.301974 Jul 25 16:04:26.124284 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 260/461] 10.222.0.105 () {62 vars in 1389 bytes} [Mon Jul 25 16:04:25 2022] PUT /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f?user_id=61c146f4b79d48cfbbf0c0c0b4abda41 => generated 148 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:26.130246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dd0b4217-122a-4b35-8978-b0da287b976a tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:26.156519 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dd0b4217-122a-4b35-8978-b0da287b976a tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.030651 Jul 25 16:04:26.158271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 261/462] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:26 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:26.175775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:26.176826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:26.185717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:26.186174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:26.187161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:26.187891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:26.329682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '753235f1e4f74066bee93c09fe8c4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78157dcf2d3a4a408b54fd46372adc92', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:26.330368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] flavor_id is None. Assuming migration. {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 16:04:26.330820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 16:04:26.940767 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8deb966-2cb9-45b5-a978-c18fa5a5ef68 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386/action" status: 202 len: 0 microversion: 2.1 time: 0.778173 Jul 25 16:04:26.944357 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 262/463] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:04:26 2022] POST /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:26.957831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6692f9aa-759c-4de4-b6d5-d55d92cc68d4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] Calling method '.version_select at 0x7f9da01c9a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:27.119668 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6692f9aa-759c-4de4-b6d5-d55d92cc68d4 tempest-QuotasAdminTestV257-229142202 tempest-QuotasAdminTestV257-229142202-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f?user_id=61c146f4b79d48cfbbf0c0c0b4abda41" status: 200 len: 190 microversion: 2.57 time: 0.174827 Jul 25 16:04:27.124446 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 263/464] 10.222.0.105 () {60 vars in 1369 bytes} [Mon Jul 25 16:04:26 2022] GET /compute/v2.1/os-quota-sets/32756571eca34f66b2357f5d2c1c422f?user_id=61c146f4b79d48cfbbf0c0c0b4abda41 => generated 190 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:27.132441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-33ced5d3-5d4e-40d1-a86b-ea1908e5e6dc tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1954604916", "id": 912259465, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:27.136192 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:27.136192 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:27.168945 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-33ced5d3-5d4e-40d1-a86b-ea1908e5e6dc tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.041744 Jul 25 16:04:27.170592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 264/465] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:27 2022] POST /compute/v2.1/flavors => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:27.194340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:27.195580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:27.210730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:27.214511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:27.215605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:27.219357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:27.619775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:27.631995 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e5f368c0-3b0d-4858-a3e5-ee4950916576 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1475 microversion: 2.1 time: 0.450820 Jul 25 16:04:27.636023 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 265/466] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:27 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:27.650156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:27.650806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:27.664131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:27.664584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:27.667489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:27.667939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:28.094870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:28.111402 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ead7eab3-8c0f-4fc4-977b-4e7687f0eb0c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1525 microversion: 2.1 time: 0.473985 Jul 25 16:04:28.119847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 266/467] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:27 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1525 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:28.138532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3040f2d-bc5a-4415-8a39-747d072fe0b9 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1097923172", "id": 370566773, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:28.146620 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:28.146620 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:28.180118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e3040f2d-bc5a-4415-8a39-747d072fe0b9 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.056743 Jul 25 16:04:28.190068 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 267/468] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:28.209041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:28.214240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:28.244054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:28.244486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:28.246325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:28.246791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:28.620517 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03ff51e9-0f64-4fe8-9a9d-9cec35a709f3 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.530965 Jul 25 16:04:28.621147 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 202/469] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:04:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:28.636420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61d35bf2-2c61-4941-afa3-eecbef1e22d7 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:28.667797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61d35bf2-2c61-4941-afa3-eecbef1e22d7 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.036854 Jul 25 16:04:28.669148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 203/470] 10.222.0.105 () {58 vars in 1174 bytes} [Mon Jul 25 16:04:28 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:28.676452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33ada951-328f-4baa-befd-9ea48a4b72fb tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Action: 'create', calling method: .version_select at 0x7f9d93f7daf0>, body: {"pool": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:28.829212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:28.840530 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-481dd7f3-6e26-46b4-939b-5443593b491b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1525 microversion: 2.1 time: 0.649186 Jul 25 16:04:28.853857 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 268/471] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:28 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1525 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:28.867759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:28.868851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:28.893589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:28.899378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:28.906418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:28.907171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:29.812917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:29.839258 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b86c3cc3-a97b-4292-b3b4-5bb111066950 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1475 microversion: 2.1 time: 0.984183 Jul 25 16:04:29.855447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 269/472] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:28 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1475 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:29.872386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3807bdc0-fc9d-4c95-abee-381a21d23a33 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:29.917078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3807bdc0-fc9d-4c95-abee-381a21d23a33 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.060076 Jul 25 16:04:29.926656 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 270/473] 10.222.0.105 () {58 vars in 1182 bytes} [Mon Jul 25 16:04:29 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:29.936007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-430749970"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:29.942713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:29.956169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:29.956643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:29.967095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:29.968005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:30.322894 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b88cb58-f65b-4f2c-a263-643a8c3cda6c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab/action" status: 202 len: 0 microversion: 2.1 time: 0.397831 Jul 25 16:04:30.324864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 271/474] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:04:29 2022] POST /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:04:30.338933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5af0da5b-1d78-4469-aadd-1d7f93da6882 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:30.365783 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5af0da5b-1d78-4469-aadd-1d7f93da6882 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.036939 Jul 25 16:04:30.366492 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 272/475] 10.222.0.105 () {58 vars in 1176 bytes} [Mon Jul 25 16:04:30 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:30.386935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ff9ded8-bdd9-4a78-b52d-fc1049654ac4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '.version_select at 0x7f9d93d22430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:30.704460 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ff9ded8-bdd9-4a78-b52d-fc1049654ac4 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a" status: 204 len: 0 microversion: 2.1 time: 0.336844 Jul 25 16:04:30.706367 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 273/476] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:30 2022] DELETE /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:30.712640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-165af713-9703-4565-a066-6112912f0a48 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:30.747234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-165af713-9703-4565-a066-6112912f0a48 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.039732 Jul 25 16:04:30.761366 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 274/477] 10.222.0.105 () {58 vars in 1174 bytes} [Mon Jul 25 16:04:30 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:30.773258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79521dfa-d0f3-46e5-b92b-4fc9c072202f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '.version_select at 0x7f9d93d22af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:30.811552 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-79521dfa-d0f3-46e5-b92b-4fc9c072202f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Image not found. Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79521dfa-d0f3-46e5-b92b-4fc9c072202f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a HTTP/1.1 Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:30.814617 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '91f02e46-0ce2-4a22-bb56-f7c4a62e228a'} Jul 25 16:04:30.816893 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:04:30.817881 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 91f02e46-0ce2-4a22-bb56-f7c4a62e228a Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:04:30.819126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f02e46-0ce2-4a22-bb56-f7c4a62e228a could not be found. Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:04:30.820293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:04:30.821626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:30.824164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79521dfa-d0f3-46e5-b92b-4fc9c072202f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:30.825301 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-79521dfa-d0f3-46e5-b92b-4fc9c072202f tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a" status: 404 len: 62 microversion: 2.1 time: 0.062501 Jul 25 16:04:30.826070 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 275/478] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:04:30 2022] GET /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:04:30.836496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e1e1155-c88c-468e-9a28-321e1d79c28b tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:30.887444 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e1e1155-c88c-468e-9a28-321e1d79c28b tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6256 microversion: 2.1 time: 0.059573 Jul 25 16:04:30.902252 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 276/479] 10.222.0.105 () {58 vars in 1174 bytes} [Mon Jul 25 16:04:30 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6256 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:30.908605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:30.909726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:30.927192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:30.927959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:30.933051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:30.933708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:30.981915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:32.079303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:32.106874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fbf7a9ce-8464-4a99-b1b0-34318c8bed1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1537 microversion: 2.1 time: 1.201237 Jul 25 16:04:32.107789 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 277/480] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:30 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1537 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:32.123586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:32.124341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:32.149884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:32.150280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:32.151114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:32.153704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:32.920755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:32.931645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90a269ef-466f-483f-bc8f-194b7a2b30d9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1475 microversion: 2.1 time: 0.822360 Jul 25 16:04:32.934196 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 278/481] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:32 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1475 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:32.939875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3c2c4a7-5b8a-4270-8030-1a90f20263dd tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:32.969502 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3c2c4a7-5b8a-4270-8030-1a90f20263dd tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6256 microversion: 2.1 time: 0.033310 Jul 25 16:04:32.970745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 279/482] 10.222.0.105 () {58 vars in 1180 bytes} [Mon Jul 25 16:04:32 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6256 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:32.998298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1ab0d3b-b243-4fd7-bb56-a0132d683ebe tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:33.051028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1ab0d3b-b243-4fd7-bb56-a0132d683ebe tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6256 microversion: 2.1 time: 0.058190 Jul 25 16:04:33.052284 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 280/483] 10.222.0.105 () {58 vars in 1178 bytes} [Mon Jul 25 16:04:32 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6256 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:33.079551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8697d5b-8713-4dba-affe-a528ea4932c1 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:33.120706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8697d5b-8713-4dba-affe-a528ea4932c1 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6256 microversion: 2.1 time: 0.054026 Jul 25 16:04:33.121327 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 281/484] 10.222.0.105 () {58 vars in 1174 bytes} [Mon Jul 25 16:04:33 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6256 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:33.139692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:33.140591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:33.147461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:33.148144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:33.149112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:33.149768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:34.634944 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33ada951-328f-4baa-befd-9ea48a4b72fb tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 5.963049 Jul 25 16:04:34.636564 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 204/485] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:04:28 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 5967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:34.643026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e6b36dab-40fd-42fd-b256-50ddbedd49b2 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:34.644677 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:34.644677 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:34.683876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:34.700831 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e6b36dab-40fd-42fd-b256-50ddbedd49b2 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/370566773" status: 202 len: 0 microversion: 2.1 time: 0.062628 Jul 25 16:04:34.701643 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 205/486] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:34 2022] DELETE /compute/v2.1/flavors/370566773 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:34.707267 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d261c0e6-17a2-494e-8f57-c41fa6a1d930 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1543 microversion: 2.1 time: 1.569665 Jul 25 16:04:34.709292 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 282/487] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:33 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1543 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:34.713151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:34.714794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:34.717609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-370c55da-2bd5-4e32-9c49-abf0e7da14bc tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Action: 'create', calling method: .version_select at 0x7f9d93d221f0>, body: {"pool": null} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:34.723832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:34.724278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:34.725305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:34.725807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:35.017740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:35.026941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0a4945c-8648-46cf-a396-52022233f9ea tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.324151 Jul 25 16:04:35.041131 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 206/488] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:34 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:35.048086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ef741e2-0161-4b45-b307-c98c5d252ed3 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.091349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0ef741e2-0161-4b45-b307-c98c5d252ed3 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.056691 Jul 25 16:04:35.114197 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 207/489] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:35.123153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9cd5e432-97f0-4841-abde-d9f5da66ce01 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.124621 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:35.124621 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:35.151919 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9cd5e432-97f0-4841-abde-d9f5da66ce01 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/912259465" status: 202 len: 0 microversion: 2.1 time: 0.033081 Jul 25 16:04:35.156724 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 208/490] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:35 2022] DELETE /compute/v2.1/flavors/912259465 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:04:35.163930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d387a36f-c97b-47dc-a58d-803a5e8cf408 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.192791 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d387a36f-c97b-47dc-a58d-803a5e8cf408 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.034448 Jul 25 16:04:35.193494 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 209/491] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:35.226399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b2013d1b-adb1-41d8-a8f1-c96ab68a35b0 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1705312684", "id": 793911140, "os-flavor-access:is_public": "False"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:35.235080 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:35.235080 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:35.272388 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b2013d1b-adb1-41d8-a8f1-c96ab68a35b0 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057016 Jul 25 16:04:35.275843 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 210/492] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:35.291774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8f081a0-8200-4f3f-8132-94c5a5005296 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.361427 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8f081a0-8200-4f3f-8132-94c5a5005296 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.059331 Jul 25 16:04:35.376346 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 211/493] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:35.636033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-46edb36c-313c-49c6-85cd-83a2d735e3a0 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.672778 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-46edb36c-313c-49c6-85cd-83a2d735e3a0 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.294555 Jul 25 16:04:35.677029 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 212/494] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:04:35 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:35.687982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0e1eba5-fd82-454a-ac62-d3a5354c9f5f tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.736898 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0e1eba5-fd82-454a-ac62-d3a5354c9f5f tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.058207 Jul 25 16:04:35.743934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 213/495] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:35.750271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:35.751127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:35.780053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:35.780718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:35.781720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:35.782315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:36.033397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=9 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.217807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:36.241838 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a039679d-2880-4db6-a492-66e10db1a26a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1525 microversion: 2.1 time: 0.493938 Jul 25 16:04:36.244991 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 214/496] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:35 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1525 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:36.266210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-823e452a-f3b3-465a-8333-dd122e6e09b4 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:36.267946 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:36.267946 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:36.309660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-823e452a-f3b3-465a-8333-dd122e6e09b4 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/793911140" status: 202 len: 0 microversion: 2.1 time: 0.060792 Jul 25 16:04:36.311426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 215/497] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:36 2022] DELETE /compute/v2.1/flavors/793911140 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:36.324602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:36.326140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:36.342724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:36.345860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:36.346804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:36.349471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:36.799876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:36.829351 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f011eb8-a68e-4ee0-80b0-abdd5f159f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.516126 Jul 25 16:04:36.830123 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 216/498] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:36 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:36.835702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:36.836845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:36.845211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:36.846241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:36.847638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:36.850896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:36.917802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:04:37.082912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca2c7f92-7029-4822-8882-0236c9d28bff tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 204 len: 0 microversion: 2.1 time: 0.249148 Jul 25 16:04:37.090408 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 217/499] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:04:36 2022] DELETE /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:37.100412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=25 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.111726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b294f2b3-4cc9-4c2c-84cb-62e344cdfe7a tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:37.141727 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b294f2b3-4cc9-4c2c-84cb-62e344cdfe7a tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.043093 Jul 25 16:04:37.142534 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 218/500] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:37 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:37.150056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e29efb5c-3fcf-4479-bdda-88e885744598 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1656944944", "imageRef": "31f7b98c-4268-4c48-8610-36a2af2b08f5", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:37.218979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-e29efb5c-3fcf-4479-bdda-88e885744598 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:04:37.955124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e29efb5c-3fcf-4479-bdda-88e885744598 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e29efb5c-3fcf-4479-bdda-88e885744598 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] Request method failure captured: Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 143 Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r8TyPiu_KGJXmozmPKcE_ydA19jRj5SfmGQZo6_1FbIfbj1ypKnUc-sts2rlO-GvsNSR_gSUpmErUha_Flfu87NgJt4qd6RftHxgpYafyG_Ih4WDExjPhZwKuEIkIKwrMpKo6HfCEjIgBK2Y221L0A4PfgCvuJ92f-SSvJmwM9jUPw Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 98a3f301336441669351257793d46efd Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsV2NegativeTest-1477716760 Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:04:37.957050 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/98a3f301336441669351257793d46efd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/98a3f301336441669351257793d46efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/98a3f301336441669351257793d46efd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_98a3f301336441669351257793d46efd"}]}] Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsV2NegativeTest-1477716760 Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 98a3f301336441669351257793d46efd Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1477716760 Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsV2NegativeTest-1477716760-project Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2e4d5598a30c4aa5993f9777faa59546 Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsV2NegativeTest-1477716760-project Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1656944944", "imageRef": "31f7b98c-4268-4c48-8610-36a2af2b08f5", "flavorRef": "452"}} Jul 25 16:04:37.958433 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: exception: Flavor's memory is too small for requested image. Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1656944944', 'imageRef': '31f7b98c-4268-4c48-8610-36a2af2b08f5', 'flavorRef': '452'}}} Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:37.959290 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:37.960571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e29efb5c-3fcf-4479-bdda-88e885744598 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e29efb5c-3fcf-4479-bdda-88e885744598 tempest-FlavorsV2NegativeTest-1477716760 tempest-FlavorsV2NegativeTest-1477716760-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.814582 Jul 25 16:04:37.961814 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 219/501] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:37 2022] POST /compute/v2.1/servers => generated 93 bytes in 816 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:04:37.978148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:37.978892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:37.999643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:38.000295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:38.001178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:38.001782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:39.097751 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-370c55da-2bd5-4e32-9c49-abf0e7da14bc tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.386706 Jul 25 16:04:39.103365 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 283/502] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:04:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:39.113045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c549cec-d2f8-4d42-8ee1-d29754a49301 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1724350339", "id": 810082610, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:39.126695 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:39.126695 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:39.164670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:39.170223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:39.191180 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d26f9a3f-7725-4086-a8be-8883c0225f1b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1531 microversion: 2.1 time: 1.215992 Jul 25 16:04:39.197670 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 220/503] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:37 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1531 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:39.250543 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c549cec-d2f8-4d42-8ee1-d29754a49301 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.131609 Jul 25 16:04:39.253130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:39.254548 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 284/504] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:39 2022] POST /compute/v2.1/flavors => generated 413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:39.283038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2c68132c-4b94-404e-b0fe-5e0d60656330 req-e792ea4f-61f9-484d-ac75-538cb70e8d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1341b3d5-e51a-41b0-af6e-bf8b1f770eab", "name": "network-vif-plugged", "status": "completed", "tag": "6593d937-1908-4ca6-81f4-4a4ce8f65ef0"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:39.297549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:39.305649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2c68132c-4b94-404e-b0fe-5e0d60656330 req-e792ea4f-61f9-484d-ac75-538cb70e8d49 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:39.306289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2c68132c-4b94-404e-b0fe-5e0d60656330 req-e792ea4f-61f9-484d-ac75-538cb70e8d49 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:39.323985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:39.324498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:39.330154 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2c68132c-4b94-404e-b0fe-5e0d60656330 req-e792ea4f-61f9-484d-ac75-538cb70e8d49 service nova] Creating event network-vif-plugged:6593d937-1908-4ca6-81f4-4a4ce8f65ef0 for instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab on n-h2-846219-13 Jul 25 16:04:39.332671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:39.347794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:39.353928 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2c68132c-4b94-404e-b0fe-5e0d60656330 req-e792ea4f-61f9-484d-ac75-538cb70e8d49 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078277 Jul 25 16:04:39.354710 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 285/505] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:39.384942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8376047a-7d0b-4dbb-aa6d-4f40525f0fad tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93ce81f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:39.408452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:39.995815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:40.008531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69ae76e0-6815-4aaf-a65f-0fe61624ef00 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.805269 Jul 25 16:04:40.009288 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 221/506] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:39 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:40.038958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86438958-3ab7-4256-820d-01c1b1cb2a3f tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:40.075580 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8376047a-7d0b-4dbb-aa6d-4f40525f0fad tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips/83678323-e7be-47f0-8e53-8d57ba40c070" status: 200 len: 142 microversion: 2.1 time: 0.715585 Jul 25 16:04:40.076664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 286/507] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:04:39 2022] GET /compute/v2.1/os-floating-ips/83678323-e7be-47f0-8e53-8d57ba40c070 => generated 142 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:40.088596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2aa455b4-a30b-42de-ad43-92143105759f tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93d225e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:40.099536 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86438958-3ab7-4256-820d-01c1b1cb2a3f tempest-FlavorsAdminTestJSON-924120583 tempest-FlavorsAdminTestJSON-924120583-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6256 microversion: 2.1 time: 0.075877 Jul 25 16:04:40.100451 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 222/508] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:40 2022] GET /compute/v2.1/flavors/detail => generated 6256 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:40.119862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86f52043-32a5-4fa3-8db5-d2ac71cf636a tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:40.121045 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:40.121045 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:40.171253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86f52043-32a5-4fa3-8db5-d2ac71cf636a tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/810082610" status: 202 len: 0 microversion: 2.1 time: 0.054183 Jul 25 16:04:40.172549 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 223/509] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:04:40 2022] DELETE /compute/v2.1/flavors/810082610 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:04:40.180795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1086c88e-2994-44dc-a86e-79b7398cb1e5 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:40.236482 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1086c88e-2994-44dc-a86e-79b7398cb1e5 tempest-FlavorsAdminTestJSON-1728660931 tempest-FlavorsAdminTestJSON-1728660931-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.059817 Jul 25 16:04:40.237170 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 224/510] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:04:40 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:40.242413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:40.263754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:40.282222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:40.288807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:40.290432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:40.290886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:41.189982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:41.202787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d330b0a-1aae-4753-944a-98ed8fc65f58 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1531 microversion: 2.1 time: 0.960248 Jul 25 16:04:41.208370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 225/511] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:40 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1531 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:41.229382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:41.230038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:41.260008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:41.260897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:41.263144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:41.266665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:41.780792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:41.792070 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57611b32-0d92-4ac8-b3f7-03f4daf17178 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.578331 Jul 25 16:04:41.799061 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 226/512] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:41 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:41.809435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3547ad30-f253-4c5a-b103-cec1c48a95ff req-c4391733-a1a5-43f8-aaa8-16bd6c30cccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1341b3d5-e51a-41b0-af6e-bf8b1f770eab", "name": "network-vif-deleted", "tag": "6593d937-1908-4ca6-81f4-4a4ce8f65ef0"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:41.836907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3547ad30-f253-4c5a-b103-cec1c48a95ff req-c4391733-a1a5-43f8-aaa8-16bd6c30cccd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:41.837624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3547ad30-f253-4c5a-b103-cec1c48a95ff req-c4391733-a1a5-43f8-aaa8-16bd6c30cccd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:41.871101 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3547ad30-f253-4c5a-b103-cec1c48a95ff req-c4391733-a1a5-43f8-aaa8-16bd6c30cccd service nova] Creating event network-vif-deleted:6593d937-1908-4ca6-81f4-4a4ce8f65ef0 for instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab on n-h2-846219-13 Jul 25 16:04:41.887000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3547ad30-f253-4c5a-b103-cec1c48a95ff req-c4391733-a1a5-43f8-aaa8-16bd6c30cccd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084705 Jul 25 16:04:41.887926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 227/513] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:42.232061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:42.232830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:42.257683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:42.258136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:42.262241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:42.262772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:42.386168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:42.388661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:42.391146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lazy-loading 'fault' on Instance uuid 1341b3d5-e51a-41b0-af6e-bf8b1f770eab {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:04:42.479562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:42.499866 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f722d7f4-cac5-4953-9e61-21b14a4c136a tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 200 len: 1318 microversion: 2.1 time: 0.271525 Jul 25 16:04:42.519206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 228/514] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:42 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:42.611547 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2aa455b4-a30b-42de-ad43-92143105759f tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/83678323-e7be-47f0-8e53-8d57ba40c070" status: 202 len: 0 microversion: 2.1 time: 2.526665 Jul 25 16:04:42.612143 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 287/515] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:04:40 2022] DELETE /compute/v2.1/os-floating-ips/83678323-e7be-47f0-8e53-8d57ba40c070 => generated 0 bytes in 2528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:04:42.622473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-381375a4-3f1b-4d4b-8cd1-78df46d596e3 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93f26670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:42.812641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:42.813324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:42.822811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:42.823435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:42.823961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:42.824402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:42.997634 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-381375a4-3f1b-4d4b-8cd1-78df46d596e3 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.378859 Jul 25 16:04:42.998518 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 229/516] 10.222.0.105 () {58 vars in 1169 bytes} [Mon Jul 25 16:04:42 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:04:43.009307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2161b4d1-06f4-4d14-9f3e-4966172c4c96 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93f26310>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:43.434358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2161b4d1-06f4-4d14-9f3e-4966172c4c96 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.428546 Jul 25 16:04:43.446650 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 230/517] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:04:43 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:04:43.471227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4e25ac9-c70d-49d8-9ca0-06a9e94dad07 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93fba3a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:43.696305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:43.706530 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1c6018cc-9231-4e53-9e46-cbc0ffadc5e4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.897593 Jul 25 16:04:43.710549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 288/518] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:42 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:43.717539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:43.729662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:43.755691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:43.764945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:43.766105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:43.766704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:43.803700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab HTTP/1.1 Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:04:43.805597 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:04:43.806807 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1341b3d5-e51a-41b0-af6e-bf8b1f770eab'} Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:04:43.807562 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:04:43.808737 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:04:43.810362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:04:43.810362 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e444c44-03c8-4636-9cf6-b9bf0b360c05 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 404 len: 111 microversion: 2.1 time: 0.094863 Jul 25 16:04:43.810362 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 289/519] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:43 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:44.046565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1779470583", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:44.163308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] validate_networks() for [('29236b2a-0a01-4dc1-874d-893614dd0b6b', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:04:46.028196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:04:46.028821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:04:46.029089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:04:46.029506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:04:46.030465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:04:46.046716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:46.047571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:46.048626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:46.049383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:46.081796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:04:46.094575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Getting quotas for user f16ea8cc8a304280a0988dbac8aa1433 and project 92c9c3fb274f4a578bf01dc3ca691967. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:04:46.111977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:04:46.114219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:04:46.118925 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4e25ac9-c70d-49d8-9ca0-06a9e94dad07 tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/11672064-2f20-4f1c-908e-350e2b0fede5" status: 202 len: 0 microversion: 2.1 time: 2.668427 Jul 25 16:04:46.120045 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 231/520] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:04:43 2022] DELETE /compute/v2.1/os-floating-ips/11672064-2f20-4f1c-908e-350e2b0fede5 => generated 0 bytes in 2671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:46.135820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:46.138128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:46.164736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:46.165120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:46.165914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:46.166346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:46.185034 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f0dde67-c1b1-4359-9f7f-b0895378bbf2 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.143735 Jul 25 16:04:46.191601 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 290/521] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:44 2022] POST /compute/v2.1/servers => generated 385 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:04:46.191601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f14f74d6-1de6-4ef0-aade-8f91aed0312c tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93d22a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:46.803221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:46.816049 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67d37e75-19b1-420e-914d-d7214644aeef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.689176 Jul 25 16:04:46.816929 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 232/522] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:46 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:46.835614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-973e125f-0ab2-40f6-ae4f-19976e5a664d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:46.836820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-973e125f-0ab2-40f6-ae4f-19976e5a664d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:46.968049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-973e125f-0ab2-40f6-ae4f-19976e5a664d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:46.983396 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-973e125f-0ab2-40f6-ae4f-19976e5a664d tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1229 microversion: 2.1 time: 0.165032 Jul 25 16:04:46.987198 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 233/523] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:46 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:47.839578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:47.840378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:47.887542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:47.888043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:47.889477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:47.889914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:49.074969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:49.092340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-971211fd-7988-4d71-a833-c789b8cfef3c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 1.256380 Jul 25 16:04:49.093157 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 234/524] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:47 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:49.109760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:49.110832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:49.120329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:49.122801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:49.136381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:49.143225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:49.470319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:49.493059 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b8045719-dc03-4010-a7ed-9cc57a659b50 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1287 microversion: 2.1 time: 0.392816 Jul 25 16:04:49.512015 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 235/525] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:49 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1287 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:49.891555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1853092983", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "934be3e8-a3dc-4628-bdcf-841c71054ba0"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:49.933209 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f14f74d6-1de6-4ef0-aade-8f91aed0312c tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/1483428d-8a87-49a4-85ab-3a77c7f06453" status: 202 len: 0 microversion: 2.1 time: 3.745736 Jul 25 16:04:49.936668 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 291/526] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:04:46 2022] DELETE /compute/v2.1/os-floating-ips/1483428d-8a87-49a4-85ab-3a77c7f06453 => generated 0 bytes in 3747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:04:49.941977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc384866-c2ea-453f-8938-32725f73e73d tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] Calling method '.version_select at 0x7f9d93d86dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:50.015132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] validate_networks() for [('934be3e8-a3dc-4628-bdcf-841c71054ba0', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:04:53.220883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:04:53.220883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:04:53.220883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:04:53.222823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:04:53.222823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:04:53.225436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:53.258275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:53.258733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:53.259762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:53.262828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:53.300941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:04:53.314944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for user d8d1e6f3591a4c4ea97eadbd97954916 and project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:04:53.339200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:04:53.342166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:04:53.417912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d675a40-8cd7-4165-a5ad-911fd8f4f59a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.916265 Jul 25 16:04:53.426799 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 236/527] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:04:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 3925 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:04:53.443010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:53.444456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:53.453681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:53.454298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:53.455605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:53.456202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:53.547478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc384866-c2ea-453f-8938-32725f73e73d tempest-FloatingIPDetailsTestJSON-401013096 tempest-FloatingIPDetailsTestJSON-401013096-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/a1638050-d8ba-4a9d-ac13-9bc30372ff7c" status: 202 len: 0 microversion: 2.1 time: 3.609445 Jul 25 16:04:53.548669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 292/528] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:04:49 2022] DELETE /compute/v2.1/os-floating-ips/a1638050-d8ba-4a9d-ac13-9bc30372ff7c => generated 0 bytes in 3611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:04:53.847344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a6d54948-c358-4be6-b225-b98b710b7819 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-684359866", "id": 440614555, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:53.852242 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:53.852242 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:53.901602 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a6d54948-c358-4be6-b225-b98b710b7819 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 469 microversion: 2.86 time: 0.351699 Jul 25 16:04:53.916709 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 293/529] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:04:53 2022] POST /compute/v2.1/flavors => generated 469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:04:53.922388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:53.927148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:53.942164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:53.942626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:53.943621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:53.946299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:53.995112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:54.005032 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9f3b7619-671c-455d-a1f5-495452803e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.576788 Jul 25 16:04:54.009303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 237/530] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:53 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:54.033691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5df446e-bbe4-400a-8ced-527c6f800c16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:54.037988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5df446e-bbe4-400a-8ced-527c6f800c16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:54.286596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5df446e-bbe4-400a-8ced-527c6f800c16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:54.315423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5df446e-bbe4-400a-8ced-527c6f800c16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1215 microversion: 2.1 time: 0.291025 Jul 25 16:04:54.334136 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 238/531] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:54 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:54.357252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16f4061b-d2bf-4d7d-aafd-968c0b0f9e70 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:54.363990 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:54.363990 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:04:54.576117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:54.584887 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11d0b68e-ab3b-46e3-9d13-7801ab55015b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.666425 Jul 25 16:04:54.589788 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 294/532] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:53 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:54.797636 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16f4061b-d2bf-4d7d-aafd-968c0b0f9e70 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/440614555/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.474321 Jul 25 16:04:54.804042 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 239/533] 10.222.0.105 () {62 vars in 1267 bytes} [Mon Jul 25 16:04:54 2022] POST /compute/v2.1/flavors/440614555/os-extra_specs => generated 62 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:54.809373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53cabdd1-5b11-4bcb-b9f0-6f8957f4fd46 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:54.810492 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:04:54.810492 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:04:54.831568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53cabdd1-5b11-4bcb-b9f0-6f8957f4fd46 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/440614555" status: 202 len: 0 microversion: 2.86 time: 0.025829 Jul 25 16:04:54.836352 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 295/534] 10.222.0.105 () {60 vars in 1204 bytes} [Mon Jul 25 16:04:54 2022] DELETE /compute/v2.1/flavors/440614555 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:54.843408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac3f08c7-bd00-462b-a5a0-f620959071b5 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:54.872758 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac3f08c7-bd00-462b-a5a0-f620959071b5 tempest-FlavorMetadataValidation-1498610135 tempest-FlavorMetadataValidation-1498610135-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6717 microversion: 2.86 time: 0.034576 Jul 25 16:04:54.874810 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 240/535] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:04:54 2022] GET /compute/v2.1/flavors/detail => generated 6717 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:04:55.044277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:55.045225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:55.065932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.066241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.067041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.067475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.345115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:55.345115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:55.376078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.376981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.379247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.381774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.555172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:55.564875 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-05d10e8f-ef23-495f-9e52-62862d60d8b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.532719 Jul 25 16:04:55.571808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 296/536] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:55 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:55.587831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-761748e7-fad1-4459-a954-525ce3f1207e req-fce766b5-2db2-433c-a245-1db0a1fb6c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c79f57-c16b-4c61-a6d3-f6da695305f9", "tag": "c5b758b5-3ebf-4e34-8ee2-b9fda4266861"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:04:55.617260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-761748e7-fad1-4459-a954-525ce3f1207e req-fce766b5-2db2-433c-a245-1db0a1fb6c76 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.627493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-761748e7-fad1-4459-a954-525ce3f1207e req-fce766b5-2db2-433c-a245-1db0a1fb6c76 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.659102 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-761748e7-fad1-4459-a954-525ce3f1207e req-fce766b5-2db2-433c-a245-1db0a1fb6c76 service nova] Creating event network-changed:c5b758b5-3ebf-4e34-8ee2-b9fda4266861 for instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 on n-h1-846219-13 Jul 25 16:04:55.690082 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-761748e7-fad1-4459-a954-525ce3f1207e req-fce766b5-2db2-433c-a245-1db0a1fb6c76 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116340 Jul 25 16:04:55.690536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 297/537] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:04:55.707596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:55.708667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:55.738041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.738493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.739403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:55.739840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:55.881977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:55.894308 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f069dd75-36d9-4229-8288-23a2ea14a1dd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1211 microversion: 2.1 time: 0.556621 Jul 25 16:04:55.894902 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 241/538] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:55 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1211 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:56.074229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:56.107152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:56.361049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:56.423467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d543a39b-b369-4781-ac6a-1b40dce0c7f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.704886 Jul 25 16:04:56.424141 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 298/539] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:55 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:56.592924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:56.595225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:56.615306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:56.616279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:56.620544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:56.625199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:56.923661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:56.925703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:56.947834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:56.950754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:56.957787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:56.958659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:57.131650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:57.139689 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c7064dd-651f-459b-9476-f22ff78b9449 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1273 microversion: 2.1 time: 0.226623 Jul 25 16:04:57.155080 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 299/540] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:56 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:57.177433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:57.192827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e21b9aa-aee1-4a26-b351-7ab9a1f1c8c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1480 microversion: 2.1 time: 0.604652 Jul 25 16:04:57.195378 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 242/541] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:56 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1480 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:57.444104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:57.444938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:57.458576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:57.459375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:57.460314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:57.462148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:57.698653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:57.708148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-861f6027-88b7-4e41-a700-36dc74b6b8c5 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.267889 Jul 25 16:04:57.709524 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 300/542] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:57 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:58.161577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:58.163090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:58.170990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:58.171565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:58.172533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:58.173122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:58.217482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:58.218318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:58.232083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:58.232557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:58.233371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:58.234180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:58.367773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:58.406243 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d284c341-4454-43e8-b879-8fe6959313e8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1273 microversion: 2.1 time: 0.248469 Jul 25 16:04:58.416767 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 243/543] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:58 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:58.486642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:58.498150 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aeeab220-5613-4528-b6c2-c0017465d993 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1479 microversion: 2.1 time: 0.286301 Jul 25 16:04:58.498998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 301/544] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:58 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1479 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:58.730247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:58.731138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:58.738046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:58.738508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:58.739280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:58.739714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:58.956232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:58.965770 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f0985448-6c3c-4727-beb1-273dbb6f521b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.238896 Jul 25 16:04:58.969803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 244/545] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:58 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:59.437282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:59.438661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:59.446675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:59.447412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:59.448434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:59.449074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:59.523759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:59.524379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:04:59.542931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:59.544334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:59.547208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:04:59.551696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:04:59.569744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:04:59.582297 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb128b3d-6aa1-4fcb-9e3a-d9c7759b36d2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1273 microversion: 2.1 time: 0.144664 Jul 25 16:04:59.593446 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 302/546] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:59 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:59.992119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:04:59.994099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:00.007892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:00.008349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:00.014227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:00.016878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:00.056477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:00.069750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bba04155-5813-4b99-80cc-c897afdfb609 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1479 microversion: 2.1 time: 0.552281 Jul 25 16:05:00.088116 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 245/547] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:59 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1479 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:00.499715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:00.515075 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8dc0b07-56d6-455a-aeb9-867b3bbfbcdb tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.528216 Jul 25 16:05:00.516095 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 303/548] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:04:59 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:00.565465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:00.566560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:00.581381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:00.581988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:00.582863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:00.583355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:00.609304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:00.610247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:00.645055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:00.646216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:00.650188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:05:00.651360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:00.652904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:00.824403 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5709e47-0d0d-4252-8e46-d52df6e2862b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 204 len: 0 microversion: 2.1 time: 0.263414 Jul 25 16:05:00.836019 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 246/549] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:05:00 2022] DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:01.066758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-68bd02e9-6cfe-4359-ab1e-f96203d4f445 req-acbb312d-494d-4ce2-8753-0dc2969b9984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfbc09e-4c5b-48c5-9422-1c12520e3386", "name": "network-vif-unplugged", "status": "completed", "tag": "bfac8b30-b4a5-49c8-bf39-2782f7de06de"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:01.108288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-68bd02e9-6cfe-4359-ab1e-f96203d4f445 req-acbb312d-494d-4ce2-8753-0dc2969b9984 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:01.112147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-68bd02e9-6cfe-4359-ab1e-f96203d4f445 req-acbb312d-494d-4ce2-8753-0dc2969b9984 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:01.160819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.176731 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-68bd02e9-6cfe-4359-ab1e-f96203d4f445 req-acbb312d-494d-4ce2-8753-0dc2969b9984 service nova] Creating event network-vif-unplugged:bfac8b30-b4a5-49c8-bf39-2782f7de06de for instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 on n-h1-846219-13 Jul 25 16:05:01.219161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:01.222016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=81 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.230473 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2883221b-3e59-4a98-9a30-43b0343fba37 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.629403 Jul 25 16:05:01.230764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-68bd02e9-6cfe-4359-ab1e-f96203d4f445 req-acbb312d-494d-4ce2-8753-0dc2969b9984 service nova] Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:05:01.241484 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 304/550] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:00 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:01.249057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:01.252062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:01.266337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:01.268115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:01.272195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:01.272883 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-68bd02e9-6cfe-4359-ab1e-f96203d4f445 req-acbb312d-494d-4ce2-8753-0dc2969b9984 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209680 Jul 25 16:05:01.273194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:01.276588 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 247/551] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:01.298368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-525565187", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "1050889106", "adminPass": "***", "networks": [{"uuid": "64159bf9-3631-4b00-a2a2-65fc3ccd367f"}], "security_groups": [{"name": "tempest-securitygroup--307858072"}], "key_name": "tempest-keypair-2032354285", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:01.629977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:01.633499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] validate_networks() for [('64159bf9-3631-4b00-a2a2-65fc3ccd367f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:05:01.639844 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-728c2c69-c84c-4b94-bf03-73e3336179e0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1479 microversion: 2.1 time: 0.396624 Jul 25 16:05:01.640530 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 305/552] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:01 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1479 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:01.897602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1108662958", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:02.006982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] validate_networks() for [('642d87a1-e2ff-4d5e-ad13-3454b40dcf1c', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:05:03.276497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:03.407392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:05:03.408027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:05:03.408651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:05:03.409247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:05:03.409799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:05:03.427117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:03.427563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:03.428373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:03.428798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:03.469808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Getting quotas for project b189f6c36b0c4f6792d9a3e354f535a6. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:03.490467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Getting quotas for user 36d8a0c9ba5a40759ee0838c7ef265cb and project b189f6c36b0c4f6792d9a3e354f535a6. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:03.520907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:05:03.532835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:05:03.694204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:05:03.694854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:05:03.695059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:05:03.695630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:05:03.696031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:05:03.712941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:03.716341 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9fd1f02-2a7c-4df7-90b7-1277ba54824e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.437090 Jul 25 16:05:03.727166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:03.731043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:03.731487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:03.737746 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 248/553] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:05:01 2022] POST /compute/v2.1/servers => generated 403 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:05:03.811562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Getting quotas for project f6d6ed3b79394344aa92af0aae019aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:03.834296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Getting quotas for user 1a52447762c64ba5bc1666f908c2154b and project f6d6ed3b79394344aa92af0aae019aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:03.866151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0e83d8ba-9cad-4f04-8e2f-4e43093da0ba tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-250347167", "id": 960141432, "os-flavor-access:is_public": "True"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:03.869726 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:03.869726 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:05:03.882265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:05:03.888424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:05:03.923654 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0e83d8ba-9cad-4f04-8e2f-4e43093da0ba tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.172396 Jul 25 16:05:03.926188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 249/554] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:05:03 2022] POST /compute/v2.1/flavors => generated 447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:03.943419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:03.944010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:03.983258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:03.983894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:03.984761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:03.985282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:04.011186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e30fb076-5478-473f-b856-39f96863855b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.366850 Jul 25 16:05:04.020536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 306/555] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:05:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:05:04.022871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:04.023513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:04.048979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:04.051941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:04.052835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:04.058548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:04.723817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:04.739071 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8d8e093-8107-4b91-8cd8-9e56a38e77e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.811570 Jul 25 16:05:04.739989 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 250/556] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:03 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:04.758727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:04.759356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:04.770761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:04.781635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:04.782367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:04.782496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:04.808036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:04.818580 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d0e9dd30-f12a-451b-97cb-75bdd68e8609 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.799685 Jul 25 16:05:04.833261 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 307/557] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:04 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:04.845581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7929b2c7-836b-4343-bca7-81664c06c3c8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:04.847085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7929b2c7-836b-4343-bca7-81664c06c3c8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:05.096716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7929b2c7-836b-4343-bca7-81664c06c3c8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:05.107011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7929b2c7-836b-4343-bca7-81664c06c3c8 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1268 microversion: 2.1 time: 0.282905 Jul 25 16:05:05.128449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 308/558] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:04 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1268 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:05.364745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f73301b7-f565-4996-b005-cad0660840e9 tempest-FlavorsV255TestJSON-2046598092 tempest-FlavorsV255TestJSON-2046598092-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:05.416728 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f73301b7-f565-4996-b005-cad0660840e9 tempest-FlavorsV255TestJSON-2046598092 tempest-FlavorsV255TestJSON-2046598092-project] 10.222.0.105 "GET /compute/v2.1/flavors/960141432" status: 200 len: 447 microversion: 2.55 time: 0.283213 Jul 25 16:05:05.433689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 309/559] 10.222.0.105 () {60 vars in 1201 bytes} [Mon Jul 25 16:05:05 2022] GET /compute/v2.1/flavors/960141432 => generated 447 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:05.438961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:05.443805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:05.456910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:05.457415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:05.471223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:05.471684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:05.541474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:05.560294 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae39a895-a8ab-4b5a-b41d-304b57a9c8cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1479 microversion: 2.1 time: 0.814818 Jul 25 16:05:05.563088 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 251/560] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:04 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1479 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:05.592980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5d4cdc16-5548-4998-aff0-c6c3e8d0864b req-4d1757cf-b3a6-4801-811e-c435734d310a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfbc09e-4c5b-48c5-9422-1c12520e3386", "tag": "bfac8b30-b4a5-49c8-bf39-2782f7de06de"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:05.669544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5d4cdc16-5548-4998-aff0-c6c3e8d0864b req-4d1757cf-b3a6-4801-811e-c435734d310a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:05.671006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5d4cdc16-5548-4998-aff0-c6c3e8d0864b req-4d1757cf-b3a6-4801-811e-c435734d310a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:05.709171 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5d4cdc16-5548-4998-aff0-c6c3e8d0864b req-4d1757cf-b3a6-4801-811e-c435734d310a service nova] Creating event network-changed:bfac8b30-b4a5-49c8-bf39-2782f7de06de for instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 on n-h1-846219-13 Jul 25 16:05:05.717115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:05.726395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-5d4cdc16-5548-4998-aff0-c6c3e8d0864b req-4d1757cf-b3a6-4801-811e-c435734d310a service nova] Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:05:05.744097 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de0d0826-7b86-4c41-ac72-cf3f6738cc2d tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1232 microversion: 2.1 time: 0.308972 Jul 25 16:05:05.746162 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 310/561] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:05 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1232 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:05.764521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e289be74-8e0b-46c8-944f-52013a59e537 req-fbdbef43-bd9a-4130-8826-257c49fa11a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c79f57-c16b-4c61-a6d3-f6da695305f9", "name": "network-vif-plugged", "status": "completed", "tag": "c5b758b5-3ebf-4e34-8ee2-b9fda4266861"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:05.770689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5d4cdc16-5548-4998-aff0-c6c3e8d0864b req-4d1757cf-b3a6-4801-811e-c435734d310a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206023 Jul 25 16:05:05.771539 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 252/562] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:05.791838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44d85e8d-2004-4a74-b6ce-338e18d106ab tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] Action: 'update', calling method: .version_select at 0x7f9da264bb80>, body: {"flavor": {"description": "new"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:05.841081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e289be74-8e0b-46c8-944f-52013a59e537 req-fbdbef43-bd9a-4130-8826-257c49fa11a5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:05.845245 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:05.845245 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:05:05.846323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e289be74-8e0b-46c8-944f-52013a59e537 req-fbdbef43-bd9a-4130-8826-257c49fa11a5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:05.875078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e289be74-8e0b-46c8-944f-52013a59e537 req-fbdbef43-bd9a-4130-8826-257c49fa11a5 service nova] Creating event network-vif-plugged:c5b758b5-3ebf-4e34-8ee2-b9fda4266861 for instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 on n-h1-846219-13 Jul 25 16:05:05.894828 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e289be74-8e0b-46c8-944f-52013a59e537 req-fbdbef43-bd9a-4130-8826-257c49fa11a5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144549 Jul 25 16:05:05.908141 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 311/563] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:05.925762 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-44d85e8d-2004-4a74-b6ce-338e18d106ab tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] 10.222.0.105 "PUT /compute/v2.1/flavors/960141432" status: 200 len: 448 microversion: 2.55 time: 0.152771 Jul 25 16:05:05.927693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:05.929234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:05.949857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:05.953031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:05.954605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:05.956016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 253/564] 10.222.0.105 () {62 vars in 1221 bytes} [Mon Jul 25 16:05:05 2022] PUT /compute/v2.1/flavors/960141432 => generated 448 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:05.963512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:05.972351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:05.977613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:06.005503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:06.006538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:06.029198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:06.036337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:06.849440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:06.884727 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e551264a-55d1-4f83-8845-dca4510f22e6 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 0.966889 Jul 25 16:05:06.888528 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 312/565] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:05 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:06.917219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c1ea38c-6d55-4764-83b9-ac440691d7be tempest-FlavorsV255TestJSON-2046598092 tempest-FlavorsV255TestJSON-2046598092-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:07.032304 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c1ea38c-6d55-4764-83b9-ac440691d7be tempest-FlavorsV255TestJSON-2046598092 tempest-FlavorsV255TestJSON-2046598092-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6627 microversion: 2.55 time: 0.123987 Jul 25 16:05:07.035728 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 313/566] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:05:06 2022] GET /compute/v2.1/flavors/detail => generated 6627 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:05:07.056420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:07.058009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:07.067992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:07.070180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:07.071447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:07.073073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:07.448226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:07.471905 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecac9fdf-92a2-45a3-aae2-3cd4a994caa7 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1326 microversion: 2.1 time: 0.429680 Jul 25 16:05:07.474093 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 314/567] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:07 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1326 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:07.487223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:07.489287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:07.524027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:07.525725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:07.529227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:07.530084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:07.568752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:07.582558 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d496dc60-a02f-4cd3-897d-131fa959e69f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 1.625180 Jul 25 16:05:07.599062 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 254/568] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:05 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:07.613163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:07.614345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:07.626554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:07.627000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:07.628080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:07.637348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:08.132896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:08.141608 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07b23ed6-59a0-4a3c-b40b-03f1ff776fce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1286 microversion: 2.1 time: 0.540878 Jul 25 16:05:08.150188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 255/569] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:07 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1286 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:08.155724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a86c7d28-90fd-4d78-b04d-a07ab3c5b34f tempest-FlavorsV255TestJSON-2046598092 tempest-FlavorsV255TestJSON-2046598092-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:08.199916 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a86c7d28-90fd-4d78-b04d-a07ab3c5b34f tempest-FlavorsV255TestJSON-2046598092 tempest-FlavorsV255TestJSON-2046598092-project] 10.222.0.105 "GET /compute/v2.1/flavors" status: 200 len: 3717 microversion: 2.55 time: 0.048376 Jul 25 16:05:08.200471 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 256/570] 10.222.0.105 () {60 vars in 1171 bytes} [Mon Jul 25 16:05:08 2022] GET /compute/v2.1/flavors => generated 3717 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:05:08.218527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:08.221257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:08.234301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:08.234754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:08.235612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:08.236047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:08.283941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:08.292849 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13b57740-b3e1-4090-9f98-5ce945cfbfdf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1479 microversion: 2.1 time: 0.815947 Jul 25 16:05:08.301855 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 315/571] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:07 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1479 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:08.316103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7d3dd86a-9d62-4934-b64f-fb2124892c86 req-1d0bebe6-4856-4453-a7d8-5436d3c8261e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10982b1-78ba-45a9-830f-6a54e6329bc5", "tag": "02843094-4646-4668-a0b7-2e3e843957fd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:08.355610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7d3dd86a-9d62-4934-b64f-fb2124892c86 req-1d0bebe6-4856-4453-a7d8-5436d3c8261e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:08.356049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7d3dd86a-9d62-4934-b64f-fb2124892c86 req-1d0bebe6-4856-4453-a7d8-5436d3c8261e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:08.384271 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7d3dd86a-9d62-4934-b64f-fb2124892c86 req-1d0bebe6-4856-4453-a7d8-5436d3c8261e service nova] Creating event network-changed:02843094-4646-4668-a0b7-2e3e843957fd for instance b10982b1-78ba-45a9-830f-6a54e6329bc5 on n-h2-846219-13 Jul 25 16:05:08.400905 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7d3dd86a-9d62-4934-b64f-fb2124892c86 req-1d0bebe6-4856-4453-a7d8-5436d3c8261e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097180 Jul 25 16:05:08.401590 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 316/572] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:08.414497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e1f23ad9-7d80-49fc-8d83-6420310dcab3 req-efbc3c2a-a96b-4bc5-b285-5c32e6637b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122ea2ba-aba9-48e7-86c2-1d88fa0a2df2", "name": "network-vif-deleted", "tag": "b8187b51-cec4-423e-809a-7fc8ea7e739d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:08.458588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e1f23ad9-7d80-49fc-8d83-6420310dcab3 req-efbc3c2a-a96b-4bc5-b285-5c32e6637b69 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:08.461972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e1f23ad9-7d80-49fc-8d83-6420310dcab3 req-efbc3c2a-a96b-4bc5-b285-5c32e6637b69 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:08.497916 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e1f23ad9-7d80-49fc-8d83-6420310dcab3 req-efbc3c2a-a96b-4bc5-b285-5c32e6637b69 service nova] Creating event network-vif-deleted:b8187b51-cec4-423e-809a-7fc8ea7e739d for instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 on n-h1-846219-13 Jul 25 16:05:08.535927 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e1f23ad9-7d80-49fc-8d83-6420310dcab3 req-efbc3c2a-a96b-4bc5-b285-5c32e6637b69 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131825 Jul 25 16:05:08.539103 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 317/573] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:08.564486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd98e391-6992-42ae-b003-ff1de38c3124 tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:08.567194 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:08.567194 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:05:08.600702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:08.652068 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd98e391-6992-42ae-b003-ff1de38c3124 tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/960141432" status: 202 len: 0 microversion: 2.55 time: 0.102666 Jul 25 16:05:08.660922 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 318/574] 10.222.0.105 () {60 vars in 1204 bytes} [Mon Jul 25 16:05:08 2022] DELETE /compute/v2.1/flavors/960141432 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:08.676686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:08.678691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:08.697954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:08.698821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:08.699849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:08.701457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:09.527935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:09.543850 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9fe54a1f-6f3f-4c91-8df2-03caf401fb19 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1326 microversion: 2.1 time: 0.881109 Jul 25 16:05:09.547198 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 319/575] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:08 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1326 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:09.560653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:09.566242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:09.578835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:09.585161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:09.587289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:09.591389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:09.797431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:09.823162 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-747b1b5d-011e-45dc-8330-9c5d64f1b655 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1329 microversion: 2.1 time: 1.609691 Jul 25 16:05:09.824541 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 257/576] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:08 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1329 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:09.843925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad6d34b9-1352-48f9-a75c-43934bc53c73 tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:09.917903 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ad6d34b9-1352-48f9-a75c-43934bc53c73 tempest-FlavorsV255TestJSON-1527562259 tempest-FlavorsV255TestJSON-1527562259-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6189 microversion: 2.55 time: 0.089369 Jul 25 16:05:09.919234 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 258/577] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:05:09 2022] GET /compute/v2.1/flavors/detail => generated 6189 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:05:09.936484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:09.943300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:09.954078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:09.956894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:09.960783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:09.969999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.246185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:10.263119 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff9ade67-91bc-4d51-b2c4-8059699f5c66 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1286 microversion: 2.1 time: 0.341380 Jul 25 16:05:10.289599 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 259/578] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:09 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1286 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:10.303145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:10.303787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:10.334369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:10.346986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:10.347616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.350325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:10.350965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.410447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:10.438706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c169198-b534-471b-b781-26e46bf8b700 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.884174 Jul 25 16:05:10.454389 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 320/579] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:09 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:10.574980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:10.576082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:10.605367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:10.606163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.607632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:10.608364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.817041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:10.838462 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-064e1969-a222-4ddf-a58b-6ccb441c2668 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1326 microversion: 2.1 time: 0.270241 Jul 25 16:05:10.845109 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 321/580] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:10 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1326 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:10.850905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:10.854029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:10.879027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:10.882087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.883080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:10.885988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:10.965068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:10.978500 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0d3eb60-a06c-49fd-a6e9-91d14414526f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1477 microversion: 2.1 time: 0.683288 Jul 25 16:05:10.979921 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 260/581] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:10 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1477 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:11.306420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:11.306420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:11.334573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.336875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.343184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.346368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.356845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:11.367253 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e9daae0-06f3-41c5-90db-fb9f5da0c848 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1525 microversion: 2.1 time: 0.520627 Jul 25 16:05:11.369049 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 322/582] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:10 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1525 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:11.405541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:11.415731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:11.436276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.436866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.438984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.444248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.479176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:05:11.621473 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5607cab2-12fa-4238-a847-92418cf1b0e1 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 204 len: 0 microversion: 2.1 time: 0.224696 Jul 25 16:05:11.623236 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 323/583] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:05:11 2022] DELETE /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:11.658999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:11.660030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:11.669906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.670716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.672370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.673024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.874643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:11.906232 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb1b99a1-81fb-491a-b237-640dde578cce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 0.603059 Jul 25 16:05:11.907009 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 261/584] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:11 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:11.939648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:11.940754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:11.951366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.952805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:11.954224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:11.956387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:12.187200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:12.209024 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65499a8f-d46f-40ad-b4ab-43c2d0cfa2c6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.568597 Jul 25 16:05:12.215395 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 324/585] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:11 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:12.244514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:12.250948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:12.274817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:12.277456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:12.281203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:12.286755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:12.662883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:12.683676 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68287377-da7d-4870-8210-488ea5ee7b08 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1531 microversion: 2.1 time: 0.762680 Jul 25 16:05:12.685023 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 262/586] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:11 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1531 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:12.692768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:12.693818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:12.703399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:12.704359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:12.705788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:12.706580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:12.895046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:12.925822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91819a1a-4b4d-4ed3-8d08-f7217feb83fd tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.707928 Jul 25 16:05:12.928566 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 325/587] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:12 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:13.220276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:13.230486 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9a101c8-ce9c-4027-8f19-295a40f477fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1477 microversion: 2.1 time: 0.543447 Jul 25 16:05:13.246427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 263/588] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:12 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1477 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:13.259604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:13.263949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:13.286028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:13.287299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:13.288905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:13.291504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:13.448624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.481766 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aa850cc6-5320-4a24-9fd6-c082766c24f9 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] 10.222.0.105 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.551175 Jul 25 16:05:13.482946 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 326/589] 10.222.0.105 () {58 vars in 1133 bytes} [Mon Jul 25 16:05:12 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 553 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:05:13.489711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:13.492371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:13.501784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=16 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.505330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:13.507084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:13.512841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:13.513732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:13.541560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.757611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.837349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:13.851844 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-539c256a-a494-4d41-a90e-104b2dad1426 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 0.603932 Jul 25 16:05:13.853989 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 264/590] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:13 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:13.869133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccad180b-ae37-4ca9-9e53-4e6f1bab9bf9 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Calling method '.version_select at 0x7f9d93ee80d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:13.891706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:13.911579 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-33f512eb-ba31-486c-9223-3c323717e61d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.427345 Jul 25 16:05:13.918383 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 327/591] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:13 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:13.931017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:13.931017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:13.951757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:13.952217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:13.953607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:13.954368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:14.016865 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ccad180b-ae37-4ca9-9e53-4e6f1bab9bf9 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] HTTP exception thrown: Image not found. Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccad180b-ae37-4ca9-9e53-4e6f1bab9bf9 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Request method failure captured: Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r844-nmJTis6LoB6hykz_NWJjspqnYuVraV2BNu4XwG3kf0JHan-jZyckGihGq4AXFOmsvfLz4A_jrFv_UhP0ZjnHqzeCM7SmM9TrS5uhpjn49jonFCsKIpHDS4-VeUnhi7cTKHaoUoRwgmW4bagF6_lvcZG6WF971_2ChFM93h7Ck Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:14.020813 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b287ca0b55504f9f96dc9f1c18bbe937"}]}] Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b7c5196dc1824aa18a24394d3ab237c7 Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '-1'} Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:14.023553 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.025355 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:14.027609 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccad180b-ae37-4ca9-9e53-4e6f1bab9bf9 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ccad180b-ae37-4ca9-9e53-4e6f1bab9bf9 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] 10.222.0.105 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.167556 Jul 25 16:05:14.032512 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 265/592] 10.222.0.105 () {58 vars in 1139 bytes} [Mon Jul 25 16:05:13 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:14.035741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:14.035741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:14.063862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:14.064307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:14.069315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:14.070243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:14.563798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:14.571704 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e257b3a-8793-4fe2-9bc3-6cdee97d12ba tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1531 microversion: 2.1 time: 0.651812 Jul 25 16:05:14.585432 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 328/593] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:13 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1531 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:14.612031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2990c7bf-42ff-49ae-ba3a-5c4be9e25ff6 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Calling method '.version_select at 0x7f9d93d06280>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:14.684851 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-2990c7bf-42ff-49ae-ba3a-5c4be9e25ff6 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] HTTP exception thrown: Image not found. Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2990c7bf-42ff-49ae-ba3a-5c4be9e25ff6 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Request method failure captured: Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/images/921b41b9-13ec-4d55-a745-bf26c811dc1j HTTP/1.1 Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r844-nmJTis6LoB6hykz_NWJjspqnYuVraV2BNu4XwG3kf0JHan-jZyckGihGq4AXFOmsvfLz4A_jrFv_UhP0ZjnHqzeCM7SmM9TrS5uhpjn49jonFCsKIpHDS4-VeUnhi7cTKHaoUoRwgmW4bagF6_lvcZG6WF971_2ChFM93h7Ck Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:05:14.687072 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b287ca0b55504f9f96dc9f1c18bbe937"}]}] Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b7c5196dc1824aa18a24394d3ab237c7 Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '921b41b9-13ec-4d55-a745-bf26c811dc1j'} Jul 25 16:05:14.688394 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 921b41b9-13ec-4d55-a745-bf26c811dc1j to delete Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:14.689296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 921b41b9-13ec-4d55-a745-bf26c811dc1j could not be found. Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:14.690410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:14.692533 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:14.695457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2990c7bf-42ff-49ae-ba3a-5c4be9e25ff6 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:14.696550 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2990c7bf-42ff-49ae-ba3a-5c4be9e25ff6 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] 10.222.0.105 "DELETE /compute/v2.1/images/921b41b9-13ec-4d55-a745-bf26c811dc1j" status: 404 len: 62 microversion: 2.1 time: 0.110054 Jul 25 16:05:14.702351 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 329/594] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:14 2022] DELETE /compute/v2.1/images/921b41b9-13ec-4d55-a745-bf26c811dc1j => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:14.714409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:14.715685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:14.730619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:14.733405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:14.734359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:14.735045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:14.853850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:14.873712 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3b7642a-93a8-4ffa-bc60-0d9f6882c923 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.847584 Jul 25 16:05:14.880071 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 266/595] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:14 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:14.904979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-acb48997-3f69-45ab-85c9-9e9886ca4f98 req-6d7866a1-e177-424a-872a-f5ee829d6a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:14.947384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-acb48997-3f69-45ab-85c9-9e9886ca4f98 req-6d7866a1-e177-424a-872a-f5ee829d6a3e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:14.948897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-acb48997-3f69-45ab-85c9-9e9886ca4f98 req-6d7866a1-e177-424a-872a-f5ee829d6a3e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:15.006426 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-acb48997-3f69-45ab-85c9-9e9886ca4f98 req-6d7866a1-e177-424a-872a-f5ee829d6a3e service nova] Creating event network-changed:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:05:15.023502 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-acb48997-3f69-45ab-85c9-9e9886ca4f98 req-6d7866a1-e177-424a-872a-f5ee829d6a3e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136876 Jul 25 16:05:15.035522 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 267/596] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:15.049448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e4e36cc-dd3f-4eeb-94ea-9d5bb77ed668 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Calling method '.version_select at 0x7f9d93f264c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:15.104117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:15.117404 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-8e4e36cc-dd3f-4eeb-94ea-9d5bb77ed668 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] HTTP exception thrown: Image not found. Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e4e36cc-dd3f-4eeb-94ea-9d5bb77ed668 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Request method failure captured: Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/5400af92-49a3-4e85-a60d-533cc529a6571 HTTP/1.1 Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r844-nmJTis6LoB6hykz_NWJjspqnYuVraV2BNu4XwG3kf0JHan-jZyckGihGq4AXFOmsvfLz4A_jrFv_UhP0ZjnHqzeCM7SmM9TrS5uhpjn49jonFCsKIpHDS4-VeUnhi7cTKHaoUoRwgmW4bagF6_lvcZG6WF971_2ChFM93h7Ck Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:15.120122 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b287ca0b55504f9f96dc9f1c18bbe937"}]}] Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b7c5196dc1824aa18a24394d3ab237c7 Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5400af92-49a3-4e85-a60d-533cc529a6571'} Jul 25 16:05:15.121864 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5400af92-49a3-4e85-a60d-533cc529a6571 to delete Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:15.122814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5400af92-49a3-4e85-a60d-533cc529a6571 could not be found. Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:15.124196 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:15.125657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:15.128094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e4e36cc-dd3f-4eeb-94ea-9d5bb77ed668 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:15.129381 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e4e36cc-dd3f-4eeb-94ea-9d5bb77ed668 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] 10.222.0.105 "DELETE /compute/v2.1/images/5400af92-49a3-4e85-a60d-533cc529a6571" status: 404 len: 62 microversion: 2.1 time: 0.094963 Jul 25 16:05:15.131688 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 268/597] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:05:15 2022] DELETE /compute/v2.1/images/5400af92-49a3-4e85-a60d-533cc529a6571 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:15.148956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:15.150303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:15.165711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:15.168426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:15.169536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:15.173028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:15.847773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:15.891748 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71106899-1a1e-4bcf-bea4-b54d40e75215 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1474 microversion: 2.1 time: 1.188336 Jul 25 16:05:15.902624 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 330/598] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:14 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1474 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:15.916447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:15.923748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:15.939247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:15.939990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:15.944972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:15.946961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.310087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:16.320134 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25904a90-1a27-4567-a569-ad0cdf4c0b2a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 1.182005 Jul 25 16:05:16.322856 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 269/599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:15 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:16.340343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-661fd3da-cb97-4de5-b082-c9de2eddc8e5 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Calling method '.version_select at 0x7f9d93ee8940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:16.379386 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-661fd3da-cb97-4de5-b082-c9de2eddc8e5 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] HTTP exception thrown: Image not found. Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-661fd3da-cb97-4de5-b082-c9de2eddc8e5 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Request method failure captured: Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/tempest-invalid-2022245721 HTTP/1.1 Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r844-nmJTis6LoB6hykz_NWJjspqnYuVraV2BNu4XwG3kf0JHan-jZyckGihGq4AXFOmsvfLz4A_jrFv_UhP0ZjnHqzeCM7SmM9TrS5uhpjn49jonFCsKIpHDS4-VeUnhi7cTKHaoUoRwgmW4bagF6_lvcZG6WF971_2ChFM93h7Ck Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:16.381354 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b287ca0b55504f9f96dc9f1c18bbe937"}]}] Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b7c5196dc1824aa18a24394d3ab237c7 Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'tempest-invalid-2022245721'} Jul 25 16:05:16.382592 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2022245721 to delete Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:16.383349 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2022245721 could not be found. Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:16.384424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-661fd3da-cb97-4de5-b082-c9de2eddc8e5 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:16.385657 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-661fd3da-cb97-4de5-b082-c9de2eddc8e5 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] 10.222.0.105 "DELETE /compute/v2.1/images/tempest-invalid-2022245721" status: 404 len: 62 microversion: 2.1 time: 0.058330 Jul 25 16:05:16.388548 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 270/600] 10.222.0.105 () {58 vars in 1211 bytes} [Mon Jul 25 16:05:16 2022] DELETE /compute/v2.1/images/tempest-invalid-2022245721 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:16.403389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:16.404544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:16.413031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.414292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.415922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.416681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.470708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:16.485493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4d7d6f63-6ac0-409a-bac3-63dbf91e8ef3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.575268 Jul 25 16:05:16.497850 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 331/601] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:15 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:16.507241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:16.507686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:16.528992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.530355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.532180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.532994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.795460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:16.821118 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6a32b96-f215-43c0-a794-dfe3bd1ebe4b tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1531 microversion: 2.1 time: 0.431197 Jul 25 16:05:16.826601 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 271/602] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:16 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1531 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:16.844434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:16.845277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:16.854950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.855584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.856399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.856865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.898967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:16.907998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:16.916973 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dbb89fd1-150f-44d1-8864-70f792be4afe tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.417868 Jul 25 16:05:16.920441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 332/603] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:16 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:16.929922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1111a5d7-225b-4871-88a8-38ce39ce1cef req-53333a38-1218-4082-8b7b-1c12536bc95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa29098-04ba-4426-8bd1-0bfa9dfa384f", "tag": "392f7b43-f4e8-4202-b34f-37c5d24445e2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:16.948111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1111a5d7-225b-4871-88a8-38ce39ce1cef req-53333a38-1218-4082-8b7b-1c12536bc95e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:16.948654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1111a5d7-225b-4871-88a8-38ce39ce1cef req-53333a38-1218-4082-8b7b-1c12536bc95e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:16.957820 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fdb25507-7e3b-4e9e-b869-8759f9e0c535 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386/action" status: 204 len: 0 microversion: 2.1 time: 0.129508 Jul 25 16:05:16.961158 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 272/604] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:05:16 2022] POST /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386/action => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:16.964786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1111a5d7-225b-4871-88a8-38ce39ce1cef req-53333a38-1218-4082-8b7b-1c12536bc95e service nova] Creating event network-changed:392f7b43-f4e8-4202-b34f-37c5d24445e2 for instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f on n-h1-846219-13 Jul 25 16:05:16.969085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-726bb677-a9db-45d9-96a4-ec665990fc66 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Calling method '.version_select at 0x7f9d93e061f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:16.970396 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1111a5d7-225b-4871-88a8-38ce39ce1cef req-53333a38-1218-4082-8b7b-1c12536bc95e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048695 Jul 25 16:05:16.971210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 333/605] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:17.016326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-726bb677-a9db-45d9-96a4-ec665990fc66 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] HTTP exception thrown: Image not found. Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-726bb677-a9db-45d9-96a4-ec665990fc66 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Request method failure captured: Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/59c47d79-4701-4ed2-8b07-a86cde5ef2e9 HTTP/1.1 Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r844-nmJTis6LoB6hykz_NWJjspqnYuVraV2BNu4XwG3kf0JHan-jZyckGihGq4AXFOmsvfLz4A_jrFv_UhP0ZjnHqzeCM7SmM9TrS5uhpjn49jonFCsKIpHDS4-VeUnhi7cTKHaoUoRwgmW4bagF6_lvcZG6WF971_2ChFM93h7Ck Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:17.018332 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b287ca0b55504f9f96dc9f1c18bbe937"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b287ca0b55504f9f96dc9f1c18bbe937"}]}] Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b287ca0b55504f9f96dc9f1c18bbe937 Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270 Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b7c5196dc1824aa18a24394d3ab237c7 Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1244056270-project Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '59c47d79-4701-4ed2-8b07-a86cde5ef2e9'} Jul 25 16:05:17.019596 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 59c47d79-4701-4ed2-8b07-a86cde5ef2e9 to delete Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:17.020354 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59c47d79-4701-4ed2-8b07-a86cde5ef2e9 could not be found. Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:17.022183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-726bb677-a9db-45d9-96a4-ec665990fc66 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:17.023525 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-726bb677-a9db-45d9-96a4-ec665990fc66 tempest-ImagesDeleteNegativeTestJSON-1244056270 tempest-ImagesDeleteNegativeTestJSON-1244056270-project] 10.222.0.105 "DELETE /compute/v2.1/images/59c47d79-4701-4ed2-8b07-a86cde5ef2e9" status: 404 len: 62 microversion: 2.1 time: 0.059635 Jul 25 16:05:17.024923 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 273/606] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:16 2022] DELETE /compute/v2.1/images/59c47d79-4701-4ed2-8b07-a86cde5ef2e9 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:17.036046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:17.037342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:17.049083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:17.050557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:17.051449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:17.051884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:17.240102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff350a25-6b41-42c8-a572-6b715780005f tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-488229370", "id": 2064520921, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:17.243337 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:17.243337 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:05:17.271957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff350a25-6b41-42c8-a572-6b715780005f tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 469 microversion: 2.61 time: 0.297515 Jul 25 16:05:17.273164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 334/607] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:05:16 2022] POST /compute/v2.1/flavors => generated 469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:17.419635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:17.427659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fb58521-dbca-4642-bf33-5e7a2e3c70c8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1474 microversion: 2.1 time: 0.405545 Jul 25 16:05:17.428254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 274/608] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:17 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:17.433011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:17.441629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:17.455833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:17.456282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:17.457076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:17.457542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:17.547793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4cf5e3a6-0ba3-4f77-9f96-3f68210534a3 tempest-FlavorsV261TestJSON-1760726474 tempest-FlavorsV261TestJSON-1760726474-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:17.563097 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4cf5e3a6-0ba3-4f77-9f96-3f68210534a3 tempest-FlavorsV261TestJSON-1760726474 tempest-FlavorsV261TestJSON-1760726474-project] 10.222.0.105 "GET /compute/v2.1/flavors/2064520921" status: 200 len: 469 microversion: 2.61 time: 0.271498 Jul 25 16:05:17.571003 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 335/609] 10.222.0.105 () {60 vars in 1204 bytes} [Mon Jul 25 16:05:17 2022] GET /compute/v2.1/flavors/2064520921 => generated 469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:05:17.581519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:17.582264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:17.592491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:17.593315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:17.595270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:17.596084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:17.974727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:17.988975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30ad3908-f1cd-438d-80ca-b4e85d7b1ce1 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 0.559230 Jul 25 16:05:17.990494 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 275/610] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:17 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:17.999466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab31a595-0d10-450b-a70f-05d2ede216d9 tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:18.004943 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:18.004943 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:05:18.091323 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ab31a595-0d10-450b-a70f-05d2ede216d9 tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] 10.222.0.105 "PUT /compute/v2.1/flavors/2064520921" status: 200 len: 470 microversion: 2.61 time: 0.098649 Jul 25 16:05:18.092368 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 276/611] 10.222.0.105 () {62 vars in 1224 bytes} [Mon Jul 25 16:05:17 2022] PUT /compute/v2.1/flavors/2064520921 => generated 470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:18.108981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:18.110608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:18.124654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:18.125720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:18.127194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:18.128736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:18.208147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:18.222948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dfe18558-4b17-4414-b1c8-48c915d1cfed tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.650505 Jul 25 16:05:18.225578 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 336/612] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:17 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:18.237938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:18.238853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:18.253823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:18.254607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:18.255704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:18.256483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:18.328323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16ea8cc8a304280a0988dbac8aa1433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c9c3fb274f4a578bf01dc3ca691967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:18.352804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12256338-118e-4c3c-be6e-de976540d816 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 200 len: 1489 microversion: 2.1 time: 0.258508 Jul 25 16:05:18.367290 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 277/613] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:18 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 1489 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:18.377044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9b7dece1-0928-4994-a70f-ba30157788b2 tempest-FlavorsV261TestJSON-1760726474 tempest-FlavorsV261TestJSON-1760726474-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:18.431287 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9b7dece1-0928-4994-a70f-ba30157788b2 tempest-FlavorsV261TestJSON-1760726474 tempest-FlavorsV261TestJSON-1760726474-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 7193 microversion: 2.61 time: 0.061524 Jul 25 16:05:18.445541 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 278/614] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:05:18 2022] GET /compute/v2.1/flavors/detail => generated 7193 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:05:18.461292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:18.461800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:18.472383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:18.472829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:18.473653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:18.474078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:18.927346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:18.941916 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6a3fb0e9-8a56-428c-b608-6cd03fe7cc8d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.714653 Jul 25 16:05:18.961509 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 337/615] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:18 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:18.968971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b897109-937c-4bac-bcb5-a77ba09449b5 tempest-FlavorsV261TestJSON-1760726474 tempest-FlavorsV261TestJSON-1760726474-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:19.028759 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b897109-937c-4bac-bcb5-a77ba09449b5 tempest-FlavorsV261TestJSON-1760726474 tempest-FlavorsV261TestJSON-1760726474-project] 10.222.0.105 "GET /compute/v2.1/flavors" status: 200 len: 3720 microversion: 2.61 time: 0.062793 Jul 25 16:05:19.030291 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 338/616] 10.222.0.105 () {60 vars in 1171 bytes} [Mon Jul 25 16:05:18 2022] GET /compute/v2.1/flavors => generated 3720 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:05:19.036649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-44d02c31-af2a-46b6-8254-1c6305415400 req-fcfe288f-bb14-4af4-9a9c-6899c6f75698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10982b1-78ba-45a9-830f-6a54e6329bc5", "name": "network-vif-plugged", "status": "completed", "tag": "02843094-4646-4668-a0b7-2e3e843957fd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:19.067093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-44d02c31-af2a-46b6-8254-1c6305415400 req-fcfe288f-bb14-4af4-9a9c-6899c6f75698 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.068069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-44d02c31-af2a-46b6-8254-1c6305415400 req-fcfe288f-bb14-4af4-9a9c-6899c6f75698 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.093638 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-44d02c31-af2a-46b6-8254-1c6305415400 req-fcfe288f-bb14-4af4-9a9c-6899c6f75698 service nova] Creating event network-vif-plugged:02843094-4646-4668-a0b7-2e3e843957fd for instance b10982b1-78ba-45a9-830f-6a54e6329bc5 on n-h2-846219-13 Jul 25 16:05:19.100065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-44d02c31-af2a-46b6-8254-1c6305415400 req-fcfe288f-bb14-4af4-9a9c-6899c6f75698 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068000 Jul 25 16:05:19.107347 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 339/617] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:19.117183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:19.119070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:19.129890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.130989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.132431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.133136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.243202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:19.319966 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94872106-b515-4a56-b4cc-8bde119ae28d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1474 microversion: 2.1 time: 0.861022 Jul 25 16:05:19.324562 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 279/618] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:18 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1474 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:19.351131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bf32ce95-e7c2-427a-9f6d-3e42eefdee0d req-68eb4f64-ce9e-41a2-a8ab-ccf2697c1641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c79f57-c16b-4c61-a6d3-f6da695305f9", "name": "network-vif-deleted", "tag": "c5b758b5-3ebf-4e34-8ee2-b9fda4266861"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:19.379024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bf32ce95-e7c2-427a-9f6d-3e42eefdee0d req-68eb4f64-ce9e-41a2-a8ab-ccf2697c1641 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.379886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bf32ce95-e7c2-427a-9f6d-3e42eefdee0d req-68eb4f64-ce9e-41a2-a8ab-ccf2697c1641 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.410896 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bf32ce95-e7c2-427a-9f6d-3e42eefdee0d req-68eb4f64-ce9e-41a2-a8ab-ccf2697c1641 service nova] Creating event network-vif-deleted:c5b758b5-3ebf-4e34-8ee2-b9fda4266861 for instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 on n-h1-846219-13 Jul 25 16:05:19.420299 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bf32ce95-e7c2-427a-9f6d-3e42eefdee0d req-68eb4f64-ce9e-41a2-a8ab-ccf2697c1641 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092045 Jul 25 16:05:19.421793 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 280/619] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:19.461743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-126a7e44-ed1c-4627-84c3-46992eedd583 tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:19.476970 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:19.476970 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:05:19.522486 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-126a7e44-ed1c-4627-84c3-46992eedd583 tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/2064520921" status: 202 len: 0 microversion: 2.61 time: 0.096490 Jul 25 16:05:19.524130 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 281/620] 10.222.0.105 () {60 vars in 1207 bytes} [Mon Jul 25 16:05:19 2022] DELETE /compute/v2.1/flavors/2064520921 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:19.534636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:19.536424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:19.552347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.553588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.555460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.556531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.903635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:19.913008 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2adcfefc-864d-4868-8867-68da4472e3ce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 0.803593 Jul 25 16:05:19.914064 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 340/621] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:19 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:19.931304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:19.932431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 43c79f57-c16b-4c61-a6d3-f6da695305f9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:19.941388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.943222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.944148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:19.944652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:19.970841 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 could not be found. Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 HTTP/1.1 Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:05:19.974941 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 could not be found. Jul 25 16:05:19.976579 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '43c79f57-c16b-4c61-a6d3-f6da695305f9'} Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 could not be found. Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:19.977467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 could not be found. Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 could not be found. Jul 25 16:05:19.978784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:19.980800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 43c79f57-c16b-4c61-a6d3-f6da695305f9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:19.981942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-690fb61f-bb3c-4a32-b889-75360797e1f7 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9" status: 404 len: 111 microversion: 2.1 time: 0.066887 Jul 25 16:05:19.985832 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 341/622] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:19 2022] GET /compute/v2.1/servers/43c79f57-c16b-4c61-a6d3-f6da695305f9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:05:19.988369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1cd316ab-4975-458f-98ff-85bef3c9a2bc tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.023247 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1cd316ab-4975-458f-98ff-85bef3c9a2bc tempest-FlavorsV261TestJSON-2060911863 tempest-FlavorsV261TestJSON-2060911863-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 6733 microversion: 2.61 time: 0.038610 Jul 25 16:05:20.023730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:20.037130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 342/623] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:05:19 2022] GET /compute/v2.1/flavors/detail => generated 6733 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:05:20.037130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.038606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:20.046884 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d99d9540-7cd5-47cd-baea-7b322fbe4a53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1315 microversion: 2.1 time: 0.520752 Jul 25 16:05:20.049688 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 282/624] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:19 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:20.062025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c2179d6-010b-45a6-b1b1-e5aa781db257 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '.version_select at 0x7f9d93f02790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.083245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.084155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.086340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.090904 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5c2179d6-010b-45a6-b1b1-e5aa781db257 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Image not found. Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c2179d6-010b-45a6-b1b1-e5aa781db257 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a HTTP/1.1 Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:20.092789 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '91f02e46-0ce2-4a22-bb56-f7c4a62e228a'} Jul 25 16:05:20.094409 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 91f02e46-0ce2-4a22-bb56-f7c4a62e228a to delete Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.095269 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f02e46-0ce2-4a22-bb56-f7c4a62e228a could not be found. Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:20.096564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c2179d6-010b-45a6-b1b1-e5aa781db257 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:20.097989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5c2179d6-010b-45a6-b1b1-e5aa781db257 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a" status: 404 len: 62 microversion: 2.1 time: 0.045508 Jul 25 16:05:20.108507 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 283/625] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:20 2022] DELETE /compute/v2.1/images/91f02e46-0ce2-4a22-bb56-f7c4a62e228a => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:20.113848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.114352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:20.114741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.135237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.135962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.136790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.137472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.171963 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab HTTP/1.1 Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:20.173612 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.175760 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '1341b3d5-e51a-41b0-af6e-bf8b1f770eab'} Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:20.176747 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.179076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.180782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:20.187616 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4754b1b2-2c88-4bf4-ae5a-912c98d775da tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 404 len: 111 microversion: 2.1 time: 0.077562 Jul 25 16:05:20.191586 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 284/626] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:05:20 2022] DELETE /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:05:20.399032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e87e468a-a361-4434-9377-b01a2eab8aaf tempest-ListImagesTestJSON-1030912363 tempest-ListImagesTestJSON-1030912363-project] Calling method '.version_select at 0x7f9d93f02670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.477727 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e87e468a-a361-4434-9377-b01a2eab8aaf tempest-ListImagesTestJSON-1030912363 tempest-ListImagesTestJSON-1030912363-project] 10.222.0.105 "GET /compute/v2.1/images/984a5010-f259-40b9-952b-c497908cc5d8" status: 200 len: 787 microversion: 2.1 time: 0.282961 Jul 25 16:05:20.480593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 285/627] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:05:20 2022] GET /compute/v2.1/images/984a5010-f259-40b9-952b-c497908cc5d8 => generated 787 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:20.493890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.497597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 1341b3d5-e51a-41b0-af6e-bf8b1f770eab] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:20.532917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.533872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.535016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.535783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.573319 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab HTTP/1.1 Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:20.575377 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.577355 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '1341b3d5-e51a-41b0-af6e-bf8b1f770eab'} Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:20.578583 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. Jul 25 16:05:20.579965 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:20.588234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 1341b3d5-e51a-41b0-af6e-bf8b1f770eab could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:20.590645 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4297acd5-acca-4cd0-8bad-1773d11b2d19 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab" status: 404 len: 111 microversion: 2.1 time: 0.107115 Jul 25 16:05:20.591963 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 286/628] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:20 2022] GET /compute/v2.1/servers/1341b3d5-e51a-41b0-af6e-bf8b1f770eab => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:05:20.600458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:20.601506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:20.609370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.610466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.611759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:20.612536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:20.862785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:20.898255 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-44f5a674-70c7-41e3-bbba-3ac21c612e89 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.867930 Jul 25 16:05:20.915917 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 343/629] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:20 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:20.936932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2a590b4-5050-4e26-a2e5-ccdd1935b4aa tempest-ListImagesTestJSON-1030912363 tempest-ListImagesTestJSON-1030912363-project] Calling method '.version_select at 0x7f9d93d065e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:21.123224 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2a590b4-5050-4e26-a2e5-ccdd1935b4aa tempest-ListImagesTestJSON-1030912363 tempest-ListImagesTestJSON-1030912363-project] 10.222.0.105 "GET /compute/v2.1/images" status: 200 len: 448 microversion: 2.1 time: 0.197983 Jul 25 16:05:21.132176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 344/630] 10.222.0.105 () {58 vars in 1127 bytes} [Mon Jul 25 16:05:20 2022] GET /compute/v2.1/images => generated 448 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:21.141283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a11803d6-c465-4114-a845-2df05c115fbf tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '.version_select at 0x7f9d93d3faf0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:21.198539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a11803d6-c465-4114-a845-2df05c115fbf tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846220243" status: 202 len: 0 microversion: 2.1 time: 0.064237 Jul 25 16:05:21.202678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 345/631] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846220243 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:21.207879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:21.208875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:21.229680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:21.230469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:21.231710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:21.232692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:21.982826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:22.002392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-995a6deb-6c5c-442c-9620-3411d57c96cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1474 microversion: 2.1 time: 1.408218 Jul 25 16:05:22.003730 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 287/632] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:20 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1474 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:22.011141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:22.012002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:22.031947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:22.037997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:22.040178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:22.043252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:22.191032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:22.202829 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc151702-ab99-4369-9edc-a4c5ce4598b8 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 1.001892 Jul 25 16:05:22.203423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 346/633] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:21 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:22.232202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14240796-4246-472a-bcce-356a8802a594 tempest-ListImagesTestJSON-1030912363 tempest-ListImagesTestJSON-1030912363-project] Calling method '.version_select at 0x7f9d93c73040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:22.305560 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-14240796-4246-472a-bcce-356a8802a594 tempest-ListImagesTestJSON-1030912363 tempest-ListImagesTestJSON-1030912363-project] 10.222.0.105 "GET /compute/v2.1/images/detail" status: 200 len: 790 microversion: 2.1 time: 0.080396 Jul 25 16:05:22.306748 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 347/634] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:05:22 2022] GET /compute/v2.1/images/detail => generated 790 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:22.313328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-911209fc-9924-4d11-ab2d-b4f3cd3688c7 req-34eaa9d6-3b5f-4610-a1aa-b75e742810a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfbc09e-4c5b-48c5-9422-1c12520e3386", "name": "network-vif-plugged", "status": "completed", "tag": "bfac8b30-b4a5-49c8-bf39-2782f7de06de"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:22.329415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-911209fc-9924-4d11-ab2d-b4f3cd3688c7 req-34eaa9d6-3b5f-4610-a1aa-b75e742810a4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:22.330311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-911209fc-9924-4d11-ab2d-b4f3cd3688c7 req-34eaa9d6-3b5f-4610-a1aa-b75e742810a4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:22.355104 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-911209fc-9924-4d11-ab2d-b4f3cd3688c7 req-34eaa9d6-3b5f-4610-a1aa-b75e742810a4 service nova] Creating event network-vif-plugged:bfac8b30-b4a5-49c8-bf39-2782f7de06de for instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 on n-h1-846219-13 Jul 25 16:05:22.363839 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-911209fc-9924-4d11-ab2d-b4f3cd3688c7 req-34eaa9d6-3b5f-4610-a1aa-b75e742810a4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055599 Jul 25 16:05:22.367318 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 348/635] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:22.375238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:22.376482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:22.384766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:22.385661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:22.401263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:22.402922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:22.427560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:22.450283 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a0a99e0-40d8-4d1f-ae29-d42312c8039d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1498 microversion: 2.1 time: 0.443019 Jul 25 16:05:22.452874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 288/636] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:22 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1498 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:22.823806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:22.840834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f7df406-6366-4591-af89-57cea3d4370e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.470174 Jul 25 16:05:22.845762 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 349/637] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:22 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:23.030306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:23.031187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:23.046367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.066982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.069983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.071155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.116782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:23.117662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:23.128736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.134646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.137390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.139163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.417460 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db1639a8-5fba-4871-a7f8-41ee5ca62cbc tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1651 microversion: 2.1 time: 0.943288 Jul 25 16:05:23.423246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:23.433552 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85f0955e-55e0-45ef-ac0a-8a3d0a8cdccb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1466 microversion: 2.1 time: 0.408132 Jul 25 16:05:23.435006 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 289/638] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:22 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1651 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:23.453269 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 350/639] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:23 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1466 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:23.461290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:23.462554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:23.463354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:23.467709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:23.478394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.479464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.480952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.482641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.483327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.484077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.490171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.491075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.814132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:23.830248 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3db6b6d2-6969-4374-9691-4341d0b6db84 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 0.393940 Jul 25 16:05:23.832219 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 290/640] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:23 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:23.837956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:23.838951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:23.862768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.865862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.866895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:23.868975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:23.912898 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-88445949-3669-4b7a-932a-b09ec4b904c3 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1619 microversion: 2.1 time: 0.456543 Jul 25 16:05:23.930147 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 351/641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:23 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1619 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:23.940796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ccca83cb-8722-4666-b1ae-5c9dc138af49 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '.version_select at 0x7f9d93c9dc10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:23.976303 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ccca83cb-8722-4666-b1ae-5c9dc138af49 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Image not found. Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ccca83cb-8722-4666-b1ae-5c9dc138af49 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/images/2ee085bd-f93a-4be5-a797-c770ee4438bc HTTP/1.1 Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:05:23.980515 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '2ee085bd-f93a-4be5-a797-c770ee4438bc'} Jul 25 16:05:23.982043 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ee085bd-f93a-4be5-a797-c770ee4438bc to delete Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:23.982834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ee085bd-f93a-4be5-a797-c770ee4438bc could not be found. Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:23.984035 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:05:23.986507 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:23.993142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ccca83cb-8722-4666-b1ae-5c9dc138af49 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:23.995472 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ccca83cb-8722-4666-b1ae-5c9dc138af49 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/images/2ee085bd-f93a-4be5-a797-c770ee4438bc" status: 404 len: 62 microversion: 2.1 time: 0.062557 Jul 25 16:05:23.998182 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 352/642] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:23 2022] DELETE /compute/v2.1/images/2ee085bd-f93a-4be5-a797-c770ee4438bc => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:24.005802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:24.006594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:24.026001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.026852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.029409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.029409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.231630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7084a9ad-227d-4455-844a-7ebdaabef2ba tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1651 microversion: 2.1 time: 0.398216 Jul 25 16:05:24.245754 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 291/643] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:23 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1651 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:24.254105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad455bc6-bb40-4c99-83e8-12ba2d14bde9 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '.version_select at 0x7f9d93e67790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:24.259805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad455bc6-bb40-4c99-83e8-12ba2d14bde9 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.260286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad455bc6-bb40-4c99-83e8-12ba2d14bde9 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.275661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ad455bc6-bb40-4c99-83e8-12ba2d14bde9 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.028548 Jul 25 16:05:24.276673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 292/644] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:05:24 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:24.283348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:24.284046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:24.291514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.292389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.293777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.294945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.305849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:24.323348 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b445be5-5536-4a7f-8a7a-10502dcc101d tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.321526 Jul 25 16:05:24.327954 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 353/645] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:23 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:24.335731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-545944bd-f2c2-4c78-92f9-d0f183ca0e06 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:24.339036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.342689 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:05:24.342689 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 HTTP/1.1 Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:24.344649 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.347267 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961'} Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:24.348029 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.349257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.350421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:24.350421 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cbdec029-a7e5-4ec8-b28c-c34bf85213d9 tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "DELETE /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 404 len: 111 microversion: 2.1 time: 0.068895 Jul 25 16:05:24.350554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-545944bd-f2c2-4c78-92f9-d0f183ca0e06 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.350554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-545944bd-f2c2-4c78-92f9-d0f183ca0e06 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.350554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-545944bd-f2c2-4c78-92f9-d0f183ca0e06 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.350554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-545944bd-f2c2-4c78-92f9-d0f183ca0e06 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.358316 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 293/646] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:05:24 2022] DELETE /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:05:24.363761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:24.364306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] [instance: 9666ce6e-2178-4ea2-9a81-1f11241a5961] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:24.388630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.390580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.391660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.398434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.424360 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] HTTP exception thrown: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Request method failure captured: Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 HTTP/1.1 Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7Kh4oNkwZdm8peItctlaXt9t1gVi5eGfjUMZ0VPqRjSUGq1AIm0jv4uKKXRshA2xbUJ5XWCd7BYTHkscVu1fjUDBhlb3JwuXtJstgGZxih19cSgpgh18dbFz-SlpPfIAcsTwMNWycpbeRLloAuXR9ahRtjEcyQVLYJjb4Yo6IdrkI Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:05:24.428327 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/92c9c3fb274f4a578bf01dc3ca691967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_92c9c3fb274f4a578bf01dc3ca691967"}]}] Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 92c9c3fb274f4a578bf01dc3ca691967 Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-695279379 Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f16ea8cc8a304280a0988dbac8aa1433 Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-695279379-project Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.432149 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '9666ce6e-2178-4ea2-9a81-1f11241a5961'} Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:24.433076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. Jul 25 16:05:24.434799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:05:24.437235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] Returning 404 to user: Instance 9666ce6e-2178-4ea2-9a81-1f11241a5961 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:24.437588 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7a06849a-195d-464f-8cef-69f19b454f1c tempest-ImagesOneServerNegativeTestJSON-695279379 tempest-ImagesOneServerNegativeTestJSON-695279379-project] 10.222.0.105 "GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961" status: 404 len: 111 microversion: 2.1 time: 0.077460 Jul 25 16:05:24.438786 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 294/647] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:24 2022] GET /compute/v2.1/servers/9666ce6e-2178-4ea2-9a81-1f11241a5961 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:05:24.444453 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-545944bd-f2c2-4c78-92f9-d0f183ca0e06 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.114954 Jul 25 16:05:24.445126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 354/648] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:05:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:24.447449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-844651d3-7e86-4a4a-90f7-66db6902e6e6 req-4fed3fac-f197-469b-8f37-188086855668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "name": "network-vif-plugged", "status": "completed", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:24.451842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-749356348", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:24.461357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-844651d3-7e86-4a4a-90f7-66db6902e6e6 req-4fed3fac-f197-469b-8f37-188086855668 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.461791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-844651d3-7e86-4a4a-90f7-66db6902e6e6 req-4fed3fac-f197-469b-8f37-188086855668 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.475995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-844651d3-7e86-4a4a-90f7-66db6902e6e6 req-4fed3fac-f197-469b-8f37-188086855668 service nova] Creating event network-vif-plugged:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:05:24.482797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-844651d3-7e86-4a4a-90f7-66db6902e6e6 req-4fed3fac-f197-469b-8f37-188086855668 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039974 Jul 25 16:05:24.483736 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 295/649] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:24.491574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-13", "block_migration": true, "disk_over_commit": false}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:24.495327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:24.505158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.505917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.506928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:24.507566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:24.594801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:05:24.648800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lazy-loading 'flavor' on Instance uuid b10982b1-78ba-45a9-830f-6a54e6329bc5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:05:24.804656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Going to try to live migrate instance to n-h1-846219-13 {{(pid=119598) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:05:24.981796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.537392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:05:25.539202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:05:25.539922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:05:25.540614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:05:25.541236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:05:25.566299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:25.567090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:25.568100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:25.568718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:25.603117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:25.610130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for user 797cc3e401c3492187cd37395c534d3c and project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:25.624571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:05:25.628855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:05:25.732864 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4965ae26-9398-4115-a949-8bd3f131d4d7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.285650 Jul 25 16:05:25.741440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 355/650] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:05:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:05:25.760844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:25.765233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:25.799292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:25.811236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:25.813549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:25.815780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:26.587956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:26.607996 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ddd06682-dc73-4b0b-9d5c-8f9a39988e0a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1328 microversion: 2.1 time: 0.858181 Jul 25 16:05:26.612991 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 356/651] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:25 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1328 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:26.634096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:26.637554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:26.674771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:26.675229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:26.675980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:26.677863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:26.724180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.173014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:27.181688 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6638881c-ac5e-4dad-be69-3c79c96fbd66 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.566432 Jul 25 16:05:27.182936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 357/652] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:26 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:27.187921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:27.188740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:27.195880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:27.196606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:27.197458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:27.197898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:27.278438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:27.298325 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1268 microversion: 2.1 time: 0.112997 Jul 25 16:05:27.300039 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 358/653] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:27 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1268 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:27.303756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:27.305934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7260b9d5-04e5-4f6b-8bc0-6d27c080bfaf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute//" status: 200 len: 379 microversion: - time: 0.002565 Jul 25 16:05:27.306754 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 359/654] 10.222.0.105 () {56 vars in 891 bytes} [Mon Jul 25 16:05:27 2022] GET /compute/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 16:05:27.759158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d12e755-ded6-4f9b-88e0-973c088c6c0c tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Action: 'create', calling method: .version_select at 0x7f9d93d86820>, body: {"keypair": {"name": "tempest-keypair-2078796400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRPpq2XDALYi6dOJn+kjr+3tRm/TdVUYHrjsgukZN30orjlG3tfPB3cgv/4E2Do6mi2D29+RqqTXuagVOCJuF7aPZnvp83qYsJH01gRJNUczkrTmaQDeRVcbWC9L+s/8Q=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:27.778557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.832471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5d12e755-ded6-4f9b-88e0-973c088c6c0c tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:27.852253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5d12e755-ded6-4f9b-88e0-973c088c6c0c tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for user 6c28ce5d84434e7ca58bf96d90032c2d and project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:27.937715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d12e755-ded6-4f9b-88e0-973c088c6c0c tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.628140 Jul 25 16:05:27.939205 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 360/655] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:05:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:27.946828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:27.947878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:27.957661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:27.958420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:27.959702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:27.961314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:28.638681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:28.680854 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a5a2520e-a61c-4b58-a597-19eb73abaed9 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1523 microversion: 2.1 time: 0.736464 Jul 25 16:05:28.683668 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 361/656] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:27 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1523 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:28.700333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd405ae0-baac-4c54-8bef-8bc9e222ed62 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9da20f7a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:28.729672 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd405ae0-baac-4c54-8bef-8bc9e222ed62 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs/tempest-keypair-2078796400" status: 200 len: 497 microversion: 2.1 time: 0.044475 Jul 25 16:05:28.731944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 362/657] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:05:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2078796400 => generated 497 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:28.746355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:28.747299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:28.763783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:28.765940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:28.767150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:28.767936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:29.230203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:29.251174 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fb784fb-d616-45f1-9765-99afa2ba23c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.509404 Jul 25 16:05:29.251849 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 363/658] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:28 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:29.258893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:29.276678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:29.308344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:29.308804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:29.313950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:29.320379 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ab5a909b-2d4f-437c-aa8b-fa30174a4b69 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5/action" status: 202 len: 0 microversion: 2.1 time: 4.834838 Jul 25 16:05:29.320930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:29.321399 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 296/659] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:05:24 2022] POST /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5/action => generated 0 bytes in 4837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:29.329503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8267170-dc22-4123-8e94-1bcdd303c76b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'create', calling method: .version_select at 0x7f9d93d4bb80>, body: {"pool": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:29.530113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:29.545702 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-857f54a1-ed0a-4708-92d1-61b579118243 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1274 microversion: 2.1 time: 0.292534 Jul 25 16:05:29.547064 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 364/660] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:29 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1274 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:29.552638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-218b665c-59a4-4812-be3f-19f813c45d98 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9d93c9dc10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:29.580555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-218b665c-59a4-4812-be3f-19f813c45d98 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078796400" status: 202 len: 0 microversion: 2.1 time: 0.032201 Jul 25 16:05:29.581690 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 365/661] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078796400 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:29.594146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-bcb0bd50-531c-43bf-a871-66ff22d39138 req-90766e25-addc-4208-9128-80797aa69be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa29098-04ba-4426-8bd1-0bfa9dfa384f", "name": "network-vif-plugged", "status": "completed", "tag": "392f7b43-f4e8-4202-b34f-37c5d24445e2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:29.608323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bcb0bd50-531c-43bf-a871-66ff22d39138 req-90766e25-addc-4208-9128-80797aa69be8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:29.610015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bcb0bd50-531c-43bf-a871-66ff22d39138 req-90766e25-addc-4208-9128-80797aa69be8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:29.623718 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-bcb0bd50-531c-43bf-a871-66ff22d39138 req-90766e25-addc-4208-9128-80797aa69be8 service nova] Creating event network-vif-plugged:392f7b43-f4e8-4202-b34f-37c5d24445e2 for instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f on n-h1-846219-13 Jul 25 16:05:29.631251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-bcb0bd50-531c-43bf-a871-66ff22d39138 req-90766e25-addc-4208-9128-80797aa69be8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047616 Jul 25 16:05:29.632647 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 366/662] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:29.640839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:29.642085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:29.665360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:29.666133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:29.667167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:29.667947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:30.374808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:30.398391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b90dc36-4537-4873-8f60-be3ce9474b83 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 0.763136 Jul 25 16:05:30.402904 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 367/663] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:29 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:30.420630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc75459e-4e0a-4b4f-975e-59084cfb2819 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Action: 'create', calling method: .version_select at 0x7f9d93c9df70>, body: {"keypair": {"name": "tempest-keypair-1978161854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsf3sFi4X9KINUO7Z02OS7jjSGsFGxB+/UPiisoAkxam7g3zKx2V9LOkURRrsLhzQEc4bgBZ4ZkrRSvqxGaF7PM44a9tvKGYHcfJa37YkUxhr0i2mz20IeP0P2/jBfA5A=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:30.475937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-fc75459e-4e0a-4b4f-975e-59084cfb2819 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:30.507477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-fc75459e-4e0a-4b4f-975e-59084cfb2819 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for user 6c28ce5d84434e7ca58bf96d90032c2d and project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:30.571505 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc75459e-4e0a-4b4f-975e-59084cfb2819 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166111 Jul 25 16:05:30.572364 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 368/664] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:05:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:30.593713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:30.594725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:30.611622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:30.612310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:30.613972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:30.615044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:31.193778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:31.211378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8c1735a-3645-4867-923e-23c44b4d889c tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1393 microversion: 2.1 time: 0.637427 Jul 25 16:05:31.226021 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 369/665] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:30 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1393 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:31.242840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:31.254151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:31.263153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:31.264002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:31.265420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:31.270045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:31.887008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:31.919852 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f6b4328-6bbd-46a3-95d3-8a05f6f62405 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 0.689801 Jul 25 16:05:31.923728 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 370/666] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:31 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:31.935013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b58f4919-ab6d-4542-85ce-f0f891eb7b06 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9d93d22d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:32.004127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b58f4919-ab6d-4542-85ce-f0f891eb7b06 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978161854" status: 202 len: 0 microversion: 2.1 time: 0.076171 Jul 25 16:05:32.012331 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 371/667] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978161854 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:32.028099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:32.029430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:32.045015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:32.049235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:32.054794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:32.058514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:33.164786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:33.226923 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-88321153-4d8e-43ac-aa5d-c6927c40f95a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 1.216008 Jul 25 16:05:33.230471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 372/668] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:32 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:33.245498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-32da2745-a5e3-4618-a093-5563d259cdcb tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Action: 'create', calling method: .version_select at 0x7f9d93d06550>, body: {"keypair": {"name": "tempest-keypair-412395755", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:33.285642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-32da2745-a5e3-4618-a093-5563d259cdcb tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:33.297722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-32da2745-a5e3-4618-a093-5563d259cdcb tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for user 6c28ce5d84434e7ca58bf96d90032c2d and project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:33.373571 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-32da2745-a5e3-4618-a093-5563d259cdcb tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.140462 Jul 25 16:05:33.375392 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 373/669] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:05:33 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:33.396496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:33.398571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:33.412768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:33.414125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:33.416013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:33.417046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:34.831693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.901600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:34.951197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c483042b-953b-4132-9f94-1db9c4ee3c75 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1593 microversion: 2.1 time: 1.563277 Jul 25 16:05:34.955111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 374/670] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:33 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1593 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:34.994851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:34.995957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:35.016625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:35.017351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:35.021205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:35.024144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:35.592343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.271687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:36.282836 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c1bddc6-4c50-4abd-b936-1d544f9a4c1d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 1.323205 Jul 25 16:05:36.295267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 375/671] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:34 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:36.300613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc5a1859-1559-4370-883e-abd8f4bbcb21 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9d93d061f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:36.355058 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc5a1859-1559-4370-883e-abd8f4bbcb21 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412395755" status: 202 len: 0 microversion: 2.1 time: 0.043603 Jul 25 16:05:36.355058 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 376/672] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412395755 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:36.356981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:36.359650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:36.379261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:36.379982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:36.381637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:36.382401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:36.534149 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8267170-dc22-4123-8e94-1bcdd303c76b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.211490 Jul 25 16:05:36.534972 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 297/673] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:05:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:36.540830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:36.541975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:36.558594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:36.559100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:36.570839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:36.571951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:36.856362 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69653a55-5bab-4a10-a0c3-b65c70e0ae83 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.318935 Jul 25 16:05:36.859150 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 298/674] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:05:36 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:36.881077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-87283ccf-ad57-4b02-b00d-5a0e38e3eb65 req-788d26a2-a02c-4d86-ad87-667102c3af35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba754468-b0f7-4418-8813-23048902169f", "tag": "2d0ff43e-5c97-48f9-b953-4d64885d233d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:36.930286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-87283ccf-ad57-4b02-b00d-5a0e38e3eb65 req-788d26a2-a02c-4d86-ad87-667102c3af35 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:36.931207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-87283ccf-ad57-4b02-b00d-5a0e38e3eb65 req-788d26a2-a02c-4d86-ad87-667102c3af35 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:36.976671 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-87283ccf-ad57-4b02-b00d-5a0e38e3eb65 req-788d26a2-a02c-4d86-ad87-667102c3af35 service nova] Creating event network-changed:2d0ff43e-5c97-48f9-b953-4d64885d233d for instance ba754468-b0f7-4418-8813-23048902169f on n-h2-846219-13 Jul 25 16:05:36.996894 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-87283ccf-ad57-4b02-b00d-5a0e38e3eb65 req-788d26a2-a02c-4d86-ad87-667102c3af35 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135302 Jul 25 16:05:36.998051 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 299/675] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:37.051200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5e1fe80-abfb-4169-945f-ecf799b377a7 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Action: 'create', calling method: .version_select at 0x7f9d93f02280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1251982254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+0hAvpMi6k1G2JESJOz8Tqre2xkZf8OlY+NvizihYVnOviq1pzJsrN+AtnwihPBr1S/TOv02sTldLZP+WBgbS5/r7dl0uUoJwiLX+TnoS01PzRcVPviIQTTyREn7xy0Q=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:37.109943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a5e1fe80-abfb-4169-945f-ecf799b377a7 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:37.122403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a5e1fe80-abfb-4169-945f-ecf799b377a7 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for user 6c28ce5d84434e7ca58bf96d90032c2d and project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:37.199946 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5e1fe80-abfb-4169-945f-ecf799b377a7 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.192680 Jul 25 16:05:37.217474 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 300/676] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:05:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:37.244208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1175396224", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:37.424066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] validate_networks() for [('642d87a1-e2ff-4d5e-ad13-3454b40dcf1c', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:05:37.611106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:37.716078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9364f29d-534d-4b00-9df5-1c7850a62ebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 1.364324 Jul 25 16:05:37.720952 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 377/677] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:36 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:37.753847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d1ccb841-1b22-46cb-9641-3119b3eba24f tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Action: 'create', calling method: .version_select at 0x7f9d93d86820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-897651255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1kp328OKPDaF+KAB22CcE3nf7bU4TH+iwomHdzf9+Kpsfe+h07aramsxnKjviQsFHS98pRaNwQXHMH5DEu+MFfBc1XVTEzvxu6vXyWmeBCqYMe0Mfyx//HqIO+YBy3lQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:37.830895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-d1ccb841-1b22-46cb-9641-3119b3eba24f tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:37.854526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-d1ccb841-1b22-46cb-9641-3119b3eba24f tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for user 6c28ce5d84434e7ca58bf96d90032c2d and project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:37.938885 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d1ccb841-1b22-46cb-9641-3119b3eba24f tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.208750 Jul 25 16:05:37.952340 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 378/678] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:05:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:37.965085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:37.969397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:37.984807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:37.986784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:37.987758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:37.990611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:40.629335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:40.641294 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cdce825c-446b-40de-bb6c-ce1519be75f7 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 2.686483 Jul 25 16:05:40.645593 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 379/679] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:37 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:40.659782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb4860f6-8f54-4211-a3fc-6c379d73c722 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Action: 'create', calling method: .version_select at 0x7f9d93d22430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-992722663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJXf8PHkPEN/SQIKytsLslpysAEEjz/mTY/0vjcLc5rB5qAK52kbrtzfIgLMOqZ5CH76li5jNnnq3e5VkMYQ2fAzgvdf3F+lMdPxNkbHVqLHP0lDxsjILGC4DEkZqgCpQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:40.715822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-eb4860f6-8f54-4211-a3fc-6c379d73c722 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:40.724076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-eb4860f6-8f54-4211-a3fc-6c379d73c722 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Getting quotas for user 6c28ce5d84434e7ca58bf96d90032c2d and project ccd77e712e2d49fe976d425b515cc0be. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:40.775331 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb4860f6-8f54-4211-a3fc-6c379d73c722 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.128110 Jul 25 16:05:40.776217 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 380/680] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:05:40 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:40.785817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:40.789087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:40.819878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:40.820638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:40.827962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:40.828800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:41.743900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:41.769427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-52b677c4-f0f6-4966-ac3b-05367429878b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 0.991245 Jul 25 16:05:41.770460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 381/681] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:40 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:41.792456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1c7c6bdd-3dc7-4629-8e30-429ebc32ecdd req-cb7770eb-6d14-4abe-8f56-90b994ff58a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10982b1-78ba-45a9-830f-6a54e6329bc5", "name": "network-vif-unplugged", "status": "completed", "tag": "02843094-4646-4668-a0b7-2e3e843957fd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:41.801445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:41.815886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1c7c6bdd-3dc7-4629-8e30-429ebc32ecdd req-cb7770eb-6d14-4abe-8f56-90b994ff58a2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:41.816737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1c7c6bdd-3dc7-4629-8e30-429ebc32ecdd req-cb7770eb-6d14-4abe-8f56-90b994ff58a2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:41.849135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1c7c6bdd-3dc7-4629-8e30-429ebc32ecdd req-cb7770eb-6d14-4abe-8f56-90b994ff58a2 service nova] Creating event network-vif-unplugged:02843094-4646-4668-a0b7-2e3e843957fd for instance b10982b1-78ba-45a9-830f-6a54e6329bc5 on n-h2-846219-13 Jul 25 16:05:41.872128 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1c7c6bdd-3dc7-4629-8e30-429ebc32ecdd req-cb7770eb-6d14-4abe-8f56-90b994ff58a2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099602 Jul 25 16:05:41.883063 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 382/682] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:41.898260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48d005b6-06db-455a-9f41-62004f0b9729 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9da016e430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:41.904934 n-d-846219-13 devstack@n-api.service[119599]: WARNING oslo_db.sqlalchemy.utils [None req-48d005b6-06db-455a-9f41-62004f0b9729 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 16:05:41.924579 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48d005b6-06db-455a-9f41-62004f0b9729 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.039332 Jul 25 16:05:41.936708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 383/683] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:05:41 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:41.949865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-131f10e6-007f-4518-a91e-e4cac6b19283 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Action: 'create', calling method: .version_select at 0x7f9d93d22d30>, body: {"keypair": {"name": "tempest-keypair-1163248459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERjDfssNzahCN1iO4cz3J58fyoTN5UPq0z548OsLx1XCoWKHEQScfb/QqOSX/joMrAJS3WrYupCIBYNKTThcaYJO4yDbRNhGCSeP/fkAdVSvlMNGFSL0Pwxc6RCX9+8Gg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:41.990714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-131f10e6-007f-4518-a91e-e4cac6b19283 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Getting quotas for project 9995a32f65804fe6aba424fb23bdd0d3. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:42.004011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-131f10e6-007f-4518-a91e-e4cac6b19283 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Getting quotas for user c2cb53e4c0dd4b37bbb40fdc1d2ff652 and project 9995a32f65804fe6aba424fb23bdd0d3. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:42.070830 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-131f10e6-007f-4518-a91e-e4cac6b19283 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.130685 Jul 25 16:05:42.072129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 384/684] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:05:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:42.078130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:42.079802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:42.090083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:42.090940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:42.091954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:42.094104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:42.481527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:05:42.482126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:05:42.483134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:05:42.483996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:05:42.484817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:05:42.521010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:42.522143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:42.535318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:42.536529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:42.574696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Getting quotas for project f6d6ed3b79394344aa92af0aae019aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:42.587184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Getting quotas for user 1a52447762c64ba5bc1666f908c2154b and project f6d6ed3b79394344aa92af0aae019aa6. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:42.618169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:05:42.623211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:05:42.723550 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6b17873-ce88-4e08-ae31-2161c83ed1ba tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.503806 Jul 25 16:05:42.725674 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 301/685] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:05:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 5507 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:05:42.756943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3641019d-d9c0-40f9-a3a4-288a52e996ce tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9d93e288b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:42.883842 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3641019d-d9c0-40f9-a3a4-288a52e996ce tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-992722663" status: 202 len: 0 microversion: 2.1 time: 0.155293 Jul 25 16:05:42.887756 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 302/686] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-992722663 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:42.907253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87e402ed-7036-4a77-bde4-ddf7f744cef5 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:42.908791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-87e402ed-7036-4a77-bde4-ddf7f744cef5 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:43.317581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:43.335633 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a8a61cb-c001-4603-8697-691ee3b66a50 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 1.259033 Jul 25 16:05:43.337629 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 385/687] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:42 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:43.345938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:43.355528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:43.391774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:43.395826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:43.397792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:43.400761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:44.156490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87e402ed-7036-4a77-bde4-ddf7f744cef5 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:44.174813 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87e402ed-7036-4a77-bde4-ddf7f744cef5 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1228 microversion: 2.1 time: 1.282683 Jul 25 16:05:44.177044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 303/688] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:42 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1228 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:44.188051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7dbc05c6-704d-4d5d-a441-5f781380b3bb tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9d93d019d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:44.230416 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7dbc05c6-704d-4d5d-a441-5f781380b3bb tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-897651255" status: 202 len: 0 microversion: 2.1 time: 0.050792 Jul 25 16:05:44.233045 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 304/689] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-897651255 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:44.249445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d8471b82-3afc-4a41-bd8d-421e4d1206b0 req-9fa45f03-57ec-4a8f-8a15-94b175b2830e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10982b1-78ba-45a9-830f-6a54e6329bc5", "tag": "02843094-4646-4668-a0b7-2e3e843957fd"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:44.274174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d8471b82-3afc-4a41-bd8d-421e4d1206b0 req-9fa45f03-57ec-4a8f-8a15-94b175b2830e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:44.274765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d8471b82-3afc-4a41-bd8d-421e4d1206b0 req-9fa45f03-57ec-4a8f-8a15-94b175b2830e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:44.291789 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d8471b82-3afc-4a41-bd8d-421e4d1206b0 req-9fa45f03-57ec-4a8f-8a15-94b175b2830e service nova] Creating event network-changed:02843094-4646-4668-a0b7-2e3e843957fd for instance b10982b1-78ba-45a9-830f-6a54e6329bc5 on n-h2-846219-13 Jul 25 16:05:44.298627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d8471b82-3afc-4a41-bd8d-421e4d1206b0 req-9fa45f03-57ec-4a8f-8a15-94b175b2830e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063379 Jul 25 16:05:44.299864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 305/690] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:44.307638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a0c2f86-cc92-42dd-9087-2428a30c9e73 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] Calling method '.version_select at 0x7f9d93d01b80>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:44.347432 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a0c2f86-cc92-42dd-9087-2428a30c9e73 tempest-KeyPairsV2TestJSON-2041190262 tempest-KeyPairsV2TestJSON-2041190262-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1251982254" status: 202 len: 0 microversion: 2.1 time: 0.043952 Jul 25 16:05:44.349073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 306/691] 10.222.0.105 () {58 vars in 1283 bytes} [Mon Jul 25 16:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1251982254 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:44.372714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:44.375784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:44.396891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:44.397367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:44.398146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:44.409427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:44.616709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:44.632453 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-43299d75-f31f-4e1c-8f4b-23326624859d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 1.291803 Jul 25 16:05:44.633044 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 386/692] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:43 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:44.844187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:44.853418 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-196548e5-06dd-4307-9b50-902ced3cc15c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 0.484962 Jul 25 16:05:44.859694 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 307/693] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:44 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:44.873651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:44.874587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:44.899039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:44.899792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:44.900738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:44.901345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:44.906186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.201334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:45.202721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:45.224588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:45.225087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:45.225938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:45.226371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:45.531416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:45.553338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0ee1333-89d4-4ebb-9080-b139925f3287 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1298 microversion: 2.1 time: 0.357772 Jul 25 16:05:45.554106 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 308/694] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:45 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1298 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:45.658560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:45.659547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:45.676563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:45.677384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:45.678543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:45.679620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:46.084633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:46.112577 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-460b441d-8b65-4cdc-a87e-81e40d169cec tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1593 microversion: 2.1 time: 1.239779 Jul 25 16:05:46.126079 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 387/695] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:44 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1593 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:46.139277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:46.140212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:46.149203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:46.149914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:46.151672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:46.152582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:46.543053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:46.553329 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-88b1418f-e52f-4401-a53c-50be210af70e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 0.900973 Jul 25 16:05:46.561564 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 309/696] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:45 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:46.573290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-eb03959a-f92c-4406-a9b5-997db6af551c req-cbc2f188-f9f9-4847-afee-7267a422a22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa29098-04ba-4426-8bd1-0bfa9dfa384f", "tag": "392f7b43-f4e8-4202-b34f-37c5d24445e2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:46.591551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-eb03959a-f92c-4406-a9b5-997db6af551c req-cbc2f188-f9f9-4847-afee-7267a422a22b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:46.592934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-eb03959a-f92c-4406-a9b5-997db6af551c req-cbc2f188-f9f9-4847-afee-7267a422a22b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:46.632832 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-eb03959a-f92c-4406-a9b5-997db6af551c req-cbc2f188-f9f9-4847-afee-7267a422a22b service nova] Creating event network-changed:392f7b43-f4e8-4202-b34f-37c5d24445e2 for instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f on n-h1-846219-13 Jul 25 16:05:46.656091 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-eb03959a-f92c-4406-a9b5-997db6af551c req-cbc2f188-f9f9-4847-afee-7267a422a22b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092319 Jul 25 16:05:46.659120 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 310/697] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:46.675381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:46.677401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:46.688597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:46.689585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:46.690655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:46.691346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:46.888775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:46.902616 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-370ad522-2b31-4822-a340-8f7e32b70972 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 0.769517 Jul 25 16:05:46.913516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 388/698] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:46 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:46.938791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:46.956318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3cca928d-2264-4b4d-8ca0-df75ace46788 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1286 microversion: 2.1 time: 0.294931 Jul 25 16:05:46.981879 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 311/699] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:46 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1286 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:47.591433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:47.592198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:47.607397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:47.609851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:47.613484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:47.616204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:47.924389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:47.925185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:47.944698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:47.945221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:47.946740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:47.947404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:48.612554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:48.639075 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3a3886d-8b1e-4aeb-9aaf-395e287d1318 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 1.052411 Jul 25 16:05:48.640422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 389/700] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:47 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:48.668076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:48.669450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:48.682446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:48.683765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:48.688955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:48.690991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:49.644394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:49.677645 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d91277eb-a6f2-4197-a03a-85dbbfb610c3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 1.756595 Jul 25 16:05:49.689949 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 312/701] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:47 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:49.927461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:49.969309 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-96bba887-8862-45dc-8641-0c9ab6a86bc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 1.326972 Jul 25 16:05:49.975201 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 390/702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:48 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:50.001505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:50.011430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:50.067541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.068298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.073942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.078406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.322608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3a27b4c7-0226-4ce9-88ef-82598b91c51e tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Calling method '.version_select at 0x7f9d93d0cf70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:50.379739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a27b4c7-0226-4ce9-88ef-82598b91c51e tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.385791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a27b4c7-0226-4ce9-88ef-82598b91c51e tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.387452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a27b4c7-0226-4ce9-88ef-82598b91c51e tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.392218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a27b4c7-0226-4ce9-88ef-82598b91c51e tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.471515 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3a27b4c7-0226-4ce9-88ef-82598b91c51e tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] 10.222.0.105 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.779999 Jul 25 16:05:50.472777 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 313/703] 10.222.0.105 () {58 vars in 1127 bytes} [Mon Jul 25 16:05:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:50.478128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b05812dc-6e07-4873-945d-22f1241861dd req-5cad0c32-0a04-4768-8eba-7bbf7ada91b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba754468-b0f7-4418-8813-23048902169f", "name": "network-vif-plugged", "status": "completed", "tag": "2d0ff43e-5c97-48f9-b953-4d64885d233d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:50.511048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b05812dc-6e07-4873-945d-22f1241861dd req-5cad0c32-0a04-4768-8eba-7bbf7ada91b9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.517396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b05812dc-6e07-4873-945d-22f1241861dd req-5cad0c32-0a04-4768-8eba-7bbf7ada91b9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.597480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b05812dc-6e07-4873-945d-22f1241861dd req-5cad0c32-0a04-4768-8eba-7bbf7ada91b9 service nova] Creating event network-vif-plugged:2d0ff43e-5c97-48f9-b953-4d64885d233d for instance ba754468-b0f7-4418-8813-23048902169f on n-h2-846219-13 Jul 25 16:05:50.628412 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b05812dc-6e07-4873-945d-22f1241861dd req-5cad0c32-0a04-4768-8eba-7bbf7ada91b9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151844 Jul 25 16:05:50.630617 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 314/704] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:50.706413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:50.708212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:50.724539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.727262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.732546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:50.735905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:50.864482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:50.880953 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dbd980c4-ad8a-4937-a0c1-66263b29248e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 0.903640 Jul 25 16:05:50.917509 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 391/705] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:49 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:50.926709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1745808969", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:51.091096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:05:51.840454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:51.869843 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0563c35f-7af7-43a8-a953-faecd39c1a64 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1316 microversion: 2.1 time: 1.167317 Jul 25 16:05:51.875868 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 315/706] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:50 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1316 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:51.901158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:51.902564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:51.938094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:51.938890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:51.945872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:51.949845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:52.023732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=30 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.677536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Getting quotas for project ffb664bf34474651b3c185648629e486. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:05:52.690844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Getting quotas for user 18cb847220024ff48020be6226219107 and project ffb664bf34474651b3c185648629e486. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:05:52.728437 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Request method failure captured: Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 1752 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9dCqINTuN9-5D2AdsYrTgRgUoiADG2tlXaeqDg2Be53D-jnPHpkl2WN-A5e_NDUchmgLhq6vG-af5Uehf_HM16YeHdTV7T_Qw9oyBXYdOW6-six2GNqlw6zB6yjGSX-8C70gZnvoOtU_TfNQu_RV75sd2szv9BUMG3pOE8ZQeKuBg Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: ffb664bf34474651b3c185648629e486 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-885358797 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ffb664bf34474651b3c185648629e486"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ffb664bf34474651b3c185648629e486"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ffb664bf34474651b3c185648629e486"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ffb664bf34474651b3c185648629e486"}]}] Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-885358797 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: ffb664bf34474651b3c185648629e486 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-885358797 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-885358797-project Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 18cb847220024ff48020be6226219107 Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-885358797-project Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1745808969", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:05:52.733067 n-d-846219-13 devstack@n-api.service[119599]: exception: Maximum number of metadata items exceeds 128 Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1745808969', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:05:52.735685 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 25 16:05:52.740675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:05:52.743628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:05:52.743628 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48b81af1-ff95-4121-84b0-9ae836dfec9f tempest-AbsoluteLimitsNegativeTestJSON-885358797 tempest-AbsoluteLimitsNegativeTestJSON-885358797-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.824627 Jul 25 16:05:52.746905 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 392/707] 10.222.0.105 () {60 vars in 1153 bytes} [Mon Jul 25 16:05:50 2022] POST /compute/v2.1/servers => generated 87 bytes in 1829 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:05:52.759557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:52.760350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:52.768720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:52.769395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:52.770534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:52.771243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:52.859432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:52.882749 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57d9e402-c91d-43af-a024-aeba281a590a tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 1.002497 Jul 25 16:05:52.883755 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 316/708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:51 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:52.914938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2045189285", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b87a0022-bc9b-40f2-a404-f3df72abfda3"}, {"port": "1f447b3c-0d41-4512-8e25-1fd3029dcae2", "tag": "port-1"}, {"port": "aaaa6592-e99d-4688-b794-f72c24f9e4e0", "tag": "port-2"}, {"uuid": "86e229e1-45e7-4c02-96af-594948a09e19", "tag": "net-1"}, {"uuid": "86e229e1-45e7-4c02-96af-594948a09e19"}, {"uuid": "0fc9872d-6036-427a-9171-462c6b553c9d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0fc9872d-6036-427a-9171-462c6b553c9d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "887ef92b-6bd2-498a-8e02-506db5a545ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "05f7719e-26e2-459b-97f7-fb0bcdbd04e1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "90a68ac6-95f9-4967-acdb-16b9f1288175", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--936181878"}], "key_name": "tempest-keypair-1163248459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:53.371048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] validate_networks() for [('b87a0022-bc9b-40f2-a404-f3df72abfda3', None, None, None, None, None), (None, None, '1f447b3c-0d41-4512-8e25-1fd3029dcae2', None, None, None), (None, None, 'aaaa6592-e99d-4688-b794-f72c24f9e4e0', None, None, None), ('86e229e1-45e7-4c02-96af-594948a09e19', None, None, None, None, None), ('86e229e1-45e7-4c02-96af-594948a09e19', None, None, None, None, None), ('0fc9872d-6036-427a-9171-462c6b553c9d', '10.2.2.100', None, None, None, None), ('0fc9872d-6036-427a-9171-462c6b553c9d', '10.2.2.200', None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:05:53.467380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:53.484403 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b8250a4-deef-46a5-ad3e-d8f5d1295a10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 0.729947 Jul 25 16:05:53.489602 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 393/709] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:52 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:53.517906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:53.518963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:53.527401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:53.527902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:53.528744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:53.534195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:54.246334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:54.263927 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf7db862-89b8-48d4-81ea-8dfbf4b861fe tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1465 microversion: 2.1 time: 0.760321 Jul 25 16:05:54.265805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 394/710] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:53 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1465 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:54.284325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-19d61492-f272-43be-bc96-018d79e6babd req-74fd76f8-22a9-458c-aa88-ba2eef0cfbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9", "tag": "4c572e1b-7f7f-4634-849f-a54ced4d3147"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:54.321805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-19d61492-f272-43be-bc96-018d79e6babd req-74fd76f8-22a9-458c-aa88-ba2eef0cfbae service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:54.323802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-19d61492-f272-43be-bc96-018d79e6babd req-74fd76f8-22a9-458c-aa88-ba2eef0cfbae service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:54.363400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-19d61492-f272-43be-bc96-018d79e6babd req-74fd76f8-22a9-458c-aa88-ba2eef0cfbae service nova] Creating event network-changed:4c572e1b-7f7f-4634-849f-a54ced4d3147 for instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 on n-h2-846219-13 Jul 25 16:05:54.384788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-19d61492-f272-43be-bc96-018d79e6babd req-74fd76f8-22a9-458c-aa88-ba2eef0cfbae service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113786 Jul 25 16:05:54.388419 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 395/711] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:54.440842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4dd87ec2-4c17-43b8-a10d-9ec51dee942e req-324e8f0a-51b6-4019-8714-ffed6eb302dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10982b1-78ba-45a9-830f-6a54e6329bc5", "name": "network-vif-unplugged", "status": "completed", "tag": "02843094-4646-4668-a0b7-2e3e843957fd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:54.466140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4dd87ec2-4c17-43b8-a10d-9ec51dee942e req-324e8f0a-51b6-4019-8714-ffed6eb302dd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:54.471694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4dd87ec2-4c17-43b8-a10d-9ec51dee942e req-324e8f0a-51b6-4019-8714-ffed6eb302dd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:54.501833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4dd87ec2-4c17-43b8-a10d-9ec51dee942e req-324e8f0a-51b6-4019-8714-ffed6eb302dd service nova] Creating event network-vif-unplugged:02843094-4646-4668-a0b7-2e3e843957fd for instance b10982b1-78ba-45a9-830f-6a54e6329bc5 on n-h2-846219-13 Jul 25 16:05:54.519798 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4dd87ec2-4c17-43b8-a10d-9ec51dee942e req-324e8f0a-51b6-4019-8714-ffed6eb302dd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122239 Jul 25 16:05:54.520819 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 396/712] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:05:54.537540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:54.538591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:54.553245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:54.553866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:54.554786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:54.555335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:55.767356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:55.802948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5edb3e7d-4fab-4c43-8d0b-057fa089b244 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 1.273484 Jul 25 16:05:55.806009 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 397/713] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:54 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:55.821434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:05:55.833785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:55.847888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:55.850323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:55.857592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:55.858483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:56.146004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:56.166020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 16:05:56.184687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:05:56.185900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:05:56.186576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:05:56.187174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:05:56.189051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:05:56.506530 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f921bed-1776-45e9-9504-a0dd98f906e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f/action" status: 202 len: 0 microversion: 2.1 time: 0.698623 Jul 25 16:05:56.511344 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 398/714] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:05:55 2022] POST /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:05:56.521224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:56.523508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:56.542919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:56.543527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:56.545815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:56.554479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:57.568632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:57.579877 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-66b861a9-2b74-4e93-a489-0b3cc808d8c0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1508 microversion: 2.1 time: 1.069585 Jul 25 16:05:57.594470 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 399/715] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:56 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1508 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:57.600388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:57.601129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:57.613911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:57.621398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:57.622610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:57.631656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:58.255568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:05:58.278352 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f25c5f3c-a2d0-477f-9fc7-2c1e5c77c0dd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1474 microversion: 2.1 time: 0.679087 Jul 25 16:05:58.280074 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 400/716] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:57 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1474 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:58.306943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:05:58.310808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:05:58.334323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:58.334785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:05:58.335596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:05:58.343343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:00.371504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=14 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:00.424081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:00.785077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:00.837852 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-820714b4-513e-4dae-9758-6ba9e35b0924 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 2.551817 Jul 25 16:06:00.842216 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 401/717] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:05:58 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:00.853675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:00.857927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:00.876464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:00.884240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:00.887823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:00.891948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:02.175375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:02.184515 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7775b2db-d64a-43d8-9642-dfb58079221b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1498 microversion: 2.1 time: 1.340637 Jul 25 16:06:02.192708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 402/718] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:00 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1498 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:02.197886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:02.206381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:02.213617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:02.214460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:02.215616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:02.216367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:02.710966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:02.865950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=58 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.356584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:03.367542 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9e67425-a508-4a1e-a9ce-8b0a1b029e85 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1474 microversion: 2.1 time: 1.173549 Jul 25 16:06:03.372210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 403/719] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:02 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1474 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:03.379539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:03.390308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:03.407843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:03.408825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:03.410024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:03.410622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:03.732734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:03.740385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.743464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d50ef405-de40-4763-95d2-639277ba6d82 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 0.369508 Jul 25 16:06:03.745703 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 404/720] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:03 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:03.752076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c316a5c3-54b2-4972-b50f-371d1a2aac15 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '.version_select at 0x7f9d93c9d550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:03.758872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c316a5c3-54b2-4972-b50f-371d1a2aac15 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:03.759591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c316a5c3-54b2-4972-b50f-371d1a2aac15 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:03.781629 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c316a5c3-54b2-4972-b50f-371d1a2aac15 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 1202 microversion: 2.1 time: 0.034324 Jul 25 16:06:03.790605 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 405/721] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:06:03 2022] GET /compute/v2.1/os-migrations => generated 1202 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:03.932840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-5565000", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:04.046261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:06:04.578330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:06:04.579204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:06:04.579798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:06:04.580312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:06:04.580826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:06:04.608713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:04.612803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:04.624391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:04.625277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:04.670670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Getting quotas for project 9995a32f65804fe6aba424fb23bdd0d3. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:04.680087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Getting quotas for user c2cb53e4c0dd4b37bbb40fdc1d2ff652 and project 9995a32f65804fe6aba424fb23bdd0d3. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:05.106837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:06:05.111699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='887ef92b-6bd2-498a-8e02-506db5a545ce',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='05f7719e-26e2-459b-97f7-fb0bcdbd04e1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90a68ac6-95f9-4967-acdb-16b9f1288175',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:06:05.147653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:06:05.148207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:06:05.148567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:06:05.149382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:06:05.149982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:06:05.173664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:05.174128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:05.174963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:05.175402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:05.225627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:05.237437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:05.270485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:06:05.273076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:06:05.451177 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38816d86-2b2f-43aa-b56a-d84af4fabcac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.658981 Jul 25 16:06:05.451885 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 406/722] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:06:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:06:05.474223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:05.479997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:05.499865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:05.500625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:05.510597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:05.511176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:05.785672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:05.909598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3091d435-c168-4a4f-b920-1bd8b32d5c82 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.32 time: 13.005804 Jul 25 16:06:05.911390 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 317/723] 10.222.0.105 () {62 vars in 1194 bytes} [Mon Jul 25 16:05:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 13010 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:06:05.922506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:05.923533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:05.942315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ef48d5b-6338-42d8-a8cc-ae08ea959063 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1651 microversion: 2.1 time: 0.480964 Jul 25 16:06:05.947210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 407/724] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:05 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1651 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:05.973291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:05.977635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:05.982010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:05.982796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:06.175123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-110432946", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "ac4d8f52-90dc-4983-890c-821ba313bf21"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:06.341339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] validate_networks() for [('ac4d8f52-90dc-4983-890c-821ba313bf21', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:06:07.086838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:07.134794 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d786c97b-6c24-4828-9eed-c1e100d7a37f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1479 microversion: 2.1 time: 1.219694 Jul 25 16:06:07.140999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 318/725] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:05 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1479 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:07.159783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:07.162022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:07.179746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:07.182525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:07.189306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:07.190385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:08.571095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:08.595909 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71c2f3a7-ce68-4333-89a8-24d0d0429dca tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 1.446873 Jul 25 16:06:08.598204 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 319/726] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:07 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:08.617826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:08.622366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:08.657230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:08.660089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:08.664876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:08.666917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:08.931599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:08.950616 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff2bad47-b90e-47af-826b-22ef5932cae2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1274 microversion: 2.1 time: 0.348817 Jul 25 16:06:08.952360 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 320/727] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:08 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:08.964359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:08.965962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:08.996722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:08.997998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:08.999809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:09.000883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:09.501750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:06:09.502313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:06:09.502409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:06:09.502744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:06:09.503161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:06:09.537151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:09.539659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:09.543207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:09.543954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:09.639012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:09.652547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for user f3a2bf8f94f44b78a80c37bc8b370726 and project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:09.686802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:06:09.691891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:06:09.757047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:09.783884 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c931c98b-87e8-4412-89bd-368798c80679 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 3.835226 Jul 25 16:06:09.784808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 408/728] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:06:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:06:09.790220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-33164739", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "934be3e8-a3dc-4628-bdcf-841c71054ba0"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:09.916834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:09.943284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] validate_networks() for [('934be3e8-a3dc-4628-bdcf-841c71054ba0', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:06:09.944555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:09.955795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:09.957314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16a7bc55-7092-41fa-bc92-e9bca36c260b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1580 microversion: 2.32 time: 1.003133 Jul 25 16:06:09.958362 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 321/729] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:08 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1580 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:09.970092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5d638a1d-18d0-446a-a991-b7139048b703 req-3b7a26dc-0ec1-4456-86d3-476cb6d6a965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9", "name": "network-vif-plugged", "status": "completed", "tag": "4c572e1b-7f7f-4634-849f-a54ced4d3147"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:09.986623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5d638a1d-18d0-446a-a991-b7139048b703 req-3b7a26dc-0ec1-4456-86d3-476cb6d6a965 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:09.987626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5d638a1d-18d0-446a-a991-b7139048b703 req-3b7a26dc-0ec1-4456-86d3-476cb6d6a965 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:10.014252 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5d638a1d-18d0-446a-a991-b7139048b703 req-3b7a26dc-0ec1-4456-86d3-476cb6d6a965 service nova] Creating event network-vif-plugged:4c572e1b-7f7f-4634-849f-a54ced4d3147 for instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 on n-h2-846219-13 Jul 25 16:06:10.026992 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5d638a1d-18d0-446a-a991-b7139048b703 req-3b7a26dc-0ec1-4456-86d3-476cb6d6a965 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066862 Jul 25 16:06:10.029628 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 322/730] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:10.046658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:10.049134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:10.058209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:10.059318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:10.060521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:10.061378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:10.876592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:10.893370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b8f56ff6-3455-4119-a2e2-696620c6776a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1479 microversion: 2.1 time: 0.859542 Jul 25 16:06:10.894043 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 323/731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:10 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1479 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:10.917039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:10.919653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:10.928538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:10.930262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:10.931775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:10.932366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:11.836074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:11.846901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4c699a0-0574-4035-98b7-a4a1f033dfb0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1328 microversion: 2.1 time: 0.947328 Jul 25 16:06:11.847513 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 324/732] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:10 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1328 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:11.857640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:11.879326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:11.887590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:11.895608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:11.897043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:11.897775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:12.168967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:12.210707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:12.229764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:12.231095 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b0b38198-78b7-4199-bdd3-60edbf58d34a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1317 microversion: 2.25 time: 0.381675 Jul 25 16:06:12.231714 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 325/733] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:11 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:12.241398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:12.242291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:12.258267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:12.260299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:12.266974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:12.268524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:12.985742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:06:12.986505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:06:12.987137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:06:12.987637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:06:12.988150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:06:13.007890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:13.008674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:13.009629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:13.010165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:13.085549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:13.093672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for user d8d1e6f3591a4c4ea97eadbd97954916 and project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:13.131989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:06:13.141617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:06:13.262055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c129b40f-9537-4851-893e-4138fea5f8b4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.472885 Jul 25 16:06:13.263006 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 409/734] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:06:09 2022] POST /compute/v2.1/servers => generated 382 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:06:13.269374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:13.278846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:13.297847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:13.308619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:13.310655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:13.311808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:13.372903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:13.412952 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9056707e-b2a2-4a42-b279-67918e6af753 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1316 microversion: 2.1 time: 1.179417 Jul 25 16:06:13.465905 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 326/735] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:12 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1316 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:13.488165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:13.495704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:13.524935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:13.525514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:13.532238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:13.532750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:14.098840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:14.113833 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb8a813e-2645-4947-82b3-972dbc03371b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1479 microversion: 2.1 time: 0.645641 Jul 25 16:06:14.121135 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 327/736] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:13 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1479 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:14.129624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:14.134702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:14.149796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:14.156311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:14.157676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:14.161818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:14.206011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:14.230806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:14.236871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:14.238284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db5fa410-e8bc-45cd-87d7-b359de72b63c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1665 microversion: 2.32 time: 0.973470 Jul 25 16:06:14.245968 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 410/737] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:13 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1665 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:14.392682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59b38072-e6f6-4f2c-a775-4d510e5617fa tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Action: 'create', calling method: .version_select at 0x7f9d93b1cd30>, body: {"keypair": {"name": "tempest-keypair-890082615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7wVVcNN+jH+I+kaWvvUqES2dgwN1xjs9gu4kcvr3OXDTnfze6XXmcEjiyb/aL67WozNMv1Hfylw/BPRAfzPRghpx0erd1WZgIKhUKFo9eKGs19E4j9tSKV0pX/XtKAIg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:14.446271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-59b38072-e6f6-4f2c-a775-4d510e5617fa tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Getting quotas for project 648dff46412648f98fd3ef0bacded28d. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:14.468434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-59b38072-e6f6-4f2c-a775-4d510e5617fa tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Getting quotas for user 695300d1268e41f985252e9454f60f39 and project 648dff46412648f98fd3ef0bacded28d. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:14.522926 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59b38072-e6f6-4f2c-a775-4d510e5617fa tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.274245 Jul 25 16:06:14.531927 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 411/738] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:06:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:14.547093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:14.554236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:14.572978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:14.578298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:14.579826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:14.580666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:14.649792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.694889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:15.209835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:15.226736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:15.230712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:15.233931 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-400441ca-d58e-41ad-8a9b-2e9f54c36948 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1323 microversion: 2.25 time: 0.698773 Jul 25 16:06:15.235974 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 412/739] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:14 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1323 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:15.244151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:15.246696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:15.283450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:15.285803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:15.293140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:15.294000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:15.446750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:15.466330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-47678dc1-a57e-4af0-9bc0-8a2bb0809c21 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1265 microversion: 2.1 time: 0.228275 Jul 25 16:06:15.480224 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 413/740] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:15 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:15.487799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:15.488524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:15.508646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:15.509457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:15.510452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:15.519119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:15.599126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:15.627211 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e7f0d3e6-c814-4c91-a47e-4cc06b482931 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 200 len: 1524 microversion: 2.1 time: 1.491892 Jul 25 16:06:15.640634 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 328/741] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:14 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 1524 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:15.649489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:15.651603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:15.678825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:15.700184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:15.702182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:15.704941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:16.595790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:16.601487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:16.606397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c468b8f6-de48-4404-8014-f3e17fed07fa tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1316 microversion: 2.1 time: 1.124936 Jul 25 16:06:16.610128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-afc12ef6-2a34-4985-831d-6aac6427a975 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1479 microversion: 2.1 time: 0.980906 Jul 25 16:06:16.613703 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 329/742] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:15 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1479 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:16.625731 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 414/743] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:15 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1316 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:16.637272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:16.637272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:16.654170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:16.657024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'action', calling method: .version_select at 0x7f9da2e43940>, body: {"addFloatingIp": {"address": "172.25.4.211"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:16.657489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:16.659308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:16.660590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:16.662363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:16.686145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:16.686958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:16.689017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:16.692786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:17.310276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Acquired lock "refresh_cache-11b56432-7c1c-47ea-b7ee-ccac3bf727e5" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:06:18.140968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:18.151924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:18.158535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:18.165196 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-963d6dc9-ba27-46ac-aaa9-c5ff60aa9685 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1757 microversion: 2.32 time: 1.550210 Jul 25 16:06:18.166130 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 330/744] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:16 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1757 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:18.181599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:18.182569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:18.193018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:18.194518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:18.197740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:18.198386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:19.668848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:19.712792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:19.718780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:19.722801 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-510bd29c-8d0c-4572-8827-88051052a8c7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1365 microversion: 2.25 time: 1.552938 Jul 25 16:06:19.723903 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 331/745] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:18 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1365 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:19.730169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:19.731749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:19.739503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:19.740386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:19.741445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:19.742433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:19.977290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:19.989716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-862c08af-7cea-4069-927a-413b612f69f9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1271 microversion: 2.1 time: 0.264019 Jul 25 16:06:19.997873 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 332/746] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:19 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:20.013856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:20.015803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:20.030152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:20.031455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:20.033985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:20.035381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:21.537486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:21.552903 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f2c139d-b8ee-44ef-af86-018673e045e1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1479 microversion: 2.1 time: 1.552996 Jul 25 16:06:21.568722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 333/747] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:19 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1479 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:21.576544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:21.581902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:21.613546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:21.614158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:21.615304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:21.615933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:23.041769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.852777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:23.878763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.892886 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6cd783c-8f7d-4403-a099-d9de6a7350bb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1316 microversion: 2.1 time: 2.321808 Jul 25 16:06:23.906333 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 334/748] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:21 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1316 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:23.932713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-138f1025-9604-44cd-b9ee-6dbd88004802 req-6670d16c-3a61-488b-acc3-642dad2b810f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b566cfc-f404-4acd-8584-14561ffcdea9", "tag": "2ec00204-5371-427b-8aae-8a7cd8ab540c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:23.960330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-138f1025-9604-44cd-b9ee-6dbd88004802 req-6670d16c-3a61-488b-acc3-642dad2b810f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:23.962127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-138f1025-9604-44cd-b9ee-6dbd88004802 req-6670d16c-3a61-488b-acc3-642dad2b810f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:23.996488 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-138f1025-9604-44cd-b9ee-6dbd88004802 req-6670d16c-3a61-488b-acc3-642dad2b810f service nova] Creating event network-changed:2ec00204-5371-427b-8aae-8a7cd8ab540c for instance 0b566cfc-f404-4acd-8584-14561ffcdea9 on n-h1-846219-13 Jul 25 16:06:24.019005 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-138f1025-9604-44cd-b9ee-6dbd88004802 req-6670d16c-3a61-488b-acc3-642dad2b810f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109713 Jul 25 16:06:24.024631 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 335/749] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:24.035231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:24.036797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:24.047862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:24.048829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:24.051535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:24.052344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:24.488701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=22 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:25.080596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:25.106762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:25.108961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:25.121024 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61a1b2ba-37d1-413c-b45f-a1a40ba97b31 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1870 microversion: 2.32 time: 1.094445 Jul 25 16:06:25.134569 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 336/750] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:24 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1870 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:25.162378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-858552669", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "276dcb9b-0e0e-44d2-a94d-e4aa7d659de4"}], "security_groups": [{"name": "tempest-securitygroup--93114957"}], "key_name": "tempest-keypair-890082615", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:26.023594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] validate_networks() for [('276dcb9b-0e0e-44d2-a94d-e4aa7d659de4', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:06:26.436351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Building network info cache for instance {{(pid=119599) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:06:26.677563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.281177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Getting quotas for project 648dff46412648f98fd3ef0bacded28d. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:29.288760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Getting quotas for user 695300d1268e41f985252e9454f60f39 and project 648dff46412648f98fd3ef0bacded28d. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:29.309907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:06:29.310565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:06:29.311203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:06:29.311814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:06:29.312392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:06:29.323769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:29.324491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:29.325581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:29.326182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:29.364749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Getting quotas for project 648dff46412648f98fd3ef0bacded28d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:29.375717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Getting quotas for user 695300d1268e41f985252e9454f60f39 and project 648dff46412648f98fd3ef0bacded28d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:29.398207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:06:29.403817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:06:29.507660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a40261c-e698-45ca-9995-96826eb84918 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.371093 Jul 25 16:06:29.508336 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 337/751] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:06:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 4373 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:06:29.513630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:29.519032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:29.534020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:29.534748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:29.535730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:29.536329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:30.164827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:30.201609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:30.204515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:30.216190 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0290ea64-5f72-4fd0-b1f6-a0c4f7ae0bc0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1365 microversion: 2.25 time: 0.696664 Jul 25 16:06:30.219314 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 338/752] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:29 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1365 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:30.232934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:30.238888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:30.254828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:30.267824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:30.273513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:30.276794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:30.843055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:30.857722 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91d63c53-67c7-448c-a1b8-29a8a895ed04 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1313 microversion: 2.1 time: 0.635940 Jul 25 16:06:30.858388 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 339/753] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:30 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:30.869026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-87e46b04-b7b8-4ca4-b1ac-88010b46a3ca req-5a1a0824-0d0b-4b12-8d32-b42770fa8f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:30.897387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-87e46b04-b7b8-4ca4-b1ac-88010b46a3ca req-5a1a0824-0d0b-4b12-8d32-b42770fa8f75 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:30.898409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-87e46b04-b7b8-4ca4-b1ac-88010b46a3ca req-5a1a0824-0d0b-4b12-8d32-b42770fa8f75 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:30.918790 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-87e46b04-b7b8-4ca4-b1ac-88010b46a3ca req-5a1a0824-0d0b-4b12-8d32-b42770fa8f75 service nova] Creating event network-changed:a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:30.918983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Updating instance_info_cache with network_info: [{"id": "2713e5e7-51d6-424b-aaf9-b3d44813245f", "address": "fa:16:3e:a9:8e:42", "network": {"id": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-797547745-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6d6ed3b79394344aa92af0aae019aa6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2713e5e7-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119599) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:06:30.927013 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-87e46b04-b7b8-4ca4-b1ac-88010b46a3ca req-5a1a0824-0d0b-4b12-8d32-b42770fa8f75 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066795 Jul 25 16:06:30.928773 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 340/754] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:30.952092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:30.953761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:30.959893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Releasing lock "refresh_cache-11b56432-7c1c-47ea-b7ee-ccac3bf727e5" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:06:30.962315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15f01e0c-6d81-4a5d-9666-d2e8e245d664 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action" status: 202 len: 0 microversion: 2.1 time: 14.322375 Jul 25 16:06:30.967506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:30.968355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:30.969530 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 415/755] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:16 2022] POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action => generated 0 bytes in 14331 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:06:30.971064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:30.971752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:30.984894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:30.985958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:31.008274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:31.012348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:31.018570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:31.021580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:31.944712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:31.956560 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1164b1bf-ebe7-43cc-b9f3-2b663e8ad755 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1478 microversion: 2.1 time: 1.025872 Jul 25 16:06:31.962659 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 341/756] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:30 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1478 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:31.976039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:31.977868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:31.996486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:31.997166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:31.998126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:31.998837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.013719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:32.052340 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0855e84f-bab8-405e-b506-2ad6a8cc9de6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1316 microversion: 2.1 time: 1.080851 Jul 25 16:06:32.076021 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 416/757] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:30 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1316 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:32.085799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d4105b59-0631-4173-94a8-1ae746750e2f req-5a9bc569-a77d-4621-94cf-c230cd80c9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58e405e-9682-4fb7-9741-c2ee3c5997f1", "tag": "5702a729-23cf-443a-a57b-cf4ac17e7a81"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:32.101886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d4105b59-0631-4173-94a8-1ae746750e2f req-5a9bc569-a77d-4621-94cf-c230cd80c9ee service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:32.102495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d4105b59-0631-4173-94a8-1ae746750e2f req-5a9bc569-a77d-4621-94cf-c230cd80c9ee service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.122308 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d4105b59-0631-4173-94a8-1ae746750e2f req-5a9bc569-a77d-4621-94cf-c230cd80c9ee service nova] Creating event network-changed:5702a729-23cf-443a-a57b-cf4ac17e7a81 for instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 on n-h1-846219-13 Jul 25 16:06:32.130564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d4105b59-0631-4173-94a8-1ae746750e2f req-5a9bc569-a77d-4621-94cf-c230cd80c9ee service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051334 Jul 25 16:06:32.132317 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 417/758] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:32.146105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:32.153596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:32.183587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:32.184518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.188002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:32.188807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.443645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:32.466418 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4393d2b-cacf-4993-b795-03583bfc0584 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1332 microversion: 2.1 time: 0.329223 Jul 25 16:06:32.467890 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 418/759] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:32 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1332 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:32.477949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-26750e09-3862-4b23-82e6-b1f68438ba6b req-27c1959b-881d-4733-bd28-e985bbf648fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b566cfc-f404-4acd-8584-14561ffcdea9", "name": "network-vif-plugged", "status": "completed", "tag": "2ec00204-5371-427b-8aae-8a7cd8ab540c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:32.506136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-26750e09-3862-4b23-82e6-b1f68438ba6b req-27c1959b-881d-4733-bd28-e985bbf648fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:32.507517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-26750e09-3862-4b23-82e6-b1f68438ba6b req-27c1959b-881d-4733-bd28-e985bbf648fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.535337 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-26750e09-3862-4b23-82e6-b1f68438ba6b req-27c1959b-881d-4733-bd28-e985bbf648fa service nova] Creating event network-vif-plugged:2ec00204-5371-427b-8aae-8a7cd8ab540c for instance 0b566cfc-f404-4acd-8584-14561ffcdea9 on n-h1-846219-13 Jul 25 16:06:32.550363 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-26750e09-3862-4b23-82e6-b1f68438ba6b req-27c1959b-881d-4733-bd28-e985bbf648fa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079348 Jul 25 16:06:32.563808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 419/760] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:32.600730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.211"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:32.611378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:32.640617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:32.640955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.643325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:32.644426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:32.723394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Acquired lock "refresh_cache-82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:06:33.083012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:33.111713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:33.115728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:33.119348 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ddafb19e-4023-4d74-9d53-9676520e158e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1891 microversion: 2.32 time: 1.153907 Jul 25 16:06:33.121433 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 342/761] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:31 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1891 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:33.134890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:33.136251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:33.149721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:33.150943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:33.152825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:33.153920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:33.918847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:33.940199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:33.943619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:33.946462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d6f10e7e-daf1-4f26-8873-749b8f952ad9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1365 microversion: 2.25 time: 0.822817 Jul 25 16:06:33.994605 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 343/762] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:33 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1365 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:34.004614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:34.011578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:34.040345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:34.041541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:34.042841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:34.043376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:34.762894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:34.793298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-abf77ae1-8dea-4835-be00-511456416d4d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1313 microversion: 2.1 time: 0.795938 Jul 25 16:06:34.794950 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 344/763] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:33 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:34.804364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:34.806041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:34.828595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:34.829490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:34.830937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:34.831831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:36.289926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:36.334670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94f7ae34-4034-47ba-8d8a-8aa865693392 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1478 microversion: 2.1 time: 1.537313 Jul 25 16:06:36.341481 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 345/764] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:34 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1478 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:36.371478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "1f447b3c-0d41-4512-8e25-1fd3029dcae2"}, {"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "aaaa6592-e99d-4688-b794-f72c24f9e4e0"}, {"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "5b988b11-3679-472a-be08-27a931119843"}, {"server_uuid": "ba754468-b0f7-4418-8813-23048902169f", "name": "network-vif-unplugged", "status": "completed", "tag": "2d0ff43e-5c97-48f9-b953-4d64885d233d"}, {"name": "network-changed", "server_uuid": "ba754468-b0f7-4418-8813-23048902169f", "tag": "2d0ff43e-5c97-48f9-b953-4d64885d233d"}, {"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "aec77042-8500-4693-86bd-08fddf0e26b2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:36.424986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=78 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:36.437984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:36.446442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:36.483173 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Creating event network-changed:1f447b3c-0d41-4512-8e25-1fd3029dcae2 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:36.484256 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Creating event network-changed:aaaa6592-e99d-4688-b794-f72c24f9e4e0 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:36.485530 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Creating event network-changed:5b988b11-3679-472a-be08-27a931119843 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:36.486694 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Creating event network-vif-unplugged:2d0ff43e-5c97-48f9-b953-4d64885d233d for instance ba754468-b0f7-4418-8813-23048902169f on n-h1-846219-13 Jul 25 16:06:36.487795 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Creating event network-changed:2d0ff43e-5c97-48f9-b953-4d64885d233d for instance ba754468-b0f7-4418-8813-23048902169f on n-h1-846219-13 Jul 25 16:06:36.489456 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Creating event network-changed:aec77042-8500-4693-86bd-08fddf0e26b2 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:36.511290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] Instance ba754468-b0f7-4418-8813-23048902169f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:06:36.557522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9bba26b9-9d7a-42b2-97b8-545543fc61ed req-bc215bec-107a-481b-9588-ffcf5499ac45 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1020 microversion: 2.1 time: 0.213284 Jul 25 16:06:36.567546 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 346/765] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 1020 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:36.591654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:36.592424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:36.616745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:36.625657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:36.626729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:36.627341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:37.950063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:37.969527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7a393f52-5453-4b64-aa95-8bfed97de25f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1503 microversion: 2.1 time: 1.399940 Jul 25 16:06:37.974891 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 347/766] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:36 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1503 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:37.992049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:37.993655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:38.008629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:38.013334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:38.014504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:38.019191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:38.459941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:38.474045 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed328511-5173-4312-90d5-5e4872d91ee1 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1396 microversion: 2.1 time: 0.497340 Jul 25 16:06:38.475142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 348/767] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:37 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1396 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:38.485286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:38.486810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:38.499621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:38.500908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:38.503072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:38.504149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:39.053738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:39.087172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:39.091173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:39.096908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7cd79620-aaee-412c-b868-ccff721f9205 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1891 microversion: 2.32 time: 0.618657 Jul 25 16:06:39.099210 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 349/768] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:38 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1891 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:39.110668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-43bbe5b4-5526-4fcb-a081-209c3f06bd77 req-4731bcab-9e1b-4da7-a61a-7485155ee1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}, {"name": "network-changed", "server_uuid": "7ef093c5-a8cb-41da-8470-de3992e69eae", "tag": "87c6104c-1dca-43c8-a238-cf56d2ce686e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:39.134665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-43bbe5b4-5526-4fcb-a081-209c3f06bd77 req-4731bcab-9e1b-4da7-a61a-7485155ee1cd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:39.142691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-43bbe5b4-5526-4fcb-a081-209c3f06bd77 req-4731bcab-9e1b-4da7-a61a-7485155ee1cd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:39.182177 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-43bbe5b4-5526-4fcb-a081-209c3f06bd77 req-4731bcab-9e1b-4da7-a61a-7485155ee1cd service nova] Creating event network-changed:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:06:39.183502 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-43bbe5b4-5526-4fcb-a081-209c3f06bd77 req-4731bcab-9e1b-4da7-a61a-7485155ee1cd service nova] Creating event network-changed:87c6104c-1dca-43c8-a238-cf56d2ce686e for instance 7ef093c5-a8cb-41da-8470-de3992e69eae on n-h2-846219-13 Jul 25 16:06:39.208728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-43bbe5b4-5526-4fcb-a081-209c3f06bd77 req-4731bcab-9e1b-4da7-a61a-7485155ee1cd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.106650 Jul 25 16:06:39.210614 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 350/769] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:39.241194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:39.244725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:39.264208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:39.266106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:39.269350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:39.270952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:39.340910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:39.391368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:39.906130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:39.930294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:39.932543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:39.934300 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b579d50a-07cb-4695-86b9-c59081e3444c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1365 microversion: 2.25 time: 0.721095 Jul 25 16:06:39.936961 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 351/770] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:39 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1365 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:39.973651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:39.974711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:39.981643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:39.982378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:39.983329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:39.983934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:40.951710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:40.969727 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9544ded-af12-452e-b301-df5154f39e19 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1313 microversion: 2.1 time: 1.012289 Jul 25 16:06:40.970697 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 352/771] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:39 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1313 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:40.976372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:40.977260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:41.002139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:41.003825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:41.007035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:41.008180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:41.519807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.network.neutron [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] re-assign floating IP 172.25.4.211 from instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 Jul 25 16:06:41.525974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=68,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:41.539110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:41.562904 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f4dddf7-4d7d-4f9c-a558-f04124574e47 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1476 microversion: 2.1 time: 0.590220 Jul 25 16:06:41.565722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 353/772] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:40 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:41.582422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-811046cb-dff1-4f99-b465-e4e5f4dacea8 req-e47b3eb2-2904-4299-8357-d5da4356b7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58e405e-9682-4fb7-9741-c2ee3c5997f1", "name": "network-vif-plugged", "status": "completed", "tag": "5702a729-23cf-443a-a57b-cf4ac17e7a81"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:41.609229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-811046cb-dff1-4f99-b465-e4e5f4dacea8 req-e47b3eb2-2904-4299-8357-d5da4356b7f7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:41.610398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-811046cb-dff1-4f99-b465-e4e5f4dacea8 req-e47b3eb2-2904-4299-8357-d5da4356b7f7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:41.633825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Building network info cache for instance {{(pid=119599) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:06:41.648729 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-811046cb-dff1-4f99-b465-e4e5f4dacea8 req-e47b3eb2-2904-4299-8357-d5da4356b7f7 service nova] Creating event network-vif-plugged:5702a729-23cf-443a-a57b-cf4ac17e7a81 for instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 on n-h1-846219-13 Jul 25 16:06:41.678462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-811046cb-dff1-4f99-b465-e4e5f4dacea8 req-e47b3eb2-2904-4299-8357-d5da4356b7f7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109502 Jul 25 16:06:41.680330 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 354/773] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:41.688614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:41.689530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:41.724882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:41.724882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:41.724882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:41.724882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:41.732043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:41.784317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:06:41.946294 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-caecd42f-bc50-4211-9b15-d3d9bdfa6b29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 204 len: 0 microversion: 2.1 time: 0.262960 Jul 25 16:06:41.948418 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 355/774] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:06:41 2022] DELETE /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:06:41.956787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-1618c0fc-fff6-49ec-b7b0-068ed8e46824 req-ab1bc540-0d9c-47d6-a176-af9a54942b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19066dc-2e77-4087-a547-5814cba90569", "tag": "9b869a2f-2d03-4aff-bf7c-7a4a414f73f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:41.971659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1618c0fc-fff6-49ec-b7b0-068ed8e46824 req-ab1bc540-0d9c-47d6-a176-af9a54942b79 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:41.972194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1618c0fc-fff6-49ec-b7b0-068ed8e46824 req-ab1bc540-0d9c-47d6-a176-af9a54942b79 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:41.993017 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-1618c0fc-fff6-49ec-b7b0-068ed8e46824 req-ab1bc540-0d9c-47d6-a176-af9a54942b79 service nova] Creating event network-changed:9b869a2f-2d03-4aff-bf7c-7a4a414f73f3 for instance e19066dc-2e77-4087-a547-5814cba90569 on n-h2-846219-13 Jul 25 16:06:42.003919 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-1618c0fc-fff6-49ec-b7b0-068ed8e46824 req-ab1bc540-0d9c-47d6-a176-af9a54942b79 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052548 Jul 25 16:06:42.006067 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 356/775] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:42.018671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:42.020787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:42.041363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:42.041363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:42.041363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:42.041363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:42.635677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:42.681467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:42.691449 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ccb30cdd-9760-4e85-bccd-d880e582d8b2 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1396 microversion: 2.1 time: 0.681833 Jul 25 16:06:42.692812 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 357/776] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:42 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1396 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:42.701226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:42.702086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:42.711509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:42.712384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:42.713959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:42.714708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:43.294900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:43.304125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:43.305657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:43.307023 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4566acf2-6da8-4f91-875d-d1b207723ecf tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.612021 Jul 25 16:06:43.307601 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 358/777] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:42 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:43.312277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:43.313302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:43.319514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:43.319949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:43.321018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:43.321353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:43.447055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Updating instance_info_cache with network_info: [{"id": "2713e5e7-51d6-424b-aaf9-b3d44813245f", "address": "fa:16:3e:a9:8e:42", "network": {"id": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-797547745-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6d6ed3b79394344aa92af0aae019aa6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2713e5e7-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119599) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:06:43.463279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Building network info cache for instance {{(pid=119599) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:06:44.145825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:44.155286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:44.156639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:44.157774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03c583c4-c49c-4319-8a3a-d33a9c1ea085 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1365 microversion: 2.25 time: 0.849247 Jul 25 16:06:44.158343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 359/778] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:43 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1365 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:44.163428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d04b53d9-41ac-49ee-ab6d-da95033e51fd req-007d9ecf-cf8e-4457-ae90-03f5df0f90d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "00cd520c-d4cc-4ec4-b596-47c08b95c9be"}, {"name": "network-changed", "server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:44.175401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d04b53d9-41ac-49ee-ab6d-da95033e51fd req-007d9ecf-cf8e-4457-ae90-03f5df0f90d8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:44.176301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d04b53d9-41ac-49ee-ab6d-da95033e51fd req-007d9ecf-cf8e-4457-ae90-03f5df0f90d8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:44.190250 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d04b53d9-41ac-49ee-ab6d-da95033e51fd req-007d9ecf-cf8e-4457-ae90-03f5df0f90d8 service nova] Creating event network-changed:00cd520c-d4cc-4ec4-b596-47c08b95c9be for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:44.190850 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d04b53d9-41ac-49ee-ab6d-da95033e51fd req-007d9ecf-cf8e-4457-ae90-03f5df0f90d8 service nova] Creating event network-changed:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:06:44.199568 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d04b53d9-41ac-49ee-ab6d-da95033e51fd req-007d9ecf-cf8e-4457-ae90-03f5df0f90d8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039756 Jul 25 16:06:44.200265 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 360/779] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:44.205773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:44.206418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:44.213156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:44.213609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:44.214375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:44.214820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:44.668503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:44.688962 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d0698340-f7b7-4374-aaf2-b560134de292 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1509 microversion: 2.1 time: 0.487206 Jul 25 16:06:44.707051 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 361/780] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:44 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:44.728570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:44.729689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:44.737075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:44.737731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:44.738630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:44.739164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.145586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:45.170503 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-76e8f9e3-57bb-414a-9b99-f7f9bf9891d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1313 microversion: 2.1 time: 0.461148 Jul 25 16:06:45.171408 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 362/781] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:44 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:45.181126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:45.182846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:45.195780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.197428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.199055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.200115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.457163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Updating instance_info_cache with network_info: [{"id": "4c572e1b-7f7f-4634-849f-a54ced4d3147", "address": "fa:16:3e:76:bb:23", "network": {"id": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-797547745-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6d6ed3b79394344aa92af0aae019aa6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4c572e1b-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119599) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:06:45.470913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Releasing lock "refresh_cache-82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:06:45.471814 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d62e556d-1d57-474c-93e9-33707b40298b tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9/action" status: 202 len: 0 microversion: 2.1 time: 12.889793 Jul 25 16:06:45.472436 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 420/782] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:32 2022] POST /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9/action => generated 0 bytes in 12908 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:06:45.481833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:45.482455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:45.489140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.489601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.490386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.490830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.512394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:45.521936 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-009d753c-20be-435a-943b-960a6a4c3e78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1473 microversion: 2.1 time: 0.348877 Jul 25 16:06:45.522872 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 363/783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:45 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:45.529384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e7512a73-d6fb-458b-a36c-9e61c31d9f5b req-6a9e33d1-d639-44c4-b882-d30427bfd50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef093c5-a8cb-41da-8470-de3992e69eae", "name": "network-vif-plugged", "status": "completed", "tag": "87c6104c-1dca-43c8-a238-cf56d2ce686e"}, {"server_uuid": "e19066dc-2e77-4087-a547-5814cba90569", "name": "network-vif-plugged", "status": "completed", "tag": "9b869a2f-2d03-4aff-bf7c-7a4a414f73f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:45.544319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e7512a73-d6fb-458b-a36c-9e61c31d9f5b req-6a9e33d1-d639-44c4-b882-d30427bfd50c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.545475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e7512a73-d6fb-458b-a36c-9e61c31d9f5b req-6a9e33d1-d639-44c4-b882-d30427bfd50c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.562415 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e7512a73-d6fb-458b-a36c-9e61c31d9f5b req-6a9e33d1-d639-44c4-b882-d30427bfd50c service nova] Creating event network-vif-plugged:87c6104c-1dca-43c8-a238-cf56d2ce686e for instance 7ef093c5-a8cb-41da-8470-de3992e69eae on n-h2-846219-13 Jul 25 16:06:45.562923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e7512a73-d6fb-458b-a36c-9e61c31d9f5b req-6a9e33d1-d639-44c4-b882-d30427bfd50c service nova] Creating event network-vif-plugged:9b869a2f-2d03-4aff-bf7c-7a4a414f73f3 for instance e19066dc-2e77-4087-a547-5814cba90569 on n-h2-846219-13 Jul 25 16:06:45.571270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e7512a73-d6fb-458b-a36c-9e61c31d9f5b req-6a9e33d1-d639-44c4-b882-d30427bfd50c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046412 Jul 25 16:06:45.572521 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 364/784] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:45.582305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:45.583649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:45.598778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.599586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.600999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.601819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.935759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:45.944086 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-60ce673c-0660-4ca4-9644-5252ba19f94d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1396 microversion: 2.1 time: 0.470445 Jul 25 16:06:45.944784 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 421/785] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:45 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1396 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:45.950083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:45.950842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:45.953594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:45.958331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.958768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.959756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.960187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:45.970617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:45.972877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:45.974405 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17cdf621-b4b3-4140-b403-01bbce2299dc tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.400016 Jul 25 16:06:45.975050 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 365/786] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:45 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:45.979979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b17828ee-0658-41d6-bdfa-a714e76a75e8 req-9fc6b1b0-ba19-402a-8cb7-6993cd41a8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b566cfc-f404-4acd-8584-14561ffcdea9", "name": "network-vif-deleted", "tag": "2ec00204-5371-427b-8aae-8a7cd8ab540c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:45.989982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b17828ee-0658-41d6-bdfa-a714e76a75e8 req-9fc6b1b0-ba19-402a-8cb7-6993cd41a8ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:45.990424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b17828ee-0658-41d6-bdfa-a714e76a75e8 req-9fc6b1b0-ba19-402a-8cb7-6993cd41a8ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.004047 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b17828ee-0658-41d6-bdfa-a714e76a75e8 req-9fc6b1b0-ba19-402a-8cb7-6993cd41a8ef service nova] Creating event network-vif-deleted:2ec00204-5371-427b-8aae-8a7cd8ab540c for instance 0b566cfc-f404-4acd-8584-14561ffcdea9 on n-h1-846219-13 Jul 25 16:06:46.009668 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b17828ee-0658-41d6-bdfa-a714e76a75e8 req-9fc6b1b0-ba19-402a-8cb7-6993cd41a8ef service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Jul 25 16:06:46.010837 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 366/787] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:46.018266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'action', calling method: .version_select at 0x7f9da2e43a60>, body: {"removeFloatingIp": {"address": "172.25.4.211"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:46.328645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:46.337055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:46.340356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.341712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.342233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.342774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.347528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:46.349178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:46.350418 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82575162-d851-4fab-ace4-d1a0d559e03d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1365 microversion: 2.25 time: 0.404511 Jul 25 16:06:46.351042 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 422/788] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:45 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:46.357061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:46.358082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:46.366276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.367037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.368170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.368789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.465810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-729b2aab-a1c6-4778-8065-5ccb8fadf5cd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f/action" status: 204 len: 0 microversion: 2.1 time: 0.113238 Jul 25 16:06:46.468050 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 423/789] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:46 2022] POST /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f/action => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:06:46.482716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:46.483350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:46.490345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.490892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.491790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.492386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.535292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.536351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.536817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lazy-loading 'fault' on Instance uuid 0b566cfc-f404-4acd-8584-14561ffcdea9 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:06:46.635323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:46.645687 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-79ede75d-d916-4374-a5a6-c97f600f1e72 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 200 len: 1306 microversion: 2.1 time: 0.175686 Jul 25 16:06:46.647065 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 424/790] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:46 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:46.664894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:46.665555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:46.672659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.673172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:46.673958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:46.674530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.394223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:47.402387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6a1ffc37-b211-47ac-ba56-bbb5c07ae4e7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1313 microversion: 2.1 time: 0.742200 Jul 25 16:06:47.403063 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 425/791] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:46 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:47.408483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a35707d2-39a0-46b9-81de-358dfa4c7c2d req-0f4b7c96-8087-4628-928a-d236770b4796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9", "tag": "4c572e1b-7f7f-4634-849f-a54ced4d3147"}, {"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "2e157acc-e2f3-40b4-a6bc-e64dd00fd338"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:47.426875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a35707d2-39a0-46b9-81de-358dfa4c7c2d req-0f4b7c96-8087-4628-928a-d236770b4796 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.427014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a35707d2-39a0-46b9-81de-358dfa4c7c2d req-0f4b7c96-8087-4628-928a-d236770b4796 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.430850 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] HTTP exception thrown: Floating IP 172.25.4.211 is not associated with instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5. Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Request method failure captured: Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action HTTP/1.1 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 49 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r8sI1UKp_aT2_F-0o0h7aWqpVz2hXr9dJobQTInNPr9PvALgvpeN0D_PFJ42miA_uD-36U84zXKnSbXvoY0eEr75A7HV40SNSJF6VfBB_KJUEChFC2-VLn9-QOBH7MYq3zU29MhaQDiMIo6MvJR8IIEb9mwJpLLIxlXK71Wm67MLaU Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f6d6ed3b79394344aa92af0aae019aa6"}]}] Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1a52447762c64ba5bc1666f908c2154b Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: {"removeFloatingIp": {"address": "172.25.4.211"}} Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: exception: Floating IP 172.25.4.211 is not associated with instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5. Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '11b56432-7c1c-47ea-b7ee-ccac3bf727e5', 'body': {'removeFloatingIp': {'address': '172.25.4.211'}}} Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.211 is not associated with instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5. Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.211 is not associated with instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5. Jul 25 16:06:47.434795 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:06:47.440037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Returning 409 to user: Floating IP 172.25.4.211 is not associated with instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:06:47.441050 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d3f0cf35-5a91-4ef9-a5ac-5e5bec20fd59 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action" status: 409 len: 146 microversion: 2.1 time: 1.428946 Jul 25 16:06:47.445697 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 367/792] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:46 2022] POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action => generated 146 bytes in 1431 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:06:47.445952 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a35707d2-39a0-46b9-81de-358dfa4c7c2d req-0f4b7c96-8087-4628-928a-d236770b4796 service nova] Creating event network-changed:4c572e1b-7f7f-4634-849f-a54ced4d3147 for instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 on n-h2-846219-13 Jul 25 16:06:47.445952 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a35707d2-39a0-46b9-81de-358dfa4c7c2d req-0f4b7c96-8087-4628-928a-d236770b4796 service nova] Creating event network-changed:2e157acc-e2f3-40b4-a6bc-e64dd00fd338 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:06:47.451934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:47.452781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:47.452921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a35707d2-39a0-46b9-81de-358dfa4c7c2d req-0f4b7c96-8087-4628-928a-d236770b4796 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048567 Jul 25 16:06:47.453795 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 426/793] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:47.462216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:47.463023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:47.472762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.473547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.474364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.474932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.482795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.484894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.485952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.488596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.926436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:47.940947 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f5d4d96-2bf8-47d5-aba7-ac2ecfbd6650 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1396 microversion: 2.1 time: 0.485126 Jul 25 16:06:47.942014 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 427/794] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:47 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1396 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:47.952880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:47.966024 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-576d1187-e820-41c7-9f26-77d14f43fed5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1473 microversion: 2.1 time: 0.522007 Jul 25 16:06:47.966569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:47.967292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:47.987399 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 368/795] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:47 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1473 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:47.988691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.992064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:47.992804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:47.997158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:47.997452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:47.997452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.012267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.013133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.014155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.014757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.514024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:48.522209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:48.523970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:48.525471 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e72cef7-2f5e-426c-ae06-622585292897 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1560 microversion: 2.25 time: 0.536726 Jul 25 16:06:48.537119 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 369/796] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:47 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1560 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:48.537119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.211"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:48.584430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:48.595919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:48.597583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:48.598859 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2945fe63-8fe1-4520-8d4b-7ed38292cedb tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.641995 Jul 25 16:06:48.599682 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 428/797] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:47 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:48.611029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-268b5bde-bd31-4527-a47b-54ad175674a5 req-00c64b44-ec04-4fe7-b4c0-69766bfba4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba754468-b0f7-4418-8813-23048902169f", "name": "network-vif-plugged", "status": "completed", "tag": "2d0ff43e-5c97-48f9-b953-4d64885d233d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:48.621891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-268b5bde-bd31-4527-a47b-54ad175674a5 req-00c64b44-ec04-4fe7-b4c0-69766bfba4bf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.622335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-268b5bde-bd31-4527-a47b-54ad175674a5 req-00c64b44-ec04-4fe7-b4c0-69766bfba4bf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.634750 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-268b5bde-bd31-4527-a47b-54ad175674a5 req-00c64b44-ec04-4fe7-b4c0-69766bfba4bf service nova] Creating event network-vif-plugged:2d0ff43e-5c97-48f9-b953-4d64885d233d for instance ba754468-b0f7-4418-8813-23048902169f on n-h1-846219-13 Jul 25 16:06:48.640827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-268b5bde-bd31-4527-a47b-54ad175674a5 req-00c64b44-ec04-4fe7-b4c0-69766bfba4bf service nova] Instance ba754468-b0f7-4418-8813-23048902169f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:06:48.652368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-268b5bde-bd31-4527-a47b-54ad175674a5 req-00c64b44-ec04-4fe7-b4c0-69766bfba4bf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044566 Jul 25 16:06:48.653526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 429/798] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:48.658516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:48.659227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:48.665946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.666439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.667202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.667711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.682954 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 HTTP/1.1 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0b566cfc-f404-4acd-8584-14561ffcdea9'} Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:06:48.684636 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a70fe641-444c-4232-ad18-58703b907fe4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 404 len: 111 microversion: 2.1 time: 0.031672 Jul 25 16:06:48.689148 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 430/799] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:48 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:06:48.691907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:48.692717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:48.699406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.700107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.701088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.705782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.896504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:48.904508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.904967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:48.906111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:48.906242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:49.145271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:49.153675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c33aebd8-0b11-4817-ab9c-ad64b0699359 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1496 microversion: 2.1 time: 0.465513 Jul 25 16:06:49.154232 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 431/800] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:48 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1496 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:49.214355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:49.215007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:49.222049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:49.222499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:49.223293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:49.223823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:49.765958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Acquired lock "refresh_cache-82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:06:49.941483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid a58e405e-9682-4fb7-9741-c2ee3c5997f1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:06:49.994599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac2fb344-53ff-48d0-b1dc-83cd1a9f3d46 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 2054 microversion: 2.25 time: 0.839148 Jul 25 16:06:49.995189 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 432/801] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:49 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 2054 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:50.000278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-431423427", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:50.074988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:06:51.041209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:06:51.041906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:06:51.042270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:06:51.042682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:06:51.043101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:06:51.053029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.053421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.054244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.054970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.074743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:51.083443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:51.101959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:06:51.105189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:06:51.158561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-491af420-3174-46d6-9d48-4b17479e9fa3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.162042 Jul 25 16:06:51.159223 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 433/802] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:06:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:06:51.165510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:51.166148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:51.174274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.175124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.176319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.176958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.263515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Building network info cache for instance {{(pid=119598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:06:51.460040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:51.478164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9faa4836-f064-4afe-991d-eb2c6d51f2a6 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1576 microversion: 2.1 time: 0.316245 Jul 25 16:06:51.479465 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 434/803] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:51 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1576 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:51.498075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:51.498358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:51.510048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.511135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.511335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.511749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.542676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:51.938111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:51.955302 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-989d9b25-53d0-4d09-90e8-9e8b96c84a17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1465 microversion: 2.1 time: 0.473574 Jul 25 16:06:51.956457 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 435/804] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:51 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1465 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:51.966601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:51.968665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:51.992216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.993636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:51.996380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:51.997393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:52.317189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Updating instance_info_cache with network_info: [{"id": "4c572e1b-7f7f-4634-849f-a54ced4d3147", "address": "fa:16:3e:76:bb:23", "network": {"id": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-797547745-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6d6ed3b79394344aa92af0aae019aa6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4c572e1b-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:06:52.340225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Releasing lock "refresh_cache-82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:06:52.341690 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-29f3ebb2-9a61-4e3b-b34c-25d82e857dc6 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9/action" status: 202 len: 0 microversion: 2.1 time: 3.813870 Jul 25 16:06:52.342970 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 370/805] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:48 2022] POST /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9/action => generated 0 bytes in 3816 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:06:52.348432 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06d0027f-a3be-4588-ad64-94e5e5417e93 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1649 microversion: 2.1 time: 0.389745 Jul 25 16:06:52.349034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 436/806] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:51 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1649 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:52.350577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:52.351643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:52.366438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:52.367395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:52.384481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:52.386357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:52.387216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:52.389314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:52.389771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:52.390591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:52.391569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:52.393298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.179714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid a58e405e-9682-4fb7-9741-c2ee3c5997f1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:06:53.188659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:53.202936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:53.204518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:53.205845 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f96476e2-c920-4a5e-98d4-0a745b987ff1 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.861360 Jul 25 16:06:53.206429 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 371/807] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:52 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:53.208808 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ac37928-609b-44c1-8e91-5a72e4ac0f03 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 2054 microversion: 2.25 time: 0.858553 Jul 25 16:06:53.221289 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 437/808] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:52 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 2054 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:53.221612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:53.221612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:53.221948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8df528bf-2f3f-45de-bdae-f37738fd41e4 req-2e9af8bc-42c4-4100-b950-792e33f7b79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9", "tag": "4c572e1b-7f7f-4634-849f-a54ced4d3147"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:53.222107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.222107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.222494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.223294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.234853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8df528bf-2f3f-45de-bdae-f37738fd41e4 req-2e9af8bc-42c4-4100-b950-792e33f7b79d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.235721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8df528bf-2f3f-45de-bdae-f37738fd41e4 req-2e9af8bc-42c4-4100-b950-792e33f7b79d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.252962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:53.254469 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8df528bf-2f3f-45de-bdae-f37738fd41e4 req-2e9af8bc-42c4-4100-b950-792e33f7b79d service nova] Creating event network-changed:4c572e1b-7f7f-4634-849f-a54ced4d3147 for instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 on n-h2-846219-13 Jul 25 16:06:53.262517 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8df528bf-2f3f-45de-bdae-f37738fd41e4 req-2e9af8bc-42c4-4100-b950-792e33f7b79d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051678 Jul 25 16:06:53.263170 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 438/809] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:53.270074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:53.270659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:53.278470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.278920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.279792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.280225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.413755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:53.422812 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6345bea3-d6e3-44cc-9b1c-19a537ef71de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1276 microversion: 2.1 time: 0.214772 Jul 25 16:06:53.423567 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 372/810] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:53 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:53.428965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:53.429798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:53.438285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.438940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.439857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.440401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.540709 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b47fda02-8c54-4c77-988c-a9aa06c03c91 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275870 Jul 25 16:06:53.548630 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 439/811] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:06:53 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:53.548630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:53.548630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:53.556473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.556473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.556771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.557757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.587982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:06:53.684559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4461f350-c22a-4d25-94f6-46808a150263 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "DELETE /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 204 len: 0 microversion: 2.1 time: 0.141435 Jul 25 16:06:53.690043 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 440/812] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:06:53 2022] DELETE /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:06:53.691760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:53.692811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:53.699405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.699958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.700924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.701729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.915517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:53.923991 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89574ca1-9128-4213-9a71-4b44d62179bd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1465 microversion: 2.1 time: 0.499072 Jul 25 16:06:53.924726 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 373/813] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:53 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1465 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:53.947475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c57e742-eccf-44b4-a384-2fb0aee26d05 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:53.950890 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:06:53.950890 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:06:53.952253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c57e742-eccf-44b4-a384-2fb0aee26d05 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.952699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c57e742-eccf-44b4-a384-2fb0aee26d05 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.953527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c57e742-eccf-44b4-a384-2fb0aee26d05 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:53.954175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c57e742-eccf-44b4-a384-2fb0aee26d05 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:53.981893 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c57e742-eccf-44b4-a384-2fb0aee26d05 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.055820 Jul 25 16:06:53.987904 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 374/814] 10.222.0.105 () {60 vars in 1222 bytes} [Mon Jul 25 16:06:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:53.991731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'action', calling method: .version_select at 0x7f9da2e43940>, body: {"addFloatingIp": {"address": "172.25.4.211"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:53.994234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:54.000768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:54.001218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:54.001997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:54.002630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:54.029540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Acquired lock "refresh_cache-11b56432-7c1c-47ea-b7ee-ccac3bf727e5" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:06:54.042951 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c3aa022-9e92-4136-870a-cda3903ed03f tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1649 microversion: 2.1 time: 0.355979 Jul 25 16:06:54.057153 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 441/815] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:53 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1649 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:54.057153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26ed950e-fa29-4e05-98e7-44a6c4d6e353 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'create', calling method: .version_select at 0x7f9d93c9dee0>, body: {"keypair": {"name": "tempest-keypair-38290664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8A1JTEmg/6nf1BldvCZXXml1496VGAzb84eYMpfe4Uz2Gx9yBw30IN/oIF4MirgZrsrcVLdGGH1Wt+wOJIaRy86JV4qOhx9ocNesQA+OnWKnEGnQPg7spD8qQOLNsclA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:54.072608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-26ed950e-fa29-4e05-98e7-44a6c4d6e353 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for project d9f0fc04dc474012a154839ce32e979d. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:06:54.079210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-26ed950e-fa29-4e05-98e7-44a6c4d6e353 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for user 797cc3e401c3492187cd37395c534d3c and project d9f0fc04dc474012a154839ce32e979d. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:06:54.128888 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26ed950e-fa29-4e05-98e7-44a6c4d6e353 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.083484 Jul 25 16:06:54.130116 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 442/816] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:06:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:54.137465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-13", "block_migration": "auto"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:54.143308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:54.150947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:54.151641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:54.152718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:54.153533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:54.247428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'flavor' on Instance uuid a58e405e-9682-4fb7-9741-c2ee3c5997f1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:06:54.301949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Going to try to live migrate instance to n-h2-846219-13 {{(pid=119599) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:06:56.994862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Building network info cache for instance {{(pid=119598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:06:57.263087 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4bd35f40-9a94-4931-8533-ac29c2de5275 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1/action" status: 202 len: 0 microversion: 2.25 time: 3.131640 Jul 25 16:06:57.264397 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 443/817] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:06:54 2022] POST /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1/action => generated 0 bytes in 3134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:06:57.271906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0af0d8cc-b37e-4a32-a5e2-64178eda3e71 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:57.281295 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:06:57.281295 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:06:57.282721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0af0d8cc-b37e-4a32-a5e2-64178eda3e71 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:57.283223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0af0d8cc-b37e-4a32-a5e2-64178eda3e71 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:57.284009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0af0d8cc-b37e-4a32-a5e2-64178eda3e71 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:57.284429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0af0d8cc-b37e-4a32-a5e2-64178eda3e71 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:57.350133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0af0d8cc-b37e-4a32-a5e2-64178eda3e71 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.083649 Jul 25 16:06:57.351117 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 444/818] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:06:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:57.363288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:57.364212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:57.380920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:57.381865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:57.382871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:57.383307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:57.848139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:57.859033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:57.860629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:57.862054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f06b3fc3-f68d-463d-8fbf-812ce62ff725 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.509616 Jul 25 16:06:57.863028 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 445/819] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:57 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:57.868340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:57.869201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:57.879105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:57.879972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:57.880875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:57.881392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.296942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:58.322011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d53c8ab8-6512-4197-8aee-d776a10529ba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1318 microversion: 2.1 time: 0.457515 Jul 25 16:06:58.324173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 446/820] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:57 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:58.337331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:58.338290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:58.347944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.348848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.350399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.351619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.554153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Updating instance_info_cache with network_info: [{"id": "2713e5e7-51d6-424b-aaf9-b3d44813245f", "address": "fa:16:3e:a9:8e:42", "network": {"id": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-797547745-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6d6ed3b79394344aa92af0aae019aa6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2713e5e7-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:06:58.568201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Releasing lock "refresh_cache-11b56432-7c1c-47ea-b7ee-ccac3bf727e5" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:06:58.569250 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45856876-83ca-4d9f-8a39-bfd7cce0082f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action" status: 202 len: 0 microversion: 2.1 time: 4.585232 Jul 25 16:06:58.570065 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 375/821] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:53 2022] POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action => generated 0 bytes in 4587 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:06:58.575080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5488111c-d83a-46eb-aa24-ca1d0c00609e req-6902e3cd-6ddd-4cea-a781-e26babbe86e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19066dc-2e77-4087-a547-5814cba90569", "tag": "9b869a2f-2d03-4aff-bf7c-7a4a414f73f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:58.586001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5488111c-d83a-46eb-aa24-ca1d0c00609e req-6902e3cd-6ddd-4cea-a781-e26babbe86e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.586464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5488111c-d83a-46eb-aa24-ca1d0c00609e req-6902e3cd-6ddd-4cea-a781-e26babbe86e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.598066 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5488111c-d83a-46eb-aa24-ca1d0c00609e req-6902e3cd-6ddd-4cea-a781-e26babbe86e3 service nova] Creating event network-changed:9b869a2f-2d03-4aff-bf7c-7a4a414f73f3 for instance e19066dc-2e77-4087-a547-5814cba90569 on n-h2-846219-13 Jul 25 16:06:58.603517 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5488111c-d83a-46eb-aa24-ca1d0c00609e req-6902e3cd-6ddd-4cea-a781-e26babbe86e3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032228 Jul 25 16:06:58.604508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 376/822] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:58.605004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:58.609939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2b94122f-b48b-464c-b107-afd91c415b31 req-58030736-ef40-49fd-9724-fef1880debb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:58.613803 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f201e743-4502-4fbf-b7c4-ceebf5688e8f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1576 microversion: 2.1 time: 0.287888 Jul 25 16:06:58.614395 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 447/823] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:58 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1576 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:58.619308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:58.619915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:58.620655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2b94122f-b48b-464c-b107-afd91c415b31 req-58030736-ef40-49fd-9724-fef1880debb9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.621068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2b94122f-b48b-464c-b107-afd91c415b31 req-58030736-ef40-49fd-9724-fef1880debb9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.626951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.627410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.628221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.628661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.633049 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2b94122f-b48b-464c-b107-afd91c415b31 req-58030736-ef40-49fd-9724-fef1880debb9 service nova] Creating event network-changed:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:06:58.638485 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2b94122f-b48b-464c-b107-afd91c415b31 req-58030736-ef40-49fd-9724-fef1880debb9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032468 Jul 25 16:06:58.639104 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 377/824] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:58.644531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:06:58.645198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:58.651680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.652127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.652896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.653346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.724855 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3cf94b77-8893-4a14-9bf6-6a0ad7185550 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae/action" status: 202 len: 0 microversion: 2.1 time: 0.084176 Jul 25 16:06:58.725548 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 378/825] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:06:58 2022] POST /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:06:58.730995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9a0ec013-9f1f-430b-82cc-4a87fd2b9500 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '.version_select at 0x7f9d93ee84c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:58.734686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a0ec013-9f1f-430b-82cc-4a87fd2b9500 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.735134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a0ec013-9f1f-430b-82cc-4a87fd2b9500 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.744834 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9a0ec013-9f1f-430b-82cc-4a87fd2b9500 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.018073 Jul 25 16:06:58.751295 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 379/826] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:06:58 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:58.751295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75a408a2-a5b8-404b-bccd-ad6ce61be953 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '.version_select at 0x7f9d93c22550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:58.844948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:58.858231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:58.861285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:06:58.862905 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ec16378-a153-4cfc-88f0-5018bce5aeae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.247524 Jul 25 16:06:58.864055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 448/827] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:58 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:06:58.869410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:58.870360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:58.876905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.877755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:58.878756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:58.879391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:59.651709 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24bded2b-ac0f-4508-8a74-61fa876c5f5a tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1654 microversion: 2.1 time: 0.786251 Jul 25 16:06:59.652648 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 449/828] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:58 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1654 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:06:59.656672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b87474e7-00f9-47c3-a41d-b23d8cb11f01 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:59.664120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b87474e7-00f9-47c3-a41d-b23d8cb11f01 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.010645 Jul 25 16:06:59.664594 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 450/829] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:06:59 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:59.669526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:59.670479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:59.674181 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75a408a2-a5b8-404b-bccd-ad6ce61be953 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips/24dd871e-1b3e-4f22-8a2e-3cf1554f76d4" status: 200 len: 184 microversion: 2.1 time: 0.927531 Jul 25 16:06:59.675230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 380/830] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:06:58 2022] GET /compute/v2.1/os-floating-ips/24dd871e-1b3e-4f22-8a2e-3cf1554f76d4 => generated 184 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:06:59.678695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:59.679269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:59.680052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:59.680630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:59.686952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:06:59.688243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:06:59.696929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:59.697436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:06:59.698263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:06:59.698869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.155184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.164711 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0af6922a-7eb0-42d2-bbbf-7c1dca4d88e0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1318 microversion: 2.1 time: 0.488000 Jul 25 16:07:00.165709 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 381/831] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:06:59 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:00.176437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2418d8e-3520-45ce-aa7a-e118e2d56e57 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1079765853", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:00.183067 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:07:00.183067 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:07:00.185818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.191159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:00.200749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.202969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.204641 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b76e5af1-afaa-4613-89c2-58b61d3fd71c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.538706 Jul 25 16:07:00.205552 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 451/832] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:06:59 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:00.213229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Action: 'action', calling method: .version_select at 0x7f9da2e43a60>, body: {"removeFloatingIp": {"address": "172.25.4.211"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:00.224666 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2418d8e-3520-45ce-aa7a-e118e2d56e57 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 501 microversion: 2.1 time: 0.057347 Jul 25 16:07:00.225348 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 382/833] 10.222.0.105 () {60 vars in 1151 bytes} [Mon Jul 25 16:07:00 2022] POST /compute/v2.1/flavors => generated 501 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:00.230733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:00.232121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:00.238286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.238734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.239513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.240026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.548341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:00.551453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:00.559628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.559628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.559628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.559628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.568926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.587048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.590385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:00.592955 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72c7a562-05de-41f1-b98e-a64b4259ed6f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.366332 Jul 25 16:07:00.594188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 383/834] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:00 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:00.603167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10492c2d-488c-487d-a151-4de6264cdf05 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:00.619080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10492c2d-488c-487d-a151-4de6264cdf05 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022831 Jul 25 16:07:00.620029 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 384/835] 10.222.0.105 () {58 vars in 1187 bytes} [Mon Jul 25 16:07:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:07:00.628863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2fa9f594-9a26-4d45-8a70-3f08e8be8937 req-94e40bda-cc59-4f60-bd23-779eb0de380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9", "name": "network-vif-deleted", "tag": "4c572e1b-7f7f-4634-849f-a54ced4d3147"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:00.647257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2fa9f594-9a26-4d45-8a70-3f08e8be8937 req-94e40bda-cc59-4f60-bd23-779eb0de380d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.647958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2fa9f594-9a26-4d45-8a70-3f08e8be8937 req-94e40bda-cc59-4f60-bd23-779eb0de380d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.671114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2fa9f594-9a26-4d45-8a70-3f08e8be8937 req-94e40bda-cc59-4f60-bd23-779eb0de380d service nova] Creating event network-vif-deleted:4c572e1b-7f7f-4634-849f-a54ced4d3147 for instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 on n-h2-846219-13 Jul 25 16:07:00.680140 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2fa9f594-9a26-4d45-8a70-3f08e8be8937 req-94e40bda-cc59-4f60-bd23-779eb0de380d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057618 Jul 25 16:07:00.681513 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 385/836] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:00.691091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0a3b9442-922f-4422-a682-3e5783456b37 req-aac5a596-6971-413c-a715-89db9cb5ec98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc20a92-2837-413c-934b-50d10d25c7c8", "tag": "80b7d0ab-8553-4019-9e11-a534507d312e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:00.706220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a3b9442-922f-4422-a682-3e5783456b37 req-aac5a596-6971-413c-a715-89db9cb5ec98 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.706667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a3b9442-922f-4422-a682-3e5783456b37 req-aac5a596-6971-413c-a715-89db9cb5ec98 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.720936 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0a3b9442-922f-4422-a682-3e5783456b37 req-aac5a596-6971-413c-a715-89db9cb5ec98 service nova] Creating event network-changed:80b7d0ab-8553-4019-9e11-a534507d312e for instance fcc20a92-2837-413c-934b-50d10d25c7c8 on n-h1-846219-13 Jul 25 16:07:00.726342 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0a3b9442-922f-4422-a682-3e5783456b37 req-aac5a596-6971-413c-a715-89db9cb5ec98 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043058 Jul 25 16:07:00.727289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 386/837] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:00.732596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:00.733656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:00.740604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.740948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.741708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:00.742159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:00.959398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Acquired lock "refresh_cache-11b56432-7c1c-47ea-b7ee-ccac3bf727e5" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:07:01.070403 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-32016227-538e-43d0-9a38-d9fe4dbd2ad1 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1634 microversion: 2.1 time: 0.341705 Jul 25 16:07:01.071002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 387/838] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:00 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1634 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:01.075923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1351041781", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "77811395-edf2-44da-bdf7-fd1f71dfef14"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:01.142001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:07:01.799982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:07:01.799982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:07:01.800666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:07:01.801347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:07:01.801791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:07:01.815374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:01.815996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:01.816931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:01.817635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:01.843276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:07:01.852653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for user 797cc3e401c3492187cd37395c534d3c and project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:07:01.864977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:01.872097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:07:01.875488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:07:01.938683 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1ea0c0a-3923-4b12-85e3-d06608626b97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.866512 Jul 25 16:07:01.939865 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 388/839] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:07:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:07:01.946420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-13", "block_migration": true, "disk_over_commit": false}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:01.949849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:01.972271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:01.973734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:01.974818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:01.975657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:02.017025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lazy-loading 'flavor' on Instance uuid 7ef093c5-a8cb-41da-8470-de3992e69eae {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:02.036326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Going to try to live migrate instance to n-h1-846219-13 {{(pid=119598) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:07:03.288825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Building network info cache for instance {{(pid=119599) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:07:04.104054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Updating instance_info_cache with network_info: [{"id": "2713e5e7-51d6-424b-aaf9-b3d44813245f", "address": "fa:16:3e:a9:8e:42", "network": {"id": "642d87a1-e2ff-4d5e-ad13-3454b40dcf1c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-797547745-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f6d6ed3b79394344aa92af0aae019aa6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2713e5e7-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119599) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:07:04.106876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:04.116487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Releasing lock "refresh_cache-11b56432-7c1c-47ea-b7ee-ccac3bf727e5" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:07:04.117976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-feded283-ae2a-4ffa-a66b-4b94dacafbce tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action" status: 202 len: 0 microversion: 2.1 time: 3.910575 Jul 25 16:07:04.118834 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 452/840] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:07:00 2022] POST /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5/action => generated 0 bytes in 3913 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:07:04.126569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:04.127430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:04.134570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.135017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.135793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.136224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.296580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:04.305764 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d77e24f1-fbf4-45be-8c88-85e6d5580210 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1318 microversion: 2.1 time: 0.185377 Jul 25 16:07:04.306646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 453/841] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:04 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:04.323761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:04.327184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:04.344291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.345022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.355102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.357827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.819194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:04.847209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:04.853533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:04.856184 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51ffbe53-673c-4acf-bb59-d47800c3bad9 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.547997 Jul 25 16:07:04.858936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 454/842] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:04 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:04.877534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:04.878783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:04.879334 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8eaf550-0773-4a41-972c-6c5b2baa9de5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae/action" status: 202 len: 0 microversion: 2.1 time: 2.937418 Jul 25 16:07:04.880101 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 389/843] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:07:01 2022] POST /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae/action => generated 0 bytes in 2939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:04.886300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:04.890206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:04.891335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.892184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.893945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.894804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.903471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.905248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:04.911267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:04.912297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.007103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:05.055069 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f92bc9f7-d9d7-4ebd-bf59-9a747b0bffbd tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1341 microversion: 2.1 time: 0.173189 Jul 25 16:07:05.057690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 390/844] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:04 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:05.064643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c2ab9098-c866-43ec-b4e4-bf7868059092 req-ba744ca1-c57e-4dc9-922f-3f18d800ec37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58e405e-9682-4fb7-9741-c2ee3c5997f1", "name": "network-vif-unplugged", "status": "completed", "tag": "5702a729-23cf-443a-a57b-cf4ac17e7a81"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:05.082921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c2ab9098-c866-43ec-b4e4-bf7868059092 req-ba744ca1-c57e-4dc9-922f-3f18d800ec37 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.083715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c2ab9098-c866-43ec-b4e4-bf7868059092 req-ba744ca1-c57e-4dc9-922f-3f18d800ec37 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.101649 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c2ab9098-c866-43ec-b4e4-bf7868059092 req-ba744ca1-c57e-4dc9-922f-3f18d800ec37 service nova] Creating event network-vif-unplugged:5702a729-23cf-443a-a57b-cf4ac17e7a81 for instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 on n-h1-846219-13 Jul 25 16:07:05.105601 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c2ab9098-c866-43ec-b4e4-bf7868059092 req-ba744ca1-c57e-4dc9-922f-3f18d800ec37 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046120 Jul 25 16:07:05.106295 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 391/845] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:05.113178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:05.114091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:05.123050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.123895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.124977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.125755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.143233 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] HTTP exception thrown: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Request method failure captured: Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 HTTP/1.1 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r8sI1UKp_aT2_F-0o0h7aWqpVz2hXr9dJobQTInNPr9PvALgvpeN0D_PFJ42miA_uD-36U84zXKnSbXvoY0eEr75A7HV40SNSJF6VfBB_KJUEChFC2-VLn9-QOBH7MYq3zU29MhaQDiMIo6MvJR8IIEb9mwJpLLIxlXK71Wm67MLaU Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f6d6ed3b79394344aa92af0aae019aa6"}]}] Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1a52447762c64ba5bc1666f908c2154b Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9'} Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:05.145404 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.149937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.150965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Returning 404 to user: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:05.152495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81706c96-ad7f-4dce-95f5-572a5b9fd7c3 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "DELETE /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 404 len: 111 microversion: 2.1 time: 0.044463 Jul 25 16:07:05.158476 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 392/846] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:05 2022] DELETE /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:05.165790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:05.167195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:05.180059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.180698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.182079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.182813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.254247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:05.266362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:05.269815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:05.271444 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e61557b1-68d2-467f-b3af-48e2b20b6282 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.410675 Jul 25 16:07:05.283590 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 455/847] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:04 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:05.296754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:05.298279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:05.305605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.307027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.308190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.308828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.343341 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] HTTP exception thrown: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Request method failure captured: Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 HTTP/1.1 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r8sI1UKp_aT2_F-0o0h7aWqpVz2hXr9dJobQTInNPr9PvALgvpeN0D_PFJ42miA_uD-36U84zXKnSbXvoY0eEr75A7HV40SNSJF6VfBB_KJUEChFC2-VLn9-QOBH7MYq3zU29MhaQDiMIo6MvJR8IIEb9mwJpLLIxlXK71Wm67MLaU Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f6d6ed3b79394344aa92af0aae019aa6"}]}] Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1a52447762c64ba5bc1666f908c2154b Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9'} Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.346478 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:05.350405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Returning 404 to user: Instance 82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:05.352253 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7c6c588b-9dbb-461d-854f-9cf7677b5ffa tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9" status: 404 len: 111 microversion: 2.1 time: 0.066255 Jul 25 16:07:05.357289 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 456/848] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:05 2022] GET /compute/v2.1/servers/82eef2f0-1cce-484c-84f7-c6d1fb3bd8d9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:05.359570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:05.360406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:05.367934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.368505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.369477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.370012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.507498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:05.519129 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e76ffc3-f597-4ee9-bdf1-c4fc4e24debe tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.362170 Jul 25 16:07:05.544657 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 393/849] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:05 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:05.556211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65f8f4b8-e1ed-49e3-9845-10eaa29a3bc0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '.version_select at 0x7f9d93bded30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:05.661484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:05.671455 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc1a0d72-7a0f-46b6-a4e5-ffe2882e0ace tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1318 microversion: 2.1 time: 0.316314 Jul 25 16:07:05.680819 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 457/850] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:05 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:05.692800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e6f64128-caf1-4d2e-9a38-94b0d835f5db req-0fec00f1-1638-405b-9ed1-b4d074002717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc20a92-2837-413c-934b-50d10d25c7c8", "name": "network-vif-plugged", "status": "completed", "tag": "80b7d0ab-8553-4019-9e11-a534507d312e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:05.713472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e6f64128-caf1-4d2e-9a38-94b0d835f5db req-0fec00f1-1638-405b-9ed1-b4d074002717 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.714255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e6f64128-caf1-4d2e-9a38-94b0d835f5db req-0fec00f1-1638-405b-9ed1-b4d074002717 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.736903 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e6f64128-caf1-4d2e-9a38-94b0d835f5db req-0fec00f1-1638-405b-9ed1-b4d074002717 service nova] Creating event network-vif-plugged:80b7d0ab-8553-4019-9e11-a534507d312e for instance fcc20a92-2837-413c-934b-50d10d25c7c8 on n-h1-846219-13 Jul 25 16:07:05.748834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e6f64128-caf1-4d2e-9a38-94b0d835f5db req-0fec00f1-1638-405b-9ed1-b4d074002717 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063499 Jul 25 16:07:05.751056 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 458/851] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:05.911350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:05.913880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:05.930342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.931880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:05.935367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:05.936814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:06.584402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:06.598594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:06.600673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:06.602839 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-14367656-2fcc-454d-b92b-c21ed1bd905e tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.722150 Jul 25 16:07:06.603678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 459/852] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:05 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:06.615548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:06.617352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:06.631368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:06.632768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:06.634895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:06.635811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.007627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:07.037431 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ddc7088-9f91-41e3-a222-626fb57f27c2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.430406 Jul 25 16:07:07.055765 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 460/853] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:06 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:07.068265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:07.069212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:07.086586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.087117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.088184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.088849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.331315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:07.443084 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65f8f4b8-e1ed-49e3-9845-10eaa29a3bc0 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/24dd871e-1b3e-4f22-8a2e-3cf1554f76d4" status: 202 len: 0 microversion: 2.1 time: 1.897025 Jul 25 16:07:07.446940 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 394/854] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:07:05 2022] DELETE /compute/v2.1/os-floating-ips/24dd871e-1b3e-4f22-8a2e-3cf1554f76d4 => generated 0 bytes in 1899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:07.451687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:07.452500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:07.461634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.462302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.463228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.463783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.468872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:07.472072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:07.494093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:07.496333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:07.498328 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6e750b3-7977-4884-8a7c-f0e53a2aebd1 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.437490 Jul 25 16:07:07.509663 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 461/855] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:07 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:07.527645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:07.528412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:07.536594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.537225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.539353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.539979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.772377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:07.782082 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-baebdb52-8b23-4219-a8e9-9ebdc4336b10 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.336841 Jul 25 16:07:07.782707 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 395/856] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:07 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:07.788231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-84f15e10-800a-4a92-9c0c-e9660eeb006a req-441b7e38-20b1-4dca-b19f-4aa016e5afed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58e405e-9682-4fb7-9741-c2ee3c5997f1", "tag": "5702a729-23cf-443a-a57b-cf4ac17e7a81"}, {"name": "network-changed", "server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:07.800222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-84f15e10-800a-4a92-9c0c-e9660eeb006a req-441b7e38-20b1-4dca-b19f-4aa016e5afed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.800766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-84f15e10-800a-4a92-9c0c-e9660eeb006a req-441b7e38-20b1-4dca-b19f-4aa016e5afed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.816484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:07.818798 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-84f15e10-800a-4a92-9c0c-e9660eeb006a req-441b7e38-20b1-4dca-b19f-4aa016e5afed service nova] Creating event network-changed:5702a729-23cf-443a-a57b-cf4ac17e7a81 for instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 on n-h1-846219-13 Jul 25 16:07:07.819960 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-84f15e10-800a-4a92-9c0c-e9660eeb006a req-441b7e38-20b1-4dca-b19f-4aa016e5afed service nova] Creating event network-changed:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:07:07.825747 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf93964e-09dc-4ea9-9987-9d3faf8c75e4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1318 microversion: 2.1 time: 0.314329 Jul 25 16:07:07.834764 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 462/857] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:07 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:07.835721 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-84f15e10-800a-4a92-9c0c-e9660eeb006a req-441b7e38-20b1-4dca-b19f-4aa016e5afed service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044360 Jul 25 16:07:07.835721 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 396/858] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:07.835908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:07.835908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:07.839757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.840211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.841016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.841521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.851083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:07.853161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:07.861327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.861774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.862574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.863002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.870921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:07:07.963931 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-062f2159-49da-4e64-b7b5-e53c626029de tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "DELETE /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 204 len: 0 microversion: 2.1 time: 0.136098 Jul 25 16:07:07.964549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 463/859] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:07 2022] DELETE /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:07:07.973360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:07.974079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:07.981980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.982435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:07.983400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:07.985219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.208553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.220057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.221904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.223337 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-19efbec5-ab4c-4459-aa9f-64bdf01c1621 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.388450 Jul 25 16:07:08.224034 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 397/860] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:07 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:08.231316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:08.231972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:08.246393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.246872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.248264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.248779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.253937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.268624 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a293acb-b4ee-48e5-a9b3-d480b61b1d62 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1529 microversion: 2.1 time: 0.299267 Jul 25 16:07:08.269668 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 464/861] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:07 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1529 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:08.419604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.433004 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-870e86e7-9801-41cd-b80c-a2f83b1f65ec tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.207179 Jul 25 16:07:08.434241 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 398/862] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:08 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:08.531921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:08.532608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:08.539642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.540090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.540873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.541360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.700130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.710003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.711693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:08.712963 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-994c1146-37d1-468a-a97a-791d63e5b44c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.185062 Jul 25 16:07:08.713592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 465/863] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:08 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:08.811476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:08.812100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:08.820466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.820962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.821830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.822277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.848673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:08.849728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:08.856772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.857291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:08.858102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:08.858635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.051092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.058542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.064740 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b56020aa-dbcd-445e-b9d3-19f4bd8cb11b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.256973 Jul 25 16:07:09.065482 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 399/864] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:08 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:09.068083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8cd853b4-688a-40ee-b902-78e21c6c3034 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1318 microversion: 2.1 time: 0.223845 Jul 25 16:07:09.068661 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 466/865] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:08 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:09.263622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:09.264144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:09.271120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.271564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.272331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.272758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.301439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:09.301775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:09.307938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.308387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.309185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.309659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.330047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:09.539465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.547857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.550016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.551585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.552870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-73eaa042-d043-4c63-8f5e-83dfedf380fe tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.293383 Jul 25 16:07:09.553839 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 400/866] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:09 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:09.557135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ec1ff20-f529-40e0-ac99-524fa98d1d49 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1529 microversion: 2.1 time: 0.260132 Jul 25 16:07:09.558408 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 467/867] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:09 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1529 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:09.558869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:09.559503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:09.567405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.567405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.568168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.568605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.702620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:09.710895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0c7f62d-f6c6-46b2-927e-ed8bdce36e4f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.156398 Jul 25 16:07:09.711508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 401/868] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:09 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:09.735992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:09.736605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:09.752834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.753300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:09.754129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:09.754552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.091543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:10.093452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:10.104125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.104593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.105493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.105928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.406660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:10.410579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:10.419525 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d6e7b73-e5d5-4d4a-a21d-08887356aba7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.332094 Jul 25 16:07:10.420799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:10.424102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:10.425731 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f5544ca8-7c37-4094-851b-126cb9625b04 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.693668 Jul 25 16:07:10.426981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 468/869] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:09 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:10.434155 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 402/870] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:10 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:10.437934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:10.439056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:10.442195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-66e68ebf-0314-4443-959a-f1813be79b5a req-ca0e0d63-662d-441e-9e6e-e1678b6ad1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef093c5-a8cb-41da-8470-de3992e69eae", "name": "network-vif-unplugged", "status": "completed", "tag": "87c6104c-1dca-43c8-a238-cf56d2ce686e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:10.456465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-66e68ebf-0314-4443-959a-f1813be79b5a req-ca0e0d63-662d-441e-9e6e-e1678b6ad1d5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.457334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-66e68ebf-0314-4443-959a-f1813be79b5a req-ca0e0d63-662d-441e-9e6e-e1678b6ad1d5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.471879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.472479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.474386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.475366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.478372 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-66e68ebf-0314-4443-959a-f1813be79b5a req-ca0e0d63-662d-441e-9e6e-e1678b6ad1d5 service nova] Creating event network-vif-unplugged:87c6104c-1dca-43c8-a238-cf56d2ce686e for instance 7ef093c5-a8cb-41da-8470-de3992e69eae on n-h2-846219-13 Jul 25 16:07:10.484231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-66e68ebf-0314-4443-959a-f1813be79b5a req-ca0e0d63-662d-441e-9e6e-e1678b6ad1d5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048767 Jul 25 16:07:10.485300 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 403/871] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:10.494790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-1446afb0-85b9-4d1e-8512-14a1f051c34f req-80c1f680-9e02-484f-a593-0c01a4e6f089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:10.506772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1446afb0-85b9-4d1e-8512-14a1f051c34f req-80c1f680-9e02-484f-a593-0c01a4e6f089 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.507581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1446afb0-85b9-4d1e-8512-14a1f051c34f req-80c1f680-9e02-484f-a593-0c01a4e6f089 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.541656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-1446afb0-85b9-4d1e-8512-14a1f051c34f req-80c1f680-9e02-484f-a593-0c01a4e6f089 service nova] Creating event network-changed:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:07:10.562641 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-1446afb0-85b9-4d1e-8512-14a1f051c34f req-80c1f680-9e02-484f-a593-0c01a4e6f089 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075255 Jul 25 16:07:10.569538 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 404/872] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:10.577761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:10.579113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:10.593355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.594088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.595278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.596214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.640918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:07:10.785497 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1f7c66b0-976f-4f3a-8067-9157180af7ce tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 204 len: 0 microversion: 2.1 time: 0.212626 Jul 25 16:07:10.791665 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 405/873] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:10 2022] DELETE /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:07:10.809706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:10.813043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:10.821379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.822646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:10.826972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:10.827723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.140967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:11.151880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-96ec841f-a86b-49e8-af15-981f03801ab1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1506 microversion: 2.1 time: 0.723568 Jul 25 16:07:11.152477 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 469/874] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:10 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:11.166998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:11.167977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:11.179162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.180069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.182727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.183637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.222966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:11.235677 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-13fa696b-74b3-4f35-83d8-ef0fd9775076 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1529 microversion: 2.1 time: 0.441090 Jul 25 16:07:11.236248 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 406/875] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:10 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1529 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:11.242289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:11.242995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:11.249583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.250287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.251293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.251896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.598196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:11.615025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:11.617339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:11.618260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:11.620827 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db7d1017-d1a4-440f-8325-a9aac04cda55 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.466752 Jul 25 16:07:11.634548 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 470/876] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:11 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:11.638630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5858949-399e-46ef-8650-14128bd6869e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.400264 Jul 25 16:07:11.639580 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 407/877] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:11 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:11.641689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:11.642658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:11.644762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:11.645434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:11.652104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.652559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.653408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.654019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.654151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.654233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.655139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:11.655927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:11.835787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:11.864454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:12.002701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:12.012379 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25891d13-272b-4849-a377-9a86cccc047e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.371631 Jul 25 16:07:12.012948 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 408/878] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:11 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:12.019474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:12.020339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:12.027338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.027785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.028109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:12.029026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.029521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.037349 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-607b01dc-1231-447e-b0f6-d19130e6c6e5 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1718 microversion: 2.1 time: 0.401088 Jul 25 16:07:12.038576 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 471/879] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:11 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1718 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:12.190799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:12.199719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:12.201272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:12.202470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8a67aa5-2696-496f-ab62-f5d1543f407a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.188176 Jul 25 16:07:12.203049 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 409/880] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:12 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:12.258840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:12.259753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:12.267478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.267923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.268737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.269197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.344449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:12.353496 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4f2947f-f722-491f-a23f-5a6ed56d6360 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1487 microversion: 2.1 time: 0.098884 Jul 25 16:07:12.354191 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 472/881] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:12 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1487 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:12.547033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4c615af8-825b-4c5f-995b-50a94f787fe9 req-97fc3718-99fe-43e6-a345-e6611f00dcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef093c5-a8cb-41da-8470-de3992e69eae", "tag": "87c6104c-1dca-43c8-a238-cf56d2ce686e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:12.559936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4c615af8-825b-4c5f-995b-50a94f787fe9 req-97fc3718-99fe-43e6-a345-e6611f00dcb4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.560551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4c615af8-825b-4c5f-995b-50a94f787fe9 req-97fc3718-99fe-43e6-a345-e6611f00dcb4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.575378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4c615af8-825b-4c5f-995b-50a94f787fe9 req-97fc3718-99fe-43e6-a345-e6611f00dcb4 service nova] Creating event network-changed:87c6104c-1dca-43c8-a238-cf56d2ce686e for instance 7ef093c5-a8cb-41da-8470-de3992e69eae on n-h2-846219-13 Jul 25 16:07:12.581561 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4c615af8-825b-4c5f-995b-50a94f787fe9 req-97fc3718-99fe-43e6-a345-e6611f00dcb4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038439 Jul 25 16:07:12.582497 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 410/882] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:07:12.618502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1c407f4b-ba57-4c7e-b7d8-e9bed4425a34 req-073e2149-7648-4fb9-a7ae-865692946cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b56432-7c1c-47ea-b7ee-ccac3bf727e5", "name": "network-vif-deleted", "tag": "2713e5e7-51d6-424b-aaf9-b3d44813245f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:12.631727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1c407f4b-ba57-4c7e-b7d8-e9bed4425a34 req-073e2149-7648-4fb9-a7ae-865692946cdd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.632170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1c407f4b-ba57-4c7e-b7d8-e9bed4425a34 req-073e2149-7648-4fb9-a7ae-865692946cdd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.650968 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1c407f4b-ba57-4c7e-b7d8-e9bed4425a34 req-073e2149-7648-4fb9-a7ae-865692946cdd service nova] Creating event network-vif-deleted:2713e5e7-51d6-424b-aaf9-b3d44813245f for instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 on n-h1-846219-13 Jul 25 16:07:12.657293 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1c407f4b-ba57-4c7e-b7d8-e9bed4425a34 req-073e2149-7648-4fb9-a7ae-865692946cdd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043755 Jul 25 16:07:12.658729 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 473/883] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:12.673544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:12.674666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:12.683693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.684418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:12.684575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.686525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.687020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.687827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:12.707520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.721867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:12.722727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:12.723165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.180597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:13.190488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e89cdf2-0d17-45f2-ade3-8ba157ea0293 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.524274 Jul 25 16:07:13.191259 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 474/884] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:12 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:13.197362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:13.208110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33c64619-8c0e-40c0-b1e5-2ef25578ae9c"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:13.215767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:13.217659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:13.218872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9cd778b2-080f-405f-a095-1132e12e6a49 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.563610 Jul 25 16:07:13.221229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:13.225143 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 411/885] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:12 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:07:13.230347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:13.230868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:13.236373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.237047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.238024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.238695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.250249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.253809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.254821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.255361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.578261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:13.585823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:13.591048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-408d5ef5-137d-4fa0-a43c-46d210b81b2b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.364578 Jul 25 16:07:13.592639 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 412/886] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:13 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:13.597695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:13.598651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:13.607137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.607967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.608994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.609734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.912483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:13.921638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80587ec4-31a6-46c9-80e6-d4a1ead42d32 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1718 microversion: 2.1 time: 0.327486 Jul 25 16:07:13.926487 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 413/887] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:13 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1718 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:13.939452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:13.940697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:13.949665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.950115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:13.951092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:13.952094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.103693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.114407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.115913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.117221 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cbdcb71c-3246-485a-8144-8b2ec4dd815e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.189442 Jul 25 16:07:14.118505 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 414/888] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:13 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:14.122365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:14.122963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:14.129462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.129905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.130690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.131120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.164354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.164896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.165556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lazy-loading 'fault' on Instance uuid 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:14.214619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.223451 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e25a3748-354c-4068-adbf-ed461a43c79e tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1318 microversion: 2.1 time: 0.104531 Jul 25 16:07:14.224059 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 415/889] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:14 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:14.229223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:14.229859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:14.236404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.236858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.238029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.238708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.385337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.393873 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24b66b45-9620-499d-84c1-beeec3249969 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.168694 Jul 25 16:07:14.394561 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 416/890] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:14 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:14.399275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:14.400377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:14.410393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.410820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.411668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.412070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.623552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.637421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.639030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.640297 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9772ebc4-305b-4b70-b2b1-7d5ab4278d6f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.244780 Jul 25 16:07:14.640883 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 417/891] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:14 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:14.650557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:14.651572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:14.658398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.658925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.659697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.660336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.811534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:14.819981 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53339ad6-e7e1-4ca8-977c-04f695526ef0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.177198 Jul 25 16:07:14.820554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 418/892] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:14 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:14.826170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-1c7f6a7d-0562-4e99-aab2-4ce4b6dd67a6 req-6633737b-133f-4edc-a5aa-8a998c6f9b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58e405e-9682-4fb7-9741-c2ee3c5997f1", "name": "network-vif-unplugged", "status": "completed", "tag": "5702a729-23cf-443a-a57b-cf4ac17e7a81"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:14.840654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1c7f6a7d-0562-4e99-aab2-4ce4b6dd67a6 req-6633737b-133f-4edc-a5aa-8a998c6f9b39 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.841121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1c7f6a7d-0562-4e99-aab2-4ce4b6dd67a6 req-6633737b-133f-4edc-a5aa-8a998c6f9b39 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.854493 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-1c7f6a7d-0562-4e99-aab2-4ce4b6dd67a6 req-6633737b-133f-4edc-a5aa-8a998c6f9b39 service nova] Creating event network-vif-unplugged:5702a729-23cf-443a-a57b-cf4ac17e7a81 for instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 on n-h1-846219-13 Jul 25 16:07:14.859827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-1c7f6a7d-0562-4e99-aab2-4ce4b6dd67a6 req-6633737b-133f-4edc-a5aa-8a998c6f9b39 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038109 Jul 25 16:07:14.860464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 419/893] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:14.946042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:14.946323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:14.952945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.953534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:14.954273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:14.954625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.108903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.121145 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e26a6a8b-75a5-491b-a34f-77d5fa010bd3 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1718 microversion: 2.1 time: 0.180099 Jul 25 16:07:15.121778 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 420/894] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:14 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:15.140105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:15.140724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:15.147566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.148013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.148794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.149266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.305774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.314523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.316063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.317394 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5a5a745-0519-432d-9b42-aa71c87fd2cc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.181245 Jul 25 16:07:15.317972 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 421/895] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:15 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:15.322900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:15.323528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:15.330402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.330854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.331635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.332077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.368518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.368965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.370812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lazy-loading 'fault' on Instance uuid 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:15.421548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52447762c64ba5bc1666f908c2154b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d6ed3b79394344aa92af0aae019aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.430236 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11f844f7-1570-45a3-a3f6-3053b5df050f tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 200 len: 1318 microversion: 2.1 time: 0.111151 Jul 25 16:07:15.430912 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 422/896] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:15 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:15.435675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:15.436591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:15.446709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.447483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.450612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.451055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.659795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.668576 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-df8d1203-0bfa-44c5-a4fd-7e07cbefc90b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.236583 Jul 25 16:07:15.669195 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 423/897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:15 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:15.674525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:15.675223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:15.682196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.682653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.683442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.683877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.917471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.927795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.929405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:15.930611 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fffb021f-3b94-40b4-a5f4-c5e3a74d151c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.260471 Jul 25 16:07:15.931173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 424/898] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:15 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:15.936056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:15.936866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:15.944088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.944602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:15.945591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:15.946128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:16.201517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:16.211945 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb767bba-b101-47a9-89a5-719cb1886c70 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.279548 Jul 25 16:07:16.212540 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 425/899] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:15 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:16.225332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:16.225332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:16.227307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:16.227307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:16.242475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:16.242475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:16.783379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:16.799531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07d69097-6d7e-47db-87dd-f6e833202942 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1718 microversion: 2.1 time: 0.585774 Jul 25 16:07:16.800177 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 426/900] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:16 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1718 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:16.815301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:16.815629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:16.830384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:16.830839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:16.836995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:16.837518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:17.013216 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c794d9ff-b304-4a3e-b1d0-f81e94ee055c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.819684 Jul 25 16:07:17.014457 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 475/901] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:07:13 2022] POST /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8/os-volume_attachments => generated 194 bytes in 3822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:17.048891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:17.050876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] [instance: 11b56432-7c1c-47ea-b7ee-ccac3bf727e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:17.073662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:17.075729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:17.077705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:17.078906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:17.120944 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] HTTP exception thrown: Instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 could not be found. Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Request method failure captured: Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 HTTP/1.1 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r8sI1UKp_aT2_F-0o0h7aWqpVz2hXr9dJobQTInNPr9PvALgvpeN0D_PFJ42miA_uD-36U84zXKnSbXvoY0eEr75A7HV40SNSJF6VfBB_KJUEChFC2-VLn9-QOBH7MYq3zU29MhaQDiMIo6MvJR8IIEb9mwJpLLIxlXK71Wm67MLaU Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f6d6ed3b79394344aa92af0aae019aa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f6d6ed3b79394344aa92af0aae019aa6"}]}] Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f6d6ed3b79394344aa92af0aae019aa6 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1941125906 Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1a52447762c64ba5bc1666f908c2154b Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1941125906-project Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 could not be found. Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '11b56432-7c1c-47ea-b7ee-ccac3bf727e5'} Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 could not be found. Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 could not be found. Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:17.127441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 could not be found. Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] Returning 404 to user: Instance 11b56432-7c1c-47ea-b7ee-ccac3bf727e5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8125e619-ed18-4bef-aa1e-93f3f08f5392 tempest-FloatingIPsAssociationTestJSON-1941125906 tempest-FloatingIPsAssociationTestJSON-1941125906-project] 10.222.0.105 "GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5" status: 404 len: 111 microversion: 2.1 time: 0.112202 Jul 25 16:07:17.137911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 476/902] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:17 2022] GET /compute/v2.1/servers/11b56432-7c1c-47ea-b7ee-ccac3bf727e5 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:17.140937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:17.147107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:17.159957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:17.161946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:17.165512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:17.166554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:18.160628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:18.176957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:18.178978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:18.185906 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-670230a1-9f17-42db-ab62-690988ae1417 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 1.378020 Jul 25 16:07:18.188180 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 427/903] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:16 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:18.198147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:18.205030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:18.219103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:18.222585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:18.223791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:18.225475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:18.954724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:18.966861 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b058908d-219b-44e6-b680-57b8fb17ea56 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 1.829906 Jul 25 16:07:18.974605 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 477/904] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:17 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:18.988099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:18.988991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:19.000819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.001559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.007353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.008725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.503211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:19.556414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:19.563363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:19.569522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bbe8bdda-c932-408f-a307-7246b39a3741 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 1.379603 Jul 25 16:07:19.570535 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 428/905] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:18 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:19.591334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:19.592332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:19.600490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.601527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.603674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.604463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.631595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:19.651758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.652426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.653147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lazy-loading 'fault' on Instance uuid 6aa29098-04ba-4426-8bd1-0bfa9dfa384f {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:19.878390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:19.906132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cbc3d78a-9761-4bd5-a2d1-4e5b1f84e540 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.929518 Jul 25 16:07:19.911465 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 478/906] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:18 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:19.927216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c75118af-7585-4f75-b12e-f6d5ee39a59a req-e4d768eb-e993-4007-991a-6480cd75090a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa29098-04ba-4426-8bd1-0bfa9dfa384f", "name": "network-vif-deleted", "tag": "392f7b43-f4e8-4202-b34f-37c5d24445e2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:19.931093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d8a0c9ba5a40759ee0838c7ef265cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b189f6c36b0c4f6792d9a3e354f535a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:19.952617 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b3cd391-0d69-450d-9161-90b140e0bf3e tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 200 len: 1358 microversion: 2.1 time: 0.380687 Jul 25 16:07:19.953254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 429/907] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:19 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:19.958368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:19.959674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:19.967273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c75118af-7585-4f75-b12e-f6d5ee39a59a req-e4d768eb-e993-4007-991a-6480cd75090a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.968064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c75118af-7585-4f75-b12e-f6d5ee39a59a req-e4d768eb-e993-4007-991a-6480cd75090a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.971189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:19.976180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.980028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:19.981467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:19.982220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.044602 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c75118af-7585-4f75-b12e-f6d5ee39a59a req-e4d768eb-e993-4007-991a-6480cd75090a service nova] Creating event network-vif-deleted:392f7b43-f4e8-4202-b34f-37c5d24445e2 for instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f on n-h1-846219-13 Jul 25 16:07:20.058728 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c75118af-7585-4f75-b12e-f6d5ee39a59a req-e4d768eb-e993-4007-991a-6480cd75090a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143949 Jul 25 16:07:20.063051 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 479/908] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:20.088219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:20.090561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:20.125717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.126647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.127803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.128461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.519572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:20.539710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:20.546403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:20.550030 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a97db950-dcf7-4078-9411-4fd374225c8d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1570 microversion: 2.25 time: 0.595257 Jul 25 16:07:20.553816 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 430/909] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:19 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1570 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:20.571056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d2e6f0b1-54f4-45a5-a994-0e5224d0f4fa req-80a17f34-6b60-45b9-88c8-5296494c8780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef093c5-a8cb-41da-8470-de3992e69eae", "name": "network-vif-unplugged", "status": "completed", "tag": "87c6104c-1dca-43c8-a238-cf56d2ce686e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:20.618373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d2e6f0b1-54f4-45a5-a994-0e5224d0f4fa req-80a17f34-6b60-45b9-88c8-5296494c8780 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.618741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d2e6f0b1-54f4-45a5-a994-0e5224d0f4fa req-80a17f34-6b60-45b9-88c8-5296494c8780 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.644193 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d2e6f0b1-54f4-45a5-a994-0e5224d0f4fa req-80a17f34-6b60-45b9-88c8-5296494c8780 service nova] Creating event network-vif-unplugged:87c6104c-1dca-43c8-a238-cf56d2ce686e for instance 7ef093c5-a8cb-41da-8470-de3992e69eae on n-h2-846219-13 Jul 25 16:07:20.672702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d2e6f0b1-54f4-45a5-a994-0e5224d0f4fa req-80a17f34-6b60-45b9-88c8-5296494c8780 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116541 Jul 25 16:07:20.682110 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 431/910] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:20.713292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:20.714352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:20.746257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.746735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.757418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.758210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.765021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:20.789777 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1b7a659-a014-47aa-b124-1e20858e2d7f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 0.718387 Jul 25 16:07:20.790133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 480/911] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:20 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:20.940058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:20.945049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:20.977450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.979725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:20.981528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:20.982668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.437054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:21.458668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:21.469287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:21.470959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5423c3ae-9f5a-4ebf-9ea9-4d21d34e6840 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.782020 Jul 25 16:07:21.489797 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 432/912] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:20 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:21.495102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:21.495749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:21.517579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.518650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.520413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.521683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.549992 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f HTTP/1.1 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6aa29098-04ba-4426-8bd1-0bfa9dfa384f'} Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.554001 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:21.558573 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.562330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:21.564958 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8dea019c-83d3-41d7-b85f-3531de90df16 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 404 len: 111 microversion: 2.1 time: 0.073457 Jul 25 16:07:21.566338 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 433/913] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:21 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:21.577624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:21.583006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:21.618644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.621946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.623112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.625304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.655267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:21.661499 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 HTTP/1.1 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '122ea2ba-aba9-48e7-86c2-1d88fa0a2df2'} Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:21.663709 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.667830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.672911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:21.674512 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3cf3c5f4-849d-45c6-9371-7a44269c9720 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 404 len: 111 microversion: 2.1 time: 0.100959 Jul 25 16:07:21.676085 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 434/914] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:21 2022] DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:07:21.681996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:21.683027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:21.696775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.699463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.702994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.703967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.704200 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2de2e0fb-d162-4f05-bf18-b4212bb6efe2 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.769041 Jul 25 16:07:21.707770 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 481/915] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:20 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:21.725584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:21.729675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:21.745590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.748096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.750387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.751053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.796226 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 HTTP/1.1 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '122ea2ba-aba9-48e7-86c2-1d88fa0a2df2'} Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.803908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:21.810977 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:21.817006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:21.818391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad88974d-81b2-4237-82dc-d5185d364b2b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 404 len: 111 microversion: 2.1 time: 0.106344 Jul 25 16:07:21.821505 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 482/916] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:21 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:21.835761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:21.836708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:21.866675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.867702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:21.870291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:21.873735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:22.806611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:22.854491 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e86bd555-4e87-4e2c-89ed-eb6a8330615b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 1.031331 Jul 25 16:07:22.865427 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 483/917] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:21 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:22.871978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:22.873948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fe0cd23-7ccb-482f-9c2a-99bc8d6626a0 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '.version_select at 0x7f9d938f08b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:22.910415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:22.916932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:22.919596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89bcd927-9d41-4086-ae09-181b1fc918bb tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1560 microversion: 2.25 time: 1.241686 Jul 25 16:07:22.957208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 435/918] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:21 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1560 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:22.962083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fe0cd23-7ccb-482f-9c2a-99bc8d6626a0 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032354285" status: 202 len: 0 microversion: 2.1 time: 0.094149 Jul 25 16:07:22.969970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7e66cb33-35f7-4f8e-bf6a-164827e0109f req-f93ba8fd-e7c1-4636-9aca-a5fcddd80c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "name": "network-vif-plugged", "status": "completed", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:22.977809 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 484/919] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:07:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2032354285 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:22.993345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:22.994838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:23.015922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7e66cb33-35f7-4f8e-bf6a-164827e0109f req-f93ba8fd-e7c1-4636-9aca-a5fcddd80c3c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:23.021759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:23.024004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:23.025967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:23.028200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7e66cb33-35f7-4f8e-bf6a-164827e0109f req-f93ba8fd-e7c1-4636-9aca-a5fcddd80c3c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:23.029494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:23.104216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7e66cb33-35f7-4f8e-bf6a-164827e0109f req-f93ba8fd-e7c1-4636-9aca-a5fcddd80c3c service nova] Creating event network-vif-plugged:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:07:23.123203 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7e66cb33-35f7-4f8e-bf6a-164827e0109f req-f93ba8fd-e7c1-4636-9aca-a5fcddd80c3c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163823 Jul 25 16:07:23.125296 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 436/920] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:23.137782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:23.139664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:23.153568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:23.155062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:23.157293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:23.158548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:23.994064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:24.023558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:24.045006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53b7e439-477f-4b9f-8c0d-38c727827fb4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.917581 Jul 25 16:07:24.046002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 437/921] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:23 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:24.046881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:24.051917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07ddaad2-1ae7-49cd-9c32-5a680881018e tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '.version_select at 0x7f9d93d01430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:24.066060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07ddaad2-1ae7-49cd-9c32-5a680881018e tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:24.066274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:24.070858 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f6139b1-4691-4789-abfe-0694fed9dc70 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 1.090658 Jul 25 16:07:24.077386 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 485/922] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:22 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:24.077703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07ddaad2-1ae7-49cd-9c32-5a680881018e tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:24.109308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:24.112978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:24.116994 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07ddaad2-1ae7-49cd-9c32-5a680881018e tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 2633 microversion: 2.25 time: 0.069582 Jul 25 16:07:24.123998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 438/923] 10.222.0.105 () {60 vars in 1189 bytes} [Mon Jul 25 16:07:24 2022] GET /compute/v2.1/os-migrations => generated 2633 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:24.127251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:24.127708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:24.128509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:24.137163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:24.151967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:24.154404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:24.174644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:24.175426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:24.176451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:24.177240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:24.186371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:25.168933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:25.199625 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38ec9adc-f463-4689-a3bf-f40168637b25 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1383 microversion: 2.1 time: 1.101839 Jul 25 16:07:25.203041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid a58e405e-9682-4fb7-9741-c2ee3c5997f1 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:25.205554 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 486/924] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:24 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1383 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:25.227816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:25.229199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:25.264069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:25.271393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:25.273415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:25.275700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:25.432860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e2d93b7-a72f-4661-b92b-9042fc631003 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 2054 microversion: 2.25 time: 1.285097 Jul 25 16:07:25.434084 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 439/925] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:24 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 2054 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:07:25.440569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:25.441865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:25.449306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:25.449904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:25.450827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:25.451393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:25.998222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:26.047955 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd8327e0-1a53-4a1c-b6ed-65b2c6b8e163 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1506 microversion: 2.1 time: 0.833647 Jul 25 16:07:26.061139 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 487/926] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:25 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1506 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:26.067098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "00cd520c-d4cc-4ec4-b596-47c08b95c9be"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "5b988b11-3679-472a-be08-27a931119843"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "1f447b3c-0d41-4512-8e25-1fd3029dcae2"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "2e157acc-e2f3-40b4-a6bc-e64dd00fd338"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:26.094007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:26.101728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:26.131408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Creating event network-vif-plugged:00cd520c-d4cc-4ec4-b596-47c08b95c9be for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:26.136186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Creating event network-vif-plugged:5b988b11-3679-472a-be08-27a931119843 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:26.136926 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Creating event network-vif-plugged:1f447b3c-0d41-4512-8e25-1fd3029dcae2 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:26.137668 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] Creating event network-vif-plugged:2e157acc-e2f3-40b4-a6bc-e64dd00fd338 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:26.154475 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c4c121fc-09a4-4b29-bf05-23dc4d49b822 req-d541d9cc-63fd-4447-bfdb-4e499698e850 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.103901 Jul 25 16:07:26.157339 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 488/927] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:26.175736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-964238050", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "ac4d8f52-90dc-4983-890c-821ba313bf21"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:26.323962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] validate_networks() for [('ac4d8f52-90dc-4983-890c-821ba313bf21', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:07:26.361838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:26.398020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:26.401367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:26.412357 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82f06d35-8586-4426-9a8c-55cf9da5b57a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.976492 Jul 25 16:07:26.418225 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 440/928] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:25 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:26.440322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:26.445866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:26.472434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:26.473265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:26.485232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:26.485693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:26.977838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:27.017603 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10ec15a8-5cec-4946-9563-27fe2823eed0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1531 microversion: 2.1 time: 0.596674 Jul 25 16:07:27.018802 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 441/929] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:26 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1531 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:27.023882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-080cdd19-9d61-42b2-97fd-972f08bc4052 tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:27.025023 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:07:27.025023 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:07:27.072800 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-080cdd19-9d61-42b2-97fd-972f08bc4052 tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/1529827593" status: 202 len: 0 microversion: 2.1 time: 0.052007 Jul 25 16:07:27.072800 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 442/930] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:07:27 2022] DELETE /compute/v2.1/flavors/1529827593 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:27.094903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:27.095520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:27.124493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:27.125013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:27.125835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:27.126617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:27.734475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:27.745800 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e41e8ff0-f487-49ae-b66e-09713b9357f0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1531 microversion: 2.1 time: 0.671389 Jul 25 16:07:27.746523 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 443/931] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:27 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1531 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:27.752529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:27.753533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:27.766203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:27.766724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:27.768471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:27.768706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.067457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:07:28.068558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:07:28.069044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:07:28.069592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:07:28.070185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:07:28.083157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.084172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.085557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.086132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.111850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:07:28.119811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for user f3a2bf8f94f44b78a80c37bc8b370726 and project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:07:28.135072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:07:28.138195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:07:28.193928 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e491368c-f412-4271-a4b0-10df4ccc04ea tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 2.032981 Jul 25 16:07:28.195665 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 489/932] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:07:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:07:28.202458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-020dc0d6-f128-4535-a6d8-2ac6f444687c tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.226572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.232348 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-020dc0d6-f128-4535-a6d8-2ac6f444687c tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5927 microversion: 2.1 time: 0.034923 Jul 25 16:07:28.233630 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 490/933] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/flavors/detail => generated 5927 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:28.251078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.255929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:28.268549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:28.274841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.275504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.276823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.277452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.289901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4cd3cb1c-0113-405f-853c-e99aacb2a508 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1481 microversion: 2.1 time: 0.542137 Jul 25 16:07:28.291566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 444/934] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:27 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1481 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:28.304605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b7f3d894-b4b4-4cc4-abe5-06426f2cc589 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.305608 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:07:28.305608 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:07:28.354575 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b7f3d894-b4b4-4cc4-abe5-06426f2cc589 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/77811395-edf2-44da-bdf7-fd1f71dfef14" status: 202 len: 0 microversion: 2.1 time: 0.059312 Jul 25 16:07:28.356823 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 445/935] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:28 2022] DELETE /compute/v2.1/flavors/77811395-edf2-44da-bdf7-fd1f71dfef14 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:28.364112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "aec77042-8500-4693-86bd-08fddf0e26b2"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-plugged", "status": "completed", "tag": "aaaa6592-e99d-4688-b794-f72c24f9e4e0"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:28.379206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.380166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.408825 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] Creating event network-vif-plugged:a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:28.410057 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] Creating event network-vif-plugged:aec77042-8500-4693-86bd-08fddf0e26b2 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:28.410920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] Creating event network-vif-plugged:aaaa6592-e99d-4688-b794-f72c24f9e4e0 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:28.425821 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-360b2efb-dbad-4545-a2e5-2905819634e5 req-5291dd49-692f-4df6-a578-94f8a76008e0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067229 Jul 25 16:07:28.432504 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 446/936] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:28.442420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40f39fd3-e285-45cc-ad79-ab6d100564a7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.444124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40f39fd3-e285-45cc-ad79-ab6d100564a7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:28.574859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40f39fd3-e285-45cc-ad79-ab6d100564a7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.592108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40f39fd3-e285-45cc-ad79-ab6d100564a7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.595815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40f39fd3-e285-45cc-ad79-ab6d100564a7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.598911 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40f39fd3-e285-45cc-ad79-ab6d100564a7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1265 microversion: 2.25 time: 0.164199 Jul 25 16:07:28.600550 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 447/937] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:28.610627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50af0df3-0441-4936-a88f-299cf45cb66d tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.612736 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:07:28.612736 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:07:28.636966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.649428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.651321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.652274 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-50af0df3-0441-4936-a88f-299cf45cb66d tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/1050889106" status: 202 len: 0 microversion: 2.1 time: 0.049359 Jul 25 16:07:28.652972 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0ed033c-bebf-462b-acd5-d2ada134f2ab tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.409575 Jul 25 16:07:28.653516 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 448/938] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:07:28 2022] DELETE /compute/v2.1/flavors/1050889106 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:28.654380 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 491/939] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:28.661628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2cba7ae-ba43-4030-bf33-c7d8a77bd2ec tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.684614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2cba7ae-ba43-4030-bf33-c7d8a77bd2ec tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.028668 Jul 25 16:07:28.685601 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 492/940] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:28.691895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee872c25-aefa-4078-81ac-d44acc64939a tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.694544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f9a427c-7467-4cda-b884-f851a69addec tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '.version_select at 0x7f9da0278f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.701869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f9a427c-7467-4cda-b884-f851a69addec tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.703026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f9a427c-7467-4cda-b884-f851a69addec tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.716488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee872c25-aefa-4078-81ac-d44acc64939a tempest-ServersWithSpecificFlavorTestJSON-1545946920 tempest-ServersWithSpecificFlavorTestJSON-1545946920-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.029258 Jul 25 16:07:28.717854 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 493/941] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:28.739664 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f9a427c-7467-4cda-b884-f851a69addec tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 1972 microversion: 2.1 time: 0.064427 Jul 25 16:07:28.741182 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 449/942] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/os-migrations => generated 1972 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:28.746448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:28.749351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:28.763433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.768424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.769786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.770246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.770957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:28.772257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:28.794996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.800706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.802461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:28.805919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:28.816106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:28.824408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Old instance type tempest-test_resize_flavor_-1079765853, new instance type m1.heat {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 16:07:28.834394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:07:28.835507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:07:28.836540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:07:28.837346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:07:28.837986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:07:28.978283 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4e0c600c-f78f-4b61-8b49-f5cafe2a3cb1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea/action" status: 202 len: 0 microversion: 2.1 time: 0.256016 Jul 25 16:07:28.979541 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 494/943] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:07:28 2022] POST /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:29.049307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.055841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.096355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.103659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.105756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.110156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.172435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f HTTP/1.1 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '6aa29098-04ba-4426-8bd1-0bfa9dfa384f'} Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:29.177124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.185130 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.188852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:29.190858 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fff5e346-c9bf-4711-bf4e-cb5ef82ca18b tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 404 len: 111 microversion: 2.1 time: 0.209307 Jul 25 16:07:29.197970 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 495/944] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:28 2022] DELETE /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:29.210297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.212365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.228042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.229272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.231338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.232470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.290690 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d05b88e2-f98c-48d5-a383-d98a7da0e0dd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1634 microversion: 2.1 time: 0.525880 Jul 25 16:07:29.292606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 450/945] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:28 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1634 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:29.311413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.312135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 6aa29098-04ba-4426-8bd1-0bfa9dfa384f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.339519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.340349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.345879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.348906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.377383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f HTTP/1.1 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6aa29098-04ba-4426-8bd1-0bfa9dfa384f'} Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.384598 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. Jul 25 16:07:29.388895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.392561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 6aa29098-04ba-4426-8bd1-0bfa9dfa384f could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:29.396031 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77147232-3c81-478c-96eb-e30136231f76 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f" status: 404 len: 111 microversion: 2.1 time: 0.095308 Jul 25 16:07:29.396627 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 451/946] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:29 2022] GET /compute/v2.1/servers/6aa29098-04ba-4426-8bd1-0bfa9dfa384f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:29.406470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ec2052c-c469-4610-b11b-7fd704e8ceb7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Action: 'create', calling method: .version_select at 0x7f9da0278940>, body: {"keypair": {"name": "tempest-keypair-344973232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/FDSn4Z/0Lu3BIfxHbq0qRfuMW1aZlh5xWKV+H3L5wJjEVUNLe1N/vdYaz2bnSKDwwXE6WiAXPb7WkjALqOiz4esjzG1KiDAir8v3YKGZZ77yN0bWvcsXPVuST0HjB1Q=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:29.427664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1ec2052c-c469-4610-b11b-7fd704e8ceb7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for project 0638463dadea48a0b7650229ad028a90. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:07:29.445702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1ec2052c-c469-4610-b11b-7fd704e8ceb7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for user d8d1e6f3591a4c4ea97eadbd97954916 and project 0638463dadea48a0b7650229ad028a90. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:07:29.480868 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ec2052c-c469-4610-b11b-7fd704e8ceb7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078783 Jul 25 16:07:29.491593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 452/947] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:07:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:29.499662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.500500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.530275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.531802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.533202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.535715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.582216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:29.587706 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 HTTP/1.1 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '122ea2ba-aba9-48e7-86c2-1d88fa0a2df2'} Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:29.592025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.599004 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.602736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:29.604446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f56176f6-a064-44d6-a74f-7f992cfda7c6 tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 404 len: 111 microversion: 2.1 time: 0.110087 Jul 25 16:07:29.605634 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 453/948] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:29 2022] DELETE /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:29.625124 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c22f25c9-14d9-4cc5-a54f-92d8d848437c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1540 microversion: 2.1 time: 0.421151 Jul 25 16:07:29.631687 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 496/949] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:29 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1540 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:29.637950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.640022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] [instance: 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.646068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.648603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.661142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.661888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.662476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.663375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.663711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.664447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.665848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.666878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.720114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] HTTP exception thrown: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Request method failure captured: Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 HTTP/1.1 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r6lvQDntNvpEWUUbYTHVph2XBR-J8Kso4dj9468RJoTpg9diK2cA67Hz1Il6iIxXzkjOmsHtpNVLK9pvk10ghxDKtKsc8V2tVG_z33oWqHBBp1BT1TVMEmH0S0ulyqhyBk2VogWneKKs9oQCNKub9DI1J8qA0o5FZQ4LXo0a5kq1fQ Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b189f6c36b0c4f6792d9a3e354f535a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b189f6c36b0c4f6792d9a3e354f535a6"}]}] Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b189f6c36b0c4f6792d9a3e354f535a6 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356 Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 36d8a0c9ba5a40759ee0838c7ef265cb Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-440161356-project Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '122ea2ba-aba9-48e7-86c2-1d88fa0a2df2'} Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.723639 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. Jul 25 16:07:29.732460 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:29.738641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] Returning 404 to user: Instance 122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:29.738641 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc48974d-4307-4130-9674-e18465c27a5f tempest-ServersWithSpecificFlavorTestJSON-440161356 tempest-ServersWithSpecificFlavorTestJSON-440161356-project] 10.222.0.105 "GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2" status: 404 len: 111 microversion: 2.1 time: 0.122416 Jul 25 16:07:29.739830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 454/950] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:29 2022] GET /compute/v2.1/servers/122ea2ba-aba9-48e7-86c2-1d88fa0a2df2 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:29.769407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:29.770689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:29.785628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.786411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.791336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:29.791336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:29.831552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:29.881349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:29.887981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:29.889603 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8179d78a-22d4-46f6-9f93-92e7283376e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1269 microversion: 2.25 time: 0.255052 Jul 25 16:07:29.906824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 497/951] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:29 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1269 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:30.607444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:30.621808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:30.629658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:30.631571 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37c39ae5-757e-4131-b5f2-ce0db76c4a5f tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1879 microversion: 2.32 time: 0.888459 Jul 25 16:07:30.638208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 455/952] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:29 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1879 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:30.670744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:30.673146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:30.692342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:30.694575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:30.696465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:30.697745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:30.934935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:30.938955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:30.966711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:30.968419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:30.972496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:30.976710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:31.259616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:31.326729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:31.341553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:31.350506 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9523ad12-09be-4ab3-8020-11614870bef8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1317 microversion: 2.25 time: 0.422396 Jul 25 16:07:31.355230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 456/953] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:30 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:31.666921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:31.668776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:31.684494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:31.686740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:31.688723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:31.689830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:31.726030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:31.871313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:31.888264 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2cbbaf98-6119-47a1-9567-56f21fdb90da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1540 microversion: 2.1 time: 1.227547 Jul 25 16:07:31.906780 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 498/954] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:30 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1540 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:32.405861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:32.407772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:32.420619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:32.422088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:32.423902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:32.424802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:32.626806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:32.638443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:32.640617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:32.641863 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca9218d3-7e90-453b-9826-175a8110d763 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1323 microversion: 2.25 time: 0.252563 Jul 25 16:07:32.642954 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 499/955] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:32 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:07:32.648756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1964288650", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "934be3e8-a3dc-4628-bdcf-841c71054ba0"}], "security_groups": [{"name": "tempest-securitygroup--1316827605"}], "key_name": "tempest-keypair-344973232", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:32.659328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:32.681701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:32.686566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:32.689653 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-924083d5-a3bf-4a5f-a231-42d3387a71c0 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2835 microversion: 2.32 time: 1.032930 Jul 25 16:07:32.691380 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 457/956] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:31 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2835 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:07:32.718031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:32.718846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:32.726638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:32.727300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:32.727897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:32.728584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:33.219356 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-127c09c2-e7dc-4a4c-a540-631784c57b4c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.505541 Jul 25 16:07:33.220007 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 458/957] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:07:32 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977/os-interface => generated 1833 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:07:33.226660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:33.227319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:33.234555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:33.235033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:33.236758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:33.237243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:33.309728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] validate_networks() for [('934be3e8-a3dc-4628-bdcf-841c71054ba0', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:07:34.175283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:34.193668 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23203f7f-6615-4199-896a-ec6da03942fa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1540 microversion: 2.1 time: 0.971614 Jul 25 16:07:34.216100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 459/958] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:33 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1540 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:34.230103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:34.231237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:34.244350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:34.245761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:34.249021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:34.250029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:34.423236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:34.440695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:34.444533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:34.446663 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-32616607-e215-4477-ae8a-e2205019c730 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1323 microversion: 2.25 time: 0.226688 Jul 25 16:07:34.447681 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 460/959] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:34 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:35.211216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8f0e0056-6487-4944-b020-77a0e3ae83fe req-81a6c565-c808-4c57-8946-557f5868589b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "tag": "a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:35.240349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8f0e0056-6487-4944-b020-77a0e3ae83fe req-81a6c565-c808-4c57-8946-557f5868589b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.241196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8f0e0056-6487-4944-b020-77a0e3ae83fe req-81a6c565-c808-4c57-8946-557f5868589b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:35.295722 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8f0e0056-6487-4944-b020-77a0e3ae83fe req-81a6c565-c808-4c57-8946-557f5868589b service nova] Creating event network-changed:a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:07:35.305882 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8f0e0056-6487-4944-b020-77a0e3ae83fe req-81a6c565-c808-4c57-8946-557f5868589b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098840 Jul 25 16:07:35.307698 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 461/960] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:07:35.318204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:35.320197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:35.335600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.336841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:35.339496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.340665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:35.440722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:07:35.441637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:07:35.442616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:07:35.452150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:07:35.453945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:07:35.480062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.483553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:35.484650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.485138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:35.536659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:07:35.567167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for user d8d1e6f3591a4c4ea97eadbd97954916 and project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:07:35.597741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:07:35.603111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:07:35.664101 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c60ea1f-3fea-41bf-bbdf-1fabaca3eebb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.019735 Jul 25 16:07:35.665879 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 500/961] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:07:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 3022 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:07:35.672030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:35.673063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:35.681449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.682213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:35.683219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:35.683976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:37.119252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:37.137716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ffb34efb-eebf-4dcb-820d-3c697730d926 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1540 microversion: 2.1 time: 1.827764 Jul 25 16:07:37.138230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 462/962] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:35 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1540 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:37.153470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:37.162457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:37.182933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:37.183674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:37.187875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:37.191970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:37.632979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:37.641355 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b32b7deb-c5f3-4bb1-b8f0-4b7e4ee5e878 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1290 microversion: 2.1 time: 0.501800 Jul 25 16:07:37.642503 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 463/963] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:37 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1290 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:37.654290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:37.654838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:37.670373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:37.671300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:37.672342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:37.673070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:37.734529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:07:37.835307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:37.850775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:37.852663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:37.854085 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4afe1c5-13a0-45bb-84c3-db74cc6d85a2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 2.186753 Jul 25 16:07:37.858401 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 501/964] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:35 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:38.065165 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0211bc1-f428-46e7-a0bd-05280ac28cbb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 204 len: 0 microversion: 2.1 time: 0.419471 Jul 25 16:07:38.073533 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 464/965] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:37 2022] DELETE /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:07:38.077303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:38.078193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:38.098189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.099228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.100369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.100984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.174215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:38.182861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:38.204767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:38.211732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.213029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.217185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.220584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.762612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:38.771454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65a55c3f-9fb0-4a9c-bbf8-3414a10e27cf tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.607673 Jul 25 16:07:38.785621 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 465/966] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:38 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:38.790841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:38.791723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:38.803506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.807496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.809011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.809727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.874362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:38.891886 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6eedd61-b0ae-414b-8a04-34318e499537 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1558 microversion: 2.1 time: 0.818354 Jul 25 16:07:38.894539 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 502/967] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:38 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1558 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:38.918339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:38.921902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:38.935998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.936459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:38.937295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:38.937738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:39.111240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:39.130547 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24ae80e5-3d83-4818-997f-c0642d28f6cf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1308 microversion: 2.1 time: 0.343518 Jul 25 16:07:39.139892 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 466/968] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:38 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:39.777191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:39.806947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:39.808140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:39.811305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:39.833956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:39.837406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:39.839328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:39.841906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:39.848811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:39.851157 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8c021ce8-cd65-4bd8-8233-2454654135ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 0.953691 Jul 25 16:07:39.852165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:39.867939 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 503/969] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:38 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:39.923714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:39.924835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:39.960922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:39.984739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:39.986418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:39.989493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:40.451404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:40.460936 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c703fd6-206f-4f46-bbb7-0127863e4b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.658159 Jul 25 16:07:40.461783 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 467/970] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:39 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:40.468489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:40.469571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:40.479298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:40.480069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:40.481121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:40.481728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:40.682140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:40.708899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0a4490c7-98d1-4156-82b6-f97873d1bef1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1296 microversion: 2.1 time: 0.245079 Jul 25 16:07:40.725867 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 468/971] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:40 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1296 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:40.794631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:40.823043 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f379661-b4c6-4786-9e71-3d1d5c78d7de tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1558 microversion: 2.1 time: 0.905056 Jul 25 16:07:40.825793 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 504/972] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:39 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1558 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:40.903167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:40.905458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:40.927652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:40.928491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:40.931952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:40.934582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:41.435854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c0f360b6-66ca-4c15-a092-6bbec84d14b3 req-04e279ec-5e26-4415-93f1-d17bb3a04962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892f287-45bd-4633-8dfa-f97af06d18ef", "tag": "3e8b5a7f-edcb-4942-a38e-1daba14ba065"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:41.460599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:41.475374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c0f360b6-66ca-4c15-a092-6bbec84d14b3 req-04e279ec-5e26-4415-93f1-d17bb3a04962 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:41.475868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:41.477963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c0f360b6-66ca-4c15-a092-6bbec84d14b3 req-04e279ec-5e26-4415-93f1-d17bb3a04962 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:41.478980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:41.480503 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-399a1af2-c332-46ec-8a9e-e9b574bc6ee4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 0.589052 Jul 25 16:07:41.494579 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 469/973] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:40 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:41.502631 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c0f360b6-66ca-4c15-a092-6bbec84d14b3 req-04e279ec-5e26-4415-93f1-d17bb3a04962 service nova] Creating event network-changed:3e8b5a7f-edcb-4942-a38e-1daba14ba065 for instance 7892f287-45bd-4633-8dfa-f97af06d18ef on n-h2-846219-13 Jul 25 16:07:41.503911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:41.505022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:41.513287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:41.514192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:41.515964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:41.516938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:41.523942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c0f360b6-66ca-4c15-a092-6bbec84d14b3 req-04e279ec-5e26-4415-93f1-d17bb3a04962 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095155 Jul 25 16:07:41.524614 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 505/974] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:07:41.745385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:41.746532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:41.770837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:41.771361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:41.772987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:41.773871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:42.518875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:42.539465 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7db0d9fe-0f09-4f66-904b-30eb0c9249a1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.798717 Jul 25 16:07:42.562729 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 506/975] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:41 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:42.581875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:42.586882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:42.595759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:42.598395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:42.599277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:42.608462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-351edddc-4c86-4f13-aa79-cfd6125d00cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 1.112216 Jul 25 16:07:42.623933 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 470/976] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:41 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:42.624444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:42.634386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:42.635081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:42.635081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:42.650432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:42.651995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:42.656875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:42.657540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.212834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:43.222066 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6882ed2e-1aae-4564-8d2f-ccc706736430 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1558 microversion: 2.1 time: 0.657304 Jul 25 16:07:43.226593 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 507/977] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:42 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1558 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:43.239964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:43.255825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:43.257656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Searching by: {'deleted': False, 'project_id': '648dff46412648f98fd3ef0bacded28d'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:07:43.273086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:43.280397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:43.285204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.286637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:43.292438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:43.293377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.310270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:43.312029 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52d1ae96-d269-42e7-8582-747b9feebac0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 0.697729 Jul 25 16:07:43.315207 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 471/978] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:42 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:43.436497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:43.439079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:07:43.581011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:43.582429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:43.595845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:43.599383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.600904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:43.603716 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00cab8f3-a4a8-4bdc-a6aa-1e0f5aa3493a tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 335 microversion: 2.1 time: 0.375870 Jul 25 16:07:43.605028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.609936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 508/979] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:07:43 2022] GET /compute/v2.1/servers => generated 335 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:43.645039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:43.662105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:43.662914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Searching by: {'deleted': False, 'project_id': '648dff46412648f98fd3ef0bacded28d'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:07:43.683429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:43.685688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.685908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:43.686244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:43.992586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:07:44.177457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:44.185897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.186583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.504168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:44.535017 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d06822fd-3a70-4c89-898f-8b529a24db97 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.957680 Jul 25 16:07:44.548867 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 472/980] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:43 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:44.584068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:44.597078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:44.602574 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d37126f-807a-473c-b62f-0858512fbe3d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.977126 Jul 25 16:07:44.603183 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 509/981] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:07:43 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:44.609255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-888fae41-5c0e-43e1-8819-959465b0c0b0 req-7953892d-b867-4d0e-8273-9a50052fd643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc20a92-2837-413c-934b-50d10d25c7c8", "name": "network-vif-deleted", "tag": "80b7d0ab-8553-4019-9e11-a534507d312e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:44.628013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-888fae41-5c0e-43e1-8819-959465b0c0b0 req-7953892d-b867-4d0e-8273-9a50052fd643 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.629020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-888fae41-5c0e-43e1-8819-959465b0c0b0 req-7953892d-b867-4d0e-8273-9a50052fd643 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.642468 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-888fae41-5c0e-43e1-8819-959465b0c0b0 req-7953892d-b867-4d0e-8273-9a50052fd643 service nova] Creating event network-vif-deleted:80b7d0ab-8553-4019-9e11-a534507d312e for instance fcc20a92-2837-413c-934b-50d10d25c7c8 on n-h1-846219-13 Jul 25 16:07:44.649850 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-888fae41-5c0e-43e1-8819-959465b0c0b0 req-7953892d-b867-4d0e-8273-9a50052fd643 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044496 Jul 25 16:07:44.651100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.651836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.652200 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 510/982] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:44.656766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.658786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.667729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:44.672124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:44.690902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.691639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.692617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.693402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.712966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:44.832106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:44.846897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f11a8598-bbee-49f8-8c6f-45cec7ec2e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1349 microversion: 2.1 time: 0.192934 Jul 25 16:07:44.848760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 511/983] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:44 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1349 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:44.857502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:44.863936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:44.871468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.872207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.873399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:44.873995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:44.975934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:44.987996 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b692ea18-df49-4652-9b17-bf96e69dcd17 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.435973 Jul 25 16:07:44.989584 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 473/984] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:44 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:45.002193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8cbca66-4348-471f-97cf-69390a5015c3 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:45.018738 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8cbca66-4348-471f-97cf-69390a5015c3 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.024285 Jul 25 16:07:45.020381 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 474/985] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:07:44 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:45.119720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:45.151946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:45.163188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:45.168369 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fea851f5-f33d-4abe-a1e0-66cf0ea59b05 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 0.314965 Jul 25 16:07:45.171129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 512/986] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:44 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:45.418816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:45.419324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:45.430542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:45.430993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:45.434113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:45.434556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:45.510423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:07:45.662476 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f16d0db1-5d0f-4295-b488-0b1821c31d74 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 204 len: 0 microversion: 2.1 time: 0.244534 Jul 25 16:07:45.666405 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 475/987] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:45 2022] DELETE /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:07:45.679300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:45.682880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:45.706495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:45.707316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:45.708963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:45.711226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:45.735177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db4b8ec-5679-48d5-932c-c6e5e65287ba tempest-FloatingIPDetailsNegativeTestJSON-559914252 tempest-FloatingIPDetailsNegativeTestJSON-559914252-project] Calling method '.version_select at 0x7f9d936a6dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:45.928868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-6db4b8ec-5679-48d5-932c-c6e5e65287ba tempest-FloatingIPDetailsNegativeTestJSON-559914252 tempest-FloatingIPDetailsNegativeTestJSON-559914252-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 832c69b2-ec82-4fee-b7f4-6320f9827c3d could not be found", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:07:45.930591 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-6db4b8ec-5679-48d5-932c-c6e5e65287ba tempest-FloatingIPDetailsNegativeTestJSON-559914252 tempest-FloatingIPDetailsNegativeTestJSON-559914252-project] HTTP exception thrown: Floating IP not found for ID 832c69b2-ec82-4fee-b7f4-6320f9827c3d Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db4b8ec-5679-48d5-932c-c6e5e65287ba tempest-FloatingIPDetailsNegativeTestJSON-559914252 tempest-FloatingIPDetailsNegativeTestJSON-559914252-project] Request method failure captured: Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-floating-ips/832c69b2-ec82-4fee-b7f4-6320f9827c3d HTTP/1.1 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_RaSPuOjr8I2gK6MM_W-M7LRTVwqS6--NdrsC7vy2fv5TiHQkAkmMOoYg9JT72VqVT4yT4W_bzCWuvn3QAikJv5NskY3edeR6HziDN3Ru5cg1xE72Z9kKR6RjD2jA6MfyoHZ913PD-5VthaOzMBGpprRBj5ORUi5seX5ARXRGzWP0 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: e7fd9bbee4cd4829897a0c15cbff55b4 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-559914252 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e7fd9bbee4cd4829897a0c15cbff55b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e7fd9bbee4cd4829897a0c15cbff55b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e7fd9bbee4cd4829897a0c15cbff55b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e7fd9bbee4cd4829897a0c15cbff55b4"}]}] Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-559914252 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: e7fd9bbee4cd4829897a0c15cbff55b4 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-559914252 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-559914252-project Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a5afb4fb70844065a5719b7449828e66 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-559914252-project Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: exception: Floating IP not found for ID 832c69b2-ec82-4fee-b7f4-6320f9827c3d Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '832c69b2-ec82-4fee-b7f4-6320f9827c3d'} Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:07:45.949492 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 832c69b2-ec82-4fee-b7f4-6320f9827c3d could not be found Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6c33f79-02ad-4870-b251-a2af203aa4f4'] Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 832c69b2-ec82-4fee-b7f4-6320f9827c3d. Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 832c69b2-ec82-4fee-b7f4-6320f9827c3d Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 832c69b2-ec82-4fee-b7f4-6320f9827c3d Jul 25 16:07:45.960479 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:45.980556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db4b8ec-5679-48d5-932c-c6e5e65287ba tempest-FloatingIPDetailsNegativeTestJSON-559914252 tempest-FloatingIPDetailsNegativeTestJSON-559914252-project] Returning 404 to user: Floating IP not found for ID 832c69b2-ec82-4fee-b7f4-6320f9827c3d {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:45.984254 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6db4b8ec-5679-48d5-932c-c6e5e65287ba tempest-FloatingIPDetailsNegativeTestJSON-559914252 tempest-FloatingIPDetailsNegativeTestJSON-559914252-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips/832c69b2-ec82-4fee-b7f4-6320f9827c3d" status: 404 len: 111 microversion: 2.1 time: 0.513727 Jul 25 16:07:45.999362 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 513/988] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:07:45 2022] GET /compute/v2.1/os-floating-ips/832c69b2-ec82-4fee-b7f4-6320f9827c3d => generated 111 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:46.040098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:46.048009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:46.052660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.076592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f82950f9-6ba6-4050-9ce1-fcbab17e3cbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.408131 Jul 25 16:07:46.080228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.081526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.082298 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 476/989] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:45 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:46.084135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.085653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.120970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:46.124502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:46.146615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.147275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.148241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.150352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.346389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.371070 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d9059d0-374d-448b-a37c-3ceb13fa6374 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1349 microversion: 2.1 time: 0.265050 Jul 25 16:07:46.389610 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 477/990] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:46 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1349 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:46.409672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bb35db70-ef95-40ae-9dd8-f27ef520e5e8 req-5c5775b9-4f3f-4cab-bd71-27952f1f0f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:46.424529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bb35db70-ef95-40ae-9dd8-f27ef520e5e8 req-5c5775b9-4f3f-4cab-bd71-27952f1f0f4d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.425038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bb35db70-ef95-40ae-9dd8-f27ef520e5e8 req-5c5775b9-4f3f-4cab-bd71-27952f1f0f4d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.442898 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bb35db70-ef95-40ae-9dd8-f27ef520e5e8 req-5c5775b9-4f3f-4cab-bd71-27952f1f0f4d service nova] Creating event network-changed:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h1-846219-13 Jul 25 16:07:46.450784 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bb35db70-ef95-40ae-9dd8-f27ef520e5e8 req-5c5775b9-4f3f-4cab-bd71-27952f1f0f4d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055552 Jul 25 16:07:46.451991 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 478/991] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:46.460510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:46.461448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:46.469894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.470349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.471150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.471831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.498530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.513531 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc9b1313-4786-4743-bcf9-bdcf9c94ea89 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1701 microversion: 2.1 time: 0.503394 Jul 25 16:07:46.516455 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 514/992] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:46 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1701 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:46.541706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:46.542443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:46.556471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.556930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.564737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:46.565235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:46.818254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.830920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71b3974a-176e-4fe7-998b-0c6d6aa522e6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.376748 Jul 25 16:07:46.844978 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 479/993] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:46 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:46.913602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.934853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.941926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:46.948252 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97d8dea4-65e9-40b5-9555-fd13d4d449ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 0.413388 Jul 25 16:07:46.961959 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 515/994] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:46 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:47.114905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:47.115616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:47.135793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:47.136245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:47.137072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:47.143669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:47.402877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:47.403720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:47.418385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:47.418843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:47.423079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:47.425062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:47.928676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:47.941355 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9364a07b-e2ea-453e-8a19-76db253ddfba tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.831892 Jul 25 16:07:47.958872 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 480/995] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:47 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:47.976426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:47.977963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:47.993808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:47.999568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:48.002913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:48.004008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:48.078886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:48.090971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f33bb787-5544-4379-afdb-4b0721357e3e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1349 microversion: 2.1 time: 0.692510 Jul 25 16:07:48.092312 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 516/996] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:47 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1349 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:48.099522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:48.100197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:48.108147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:48.108963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:48.111335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:48.111335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:49.373384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:49.408186 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f3a5c85-1410-43e3-b16b-dee531b95113 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1701 microversion: 2.1 time: 1.451853 Jul 25 16:07:49.409204 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 481/997] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:47 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1701 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:49.427619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:49.434739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:49.455480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:49.465995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:49.468216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:49.473762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:49.695803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:49.713585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e678db0-0656-49e0-aa33-15408a2d4280 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 1.619738 Jul 25 16:07:49.715976 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 517/998] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:48 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:49.721579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:49.729841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:49.755370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:49.756110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:49.757203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:49.757898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:50.567604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:50.597481 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc12a944-37a2-4d6c-8db4-96ec90b3bdfa tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.879711 Jul 25 16:07:50.599209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 518/999] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:49 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:50.608193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:50.614904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:50.649386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:50.650494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:50.651948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:50.652803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:50.694832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:50.716181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:50.718611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:50.722406 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68bc0b94-a9b0-4eef-98b0-4f2fc2860600 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 1.311714 Jul 25 16:07:50.724998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 482/1000] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:49 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:50.733602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b644b085-9b4b-427a-b2ad-404723270b52 req-6fd812cb-0d18-4702-81ec-3dad4ec7c686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19066dc-2e77-4087-a547-5814cba90569", "name": "network-vif-unplugged", "status": "completed", "tag": "9b869a2f-2d03-4aff-bf7c-7a4a414f73f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:50.779819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b644b085-9b4b-427a-b2ad-404723270b52 req-6fd812cb-0d18-4702-81ec-3dad4ec7c686 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:50.784704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b644b085-9b4b-427a-b2ad-404723270b52 req-6fd812cb-0d18-4702-81ec-3dad4ec7c686 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:50.817784 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b644b085-9b4b-427a-b2ad-404723270b52 req-6fd812cb-0d18-4702-81ec-3dad4ec7c686 service nova] Creating event network-vif-unplugged:9b869a2f-2d03-4aff-bf7c-7a4a414f73f3 for instance e19066dc-2e77-4087-a547-5814cba90569 on n-h2-846219-13 Jul 25 16:07:50.835957 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b644b085-9b4b-427a-b2ad-404723270b52 req-6fd812cb-0d18-4702-81ec-3dad4ec7c686 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108833 Jul 25 16:07:50.837065 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 483/1001] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:50.849322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:50.850732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:50.863016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:50.863864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:50.865778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:50.866909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:50.955705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:50.986115 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b2cd242-b759-45e3-bb6e-a22fd28a6156 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1349 microversion: 2.1 time: 0.384873 Jul 25 16:07:50.997571 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 519/1002] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:50 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1349 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:51.011771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:51.013536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:51.049016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:51.059907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:51.092970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:51.094960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:52.640669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:52.664289 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23b9ca0f-9450-4de7-89f0-13e27afd23ff tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1701 microversion: 2.1 time: 1.824892 Jul 25 16:07:52.666378 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 484/1003] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:50 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1701 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:52.685040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:52.691105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:52.706861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:52.707690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:52.708605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:52.713859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:52.729000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:52.747296 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18f7cb04-04d1-4497-9cd0-a98e15c26300 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 1.744525 Jul 25 16:07:52.748592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 520/1004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:50 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:52.776202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:52.777996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:52.788596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:52.790349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:52.792229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:52.793004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.450154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:53.463110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:53.465245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:53.467146 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e59ce56b-a468-465c-9293-ee69abf573a3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 0.716989 Jul 25 16:07:53.468123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 521/1005] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:52 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:53.491434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:53.492334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:53.500729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.501219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.502266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.503381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.547513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.548076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.548574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lazy-loading 'fault' on Instance uuid fcc20a92-2837-413c-934b-50d10d25c7c8 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:53.550541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:53.571498 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4c9c749a-d42c-471a-ac53-108be0c6f2e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.898739 Jul 25 16:07:53.572886 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 485/1006] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:52 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:53.580161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c198e5fa-eba0-4c34-a985-de75b622fe0f req-577e0a71-5b0d-48cf-828e-479a9e39b14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892f287-45bd-4633-8dfa-f97af06d18ef", "name": "network-vif-plugged", "status": "completed", "tag": "3e8b5a7f-edcb-4942-a38e-1daba14ba065"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:53.609022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c198e5fa-eba0-4c34-a985-de75b622fe0f req-577e0a71-5b0d-48cf-828e-479a9e39b14e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.609836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c198e5fa-eba0-4c34-a985-de75b622fe0f req-577e0a71-5b0d-48cf-828e-479a9e39b14e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.635106 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c198e5fa-eba0-4c34-a985-de75b622fe0f req-577e0a71-5b0d-48cf-828e-479a9e39b14e service nova] Creating event network-vif-plugged:3e8b5a7f-edcb-4942-a38e-1daba14ba065 for instance 7892f287-45bd-4633-8dfa-f97af06d18ef on n-h2-846219-13 Jul 25 16:07:53.647281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c198e5fa-eba0-4c34-a985-de75b622fe0f req-577e0a71-5b0d-48cf-828e-479a9e39b14e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072017 Jul 25 16:07:53.650085 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 486/1007] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:53.694227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:53.695431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:53.710881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.711665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.713163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.714234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.790294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:53.864299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:53.916129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:53.916904 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a25b0abd-73c1-406c-aa60-fed0f4d939e8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 200 len: 1354 microversion: 2.1 time: 0.431051 Jul 25 16:07:53.922052 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 522/1008] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:53 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 1354 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:53.933887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:53.936251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:53.942657 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e096448-8f46-4f16-b248-f3695ff1c450 tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1635 microversion: 2.1 time: 0.256178 Jul 25 16:07:53.946080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 487/1009] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:53 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1635 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:53.962019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.962824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:53.965214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:53.966432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:54.173208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:54.295068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-59ada109-7413-4472-a20d-b954b51660e3 req-cfb6d848-65a0-4528-a1ce-048b5c6165a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19066dc-2e77-4087-a547-5814cba90569", "name": "network-vif-deleted", "tag": "9b869a2f-2d03-4aff-bf7c-7a4a414f73f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:54.318453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-59ada109-7413-4472-a20d-b954b51660e3 req-cfb6d848-65a0-4528-a1ce-048b5c6165a0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:54.319374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-59ada109-7413-4472-a20d-b954b51660e3 req-cfb6d848-65a0-4528-a1ce-048b5c6165a0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:54.336844 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-59ada109-7413-4472-a20d-b954b51660e3 req-cfb6d848-65a0-4528-a1ce-048b5c6165a0 service nova] Creating event network-vif-deleted:9b869a2f-2d03-4aff-bf7c-7a4a414f73f3 for instance e19066dc-2e77-4087-a547-5814cba90569 on n-h2-846219-13 Jul 25 16:07:54.343314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-59ada109-7413-4472-a20d-b954b51660e3 req-cfb6d848-65a0-4528-a1ce-048b5c6165a0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052700 Jul 25 16:07:54.344582 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 488/1010] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:07:54.394342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:54.411500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4a6dde0c-f941-4875-90a4-dfb4ba3697c6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.486823 Jul 25 16:07:54.431730 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 523/1011] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:53 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:54.500376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:54.501707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:54.520574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:54.532226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:54.534213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:54.535289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:54.596576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:54.597460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:54.623463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:54.624888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:54.630172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:54.630805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.606760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:55.638102 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1afe7eb0-f28f-4e8a-bd30-cd0cab9ccb2a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 1.045782 Jul 25 16:07:55.640183 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 524/1012] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:54 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:07:55.652577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:55.655529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:55.669642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.672158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.674155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.675422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.748142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:55.752164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 HTTP/1.1 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fcc20a92-2837-413c-934b-50d10d25c7c8'} Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:55.755456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-19efcbb7-1eb7-4d9a-bc63-3cc2508ab02c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 404 len: 111 microversion: 2.1 time: 0.119194 Jul 25 16:07:55.777408 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 525/1013] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:55 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:55.791975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:55.800137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:55.839198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.842346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.843969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.844756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.873494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:55.886798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:55.888392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:55.889646 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11624de1-db67-4e22-8bdb-92f53ecdae25 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1365 microversion: 2.25 time: 1.397436 Jul 25 16:07:55.895660 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 489/1014] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:54 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1365 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:55.901451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:55.902322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:55.920458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.921301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.922522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.923142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.991078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:55.992281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:55.993338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lazy-loading 'fault' on Instance uuid e19066dc-2e77-4087-a547-5814cba90569 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:56.211888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695300d1268e41f985252e9454f60f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648dff46412648f98fd3ef0bacded28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:56.230210 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1057f670-4e30-4e79-9730-5288a8414a6f tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 200 len: 1362 microversion: 2.1 time: 0.459783 Jul 25 16:07:56.231888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 526/1015] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:55 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:56.241861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-824114a0-6608-4e1e-b8c5-cda2e417e5c3 req-73c274ec-003c-4cde-9a22-57a057719006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "name": "network-vif-plugged", "status": "completed", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:56.273678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-824114a0-6608-4e1e-b8c5-cda2e417e5c3 req-73c274ec-003c-4cde-9a22-57a057719006 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:56.275112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-824114a0-6608-4e1e-b8c5-cda2e417e5c3 req-73c274ec-003c-4cde-9a22-57a057719006 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:56.311878 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-824114a0-6608-4e1e-b8c5-cda2e417e5c3 req-73c274ec-003c-4cde-9a22-57a057719006 service nova] Creating event network-vif-plugged:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h1-846219-13 Jul 25 16:07:56.325649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-824114a0-6608-4e1e-b8c5-cda2e417e5c3 req-73c274ec-003c-4cde-9a22-57a057719006 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089629 Jul 25 16:07:56.328487 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 527/1016] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:07:56.340525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:56.345017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:56.358087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:56.359325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:56.361065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:56.362217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:56.390035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:56.402880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2078aa30-5eca-430b-8d2e-fca291847369 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.501919 Jul 25 16:07:56.403916 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 490/1017] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:55 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:56.423882 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8/os-volume_attachments HTTP/1.1 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': 'fcc20a92-2837-413c-934b-50d10d25c7c8'} Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:56.436121 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:07:56.444622 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:56.452437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:56.454520 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b5a8ff93-472d-460f-bdef-f2ea08325717 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.123631 Jul 25 16:07:56.462816 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 528/1018] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:07:56 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8/os-volume_attachments => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:56.681458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:56.682581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:56.703343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:56.703907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:56.705161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:56.705592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:56.776809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1365024198", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:07:56.864335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:56.952095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:07:57.050762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:57.054810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:57.065688 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-386dbb1c-36b5-4bde-898b-934a382b1927 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.390967 Jul 25 16:07:57.070958 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 491/1019] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:56 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:57.082662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:57.083579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:57.099742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:57.103928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:57.105275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:57.106094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:57.585152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:57.595770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:57.597899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:57.600009 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d7008d34-8d5e-4f62-a7b8-0d51065c08ae tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1560 microversion: 2.25 time: 0.525858 Jul 25 16:07:57.612224 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 492/1020] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:57 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1560 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:57.640520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:57.642257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] [instance: e19066dc-2e77-4087-a547-5814cba90569] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:57.655061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:57.657025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:57.658990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:57.660270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:57.703528 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] HTTP exception thrown: Instance e19066dc-2e77-4087-a547-5814cba90569 could not be found. Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Request method failure captured: Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 HTTP/1.1 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r90ao28ivQ5et3mtlXFUaaC2hxflf-OH--aFZSImJ_90AXaxJoCO_6V-g3pFTC0sCKMuczILDDKvddJkOmvfa4UEPtAv5LYsVMepKVj8hp2LrLW4rvzSVgDPw2MKQmvN24X67ABUDWT-Nu1jKQqXIFqU3ig__InBMJd7VqhtzPUBco Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 648dff46412648f98fd3ef0bacded28d Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-698682266 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/648dff46412648f98fd3ef0bacded28d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/648dff46412648f98fd3ef0bacded28d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/648dff46412648f98fd3ef0bacded28d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_648dff46412648f98fd3ef0bacded28d"}]}] Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-698682266 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 648dff46412648f98fd3ef0bacded28d Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-698682266 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-698682266-project Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 695300d1268e41f985252e9454f60f39 Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-698682266-project Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance e19066dc-2e77-4087-a547-5814cba90569 could not be found. Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'e19066dc-2e77-4087-a547-5814cba90569'} Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19066dc-2e77-4087-a547-5814cba90569 could not be found. Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19066dc-2e77-4087-a547-5814cba90569 could not be found. Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:57.708140 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19066dc-2e77-4087-a547-5814cba90569 could not be found. Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:07:57.720225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Returning 404 to user: Instance e19066dc-2e77-4087-a547-5814cba90569 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:57.722775 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f7276bd-a8af-43c2-9bc1-377400fbac4c tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569" status: 404 len: 111 microversion: 2.1 time: 0.108502 Jul 25 16:07:57.729729 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 493/1021] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:57 2022] GET /compute/v2.1/servers/e19066dc-2e77-4087-a547-5814cba90569 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:57.740023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:57.741735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:57.754875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:57.756219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:57.757919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:57.758855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.155532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:07:58.157008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:07:58.157738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:07:58.158371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:07:58.159326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:07:58.170366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:58.173323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.174475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.175751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.176404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.190013 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-efd82a32-14da-4fc2-b219-858f164f1565 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.457790 Jul 25 16:07:58.190914 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 494/1022] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:57 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:58.208365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:07:58.217937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:07:58.221541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:58.222783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:58.233660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.234444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.235579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.236701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.237072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:07:58.240089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:07:58.298818 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c053f6be-7252-4c08-bc82-5883ddf4191c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.533316 Jul 25 16:07:58.299970 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 529/1023] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:07:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:07:58.306052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f83a27ef-2919-4d5d-be0a-c0b496cd2e4d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] Calling method '.version_select at 0x7f9d938df3a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:58.339678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f83a27ef-2919-4d5d-be0a-c0b496cd2e4d tempest-ServersTestJSON-698682266 tempest-ServersTestJSON-698682266-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890082615" status: 202 len: 0 microversion: 2.1 time: 0.037658 Jul 25 16:07:58.341873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 530/1024] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:07:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890082615 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:07:58.356558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:58.358386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:58.368691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.370065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.371343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.372044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.575434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 7892f287-45bd-4633-8dfa-f97af06d18ef {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:58.608127 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c28ed37e-eaf0-418b-8312-53ead3e699d7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 2054 microversion: 2.25 time: 0.397244 Jul 25 16:07:58.610267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 495/1025] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:58 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 2054 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:58.623336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ffea90a-e1c5-468e-b730-d095722de46b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:58.624847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ffea90a-e1c5-468e-b730-d095722de46b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:58.800633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:58.819804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ffea90a-e1c5-468e-b730-d095722de46b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:07:58.820050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f28008a-d157-4d4b-a110-1ac74624018a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1364 microversion: 2.1 time: 0.475379 Jul 25 16:07:58.820811 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 531/1026] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:58 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1364 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:58.826356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:58.827131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:58.829613 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ffea90a-e1c5-468e-b730-d095722de46b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b" status: 200 len: 1219 microversion: 2.1 time: 0.216997 Jul 25 16:07:58.833506 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 496/1027] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:58 2022] GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b => generated 1219 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:07:58.852702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.855004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.856586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:58.857917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:58.866501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5bd172e5-5d01-4a1f-8e94-21e19565ad09 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:58.867142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5bd172e5-5d01-4a1f-8e94-21e19565ad09 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:58.933629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5bd172e5-5d01-4a1f-8e94-21e19565ad09 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:07:59.630246 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-5bd172e5-5d01-4a1f-8e94-21e19565ad09 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Instance Mapping does not exist while attempting local delete cleanup. Jul 25 16:07:59.631412 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5bd172e5-5d01-4a1f-8e94-21e19565ad09 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b" status: 204 len: 0 microversion: 2.1 time: 0.783572 Jul 25 16:07:59.643980 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 497/1028] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:07:58 2022] DELETE /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:07:59.689606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:59.694894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:59.708295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:59.709256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:59.710433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:59.711281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:59.790341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 7892f287-45bd-4633-8dfa-f97af06d18ef {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:07:59.831360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d903832d-a6ff-42b6-8154-04381d09beb3 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 2054 microversion: 2.25 time: 1.009300 Jul 25 16:07:59.832759 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 532/1029] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:07:58 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 2054 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:07:59.840113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28c2dc42-e2ef-46b5-9ce9-dd67ce96d883 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:59.840899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-28c2dc42-e2ef-46b5-9ce9-dd67ce96d883 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:59.848464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-28c2dc42-e2ef-46b5-9ce9-dd67ce96d883 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28c2dc42-e2ef-46b5-9ce9-dd67ce96d883 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b HTTP/1.1 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3e3b5b68-02b9-4784-ae83-24c9b40f655b'} Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:07:59.850703 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:07:59.855691 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:07:59.855691 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:07:59.855691 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:07:59.855691 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:07:59.855691 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:07:59.860428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28c2dc42-e2ef-46b5-9ce9-dd67ce96d883 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:07:59.861514 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-28c2dc42-e2ef-46b5-9ce9-dd67ce96d883 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b" status: 404 len: 111 microversion: 2.1 time: 0.026254 Jul 25 16:07:59.871243 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 533/1030] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:59 2022] GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:07:59.882968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:07:59.883845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:07:59.893503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:59.894497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:07:59.897507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:07:59.898637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.277203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:00.303300 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b25797b8-b237-4710-90a1-0fd241ad52b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.657153 Jul 25 16:08:00.306069 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 498/1031] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:59 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:00.318422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25015293-d3ed-4ac2-9ad6-2da08aee4601 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:00.326280 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:00.326280 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:00.330518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25015293-d3ed-4ac2-9ad6-2da08aee4601 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:00.332353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25015293-d3ed-4ac2-9ad6-2da08aee4601 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.334186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25015293-d3ed-4ac2-9ad6-2da08aee4601 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:00.335016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25015293-d3ed-4ac2-9ad6-2da08aee4601 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.369510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:00.393424 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25015293-d3ed-4ac2-9ad6-2da08aee4601 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.083940 Jul 25 16:08:00.401427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 499/1032] 10.222.0.105 () {60 vars in 1222 bytes} [Mon Jul 25 16:08:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:08:00.409685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-400009204", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:00.414391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3bf7015e-162e-4611-9d8b-c83ab3ef6438 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1547 microversion: 2.1 time: 0.531168 Jul 25 16:08:00.416587 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 534/1033] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:07:59 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1547 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:00.427114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41776e07-c486-46a0-afca-dc75fbaf90fb tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d938e7820>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:00.513445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41776e07-c486-46a0-afca-dc75fbaf90fb tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f" status: 200 len: 639 microversion: 2.1 time: 0.093853 Jul 25 16:08:00.524000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:08:00.525769 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 535/1034] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:08:00 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f => generated 639 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:00.536136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:00.536971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:00.546343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:00.546796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.547854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:00.548458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.658115 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a842fbb8-1b11-44c1-ab06-64597acb80aa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef/action" status: 202 len: 0 microversion: 2.25 time: 0.129726 Jul 25 16:08:00.659493 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 536/1035] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:08:00 2022] POST /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:08:00.671649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:00.672733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:00.683651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:00.684568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.686062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:00.686901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:00.901697 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e1f6834-413d-4854-bdb4-ae6f78c5e9d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239670 Jul 25 16:08:00.902691 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 537/1036] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:08:00 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:00.916158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c58edbe9-bf99-4252-bf7e-917e57066b9c tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9d93584a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:01.041907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c58edbe9-bf99-4252-bf7e-917e57066b9c tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:01.056098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c58edbe9-bf99-4252-bf7e-917e57066b9c tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:01.664655 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c58edbe9-bf99-4252-bf7e-917e57066b9c tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.758831 Jul 25 16:08:01.666814 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 538/1037] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:00 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:01.674445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:01.675163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:01.688687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:01.689805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:01.691683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:01.692751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.030327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:08:02.031136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:08:02.032055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:08:02.032461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:08:02.033059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:08:02.047494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:02.048279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.049411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:02.050262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.076491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:02.087512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:02.108216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:02.117415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:08:02.123373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:08:02.146768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 7892f287-45bd-4633-8dfa-f97af06d18ef {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:08:02.180642 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bcb016ba-d0b0-4103-b78c-189a5fb48318 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 2039 microversion: 2.25 time: 0.510028 Jul 25 16:08:02.182693 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 539/1038] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:01 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 2039 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:02.194258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:02.195680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:02.211083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:02.212251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.213984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:02.215060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.232043 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84565530-2536-4be9-8f32-d3a063afbe60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.828330 Jul 25 16:08:02.233584 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 500/1039] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:08:02.240327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2a8f3b97-64ea-4345-904e-43884510b860 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d93c0aa60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:02.747489 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2a8f3b97-64ea-4345-904e-43884510b860 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "DELETE /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.511496 Jul 25 16:08:02.748496 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 501/1040] 10.222.0.105 () {58 vars in 1301 bytes} [Mon Jul 25 16:08:02 2022] DELETE /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata/os_version => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:08:02.756277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-13", "block_migration": "auto"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:02.762347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:02.772927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:02.774598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.776617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:02.778198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:02.843959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'flavor' on Instance uuid 7892f287-45bd-4633-8dfa-f97af06d18ef {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:08:02.874243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Going to try to live migrate instance to n-h1-846219-13 {{(pid=119598) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:08:02.942041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:02.967303 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24882cb8-4431-4547-9d38-ce93b48f6731 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1545 microversion: 2.1 time: 0.782295 Jul 25 16:08:02.974001 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 540/1041] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:02 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1545 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:02.982459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-959197c1-da05-497e-a4f9-dca6f5dbe8d7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:02.995883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-959197c1-da05-497e-a4f9-dca6f5dbe8d7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:03.393297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-959197c1-da05-497e-a4f9-dca6f5dbe8d7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:03.430772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-959197c1-da05-497e-a4f9-dca6f5dbe8d7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1218 microversion: 2.1 time: 0.452147 Jul 25 16:08:03.436229 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 541/1042] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:02 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1218 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:03.468484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-009622ff-859c-4df4-9f85-121957df42ae tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d936a7c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:03.677223 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-009622ff-859c-4df4-9f85-121957df42ae tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 37 microversion: 2.1 time: 0.237447 Jul 25 16:08:03.680493 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 542/1043] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:08:03 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 37 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:03.714624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61261733-a3df-4fbe-b989-7cf34b9c827d tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9d938df670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:03.904818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-61261733-a3df-4fbe-b989-7cf34b9c827d tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:03.946870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-61261733-a3df-4fbe-b989-7cf34b9c827d tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:04.672016 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-61261733-a3df-4fbe-b989-7cf34b9c827d tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.980830 Jul 25 16:08:04.673004 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 543/1044] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:03 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:04.678947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:04.685416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:04.703387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:04.704283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:04.706886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:04.708391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:05.381172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:05.397204 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f4f42ae-e003-4a4c-bb07-30f1bd25eea1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1544 microversion: 2.1 time: 0.722764 Jul 25 16:08:05.397803 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 544/1045] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:04 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1544 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:06.000716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e02aecfc-74a5-496d-baa6-e09f76204575 req-ee651889-3ae7-4721-8fd8-0f380bdc254f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:06.072419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e02aecfc-74a5-496d-baa6-e09f76204575 req-ee651889-3ae7-4721-8fd8-0f380bdc254f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:06.077726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e02aecfc-74a5-496d-baa6-e09f76204575 req-ee651889-3ae7-4721-8fd8-0f380bdc254f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:06.124765 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e02aecfc-74a5-496d-baa6-e09f76204575 req-ee651889-3ae7-4721-8fd8-0f380bdc254f service nova] Creating event network-changed:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h1-846219-13 Jul 25 16:08:06.137002 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e02aecfc-74a5-496d-baa6-e09f76204575 req-ee651889-3ae7-4721-8fd8-0f380bdc254f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.736288 Jul 25 16:08:06.138708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 545/1046] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:06.145770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:06.148231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:06.163902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:06.165264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:06.166558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:06.167320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:06.353707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:06.380658 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b3411d46-0e8b-4efa-be81-fb14d03d1488 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1276 microversion: 2.1 time: 0.239544 Jul 25 16:08:06.403978 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 546/1047] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:06 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:06.441499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab6e808e-eec5-435d-aead-178a1e1352ee tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d935ed940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:06.568388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab6e808e-eec5-435d-aead-178a1e1352ee tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.159953 Jul 25 16:08:06.572924 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 547/1048] 10.222.0.105 () {58 vars in 1295 bytes} [Mon Jul 25 16:08:06 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata/os_distro => generated 33 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:06.595654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:06.602323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:06.629084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:06.638748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:06.640246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:06.642648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:06.997822 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-988d7984-b339-4320-8944-dfd9b96bdbb7 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef/action" status: 202 len: 0 microversion: 2.25 time: 4.247456 Jul 25 16:08:06.998631 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 502/1049] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:08:02 2022] POST /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef/action => generated 0 bytes in 4249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:08:07.008801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7dacf4cf-9483-40cc-8ade-a5c25ab9d827 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9d93a8a1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:07.139670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7dacf4cf-9483-40cc-8ade-a5c25ab9d827 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:07.152168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7dacf4cf-9483-40cc-8ade-a5c25ab9d827 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:07.506603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:07.530776 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-403eedfd-c8ce-4eb9-8b41-c96dae95323f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1476 microversion: 2.1 time: 0.954974 Jul 25 16:08:07.532168 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 548/1050] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:06 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1476 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:07.544912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:07.546091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:07.557682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:07.558878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:07.560545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:07.561656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:07.604400 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7dacf4cf-9483-40cc-8ade-a5c25ab9d827 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.603774 Jul 25 16:08:07.614052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 503/1051] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:06 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:07.623875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:07.626232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:07.642411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:07.644237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:07.646540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:07.647944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:08.198514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:08.369989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:08.380585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b9d5855-46bf-44de-91de-beb8f78358b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.764787 Jul 25 16:08:08.384505 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 504/1052] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:07 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:08.393082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:08.404625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:08.407290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d16ad01-d951-4472-b6d6-b5d3dfdb1ba2 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d93a92af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:08.418850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:08.421687 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7f316e2-ee7c-457d-ad47-641195f43da9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.886974 Jul 25 16:08:08.422665 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 549/1053] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:07 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:08.483904 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d16ad01-d951-4472-b6d6-b5d3dfdb1ba2 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.097930 Jul 25 16:08:08.484575 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 505/1054] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:08:08 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:08.490407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8d57f5dd-fed0-4cb6-a389-54501a01c01b req-94c4c803-cd94-4075-8150-69c1f952cf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "name": "network-vif-unplugged", "status": "completed", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:08.521201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8d57f5dd-fed0-4cb6-a389-54501a01c01b req-94c4c803-cd94-4075-8150-69c1f952cf62 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:08.523929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8d57f5dd-fed0-4cb6-a389-54501a01c01b req-94c4c803-cd94-4075-8150-69c1f952cf62 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:08.555523 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8d57f5dd-fed0-4cb6-a389-54501a01c01b req-94c4c803-cd94-4075-8150-69c1f952cf62 service nova] Creating event network-vif-unplugged:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:08:08.573548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-8d57f5dd-fed0-4cb6-a389-54501a01c01b req-94c4c803-cd94-4075-8150-69c1f952cf62 service nova] Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:08:08.587364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8d57f5dd-fed0-4cb6-a389-54501a01c01b req-94c4c803-cd94-4075-8150-69c1f952cf62 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101045 Jul 25 16:08:08.588455 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 506/1055] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:08.599517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7982136-1e02-4995-bc0b-8e225db2f3b7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9d93b3ff70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:08.711987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f7982136-1e02-4995-bc0b-8e225db2f3b7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:08.720107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f7982136-1e02-4995-bc0b-8e225db2f3b7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:08.888923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-733374da-5293-43d9-9ca6-7ec9de6f4106 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-887903402", "id": 1167860989, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:08.903227 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:08.903227 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:08.940028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-733374da-5293-43d9-9ca6-7ec9de6f4106 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 440 microversion: 2.1 time: 0.514189 Jul 25 16:08:08.957745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 550/1056] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:08 2022] POST /compute/v2.1/flavors => generated 440 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:08.970534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:08.972400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:08.984913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:08.985933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:08.990383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:08.992965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:09.029450 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7982136-1e02-4995-bc0b-8e225db2f3b7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.439773 Jul 25 16:08:09.031077 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 507/1057] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:08 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:09.047441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9e274fb3-2b69-452d-9a4d-78ecfd090f83 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:09.071162 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:09.071162 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:09.265191 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9e274fb3-2b69-452d-9a4d-78ecfd090f83 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/1167860989/action" status: 200 len: 97 microversion: 2.1 time: 0.232426 Jul 25 16:08:09.265834 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 508/1058] 10.222.0.105 () {60 vars in 1205 bytes} [Mon Jul 25 16:08:09 2022] POST /compute/v2.1/flavors/1167860989/action => generated 97 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:09.285413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d963f400-2090-436c-9d27-477d8fcd1ec6 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9da06b41f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:09.402131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d963f400-2090-436c-9d27-477d8fcd1ec6 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:09.419567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d963f400-2090-436c-9d27-477d8fcd1ec6 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:09.506420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:09.530174 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c7d848e-6a9e-44f1-91d9-786cafb258f9 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1476 microversion: 2.1 time: 0.570011 Jul 25 16:08:09.549194 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 551/1059] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:08 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1476 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:09.556303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3228aa27-361b-4d1f-880d-7a25b1eada7c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:09.572328 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:09.572328 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:09.785854 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3228aa27-361b-4d1f-880d-7a25b1eada7c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 8da6ada1ddcb45a38c58ecf217585ec9 combination. Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3228aa27-361b-4d1f-880d-7a25b1eada7c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Request method failure captured: Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/flavors/1167860989/action HTTP/1.1 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 67 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_muVY5eme--bEHH4hY9cBMoH9Xzr_z9a-fxUboicgwmWYzrHXgwiN5fp218CdAoB-KFjbEdyJjC4Uwcq-HGYInB265Igc6FW_Lo_rT_e7HXYCaHTs4rdtIorx6N6rfDjWoi0F1mZCtDVle13C-1jF6pe2epaC4enVXyj_USGw8L8M Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9a21f9913f7f458a8e4c41fd2eeb81ec Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9a21f9913f7f458a8e4c41fd2eeb81ec"}]}] Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9a21f9913f7f458a8e4c41fd2eeb81ec Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2910b60c40134013bddfee56ded56ff5 Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: {"addTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor access already exists for flavor 35 and project 8da6ada1ddcb45a38c58ecf217585ec9 combination. Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1167860989', 'body': {'addTenantAccess': {'tenant': '8da6ada1ddcb45a38c58ecf217585ec9'}}} Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result.read() Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-8da6ada1ddcb45a38c58ecf217585ec9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.794690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result.read() Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:08:09.807698 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-8da6ada1ddcb45a38c58ecf217585ec9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 16, 8, 9, 778153), 'updated_at': None, 'flavor_id': 35, 'project_id': '8da6ada1ddcb45a38c58ecf217585ec9'}] Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project 8da6ada1ddcb45a38c58ecf217585ec9 combination. Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project 8da6ada1ddcb45a38c58ecf217585ec9 combination. Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project 8da6ada1ddcb45a38c58ecf217585ec9 combination. Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:09.818815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3228aa27-361b-4d1f-880d-7a25b1eada7c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 8da6ada1ddcb45a38c58ecf217585ec9 combination. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:09.829262 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3228aa27-361b-4d1f-880d-7a25b1eada7c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/1167860989/action" status: 409 len: 152 microversion: 2.1 time: 0.267956 Jul 25 16:08:09.829262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 552/1060] 10.222.0.105 () {60 vars in 1205 bytes} [Mon Jul 25 16:08:09 2022] POST /compute/v2.1/flavors/1167860989/action => generated 152 bytes in 275 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:08:09.844291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:09.847723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:09.861257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:09.862068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:09.863960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:09.865061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:09.922914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:10.345515 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d963f400-2090-436c-9d27-477d8fcd1ec6 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 64 microversion: 2.1 time: 1.067046 Jul 25 16:08:10.346927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 509/1061] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:09 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 64 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:10.377320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:10.378546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:10.397634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:10.398710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:10.399944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:10.400648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:10.868176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:10.884326 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-039d3c33-130f-4857-b4c0-e127495c82d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 1.052578 Jul 25 16:08:10.884939 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 553/1062] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:09 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:10.895829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b12c59d-88f0-429f-8040-c7223f34256a tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:10.901879 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:10.901879 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:11.047690 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b12c59d-88f0-429f-8040-c7223f34256a tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/1167860989/action" status: 200 len: 21 microversion: 2.1 time: 0.160642 Jul 25 16:08:11.049002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 554/1063] 10.222.0.105 () {60 vars in 1205 bytes} [Mon Jul 25 16:08:10 2022] POST /compute/v2.1/flavors/1167860989/action => generated 21 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:11.052956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:11.071233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:11.073329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:11.074893 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-186b1f9b-70e1-481c-a1dd-5f387a89fa82 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.715638 Jul 25 16:08:11.075743 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 510/1064] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:10 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:11.086041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25d2178f-0cd8-4d96-8bf8-1bb28f13aee2 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d936a70d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:11.096474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:11.096474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:11.117252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:11.118043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:11.120062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:11.130494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:11.188123 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25d2178f-0cd8-4d96-8bf8-1bb28f13aee2 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.130718 Jul 25 16:08:11.188919 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 555/1065] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:08:11 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 64 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:11.202742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f385392a-c783-4dbd-95cb-a7a1524cf2fd tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:11.204502 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:11.204502 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:11.235604 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f385392a-c783-4dbd-95cb-a7a1524cf2fd tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/1167860989" status: 202 len: 0 microversion: 2.1 time: 0.044772 Jul 25 16:08:11.236439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 556/1066] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:08:11 2022] DELETE /compute/v2.1/flavors/1167860989 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:11.243710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad391eae-eb03-4638-8f7e-002611312853 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9d938df3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:11.357739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ad391eae-eb03-4638-8f7e-002611312853 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:11.367059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ad391eae-eb03-4638-8f7e-002611312853 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:11.703796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:11.738672 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bf3a5fc-58db-4d80-b437-87f1c4dfd3a0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1473 microversion: 2.1 time: 0.658240 Jul 25 16:08:11.739619 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 511/1067] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:11 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1473 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:11.763158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f2c786b-0ecf-4bc8-84ca-ecc6bbd23879 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:11.859693 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f2c786b-0ecf-4bc8-84ca-ecc6bbd23879 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.110458 Jul 25 16:08:11.877966 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 512/1068] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:08:11 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:11.894877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-79740f0e-7714-4cf4-b987-c9b157b11a56 req-f5fd37f7-8b5b-4612-af7c-bddf6c088b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa11af2-1b5a-4c22-b916-9d53e152cffe", "tag": "a875d74f-57a5-4529-bdf5-db5297e5aa89"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:11.912831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-79740f0e-7714-4cf4-b987-c9b157b11a56 req-f5fd37f7-8b5b-4612-af7c-bddf6c088b55 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:11.913940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-79740f0e-7714-4cf4-b987-c9b157b11a56 req-f5fd37f7-8b5b-4612-af7c-bddf6c088b55 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:11.939109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-79740f0e-7714-4cf4-b987-c9b157b11a56 req-f5fd37f7-8b5b-4612-af7c-bddf6c088b55 service nova] Creating event network-changed:a875d74f-57a5-4529-bdf5-db5297e5aa89 for instance eaa11af2-1b5a-4c22-b916-9d53e152cffe on n-h2-846219-13 Jul 25 16:08:11.954932 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-79740f0e-7714-4cf4-b987-c9b157b11a56 req-f5fd37f7-8b5b-4612-af7c-bddf6c088b55 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075313 Jul 25 16:08:11.955910 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 513/1069] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:11.964015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:11.964942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:11.985665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:11.986206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:11.987012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:11.987538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:12.065621 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad391eae-eb03-4638-8f7e-002611312853 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.827459 Jul 25 16:08:12.068388 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 557/1070] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:11 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:12.090430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:12.093195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00a862ac-68c6-47df-8614-87e541fffa26 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-319340190", "id": 466027209, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:12.117577 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:12.117577 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:12.141612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:12.143071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:12.145852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:12.147098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:12.153933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:12.180484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00a862ac-68c6-47df-8614-87e541fffa26 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.108339 Jul 25 16:08:12.181601 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 558/1071] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:12 2022] POST /compute/v2.1/flavors => generated 436 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:12.208127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:12.209840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:12.221656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:12.226211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:12.226878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:12.227821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:12.228442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:12.239337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for user 797cc3e401c3492187cd37395c534d3c and project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:12.500128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e70c8193-84e1-43c2-9a65-f6d01894123e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea/action" status: 202 len: 0 microversion: 2.1 time: 0.541523 Jul 25 16:08:12.504592 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 514/1072] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:08:11 2022] POST /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:12.512447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fcfbac37-4190-4090-aaf6-cc4a561655c7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update', calling method: .version_select at 0x7f9da01153a0>, body: {"meta": {"os_version": "alt"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:12.644361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-fcfbac37-4190-4090-aaf6-cc4a561655c7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:12.662862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-fcfbac37-4190-4090-aaf6-cc4a561655c7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:12.709520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:12.733383 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2855ce6-4497-44b1-8133-66d6af18375a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.537868 Jul 25 16:08:12.739702 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 559/1073] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:12 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:12.773573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:12.774880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:12.792880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:12.793596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:12.795018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:12.795831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:13.294447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fcfbac37-4190-4090-aaf6-cc4a561655c7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.790533 Jul 25 16:08:13.295378 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 515/1074] 10.222.0.105 () {60 vars in 1318 bytes} [Mon Jul 25 16:08:12 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata/os_version => generated 31 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:13.320494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40a17bf8-61c7-493c-b658-86d9478de7a7 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:13.322367 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:13.322367 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:13.341525 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-40a17bf8-61c7-493c-b658-86d9478de7a7 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40a17bf8-61c7-493c-b658-86d9478de7a7 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Request method failure captured: Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/flavors/466027209/os-flavor-access HTTP/1.1 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_muVY5eme--bEHH4hY9cBMoH9Xzr_z9a-fxUboicgwmWYzrHXgwiN5fp218CdAoB-KFjbEdyJjC4Uwcq-HGYInB265Igc6FW_Lo_rT_e7HXYCaHTs4rdtIorx6N6rfDjWoi0F1mZCtDVle13C-1jF6pe2epaC4enVXyj_USGw8L8M Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 9a21f9913f7f458a8e4c41fd2eeb81ec Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9a21f9913f7f458a8e4c41fd2eeb81ec"}]}] Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 9a21f9913f7f458a8e4c41fd2eeb81ec Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2910b60c40134013bddfee56ded56ff5 Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: exception: Access list not available for public flavors. Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '466027209'} Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 25 16:08:13.356191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:13.366453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40a17bf8-61c7-493c-b658-86d9478de7a7 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:13.377369 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40a17bf8-61c7-493c-b658-86d9478de7a7 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/466027209/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.071663 Jul 25 16:08:13.378189 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 516/1075] 10.222.0.105 () {58 vars in 1211 bytes} [Mon Jul 25 16:08:13 2022] GET /compute/v2.1/flavors/466027209/os-flavor-access => generated 91 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:08:13.387079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:13.388387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:13.426358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:13.429019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:13.434529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:13.437423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:13.461827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:13.474197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:13.479008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:13.480420 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1672b3d-57a9-45dc-ad64-336308d42587 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.738659 Jul 25 16:08:13.485962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:13.495085 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 560/1076] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:12 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:13.509456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e5068b2-570a-4a54-8d51-aeb4114ef2e9 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d93586d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:13.568285 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e5068b2-570a-4a54-8d51-aeb4114ef2e9 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 58 microversion: 2.1 time: 0.071648 Jul 25 16:08:13.569555 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 561/1077] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:08:13 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 58 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:13.586824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c685e805-aaec-4ffa-a043-76c733cd7af2 req-90dfae2d-2511-492e-a194-0e04f79b001e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "name": "network-vif-plugged", "status": "completed", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:13.599677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c685e805-aaec-4ffa-a043-76c733cd7af2 req-90dfae2d-2511-492e-a194-0e04f79b001e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:13.600480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c685e805-aaec-4ffa-a043-76c733cd7af2 req-90dfae2d-2511-492e-a194-0e04f79b001e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:13.616627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c685e805-aaec-4ffa-a043-76c733cd7af2 req-90dfae2d-2511-492e-a194-0e04f79b001e service nova] Creating event network-vif-plugged:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:08:13.625180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-c685e805-aaec-4ffa-a043-76c733cd7af2 req-90dfae2d-2511-492e-a194-0e04f79b001e service nova] Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:08:13.635457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c685e805-aaec-4ffa-a043-76c733cd7af2 req-90dfae2d-2511-492e-a194-0e04f79b001e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064321 Jul 25 16:08:13.636584 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 562/1078] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:13.645213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dee0684c-6c00-4a02-bd35-7e3f7b2539cb tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:13.646174 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:13.646174 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:13.671674 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dee0684c-6c00-4a02-bd35-7e3f7b2539cb tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/466027209" status: 202 len: 0 microversion: 2.1 time: 0.032902 Jul 25 16:08:13.677984 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 563/1079] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:08:13 2022] DELETE /compute/v2.1/flavors/466027209 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:13.694857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3fda630a-0af1-40fb-8a7a-91711f847dd7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'update_all', calling method: .version_select at 0x7f9d936a7310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:13.800107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3fda630a-0af1-40fb-8a7a-91711f847dd7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:13.814944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3fda630a-0af1-40fb-8a7a-91711f847dd7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:13.820478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:13.849624 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5a59228b-e71a-43c4-be83-3343b9f4f394 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1472 microversion: 2.1 time: 0.468036 Jul 25 16:08:13.856401 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 517/1080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:13 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1472 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:13.875756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-743a2e13-0868-4d5f-9620-d6a54a8337f8 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:13.944521 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-743a2e13-0868-4d5f-9620-d6a54a8337f8 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.084748 Jul 25 16:08:13.954633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 518/1081] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:08:13 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:13.967958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:13.970139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:13.988893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:13.990453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:13.993845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:13.997353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:14.422168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3fda630a-0af1-40fb-8a7a-91711f847dd7 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.747504 Jul 25 16:08:14.422827 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 564/1082] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:13 2022] PUT /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 61 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:14.436383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-447d5754-acb9-453f-8e84-8e1f45005078 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1745739017", "id": 386376627, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:14.439459 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:14.439459 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:14.456965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-447d5754-acb9-453f-8e84-8e1f45005078 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.032221 Jul 25 16:08:14.457416 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 565/1083] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:14 2022] POST /compute/v2.1/flavors => generated 438 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:14.462134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2110a935-8c2c-41bc-ac75-8bbfa80f6a7e req-2899375b-07d3-4777-9bf4-fdd5b9000f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892f287-45bd-4633-8dfa-f97af06d18ef", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8b5a7f-edcb-4942-a38e-1daba14ba065"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:14.472284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2110a935-8c2c-41bc-ac75-8bbfa80f6a7e req-2899375b-07d3-4777-9bf4-fdd5b9000f3f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:14.472823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2110a935-8c2c-41bc-ac75-8bbfa80f6a7e req-2899375b-07d3-4777-9bf4-fdd5b9000f3f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:14.486366 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2110a935-8c2c-41bc-ac75-8bbfa80f6a7e req-2899375b-07d3-4777-9bf4-fdd5b9000f3f service nova] Creating event network-vif-unplugged:3e8b5a7f-edcb-4942-a38e-1daba14ba065 for instance 7892f287-45bd-4633-8dfa-f97af06d18ef on n-h2-846219-13 Jul 25 16:08:14.491781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2110a935-8c2c-41bc-ac75-8bbfa80f6a7e req-2899375b-07d3-4777-9bf4-fdd5b9000f3f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033077 Jul 25 16:08:14.492410 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 566/1084] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:14.498174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bfb4df58-66cb-4955-b06f-6924ce379964 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Action: 'create', calling method: .version_select at 0x7f9d93869b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:14.564250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-bfb4df58-66cb-4955-b06f-6924ce379964 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:14.572670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-bfb4df58-66cb-4955-b06f-6924ce379964 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Getting quotas for user d7a257c4003d4d5db3418f6a1b33c25b and project d8f7dc45a6094a7ab7dea950f5664a2b. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:14.576931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:14.630601 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53891a0e-7d61-46c4-97f6-10573b87a793 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.673673 Jul 25 16:08:14.633313 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 519/1085] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:13 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:15.021853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f2d8ac6-4147-4523-bf19-34f0354572d7 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:15.028285 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:15.028285 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:15.030608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f2d8ac6-4147-4523-bf19-34f0354572d7 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1fab50da59f54c81bc212476b72acbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da6ada1ddcb45a38c58ecf217585ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f2d8ac6-4147-4523-bf19-34f0354572d7 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Request method failure captured: Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/flavors/386376627/action HTTP/1.1 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 67 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_lsUmJGlmx2BeT8DaGDfAJfyMjICqtRGKoA3eG1pFc-qNzsZMOk4pe8Bj-VM1LTEvyM9-CMtLiZ5mgt_uuoVtgucuXWLGzoswM8T75jWtDjY9RGfxmcItub-iOxuY1nqdW18HQhVRUrOEBJSNnbSq2XHwvxgdaExWs2FwoEswj7Mo Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 8da6ada1ddcb45a38c58ecf217585ec9 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-848933884 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8da6ada1ddcb45a38c58ecf217585ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8da6ada1ddcb45a38c58ecf217585ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8da6ada1ddcb45a38c58ecf217585ec9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8da6ada1ddcb45a38c58ecf217585ec9"}]}] Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-848933884 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 8da6ada1ddcb45a38c58ecf217585ec9 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-848933884 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsAccessNegativeTestJSON-848933884-project Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1fab50da59f54c81bc212476b72acbf3 Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-848933884-project Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: {"addTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '386376627', 'body': {'addTenantAccess': {'tenant': '8da6ada1ddcb45a38c58ecf217585ec9'}}} Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:08:15.034167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f2d8ac6-4147-4523-bf19-34f0354572d7 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:15.039362 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f2d8ac6-4147-4523-bf19-34f0354572d7 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] 10.222.0.105 "POST /compute/v2.1/flavors/386376627/action" status: 403 len: 130 microversion: 2.1 time: 0.399696 Jul 25 16:08:15.040618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bfb4df58-66cb-4955-b06f-6924ce379964 tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "POST /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.543720 Jul 25 16:08:15.041825 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 567/1086] 10.222.0.105 () {60 vars in 1286 bytes} [Mon Jul 25 16:08:14 2022] POST /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 85 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:15.042937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 520/1087] 10.222.0.105 () {60 vars in 1202 bytes} [Mon Jul 25 16:08:14 2022] POST /compute/v2.1/flavors/386376627/action => generated 130 bytes in 408 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:15.049023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:15.051412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:15.052382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:15.054688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:15.076397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:15.077338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:15.077888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:15.078814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:15.078960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:15.080056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:15.080201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:15.081687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:15.784100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:15.790603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:15.809211 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87df6d02-b655-4761-8f4c-a0ac858f1c87 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1472 microversion: 2.1 time: 0.762136 Jul 25 16:08:15.811160 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 521/1088] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:15 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1472 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:15.816565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91d5b9d7-2940-4431-aead-89bedc9169fb tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] Calling method '.version_select at 0x7f9d93aa8280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:15.834133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:15.841461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:15.846400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-886cc50f-cf44-454b-99c9-b85fb62493fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.803199 Jul 25 16:08:15.850197 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 568/1089] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:15 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:15.858733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2bc44d2-9d4c-4578-a45a-b079419e1d02 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:15.868860 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:15.868860 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:15.881138 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91d5b9d7-2940-4431-aead-89bedc9169fb tempest-ImagesMetadataTestJSON-1658545756 tempest-ImagesMetadataTestJSON-1658545756-project] 10.222.0.105 "GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.068372 Jul 25 16:08:15.881895 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 522/1090] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:08:15 2022] GET /compute/v2.1/images/f115503e-edc0-44ac-aa3c-93952d28165f/metadata => generated 85 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:15.888131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:15.888380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:15.909139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:15.909907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:15.910932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:15.912564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:15.924062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2bc44d2-9d4c-4578-a45a-b079419e1d02 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/386376627" status: 202 len: 0 microversion: 2.1 time: 0.072248 Jul 25 16:08:15.925724 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 569/1091] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:08:15 2022] DELETE /compute/v2.1/flavors/386376627 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:15.935849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8923d16b-4c76-4cba-8faa-305bd0ca7541 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:15.968981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8923d16b-4c76-4cba-8faa-305bd0ca7541 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.038569 Jul 25 16:08:15.970207 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 570/1092] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:08:15 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:08:15.995484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6155ff85-ad65-4512-ab35-878292bc7105 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-429233155", "id": 94892237, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:15.999096 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:15.999096 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:16.024627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6155ff85-ad65-4512-ab35-878292bc7105 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.033486 Jul 25 16:08:16.025747 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 571/1093] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:15 2022] POST /compute/v2.1/flavors => generated 434 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:16.039996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2bebba2d-0e38-4765-997c-67316e98c2ba tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:16.044444 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:16.044444 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:16.251512 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2bebba2d-0e38-4765-997c-67316e98c2ba tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/94892237/action" status: 200 len: 95 microversion: 2.1 time: 0.216074 Jul 25 16:08:16.258936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 572/1094] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:08:16 2022] POST /compute/v2.1/flavors/94892237/action => generated 95 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:16.265828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ead10ddc-b54f-408b-8849-0a46a29809d6 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:16.269535 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:16.269535 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:16.271062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ead10ddc-b54f-408b-8849-0a46a29809d6 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1fab50da59f54c81bc212476b72acbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da6ada1ddcb45a38c58ecf217585ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ead10ddc-b54f-408b-8849-0a46a29809d6 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Request method failure captured: Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/flavors/94892237/action HTTP/1.1 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 70 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_lsUmJGlmx2BeT8DaGDfAJfyMjICqtRGKoA3eG1pFc-qNzsZMOk4pe8Bj-VM1LTEvyM9-CMtLiZ5mgt_uuoVtgucuXWLGzoswM8T75jWtDjY9RGfxmcItub-iOxuY1nqdW18HQhVRUrOEBJSNnbSq2XHwvxgdaExWs2FwoEswj7Mo Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8da6ada1ddcb45a38c58ecf217585ec9 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-848933884 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8da6ada1ddcb45a38c58ecf217585ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8da6ada1ddcb45a38c58ecf217585ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8da6ada1ddcb45a38c58ecf217585ec9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8da6ada1ddcb45a38c58ecf217585ec9"}]}] Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-848933884 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8da6ada1ddcb45a38c58ecf217585ec9 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-848933884 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FlavorsAccessNegativeTestJSON-848933884-project Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1fab50da59f54c81bc212476b72acbf3 Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-848933884-project Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: {"removeTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '94892237', 'body': {'removeTenantAccess': {'tenant': '8da6ada1ddcb45a38c58ecf217585ec9'}}} Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can( Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 16:08:16.273353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 16:08:16.277876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.280296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ead10ddc-b54f-408b-8849-0a46a29809d6 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:16.281509 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ead10ddc-b54f-408b-8849-0a46a29809d6 tempest-FlavorsAccessNegativeTestJSON-848933884 tempest-FlavorsAccessNegativeTestJSON-848933884-project] 10.222.0.105 "POST /compute/v2.1/flavors/94892237/action" status: 403 len: 133 microversion: 2.1 time: 0.021005 Jul 25 16:08:16.286776 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 573/1095] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:08:16 2022] POST /compute/v2.1/flavors/94892237/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:16.294221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-534a41ac-0f5e-4688-9fc4-288851935cf8 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8da6ada1ddcb45a38c58ecf217585ec9"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:16.514384 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-534a41ac-0f5e-4688-9fc4-288851935cf8 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/94892237/action" status: 200 len: 21 microversion: 2.1 time: 0.211899 Jul 25 16:08:16.525023 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 574/1096] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:08:16 2022] POST /compute/v2.1/flavors/94892237/action => generated 21 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:16.538251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-117d6e2a-9e1d-43d2-b7b1-b056fc14e8eb tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:16.597028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-117d6e2a-9e1d-43d2-b7b1-b056fc14e8eb tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/94892237" status: 202 len: 0 microversion: 2.1 time: 0.069847 Jul 25 16:08:16.601904 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 575/1097] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:08:16 2022] DELETE /compute/v2.1/flavors/94892237 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:16.615910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-daf92e1e-1838-45c5-b5f1-34a91a883af7 req-9b30abbb-467d-4320-ac3e-d0d5532656e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892f287-45bd-4633-8dfa-f97af06d18ef", "tag": "3e8b5a7f-edcb-4942-a38e-1daba14ba065"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:16.631353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-daf92e1e-1838-45c5-b5f1-34a91a883af7 req-9b30abbb-467d-4320-ac3e-d0d5532656e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:16.633113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-daf92e1e-1838-45c5-b5f1-34a91a883af7 req-9b30abbb-467d-4320-ac3e-d0d5532656e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:16.652866 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-daf92e1e-1838-45c5-b5f1-34a91a883af7 req-9b30abbb-467d-4320-ac3e-d0d5532656e3 service nova] Creating event network-changed:3e8b5a7f-edcb-4942-a38e-1daba14ba065 for instance 7892f287-45bd-4633-8dfa-f97af06d18ef on n-h2-846219-13 Jul 25 16:08:16.659991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-daf92e1e-1838-45c5-b5f1-34a91a883af7 req-9b30abbb-467d-4320-ac3e-d0d5532656e3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054759 Jul 25 16:08:16.662351 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 576/1098] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:16.675327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-802eaca2-8e0a-4a35-a6e7-f60027b04de0 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:16.733402 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-802eaca2-8e0a-4a35-a6e7-f60027b04de0 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.066926 Jul 25 16:08:16.736694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 577/1099] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:08:16 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:16.773764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58d6bb59-005c-4218-8c58-3815e6338362 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-189390448", "id": 580279230, "os-flavor-access:is_public": "False"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:16.778080 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:16.778080 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:16.802465 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-58d6bb59-005c-4218-8c58-3815e6338362 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.034627 Jul 25 16:08:16.805046 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 578/1100] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:16 2022] POST /compute/v2.1/flavors => generated 437 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:16.823965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43e4f89b-f9b7-4dab-ae81-0ab6235f8f04 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "584672a20dcd4ef09fef7da0ac345930"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:16.826760 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:16.826760 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:16.958786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-43e4f89b-f9b7-4dab-ae81-0ab6235f8f04 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] HTTP exception thrown: Flavor access not found for 39 / 584672a20dcd4ef09fef7da0ac345930 combination. Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43e4f89b-f9b7-4dab-ae81-0ab6235f8f04 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Request method failure captured: Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/flavors/580279230/action HTTP/1.1 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 70 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_muVY5eme--bEHH4hY9cBMoH9Xzr_z9a-fxUboicgwmWYzrHXgwiN5fp218CdAoB-KFjbEdyJjC4Uwcq-HGYInB265Igc6FW_Lo_rT_e7HXYCaHTs4rdtIorx6N6rfDjWoi0F1mZCtDVle13C-1jF6pe2epaC4enVXyj_USGw8L8M Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9a21f9913f7f458a8e4c41fd2eeb81ec Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9a21f9913f7f458a8e4c41fd2eeb81ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9a21f9913f7f458a8e4c41fd2eeb81ec"}]}] Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9a21f9913f7f458a8e4c41fd2eeb81ec Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2910b60c40134013bddfee56ded56ff5 Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: {"removeTenantAccess": {"tenant": "584672a20dcd4ef09fef7da0ac345930"}} Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor access not found for 39 / 584672a20dcd4ef09fef7da0ac345930 combination. Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '580279230', 'body': {'removeTenantAccess': {'tenant': '584672a20dcd4ef09fef7da0ac345930'}}} Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 584672a20dcd4ef09fef7da0ac345930 combination. Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:16.960623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 584672a20dcd4ef09fef7da0ac345930 combination. Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 584672a20dcd4ef09fef7da0ac345930 combination. Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43e4f89b-f9b7-4dab-ae81-0ab6235f8f04 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Returning 404 to user: Flavor access not found for 39 / 584672a20dcd4ef09fef7da0ac345930 combination. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-43e4f89b-f9b7-4dab-ae81-0ab6235f8f04 tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/580279230/action" status: 404 len: 124 microversion: 2.1 time: 0.148805 Jul 25 16:08:16.973008 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 579/1101] 10.222.0.105 () {60 vars in 1202 bytes} [Mon Jul 25 16:08:16 2022] POST /compute/v2.1/flavors/580279230/action => generated 124 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:08:16.981922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:16.982401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:16.991151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:17.002309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:17.003247 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-654eb413-621d-43dc-a9dc-dfedf14340b0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 1.119514 Jul 25 16:08:17.004895 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 523/1102] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:15 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:17.007362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:17.008916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:17.009712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:17.029760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:17.031138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:17.047806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:17.048686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:17.049826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:17.050691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:17.842168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:17.853338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:17.868304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:17.868890 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97e13807-b827-4308-9f7f-5b1c843e85df tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1472 microversion: 2.1 time: 0.898389 Jul 25 16:08:17.872440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:17.876019 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-faa82252-3c96-43a2-9213-553cd65f14ca tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.863005 Jul 25 16:08:17.877635 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 524/1103] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:17 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:17.893308 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 580/1104] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:16 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1472 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:17.893308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6d00b9a-725b-4e52-8cc8-0514fca57d9d tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:17.893308 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:17.893308 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:17.949922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6d00b9a-725b-4e52-8cc8-0514fca57d9d tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/580279230" status: 202 len: 0 microversion: 2.1 time: 0.068653 Jul 25 16:08:17.950808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 581/1105] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:08:17 2022] DELETE /compute/v2.1/flavors/580279230 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:17.971200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-545a008e-464a-47ae-b949-7a6745d7249c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:18.006272 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-545a008e-464a-47ae-b949-7a6745d7249c tempest-FlavorsAccessNegativeTestJSON-1317402065 tempest-FlavorsAccessNegativeTestJSON-1317402065-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.045816 Jul 25 16:08:18.008243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 525/1106] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:08:17 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:18.032386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:18.047167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:18.083807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:18.084356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:18.085334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:18.085823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:18.763512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:18.774404 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-442a743d-bd79-4c9d-945a-2fee5a0d3fd5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.751003 Jul 25 16:08:18.783600 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 582/1107] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:18 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:08:18.949402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:18.955683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:18.957861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:18.964337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:18.999426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:19.002237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:19.004254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:19.008475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:19.013290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:19.016362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:19.018567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:19.021540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:19.857996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:19.873427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:19.882682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:19.885468 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d90e8f4d-4809-4b17-801f-205f80b50179 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.951447 Jul 25 16:08:19.890763 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 526/1108] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:18 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:19.896912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:19.902788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:19.939370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:19.940806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:19.942789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:19.943860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:20.097674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:20.107480 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3387a2d-ff26-49b2-a8d7-a697d984a658 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1538 microversion: 2.1 time: 1.171593 Jul 25 16:08:20.108579 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 583/1109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:18 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1538 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:20.151632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8289af72-4bb4-486d-9f72-9dff4209b402 req-65c49eae-ddbe-4d97-bd1a-18d98015ba36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "name": "network-vif-unplugged", "status": "completed", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:20.177841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8289af72-4bb4-486d-9f72-9dff4209b402 req-65c49eae-ddbe-4d97-bd1a-18d98015ba36 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:20.178597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8289af72-4bb4-486d-9f72-9dff4209b402 req-65c49eae-ddbe-4d97-bd1a-18d98015ba36 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:20.239459 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8289af72-4bb4-486d-9f72-9dff4209b402 req-65c49eae-ddbe-4d97-bd1a-18d98015ba36 service nova] Creating event network-vif-unplugged:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:08:20.275376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-8289af72-4bb4-486d-9f72-9dff4209b402 req-65c49eae-ddbe-4d97-bd1a-18d98015ba36 service nova] Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:08:20.290378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8289af72-4bb4-486d-9f72-9dff4209b402 req-65c49eae-ddbe-4d97-bd1a-18d98015ba36 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144895 Jul 25 16:08:20.291418 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 584/1110] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:08:20.460628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:20.475542 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f481b54-129a-49bd-b243-9b667c7a20bc tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.583203 Jul 25 16:08:20.476367 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 527/1111] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:19 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:20.954203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:20.956271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:20.973625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:20.974838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:20.988029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:20.989303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:21.146303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:21.147205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:21.172707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:21.178362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:21.182676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:21.185408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:21.657265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:21.679494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:21.685371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:21.692107 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ea9df18-8d7c-4e5b-853f-4c5a5b7db447 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.743073 Jul 25 16:08:21.693230 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 585/1112] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:20 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:21.753226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:21.780160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-526b9420-50a2-43d5-9925-f1642b6b7b76 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1538 microversion: 2.1 time: 0.638047 Jul 25 16:08:21.800691 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 528/1113] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:21 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1538 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:21.823753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:21.824413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:21.840532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:21.841278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:21.843072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:21.844128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.185009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:22.256753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-444139f6-62c4-4ec8-ad75-63796c63abb8 tempest-AbsoluteLimitsTestJSON-272583270 tempest-AbsoluteLimitsTestJSON-272583270-project] Calling method '.version_select at 0x7f9d93584dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:22.271831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=14,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:22.307619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444139f6-62c4-4ec8-ad75-63796c63abb8 tempest-AbsoluteLimitsTestJSON-272583270 tempest-AbsoluteLimitsTestJSON-272583270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.309451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444139f6-62c4-4ec8-ad75-63796c63abb8 tempest-AbsoluteLimitsTestJSON-272583270 tempest-AbsoluteLimitsTestJSON-272583270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.313473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444139f6-62c4-4ec8-ad75-63796c63abb8 tempest-AbsoluteLimitsTestJSON-272583270 tempest-AbsoluteLimitsTestJSON-272583270-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.314731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444139f6-62c4-4ec8-ad75-63796c63abb8 tempest-AbsoluteLimitsTestJSON-272583270 tempest-AbsoluteLimitsTestJSON-272583270-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.334749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:22.352198 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3051e05f-8020-48bc-a010-cefdcf13dc00 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.549239 Jul 25 16:08:22.373509 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 529/1114] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:21 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:22.401117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-444139f6-62c4-4ec8-ad75-63796c63abb8 tempest-AbsoluteLimitsTestJSON-272583270 tempest-AbsoluteLimitsTestJSON-272583270-project] 10.222.0.105 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.701370 Jul 25 16:08:22.412898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 586/1115] 10.222.0.105 () {58 vars in 1127 bytes} [Mon Jul 25 16:08:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:22.506760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fadbcad6-2ada-4482-b66d-d33c13c5e5a3 req-b044de3f-52dc-40a0-8c46-35af0175aaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa11af2-1b5a-4c22-b916-9d53e152cffe", "name": "network-vif-plugged", "status": "completed", "tag": "a875d74f-57a5-4529-bdf5-db5297e5aa89"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:22.526506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:22.529487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fadbcad6-2ada-4482-b66d-d33c13c5e5a3 req-b044de3f-52dc-40a0-8c46-35af0175aaba service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.530274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fadbcad6-2ada-4482-b66d-d33c13c5e5a3 req-b044de3f-52dc-40a0-8c46-35af0175aaba service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.549080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fadbcad6-2ada-4482-b66d-d33c13c5e5a3 req-b044de3f-52dc-40a0-8c46-35af0175aaba service nova] Creating event network-vif-plugged:a875d74f-57a5-4529-bdf5-db5297e5aa89 for instance eaa11af2-1b5a-4c22-b916-9d53e152cffe on n-h2-846219-13 Jul 25 16:08:22.559338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fadbcad6-2ada-4482-b66d-d33c13c5e5a3 req-b044de3f-52dc-40a0-8c46-35af0175aaba service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057899 Jul 25 16:08:22.562132 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 530/1116] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:08:22.745874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:22.753227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:22.801476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.803531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.805966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.807122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.820312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:22.821156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:22.840277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=26 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:22.842719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.843262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:22.852651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:22.853457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:23.439974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:23.465582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:23.471120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:23.475838 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f7f03805-7f19-4b94-b1c6-40acbc9aa872 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.746818 Jul 25 16:08:23.478068 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 587/1117] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:22 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:23.491516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:23.493610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:23.511899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:23.526412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:23.528136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-02c39364-c685-4eda-b730-031278fda86d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1538 microversion: 2.1 time: 0.712670 Jul 25 16:08:23.528718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:23.529502 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 531/1118] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:22 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1538 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:08:23.533145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:23.534048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:23.924926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e3ba480e-a95b-49cc-a111-c4da5d9d59c3 req-c9994326-c954-40d1-a713-527ac4bb063a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892f287-45bd-4633-8dfa-f97af06d18ef", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8b5a7f-edcb-4942-a38e-1daba14ba065"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:23.950115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e3ba480e-a95b-49cc-a111-c4da5d9d59c3 req-c9994326-c954-40d1-a713-527ac4bb063a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:23.950672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e3ba480e-a95b-49cc-a111-c4da5d9d59c3 req-c9994326-c954-40d1-a713-527ac4bb063a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:23.978927 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e3ba480e-a95b-49cc-a111-c4da5d9d59c3 req-c9994326-c954-40d1-a713-527ac4bb063a service nova] Creating event network-vif-unplugged:3e8b5a7f-edcb-4942-a38e-1daba14ba065 for instance 7892f287-45bd-4633-8dfa-f97af06d18ef on n-h2-846219-13 Jul 25 16:08:23.995083 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e3ba480e-a95b-49cc-a111-c4da5d9d59c3 req-c9994326-c954-40d1-a713-527ac4bb063a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074595 Jul 25 16:08:23.996361 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 532/1119] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:08:24.215938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:24.225615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d94e07c1-c864-421f-a5aa-25343bbf3c0a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1318 microversion: 2.1 time: 0.745283 Jul 25 16:08:24.231443 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 588/1120] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:23 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:24.510875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:24.512299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:24.529158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:24.529986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:24.531292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:24.542388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:24.559780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:24.566872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:24.601690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:24.614834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:24.615470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:24.615933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:26.121531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:26.140789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:26.147246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:26.150193 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae6b2341-febf-459a-9997-a75e98463a10 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 1.653044 Jul 25 16:08:26.153168 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 533/1121] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:24 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:26.156972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:26.175585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64c6102e-3de0-4ef0-bdcf-36c2ff142f2a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1538 microversion: 2.1 time: 1.623672 Jul 25 16:08:26.184445 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 589/1122] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:24 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1538 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:26.190299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:26.192538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:26.202117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:26.204753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:26.206721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:26.207956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:26.845977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:26.861279 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-983d4d0c-0249-4e26-986a-626ce00b2707 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1505 microversion: 2.1 time: 0.698852 Jul 25 16:08:26.862851 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 534/1123] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:26 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1505 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:26.897888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:26.898865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:26.916675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:26.917812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:26.920211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:26.921531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:26.965341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-203227047", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "bf7cffd1-c01b-4e38-b71f-ae1a06a7d37a"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:27.112011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] validate_networks() for [('bf7cffd1-c01b-4e38-b71f-ae1a06a7d37a', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:08:27.143207 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04019ad8-93d9-4583-b8dd-2ee3513118d1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe/action" status: 202 len: 0 microversion: 2.1 time: 0.260764 Jul 25 16:08:27.168597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 535/1124] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:08:26 2022] POST /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:27.208358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:27.210862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:27.234801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:27.236165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:27.237871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:27.239224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:27.990222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:28.001789 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da197ce1-24cc-47b4-b95a-87df0f9e14c4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1510 microversion: 2.1 time: 0.831626 Jul 25 16:08:28.010171 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 536/1125] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:27 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1510 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:28.019059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:28.068943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:28.092885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:28.094842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:28.098382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:28.099421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:28.828512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:28.842370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:28.844326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:28.846074 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60c28d68-a446-4285-bea9-e04c0d7650d8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1570 microversion: 2.25 time: 0.833582 Jul 25 16:08:28.847572 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 537/1126] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:28 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1570 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:28.854607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:28.855534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:28.864017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:28.865242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:28.866498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:28.867274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:28.877825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:29.500015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:08:29.501364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:08:29.504024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:08:29.504794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:08:29.505463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:08:29.517577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=31 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:29.530664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:29.531570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:29.534701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:29.540064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:29.596519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Getting quotas for project c246f2da81744207af71ec9a7309b6c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:29.606813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Getting quotas for user 716f20a451c046f29d68d5fe43c35d45 and project c246f2da81744207af71ec9a7309b6c0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:29.624005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:08:29.641613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:08:29.698311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:29.739674 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6cfaeacf-f841-4e44-917f-c5105719cd3e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1531 microversion: 2.1 time: 0.890677 Jul 25 16:08:29.741666 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25072376-d177-4954-a45e-fbf1371a441e tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.21 time: 3.234301 Jul 25 16:08:29.744678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 590/1127] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:08:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 3242 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:08:29.767645 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 538/1128] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:28 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1531 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:29.783779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:29.791939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:29.807055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:29.807925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:29.809982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:29.810785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:30.151935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:30.164392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da49893e-02e2-479a-89c3-d880775732be tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1490 microversion: 2.1 time: 0.405672 Jul 25 16:08:30.165332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 539/1129] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:29 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1490 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:30.264993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b33c19e2-af60-485d-a5fc-2b4ba9ca87c3 req-05c10d83-7a2e-463e-98ab-fb835bb0dfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "name": "network-vif-plugged", "status": "completed", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:30.280829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b33c19e2-af60-485d-a5fc-2b4ba9ca87c3 req-05c10d83-7a2e-463e-98ab-fb835bb0dfd4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:30.282336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b33c19e2-af60-485d-a5fc-2b4ba9ca87c3 req-05c10d83-7a2e-463e-98ab-fb835bb0dfd4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:30.299682 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b33c19e2-af60-485d-a5fc-2b4ba9ca87c3 req-05c10d83-7a2e-463e-98ab-fb835bb0dfd4 service nova] Creating event network-vif-plugged:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:08:30.310651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b33c19e2-af60-485d-a5fc-2b4ba9ca87c3 req-05c10d83-7a2e-463e-98ab-fb835bb0dfd4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.563405 Jul 25 16:08:30.318514 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 591/1130] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:30.350292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59746b8a-aec4-4f01-84f6-5189560bc249 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:30.352034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59746b8a-aec4-4f01-84f6-5189560bc249 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:30.357856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14bf3602-8b0e-41a7-83fc-6c11967927c2 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2051979052", "ram": 512, "vcpus": 1, "disk": 10, "id": 731716627, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:30.373527 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:30.373527 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:30.417400 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14bf3602-8b0e-41a7-83fc-6c11967927c2 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.250220 Jul 25 16:08:30.418343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 540/1131] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:30 2022] POST /compute/v2.1/flavors => generated 415 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:30.426676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:30.427628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:30.451799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:30.454783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:30.461559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:30.462521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:30.554611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59746b8a-aec4-4f01-84f6-5189560bc249 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:30.564620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59746b8a-aec4-4f01-84f6-5189560bc249 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:30.571892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59746b8a-aec4-4f01-84f6-5189560bc249 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:30.581961 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59746b8a-aec4-4f01-84f6-5189560bc249 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1262 microversion: 2.21 time: 0.261511 Jul 25 16:08:30.583289 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 592/1132] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:30 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1262 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:30.594516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:30.595918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:30.619917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:30.620907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:30.624306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:30.627619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:32.096301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:32.122052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57a125f3-6f76-47c8-9aea-ee9229d7f283 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1531 microversion: 2.1 time: 1.702084 Jul 25 16:08:32.141977 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 541/1133] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:30 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1531 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:32.168031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:32.169676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:32.182090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:32.183983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:32.185796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:32.186817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:32.230910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:32.256434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:32.265755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:08:32.270154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:32.272735 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2f038352-1d18-43ce-93b4-27824e56e609 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1545 microversion: 2.25 time: 1.687747 Jul 25 16:08:32.280760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 593/1134] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:30 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1545 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:32.677134 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99dc239f-0715-455d-b1cc-57c2eca2b12a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 204 len: 0 microversion: 2.1 time: 0.532570 Jul 25 16:08:32.684652 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 542/1135] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:08:32 2022] DELETE /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:08:32.712817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:32.729227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:32.766095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:32.768934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:32.771913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b227bb2-4994-47af-b065-ee82ac66183f tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:32.775955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:32.779369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:32.808739 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1b227bb2-4994-47af-b065-ee82ac66183f tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] HTTP exception thrown: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b227bb2-4994-47af-b065-ee82ac66183f tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Request method failure captured: Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/flavors/731716627/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_7HFcYnhYYSnwrozDD-E7FLZf5dKTOatqj5-z3XSYfKIEd8rRAsakS27srhLv9NDPgXncg1Y9R7plds6IL3cnf_K4cWfK1bauE7MAL_PCECz2CZcWmkp_-G2Y4R8Y8zbfJ7Xk2zGZHL3wKFzd0A5_RJpgnW1U2vkh-7kJ-4aSvmew Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/608b2efb044c462aa76833fa56649752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_608b2efb044c462aa76833fa56649752"}]}] Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 85b1ca59ff3542969af4a9132a763ef1 Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'flavor_id': '731716627', 'id': 'hw:cpu_thread_policy'} Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:32.821956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.835493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b227bb2-4994-47af-b065-ee82ac66183f tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Returning 404 to user: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:32.838884 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b227bb2-4994-47af-b065-ee82ac66183f tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] 10.222.0.105 "GET /compute/v2.1/flavors/731716627/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.555910 Jul 25 16:08:32.845370 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 594/1136] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:08:32 2022] GET /compute/v2.1/flavors/731716627/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 563 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:32.881194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-352693bf-2411-479c-8e56-6a8c98c30cf0 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:32.887662 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:32.887662 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:08:32.946054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-352693bf-2411-479c-8e56-6a8c98c30cf0 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] HTTP exception thrown: Flavor 77811395-edf2-44da-bdf7-fd1f71dfef14 could not be found. Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-352693bf-2411-479c-8e56-6a8c98c30cf0 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Request method failure captured: Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/flavors/77811395-edf2-44da-bdf7-fd1f71dfef14 HTTP/1.1 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r71kH_t04nrLj9vrimfZZUSxkL0er4WMZMwWW9OtV0Qu9c1TSt21Jcg9rN4fnzL7X8y_Pwib9tHauX9xMQx1yvcAS2nVORIChGP7TYwRUo_4Vhe4s8dgPRPxON-hUmb0IPKo2H8sePA3Nhzubt8tshRjTUCOktu7_8ejNxA-SqrbF4 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 78157dcf2d3a4a408b54fd46372adc92 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MigrationsAdminTest-1673509893 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/78157dcf2d3a4a408b54fd46372adc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/78157dcf2d3a4a408b54fd46372adc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/78157dcf2d3a4a408b54fd46372adc92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_78157dcf2d3a4a408b54fd46372adc92"}]}] Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MigrationsAdminTest-1673509893 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 78157dcf2d3a4a408b54fd46372adc92 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MigrationsAdminTest-1673509893 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MigrationsAdminTest-1673509893-project-admin Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 753235f1e4f74066bee93c09fe8c4676 Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MigrationsAdminTest-1673509893-project-admin Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor 77811395-edf2-44da-bdf7-fd1f71dfef14 could not be found. Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '77811395-edf2-44da-bdf7-fd1f71dfef14'} Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 77811395-edf2-44da-bdf7-fd1f71dfef14 could not be found. Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 77811395-edf2-44da-bdf7-fd1f71dfef14 could not be found. Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.957985 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 77811395-edf2-44da-bdf7-fd1f71dfef14 could not be found. Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-352693bf-2411-479c-8e56-6a8c98c30cf0 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Returning 404 to user: Flavor 77811395-edf2-44da-bdf7-fd1f71dfef14 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:32.966297 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-352693bf-2411-479c-8e56-6a8c98c30cf0 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/77811395-edf2-44da-bdf7-fd1f71dfef14" status: 404 len: 109 microversion: 2.1 time: 0.113141 Jul 25 16:08:32.974587 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 595/1137] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:08:32 2022] DELETE /compute/v2.1/flavors/77811395-edf2-44da-bdf7-fd1f71dfef14 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:33.014860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-552f3c10-4ce0-4158-999f-dba24991bbef tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '.version_select at 0x7f9d93574ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:33.029168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-552f3c10-4ce0-4158-999f-dba24991bbef tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:33.029980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-552f3c10-4ce0-4158-999f-dba24991bbef tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:33.103324 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-552f3c10-4ce0-4158-999f-dba24991bbef tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 2989 microversion: 2.25 time: 0.126703 Jul 25 16:08:33.117214 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 596/1138] 10.222.0.105 () {60 vars in 1189 bytes} [Mon Jul 25 16:08:32 2022] GET /compute/v2.1/os-migrations => generated 2989 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:33.135431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:33.144890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:33.177984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:33.178592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:33.181815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:33.187048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:33.495097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:33.508968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:33.510948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:33.512337 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-adc36340-cdd7-4874-81cc-f60e00a599fb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1322 microversion: 2.21 time: 0.826139 Jul 25 16:08:33.513485 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 543/1139] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:32 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1322 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:33.519137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-715c2bd9-a00d-479e-968c-1a12768176e2 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:33.522804 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:33.522804 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:33.524320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-715c2bd9-a00d-479e-968c-1a12768176e2 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '85b1ca59ff3542969af4a9132a763ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b2efb044c462aa76833fa56649752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-715c2bd9-a00d-479e-968c-1a12768176e2 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Request method failure captured: Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/flavors/731716627/os-extra_specs HTTP/1.1 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 66 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_7HFcYnhYYSnwrozDD-E7FLZf5dKTOatqj5-z3XSYfKIEd8rRAsakS27srhLv9NDPgXncg1Y9R7plds6IL3cnf_K4cWfK1bauE7MAL_PCECz2CZcWmkp_-G2Y4R8Y8zbfJ7Xk2zGZHL3wKFzd0A5_RJpgnW1U2vkh-7kJ-4aSvmew Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/608b2efb044c462aa76833fa56649752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_608b2efb044c462aa76833fa56649752"}]}] Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 85b1ca59ff3542969af4a9132a763ef1 Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '731716627', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:08:33.526979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 16:08:33.531152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:33.532969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-715c2bd9-a00d-479e-968c-1a12768176e2 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:33.534254 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-715c2bd9-a00d-479e-968c-1a12768176e2 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] 10.222.0.105 "POST /compute/v2.1/flavors/731716627/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019367 Jul 25 16:08:33.535456 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 544/1140] 10.222.0.105 () {60 vars in 1226 bytes} [Mon Jul 25 16:08:33 2022] POST /compute/v2.1/flavors/731716627/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:33.542671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:33.543730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:33.553754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:33.554703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:33.555924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:33.556373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:33.866957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:33.898701 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2425aa95-8ea8-4269-b33f-c0918a1f4232 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1496 microversion: 2.1 time: 0.776425 Jul 25 16:08:33.902904 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 597/1141] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:33 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1496 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:33.913667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1200559684", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:33.986290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 7892f287-45bd-4633-8dfa-f97af06d18ef {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:08:34.037804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41d7829d-7269-402f-8fb4-c9c6a11f755b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 2039 microversion: 2.25 time: 0.500659 Jul 25 16:08:34.044100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 545/1142] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:33 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 2039 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:34.069053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8adb587b-111f-4b8c-9106-a548c787cb85 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:34.082038 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:34.082038 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:34.103173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:08:34.157166 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8adb587b-111f-4b8c-9106-a548c787cb85 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/731716627/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106852 Jul 25 16:08:34.158587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 546/1143] 10.222.0.105 () {60 vars in 1226 bytes} [Mon Jul 25 16:08:34 2022] POST /compute/v2.1/flavors/731716627/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:08:34.168502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23482bd4-2dd8-406f-a2af-d8a0d5ef44e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Action: 'create', calling method: .version_select at 0x7f9d93a46670>, body: {"keypair": {"name": "tempest-keypair-341799139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBvaPMXBQNTW1Ah5dHqDlFovs/QHk6ksQthqDPmj1CC8whLE4I7PFcwg9L96ugY5S27h+wEeA9L3oFTdT99el/3OEZJEVWP/fTljnILSdC2ljqvdy0itVNqEbxLfdy3mA=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:34.219149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-23482bd4-2dd8-406f-a2af-d8a0d5ef44e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:34.231147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-23482bd4-2dd8-406f-a2af-d8a0d5ef44e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for user f3a2bf8f94f44b78a80c37bc8b370726 and project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:34.287511 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23482bd4-2dd8-406f-a2af-d8a0d5ef44e7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.126593 Jul 25 16:08:34.288447 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 547/1144] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:08:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:34.308573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4738b2c1-cbfb-44a4-b18f-4e7071880516 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:34.310632 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:34.310632 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:34.312841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4738b2c1-cbfb-44a4-b18f-4e7071880516 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '85b1ca59ff3542969af4a9132a763ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b2efb044c462aa76833fa56649752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4738b2c1-cbfb-44a4-b18f-4e7071880516 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Request method failure captured: Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_7HFcYnhYYSnwrozDD-E7FLZf5dKTOatqj5-z3XSYfKIEd8rRAsakS27srhLv9NDPgXncg1Y9R7plds6IL3cnf_K4cWfK1bauE7MAL_PCECz2CZcWmkp_-G2Y4R8Y8zbfJ7Xk2zGZHL3wKFzd0A5_RJpgnW1U2vkh-7kJ-4aSvmew Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/608b2efb044c462aa76833fa56649752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_608b2efb044c462aa76833fa56649752"}]}] Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 85b1ca59ff3542969af4a9132a763ef1 Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '731716627', 'id': 'hw:numa_nodes'} Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.317839 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.326467 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.326467 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.326467 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:08:34.326467 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:08:34.326467 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 16:08:34.326467 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.334183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4738b2c1-cbfb-44a4-b18f-4e7071880516 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:34.335545 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4738b2c1-cbfb-44a4-b18f-4e7071880516 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] 10.222.0.105 "DELETE /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034954 Jul 25 16:08:34.336596 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 548/1145] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:08:34 2022] DELETE /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes => generated 124 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:34.348657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-738fe896-d9e0-443c-9718-bcc0d6489e0f tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:34.433751 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-738fe896-d9e0-443c-9718-bcc0d6489e0f tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors/731716627/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083856 Jul 25 16:08:34.435035 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 549/1146] 10.222.0.105 () {60 vars in 1226 bytes} [Mon Jul 25 16:08:34 2022] POST /compute/v2.1/flavors/731716627/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 16:08:34.450986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80d96150-3e22-46ac-bce8-443cc750a227 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:34.459023 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:34.459023 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:34.464813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80d96150-3e22-46ac-bce8-443cc750a227 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '85b1ca59ff3542969af4a9132a763ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608b2efb044c462aa76833fa56649752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80d96150-3e22-46ac-bce8-443cc750a227 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Request method failure captured: Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 22 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_7HFcYnhYYSnwrozDD-E7FLZf5dKTOatqj5-z3XSYfKIEd8rRAsakS27srhLv9NDPgXncg1Y9R7plds6IL3cnf_K4cWfK1bauE7MAL_PCECz2CZcWmkp_-G2Y4R8Y8zbfJ7Xk2zGZHL3wKFzd0A5_RJpgnW1U2vkh-7kJ-4aSvmew Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/608b2efb044c462aa76833fa56649752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/608b2efb044c462aa76833fa56649752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_608b2efb044c462aa76833fa56649752"}]}] Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 608b2efb044c462aa76833fa56649752 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 85b1ca59ff3542969af4a9132a763ef1 Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: {"hw:numa_nodes": "1"} Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '731716627', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 16:08:34.485286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 16:08:34.489431 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.494648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80d96150-3e22-46ac-bce8-443cc750a227 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:34.495879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80d96150-3e22-46ac-bce8-443cc750a227 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815 tempest-FlavorsExtraSpecsNegativeTestJSON-36464815-project] 10.222.0.105 "PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.049832 Jul 25 16:08:34.497637 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 550/1147] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:08:34 2022] PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes => generated 124 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:34.509869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea71126d-6c04-4cfe-88ca-5b0e07d7b5cc tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:34.520330 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ea71126d-6c04-4cfe-88ca-5b0e07d7b5cc tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] HTTP exception thrown: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea71126d-6c04-4cfe-88ca-5b0e07d7b5cc tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Request method failure captured: Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/flavors/731716627/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_8SbMbXpQhyl1x404hoJ-InIFLYCLhTTlrTdc3Syk1NczclXpm1FP0PQ-UDaf-1jVCBtNqLPsnhxUDsRe3-h4Xpqp7qYQ74VY408JvB6v6xr1RtHVgu9BNE9pJDde2X0EKBt2UYJaDf_XU1d9WQmYXShTeFAUD2x3mCvkU9ExJ8T8 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 11e86b72ab2a4117bb5c3fd61d4ecd9f Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}] Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 11e86b72ab2a4117bb5c3fd61d4ecd9f Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a7c30b1b88d146499965aebd9fbb6700 Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: exception: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '731716627', 'id': 'hw:cpu_thread_policy'} Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. Jul 25 16:08:34.523242 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.532117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea71126d-6c04-4cfe-88ca-5b0e07d7b5cc tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Returning 404 to user: Flavor 731716627 has no extra specs with key hw:cpu_thread_policy. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:34.533610 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea71126d-6c04-4cfe-88ca-5b0e07d7b5cc tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/731716627/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.027571 Jul 25 16:08:34.534446 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 551/1148] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:08:34 2022] DELETE /compute/v2.1/flavors/731716627/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:34.558634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de70c23f-c35c-4160-82ab-9d2f91e99366 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:34.574344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-de70c23f-c35c-4160-82ab-9d2f91e99366 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de70c23f-c35c-4160-82ab-9d2f91e99366 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Request method failure captured: Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 27 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_8SbMbXpQhyl1x404hoJ-InIFLYCLhTTlrTdc3Syk1NczclXpm1FP0PQ-UDaf-1jVCBtNqLPsnhxUDsRe3-h4Xpqp7qYQ74VY408JvB6v6xr1RtHVgu9BNE9pJDde2X0EKBt2UYJaDf_XU1d9WQmYXShTeFAUD2x3mCvkU9ExJ8T8 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 11e86b72ab2a4117bb5c3fd61d4ecd9f Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}] Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 11e86b72ab2a4117bb5c3fd61d4ecd9f Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a7c30b1b88d146499965aebd9fbb6700 Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: {"hw:cpu_policy": "shared"} Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: exception: Request body and URI mismatch Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '731716627', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 25 16:08:34.583420 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:34.590994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de70c23f-c35c-4160-82ab-9d2f91e99366 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:34.590994 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de70c23f-c35c-4160-82ab-9d2f91e99366 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.041499 Jul 25 16:08:34.602267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 552/1149] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:08:34 2022] PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:08:34.626156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:34.630103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:34.673060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:34.678329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:34.681166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:34.682340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:34.987331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:35.000924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:35.002935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:35.004136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9051c65e-4e27-4ba1-8be9-e4909ea4da1c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1320 microversion: 2.21 time: 0.399947 Jul 25 16:08:35.027624 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 553/1150] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:34 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1320 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:35.043849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-198357a6-de97-4f2c-9163-de6578ad52f6 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-198357a6-de97-4f2c-9163-de6578ad52f6 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Request method failure captured: Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 49 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_8SbMbXpQhyl1x404hoJ-InIFLYCLhTTlrTdc3Syk1NczclXpm1FP0PQ-UDaf-1jVCBtNqLPsnhxUDsRe3-h4Xpqp7qYQ74VY408JvB6v6xr1RtHVgu9BNE9pJDde2X0EKBt2UYJaDf_XU1d9WQmYXShTeFAUD2x3mCvkU9ExJ8T8 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 11e86b72ab2a4117bb5c3fd61d4ecd9f Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_11e86b72ab2a4117bb5c3fd61d4ecd9f"}]}] Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 11e86b72ab2a4117bb5c3fd61d4ecd9f Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a7c30b1b88d146499965aebd9fbb6700 Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'flavor_id': '731716627', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance: Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:08:35.051828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 16:08:35.057358 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:35.069900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-198357a6-de97-4f2c-9163-de6578ad52f6 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:35.071567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-198357a6-de97-4f2c-9163-de6578ad52f6 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.042081 Jul 25 16:08:35.078133 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 554/1151] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:08:35 2022] PUT /compute/v2.1/flavors/731716627/os-extra_specs/hw:numa_nodes => generated 117 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:08:35.079728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:35.080834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:35.101085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:35.101710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:35.102712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:35.107243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:35.984084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:08:35.986111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:08:35.986607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:08:35.987022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:08:35.987442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:08:35.992281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:36.006447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da0cdaff-6096-4606-9bd6-9085dc9aa9c9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1496 microversion: 2.1 time: 0.930564 Jul 25 16:08:36.009245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:36.010237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:36.011499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:36.012115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:36.023460 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 555/1152] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:35 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1496 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:36.033922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c943e113-5a6f-4d01-99cd-470f99bf483d tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:36.035501 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:08:36.035501 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:08:36.065832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:36.085542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Getting quotas for user 797cc3e401c3492187cd37395c534d3c and project d9f0fc04dc474012a154839ce32e979d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:36.086396 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c943e113-5a6f-4d01-99cd-470f99bf483d tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/731716627" status: 202 len: 0 microversion: 2.1 time: 0.061294 Jul 25 16:08:36.090297 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 556/1153] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:08:36 2022] DELETE /compute/v2.1/flavors/731716627 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:36.111225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:36.113202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:36.116510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:08:36.118949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:08:36.127922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:36.129048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:36.130872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:36.131906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:36.232887 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e52d787-a564-41cc-9f90-fcecc95fa54a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.327505 Jul 25 16:08:36.237548 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 598/1154] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:08:36.252095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cd9333e2-68f5-4cc8-9843-0b51aeb1fd4a tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:36.320454 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cd9333e2-68f5-4cc8-9843-0b51aeb1fd4a tempest-FlavorsExtraSpecsNegativeTestJSON-912665720 tempest-FlavorsExtraSpecsNegativeTestJSON-912665720-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.080872 Jul 25 16:08:36.322817 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 599/1155] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:08:36 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:36.333205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e5caf5e-2c2e-4c81-87d4-934491a8d70d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:36.335988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e5caf5e-2c2e-4c81-87d4-934491a8d70d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:36.705648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e5caf5e-2c2e-4c81-87d4-934491a8d70d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:36.721045 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e5caf5e-2c2e-4c81-87d4-934491a8d70d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1217 microversion: 2.1 time: 0.395278 Jul 25 16:08:36.723455 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 600/1156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:36 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1217 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:37.035501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:37.038807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:37.060343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:37.061434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:37.068692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:37.075992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:37.122075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:37.153463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:37.170896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:37.179846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:37.181240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a0044eb-0a9d-4444-9218-4eed3d6853f4 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 1.088962 Jul 25 16:08:37.213842 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 557/1157] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:36 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:37.762580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:37.763201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:37.777455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:37.782502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:37.785238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:37.795126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:38.136507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:38.157863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4333f615-01c8-4d16-b2e9-6e4f152c0442 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1213 microversion: 2.1 time: 0.398797 Jul 25 16:08:38.160147 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 558/1158] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:37 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1213 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:08:38.242982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:38.255762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:38.257496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:38.289596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ffc7628-a119-4b95-96e2-57b18daa1697 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1496 microversion: 2.1 time: 1.260002 Jul 25 16:08:38.293728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:38.294537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:38.299495 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 601/1159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:37 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1496 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:08:38.305363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:38.306767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.214282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:39.216118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:39.228731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:39.229780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.231557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:39.232431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.552848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:39.607314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a184d99-bdcf-4172-9202-75534c402e9d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1275 microversion: 2.1 time: 0.401402 Jul 25 16:08:39.627738 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 602/1160] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:39 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1275 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:39.643568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:39.644301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:39.665198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:39.665760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.666626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:39.667407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.744835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:39.796358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:39.808733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:39.813375 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-416645f1-0d49-4b4f-85fb-8fef976e8d06 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 1.577728 Jul 25 16:08:39.820416 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 559/1161] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:38 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:39.831993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:39.833156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:39.846569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:39.847828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.849047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:39.849802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:39.965517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:39.986006 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f11cd916-92d9-4b4c-a872-92aba4ace7b9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 200 len: 1288 microversion: 2.1 time: 0.354162 Jul 25 16:08:39.989771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 603/1162] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:39 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 1288 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:40.008346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b062b683-e51f-48a1-903d-3f3fd760373c req-b7a0d8a5-73ab-4d53-b8e2-60c205e8421e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa11af2-1b5a-4c22-b916-9d53e152cffe", "name": "network-vif-deleted", "tag": "a875d74f-57a5-4529-bdf5-db5297e5aa89"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:40.065773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b062b683-e51f-48a1-903d-3f3fd760373c req-b7a0d8a5-73ab-4d53-b8e2-60c205e8421e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:40.067736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b062b683-e51f-48a1-903d-3f3fd760373c req-b7a0d8a5-73ab-4d53-b8e2-60c205e8421e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:40.123622 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b062b683-e51f-48a1-903d-3f3fd760373c req-b7a0d8a5-73ab-4d53-b8e2-60c205e8421e service nova] Creating event network-vif-deleted:a875d74f-57a5-4529-bdf5-db5297e5aa89 for instance eaa11af2-1b5a-4c22-b916-9d53e152cffe on n-h2-846219-13 Jul 25 16:08:40.147009 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b062b683-e51f-48a1-903d-3f3fd760373c req-b7a0d8a5-73ab-4d53-b8e2-60c205e8421e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154998 Jul 25 16:08:40.152019 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 604/1163] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:40.359550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1611230832", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "ac4d8f52-90dc-4983-890c-821ba313bf21"}], "security_groups": [{"name": "tempest-securitygroup--1201827745"}], "key_name": "tempest-keypair-341799139", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:40.774488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:40.806942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:40.810279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:40.813412 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52159a1b-1436-4101-9d1c-245226b92962 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2952 microversion: 2.32 time: 0.990947 Jul 25 16:08:40.815642 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 560/1164] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:39 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2952 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:40.832789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:40.834954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:40.851870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:40.854851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:40.857052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:40.858660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:40.976241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] validate_networks() for [('ac4d8f52-90dc-4983-890c-821ba313bf21', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:08:41.144367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:41.156850 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59f41ca2-37e3-4672-89d0-27691b0ea04b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1275 microversion: 2.1 time: 0.338548 Jul 25 16:08:41.158182 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 561/1165] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:40 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1275 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:41.169312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:41.171069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:41.187927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:41.189904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:41.193467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:41.194651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:42.560466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:42.590829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:42.594407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:42.599808 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-496d650a-afec-4a94-ad84-9ddfef51e77c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 1.438805 Jul 25 16:08:42.633903 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 562/1166] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:41 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:42.651934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:42.653230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:42.667305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:42.671420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:42.673490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:42.677919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:42.915586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:08:42.916883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:08:42.918448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:08:42.919146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:08:42.921292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:08:42.939285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:42.940344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:42.941420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:42.942250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:42.963548 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83737413-416a-4d34-afab-84d4852a298c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.323746 Jul 25 16:08:42.964878 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 563/1167] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:08:42 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977/os-interface => generated 1833 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:42.971736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:42.972837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:42.993903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.001589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:43.006244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:43.007990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:43.011542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:43.014286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:43.047100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for user f3a2bf8f94f44b78a80c37bc8b370726 and project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:43.083667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.090465 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe HTTP/1.1 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'eaa11af2-1b5a-4c22-b916-9d53e152cffe'} Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:08:43.099387 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9719b34-bd2c-4874-97b0-65e373d3f97d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 404 len: 111 microversion: 2.1 time: 0.138068 Jul 25 16:08:43.111530 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 564/1168] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:42 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:08:43.115860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:08:43.122287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:08:43.325510 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8bfd8e9d-a959-4c5e-8501-70dc79fc000b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.25 time: 2.974503 Jul 25 16:08:43.334909 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 605/1169] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:08:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:08:43.345695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:43.346320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:43.378842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:43.379293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:43.380083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:43.380767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:43.989705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:44.027796 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-05bcbea5-f65e-475f-b28d-3cc95de80a81 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.682835 Jul 25 16:08:44.034025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 606/1170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:43 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:44.052370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-494e1ec3-009b-4254-8b93-020f9e8f9214 req-e23d57b2-863c-4e30-ad8e-f7388390d2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d985b919-a1e2-4db8-9493-32c6d1fa9ee7", "tag": "2a47809f-7be7-488f-be91-f127105fc673"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:44.117723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-494e1ec3-009b-4254-8b93-020f9e8f9214 req-e23d57b2-863c-4e30-ad8e-f7388390d2fc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:44.118721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-494e1ec3-009b-4254-8b93-020f9e8f9214 req-e23d57b2-863c-4e30-ad8e-f7388390d2fc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:44.173295 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-494e1ec3-009b-4254-8b93-020f9e8f9214 req-e23d57b2-863c-4e30-ad8e-f7388390d2fc service nova] Creating event network-changed:2a47809f-7be7-488f-be91-f127105fc673 for instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 on n-h1-846219-13 Jul 25 16:08:44.173500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78d1fc52-4b5c-4f63-b2c2-76b3fdf8d246 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93a40dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1272337070", "description": "tempest-description-1237928945"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:44.198344 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-494e1ec3-009b-4254-8b93-020f9e8f9214 req-e23d57b2-863c-4e30-ad8e-f7388390d2fc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156588 Jul 25 16:08:44.201690 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 607/1171] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:44.221296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91403781-f1c9-40be-a7ce-6ad55abf2828 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:44.222599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91403781-f1c9-40be-a7ce-6ad55abf2828 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:44.269585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:44.485550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91403781-f1c9-40be-a7ce-6ad55abf2828 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:44.529659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91403781-f1c9-40be-a7ce-6ad55abf2828 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:44.542202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91403781-f1c9-40be-a7ce-6ad55abf2828 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:44.544484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91403781-f1c9-40be-a7ce-6ad55abf2828 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1289 microversion: 2.25 time: 0.339175 Jul 25 16:08:44.554231 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 608/1172] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:44 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1289 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:44.579218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1462301138", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:44.849221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:08:45.770423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78d1fc52-4b5c-4f63-b2c2-76b3fdf8d246 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.660434 Jul 25 16:08:45.783165 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 565/1173] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:43 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:45.794924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:45.796166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:45.841952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:45.848622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:45.852389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:45.863598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:46.432104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:46.447922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:46.453006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:46.458504 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7efc3e89-313c-403d-84f2-615276c2a7fe tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 0.672602 Jul 25 16:08:46.474886 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 566/1174] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:45 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:46.720054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-46c89d57-4c47-40fd-bfc2-9925de91d612 req-46bd6977-9e5f-45dd-a2b0-c07409c5161c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:46.731503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-46c89d57-4c47-40fd-bfc2-9925de91d612 req-46bd6977-9e5f-45dd-a2b0-c07409c5161c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:46.732349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-46c89d57-4c47-40fd-bfc2-9925de91d612 req-46bd6977-9e5f-45dd-a2b0-c07409c5161c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:46.749615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-46c89d57-4c47-40fd-bfc2-9925de91d612 req-46bd6977-9e5f-45dd-a2b0-c07409c5161c service nova] Creating event network-changed:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h2-846219-13 Jul 25 16:08:46.754890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:08:46.755859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:08:46.756752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:08:46.759058 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-46c89d57-4c47-40fd-bfc2-9925de91d612 req-46bd6977-9e5f-45dd-a2b0-c07409c5161c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280915 Jul 25 16:08:46.760208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 567/1175] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:46.760808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:08:46.761342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:08:46.766578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:46.767817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:46.768507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:46.777715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:46.778572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:46.779333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:46.779771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:46.824034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:46.824480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:46.825333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:46.825775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:46.873762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:08:46.884582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:08:46.918278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:08:46.922706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:08:47.015230 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59422ca1-8511-4a25-9cb7-c068e638d99b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.456134 Jul 25 16:08:47.017814 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 609/1176] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:08:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:08:47.034051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:47.035095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:47.042957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:47.043786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:47.044815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:47.045533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:47.090036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:47.105835 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72bf22eb-d634-4af4-96d7-e01163eae962 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.343728 Jul 25 16:08:47.107607 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 568/1177] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:46 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:47.117901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9e7fd88-5662-41c8-a546-5f28cd2c3c53 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93ab1d30>, body: {"security_group_rule": {"parent_group_id": "58cd36ef-ab03-42a3-bc81-c69181f0b546", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:47.168064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:47.179930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:47.182772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:47.184393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac06ae92-b38a-449b-9d08-f65cc0330ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1347 microversion: 2.25 time: 0.155716 Jul 25 16:08:47.185758 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 610/1178] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:47 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1347 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:47.192195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71ab5fc5-ac90-48ca-97b5-bcd5bf262104 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:47.193444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71ab5fc5-ac90-48ca-97b5-bcd5bf262104 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:47.336152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71ab5fc5-ac90-48ca-97b5-bcd5bf262104 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:47.350568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71ab5fc5-ac90-48ca-97b5-bcd5bf262104 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1219 microversion: 2.1 time: 0.158391 Jul 25 16:08:47.354317 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 611/1179] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:47 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:47.489688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:47.491191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:47.517201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:47.517728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:47.519560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:47.520563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:48.006272 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9e7fd88-5662-41c8-a546-5f28cd2c3c53 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.896826 Jul 25 16:08:48.007079 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 569/1180] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:08:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:48.026736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b40dd444-df95-43c1-a46b-417a4024f579 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93a135e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-350127339", "description": "tempest-description-114263291"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:48.204092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:48.247049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:48.256752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:48.259505 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-87cc475a-9b63-4358-b5ef-2ba169f17998 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 0.773959 Jul 25 16:08:48.300671 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 612/1181] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:47 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:08:48.310180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:48.313872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:48.326422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:48.327259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:48.328380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:48.329168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:48.792330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:48.823317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a2ca18a-4beb-4a48-9017-e9a7e8630e29 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.519397 Jul 25 16:08:48.825143 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 613/1182] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:48 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:48.835391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:48.836915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:48.850233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:48.851144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:48.854292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:48.855361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:49.147685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:49.156812 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b40dd444-df95-43c1-a46b-417a4024f579 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.133919 Jul 25 16:08:49.161144 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 570/1183] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:48 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:49.173373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:49.174441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:49.187003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:49.187634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:49.188576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:49.189150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:49.215263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:49.230040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:49.241623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ae9a830-5ef8-4c44-8317-da38b0448599 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1347 microversion: 2.25 time: 0.407677 Jul 25 16:08:49.246201 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 614/1184] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:48 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1347 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:49.265932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-255b8105-6b78-47e3-9eff-0c2e94bb7d53 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d935219d0>, body: {"security_group_rule": {"parent_group_id": "b2184d84-71e8-418e-9ff0-b4fb278bd81e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:49.361136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:49.383658 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a03c835f-7cc1-480d-9616-b60371e155e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1289 microversion: 2.1 time: 0.220737 Jul 25 16:08:49.389425 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 571/1185] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:49 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1289 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:49.397269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:49.398443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:49.411079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:49.413533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:49.414619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:49.415072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:50.393687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:50.405263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:50.407697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:50.409126 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5344a8ab-1dda-464a-871c-ab2b810b26f2 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 1.023446 Jul 25 16:08:50.429779 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 572/1186] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:49 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:50.436537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:50.437588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:50.445466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:50.445963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:50.446906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:50.447450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:50.565622 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-255b8105-6b78-47e3-9eff-0c2e94bb7d53 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.314537 Jul 25 16:08:50.578229 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 615/1187] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:08:49 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:50.598122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:50.599338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:50.607645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:50.608531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:50.609611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:50.610297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:51.005131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:51.019445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f550cd04-a519-4c85-aca2-b35ed5be82f1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.587790 Jul 25 16:08:51.024475 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 573/1188] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:50 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:51.040085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:51.049388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:51.070177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:51.072949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:51.075635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:51.078522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:51.256362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:51.280026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:51.293514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:51.295100 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-444dd690-291c-425d-8ee0-3016c5e72b27 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.714428 Jul 25 16:08:51.296222 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 616/1189] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:50 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:51.310150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-271e6e5f-9fab-475b-8696-44fe58779fdd tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d935214c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-880028176", "description": "tempest-description-229837430"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:51.809684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:51.826048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53b3cd82-1472-4b62-9fe0-3ddc3823d2ef tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.799136 Jul 25 16:08:51.845750 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 574/1190] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:51 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:51.868704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:51.870393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:51.887584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:51.888958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:51.890887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:51.892167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:52.268081 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-271e6e5f-9fab-475b-8696-44fe58779fdd tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.970065 Jul 25 16:08:52.275546 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 617/1191] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:51 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:52.304794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6d49e237-37be-44b0-8ec8-2e100be7d09c req-ebb0eeb5-98c9-42f9-bd0d-425c65c62ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d985b919-a1e2-4db8-9493-32c6d1fa9ee7", "name": "network-vif-plugged", "status": "completed", "tag": "2a47809f-7be7-488f-be91-f127105fc673"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:52.335769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6d49e237-37be-44b0-8ec8-2e100be7d09c req-ebb0eeb5-98c9-42f9-bd0d-425c65c62ce8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:52.337764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6d49e237-37be-44b0-8ec8-2e100be7d09c req-ebb0eeb5-98c9-42f9-bd0d-425c65c62ce8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:52.363321 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6d49e237-37be-44b0-8ec8-2e100be7d09c req-ebb0eeb5-98c9-42f9-bd0d-425c65c62ce8 service nova] Creating event network-vif-plugged:2a47809f-7be7-488f-be91-f127105fc673 for instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 on n-h1-846219-13 Jul 25 16:08:52.382873 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6d49e237-37be-44b0-8ec8-2e100be7d09c req-ebb0eeb5-98c9-42f9-bd0d-425c65c62ce8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095769 Jul 25 16:08:52.385116 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 618/1192] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:52.399454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:52.402464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:52.415212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:52.416391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:52.418610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:52.419624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:52.480983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:52.511094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:52.518101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:52.525334 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-710aaf10-e671-4edb-8ec6-04e2e84c014b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 0.677293 Jul 25 16:08:52.526786 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 575/1193] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:51 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:52.546187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9057ba22-7a07-406d-a70d-c01f9d3e69e0 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93a763a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-573564888", "description": "tempest-description-693524295"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:53.223201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:53.268928 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da0782ed-fc2c-40f9-8d28-a4ca75ff34fb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.881288 Jul 25 16:08:53.272161 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 619/1194] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:52 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:53.283757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:53.285342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:53.299620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:53.301079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:53.303282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:53.304336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:53.617977 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9057ba22-7a07-406d-a70d-c01f9d3e69e0 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.088963 Jul 25 16:08:53.621717 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 576/1195] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:53.635159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:53.635823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:53.643806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:53.644268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:53.645136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:53.645852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:54.186062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:54.203600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:54.220090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:54.234701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:54.236908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-533067db-8974-4034-994b-a4f2ac6ad111 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.962591 Jul 25 16:08:54.241564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 620/1196] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:53 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:54.280408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:54.288164 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4ac590a-973f-4cef-bbf5-bd4e9561bc6d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.662242 Jul 25 16:08:54.289022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:54.303672 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 577/1197] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:53 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:54.340584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:54.341810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c534170-e4ba-407a-a157-8fda1e59d46c tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9da02a1700>, body: {"security_group_rule": {"parent_group_id": "086460fb-a11c-41fc-acca-4a444f7dbbb8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "97edc0bc-ffa2-482a-bf33-0c9d7ddec611"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:54.342399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:54.344035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:54.352719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.172286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:55.182313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:55.184109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:55.185867 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a95dee22-c4f5-4d6e-816e-ebb383b02502 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1362 microversion: 2.21 time: 0.943624 Jul 25 16:08:55.186851 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 621/1198] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:54 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1362 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:55.193380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f8cca089-9cf6-4f03-a530-c8380d7b5ac0 req-5f4d5c65-50c5-483c-bd77-997bf6ed8cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c047e2-d8dd-4bab-87cc-13dc514d7d58", "tag": "8ddf5585-13f6-4f34-8418-5d89099cddbf"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:55.208987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f8cca089-9cf6-4f03-a530-c8380d7b5ac0 req-5f4d5c65-50c5-483c-bd77-997bf6ed8cf1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.210014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f8cca089-9cf6-4f03-a530-c8380d7b5ac0 req-5f4d5c65-50c5-483c-bd77-997bf6ed8cf1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.225150 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f8cca089-9cf6-4f03-a530-c8380d7b5ac0 req-5f4d5c65-50c5-483c-bd77-997bf6ed8cf1 service nova] Creating event network-changed:8ddf5585-13f6-4f34-8418-5d89099cddbf for instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 on n-h1-846219-13 Jul 25 16:08:55.236393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f8cca089-9cf6-4f03-a530-c8380d7b5ac0 req-5f4d5c65-50c5-483c-bd77-997bf6ed8cf1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047413 Jul 25 16:08:55.238132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 622/1199] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:55.245599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-72c54146-d235-48f4-958c-ed0d15e18901 req-f360dd59-725b-41ed-910c-5df911cfbbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:55.260449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-72c54146-d235-48f4-958c-ed0d15e18901 req-f360dd59-725b-41ed-910c-5df911cfbbd9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.261089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-72c54146-d235-48f4-958c-ed0d15e18901 req-f360dd59-725b-41ed-910c-5df911cfbbd9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.279442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-72c54146-d235-48f4-958c-ed0d15e18901 req-f360dd59-725b-41ed-910c-5df911cfbbd9 service nova] Creating event network-changed:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h2-846219-13 Jul 25 16:08:55.285805 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-72c54146-d235-48f4-958c-ed0d15e18901 req-f360dd59-725b-41ed-910c-5df911cfbbd9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046053 Jul 25 16:08:55.287586 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 623/1200] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:55.299097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:55.300880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:55.315844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.318216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.320647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.321952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.474659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5c534170-e4ba-407a-a157-8fda1e59d46c tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.164100 Jul 25 16:08:55.478206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 578/1201] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:08:54 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:55.490679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-973ff0f5-c1b6-4660-83ce-d83328ea5ee2 req-733ce3ad-51a1-493d-85cb-0def058c006c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "name": "network-vif-plugged", "status": "completed", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:55.520583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-973ff0f5-c1b6-4660-83ce-d83328ea5ee2 req-733ce3ad-51a1-493d-85cb-0def058c006c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.521037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-973ff0f5-c1b6-4660-83ce-d83328ea5ee2 req-733ce3ad-51a1-493d-85cb-0def058c006c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.566015 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-973ff0f5-c1b6-4660-83ce-d83328ea5ee2 req-733ce3ad-51a1-493d-85cb-0def058c006c service nova] Creating event network-vif-plugged:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h2-846219-13 Jul 25 16:08:55.578516 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-973ff0f5-c1b6-4660-83ce-d83328ea5ee2 req-733ce3ad-51a1-493d-85cb-0def058c006c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096960 Jul 25 16:08:55.583484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 579/1202] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:55.601630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:55.602007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:55.628611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.631827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.634679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:55.637358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:55.968374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:55.982953 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31fb5a8e-908c-47b0-9484-c093d18b97e5 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.693508 Jul 25 16:08:55.986767 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 624/1203] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:55 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:55.995379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:55.996714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:56.010647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.012822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.014350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.015125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.088366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.097957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.099760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.100969 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-602e37da-b1e6-451b-a486-fb3d3a764bf5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.513078 Jul 25 16:08:56.121956 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 580/1204] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:55 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:56.139737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7af92b70-de91-42f8-9499-de3cef42f096 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93c0aaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-210631119", "description": "tempest-description-169858595"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:56.335929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.357066 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31155b96-88e2-44b5-8827-e7aea7d691b7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.367213 Jul 25 16:08:56.359828 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 625/1205] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:55 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:56.372308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:56.373476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:56.390889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.391822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.393441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.394348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.582031 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7af92b70-de91-42f8-9499-de3cef42f096 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.458397 Jul 25 16:08:56.589977 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 581/1206] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:56.595798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a7e86f7-f9a2-43d1-a814-bb43fa06c3d8 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93a40040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-959525188", "description": "tempest-description-1087600956"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:56.707326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.712720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:56.720150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.722628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:56.724778 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e03ce6f8-4c4b-4d64-b52b-fe37767cca3d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1555 microversion: 2.21 time: 0.362916 Jul 25 16:08:56.725680 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 626/1207] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:56 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1555 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:56.752437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:56.760132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:56.774954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.777523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.779800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.780598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.819281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:08:56.850744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:56.896261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5a7e86f7-f9a2-43d1-a814-bb43fa06c3d8 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.303784 Jul 25 16:08:56.902081 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 582/1208] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:56.932724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c7241eca-1076-4b51-ab92-28d6dbcaea2b tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93e67ee0>, body: {"security_group_rule": {"parent_group_id": "865b331a-fa1d-4bd5-80b5-2196f783ae2b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6fba13aa-f664-4262-95bd-3acf7ee0ceed"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:56.970482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a18f9eee-67b7-4ba7-bdb5-3827edd9090d tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 204 len: 0 microversion: 2.21 time: 0.223295 Jul 25 16:08:56.972034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 627/1209] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:08:56 2022] DELETE /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:08:56.981499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:56.982147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:56.990000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.990795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:56.992597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:56.993154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.281272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.303709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.314684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.325194 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b114e273-1c32-43f0-b4e7-8a836118e75c tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1561 microversion: 2.21 time: 0.345522 Jul 25 16:08:57.332748 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 628/1210] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:56 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1561 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:08:57.344811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=31 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:57.365703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:57.367374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:57.391402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:57.392113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.393409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:57.394492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.474836 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c7241eca-1076-4b51-ab92-28d6dbcaea2b tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.553572 Jul 25 16:08:57.495885 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 583/1211] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:08:56 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:08:57.520000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:57.521560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:57.544600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:57.549902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.554039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:57.557700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.701543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.711664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d4d84ba-1f21-44d3-b2bb-cb3a988d0756 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1317 microversion: 2.1 time: 0.374687 Jul 25 16:08:57.717673 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 629/1212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:57 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:57.733518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:57.742145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:57.749614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:57.750233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.751081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:57.751581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:57.821524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.848599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.853127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:57.855309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db5062ca-679e-4f8b-be84-abe3d8ab2260 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.357394 Jul 25 16:08:57.876747 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 584/1213] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:57 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:57.885165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-abad9ce3-b5f2-4a43-b7f5-c8732fefc37d tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93c0ae50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:57.995210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:58.005363 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-824dfd6b-e0f1-40b6-ae01-82f9ea3f172a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.288919 Jul 25 16:08:58.006627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 630/1214] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:57 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:58.268414 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-abad9ce3-b5f2-4a43-b7f5-c8732fefc37d tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/6fba13aa-f664-4262-95bd-3acf7ee0ceed" status: 202 len: 0 microversion: 2.1 time: 0.389944 Jul 25 16:08:58.269037 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 585/1215] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:08:57 2022] DELETE /compute/v2.1/os-security-groups/6fba13aa-f664-4262-95bd-3acf7ee0ceed => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:08:58.282805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-122f5f0f-ef0a-4c2d-ba3e-0a634a3ce446 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d9357b940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:58.365227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:58.366551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:58.382686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:58.383835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:58.390219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:58.391835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:58.481874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-122f5f0f-ef0a-4c2d-ba3e-0a634a3ce446 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/865b331a-fa1d-4bd5-80b5-2196f783ae2b" status: 200 len: 246 microversion: 2.1 time: 0.207092 Jul 25 16:08:58.483456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 631/1216] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:08:58 2022] GET /compute/v2.1/os-security-groups/865b331a-fa1d-4bd5-80b5-2196f783ae2b => generated 246 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:08:58.504529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc7fc6b1-f303-4514-8430-3163f32b8586 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d936a7ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-94427689", "description": "tempest-description-1886398119"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:58.721210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:58.739261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:58.743639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:58.746867 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b66bbd83-2a74-4056-b3dc-4fb3b9c72956 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1561 microversion: 2.21 time: 0.391117 Jul 25 16:08:58.748771 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 586/1217] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:58 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1561 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:58.757202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:58.758767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:58.768798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:58.769549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:58.770623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:58.771297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:58.929538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc7fc6b1-f303-4514-8430-3163f32b8586 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.428201 Jul 25 16:08:58.938142 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 632/1218] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:08:58 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:58.955861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:58.956751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:58.966423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:58.966898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:58.968063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:58.968979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:59.064003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:59.075986 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b52c48dc-ee97-4774-bb00-2f53f3f09b92 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1467 microversion: 2.1 time: 0.325091 Jul 25 16:08:59.089722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 587/1219] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:58 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1467 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:59.098342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a33a5e0d-97b9-477e-818d-b927980bcb68 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93a134c0>, body: {"security_group_rule": {"parent_group_id": "5e1a4455-8a5e-4920-ad06-c24a3900bd93", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:59.267797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:59.282160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:59.285968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:59.287493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-655697f5-c4ea-4c2f-a77f-e585637099fd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.347953 Jul 25 16:08:59.302031 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 633/1220] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:58 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:08:59.319506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:59.320397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:59.331903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:59.332895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:59.333983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:59.334461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:59.568687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a33a5e0d-97b9-477e-818d-b927980bcb68 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.477517 Jul 25 16:08:59.569697 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 588/1221] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:08:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:08:59.574420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:59.575050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:59.587465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:59.588129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:59.589111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:59.592474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:59.609017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:08:59.616194 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cdd049ac-9a8e-4d5f-a41c-c1ff6fb02ad0 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.312865 Jul 25 16:08:59.627218 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 634/1222] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:59 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:59.639387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd7ca564-68b0-47a2-91e2-9cedf82f6f63 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Action: 'create', calling method: .version_select at 0x7f9d93500a60>, body: {"security_group_rule": {"parent_group_id": "5e1a4455-8a5e-4920-ad06-c24a3900bd93", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:08:59.846885 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7afe2e68-071c-4449-a922-eef60b55e56b tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1620 microversion: 2.1 time: 0.276067 Jul 25 16:08:59.847485 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 589/1223] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:08:59 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1620 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:08:59.871559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:08:59.876906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:08:59.886151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:59.886947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:08:59.887996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:08:59.888623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.118623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd7ca564-68b0-47a2-91e2-9cedf82f6f63 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.487925 Jul 25 16:09:00.120777 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 635/1224] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:08:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:00.129516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:00.134079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:00.136492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:00.147983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:00.152576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:00.156435 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41f9f886-9491-41a4-bfb5-7ae14e9dfffc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1561 microversion: 2.21 time: 0.307292 Jul 25 16:09:00.157214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:00.157742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.160497 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 590/1225] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:08:59 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1561 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:00.170259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2e9601b-401a-41f0-8e31-4340902bc901 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93a0ca60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:00.176178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:00.177452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.228450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '753235f1e4f74066bee93c09fe8c4676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78157dcf2d3a4a408b54fd46372adc92', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:00.229079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] flavor_id is None. Assuming migration. {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 16:09:00.229681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 16:09:00.270859 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2e9601b-401a-41f0-8e31-4340902bc901 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/5e1a4455-8a5e-4920-ad06-c24a3900bd93" status: 200 len: 663 microversion: 2.1 time: 0.107927 Jul 25 16:09:00.271848 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 591/1226] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:09:00 2022] GET /compute/v2.1/os-security-groups/5e1a4455-8a5e-4920-ad06-c24a3900bd93 => generated 663 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:00.292357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-250cdd9a-c5cf-49c3-a940-ba754a9be66f tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93f028b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:00.514419 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2171ee82-e575-482b-9bc8-78658dc7e1b5 tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230/action" status: 202 len: 0 microversion: 2.1 time: 0.386080 Jul 25 16:09:00.515277 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 636/1227] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:09:00 2022] POST /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:00.534091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:00.535971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:00.556817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:00.559981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.561707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:00.566455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.567696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-250cdd9a-c5cf-49c3-a940-ba754a9be66f tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-group-rules/1f2d61b6-1458-4d5b-b24f-4b138e39af74" status: 202 len: 0 microversion: 2.1 time: 0.283829 Jul 25 16:09:00.569358 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 592/1228] 10.222.0.105 () {58 vars in 1292 bytes} [Mon Jul 25 16:09:00 2022] DELETE /compute/v2.1/os-security-group-rules/1f2d61b6-1458-4d5b-b24f-4b138e39af74 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:00.584375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:00.587735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:00.614177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:00.615020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.617327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:00.618100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:00.978987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:00.988984 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3238621b-4e51-4ba7-a9c9-d23e6c2520bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1476 microversion: 2.1 time: 0.417888 Jul 25 16:09:00.996587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:01.009428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 593/1229] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:00 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:01.022000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:01.022891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b64f6e8-c8c8-44a6-be96-4cf0e09acae0 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93a10f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:01.024095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:01.025519 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57ae0036-b380-40c9-873d-d3cc58905079 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.508945 Jul 25 16:09:01.026105 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 637/1230] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:00 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:01.034956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:01.039456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:01.079250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:01.080129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:01.082307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:01.086225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:01.737587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:01.749131 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-961c3eca-f9f2-4b1f-9b9a-d91be4483b22 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.721599 Jul 25 16:09:01.752181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 638/1231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:01 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:01.767050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:01.767966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:01.782449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:01.782894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:01.783928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:01.784373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:02.314757 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b64f6e8-c8c8-44a6-be96-4cf0e09acae0 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/5e1a4455-8a5e-4920-ad06-c24a3900bd93" status: 202 len: 0 microversion: 2.1 time: 1.299789 Jul 25 16:09:02.329046 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 594/1232] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:01 2022] DELETE /compute/v2.1/os-security-groups/5e1a4455-8a5e-4920-ad06-c24a3900bd93 => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:02.346064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:02.352475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:02.378448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:02.379614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:02.381481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:02.383540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:02.587822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:02.641433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:02.648208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:02.652684 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ade7850d-5606-42e8-87a1-43d899cf38bb tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1561 microversion: 2.21 time: 0.898612 Jul 25 16:09:02.667772 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 639/1233] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:01 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1561 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:02.679426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:02.680835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:02.695825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:02.697394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:02.699283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:02.700458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:03.430660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:03.464693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:03.473852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:03.477843 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8590a969-1b3b-4207-b877-e677be1c60ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.807960 Jul 25 16:09:03.483927 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 640/1234] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:02 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:03.514279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d9357b4c0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:03.626691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:09:03.628697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Neutron security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:09:03.630184 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] HTTP exception thrown: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.630184 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Request method failure captured: Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/6fba13aa-f664-4262-95bd-3acf7ee0ceed HTTP/1.1 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sAJy2WZD6bOhmSazjkHsE58SMnlzMFmAg1laFuSKf2kZUJKI-iDmH23mlGdunXD_T-VN_MQjU3fgsSq5TH_NaP_SLQA16y-gevep1_0mThqPYeiQET0ysggKsDvk2cMRkLZu16xnzWK4M7cu-b3H2bdrWF335P3zveQSZHQzurcbe4 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c55ae7742405480daabc264336baf0bf Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1048269420 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c55ae7742405480daabc264336baf0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c55ae7742405480daabc264336baf0bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c55ae7742405480daabc264336baf0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c55ae7742405480daabc264336baf0bf"}]}] Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1048269420 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c55ae7742405480daabc264336baf0bf Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1048269420 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupRulesTestJSON-1048269420-project Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 20d0f23a1b854e06ab1a5ace588e3ab7 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1048269420-project Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '6fba13aa-f664-4262-95bd-3acf7ee0ceed'} Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:09:03.636566 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] Jul 25 16:09:03.645576 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:03.656284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Returning 404 to user: Security group 6fba13aa-f664-4262-95bd-3acf7ee0ceed does not exist Jul 25 16:09:03.656284 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-978b6b1b-e5b4-47d8-bfdf-c2dd287ceef9'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:03.656284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab078392-6cee-4ceb-b31a-ac434abb7ba9 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/6fba13aa-f664-4262-95bd-3acf7ee0ceed" status: 404 len: 194 microversion: 2.1 time: 0.165045 Jul 25 16:09:03.661609 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 641/1235] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:03 2022] DELETE /compute/v2.1/os-security-groups/6fba13aa-f664-4262-95bd-3acf7ee0ceed => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:09:03.679558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:03.687567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:03.689142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:03.707622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:03.727171 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7da1e83-7f03-4eba-aa7f-1e14605fd329 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1476 microversion: 2.1 time: 1.394876 Jul 25 16:09:03.727777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:03.728905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:03.729682 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 595/1236] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:02 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1476 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:03.730733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:03.741704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:03.756612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-60f9a944-ad4f-4813-91a5-2c74ad83e42e req-6f2685f5-e032-4875-a4e6-9c461d6fd215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "name": "network-vif-plugged", "status": "completed", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:03.802172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-60f9a944-ad4f-4813-91a5-2c74ad83e42e req-6f2685f5-e032-4875-a4e6-9c461d6fd215 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:03.811888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-60f9a944-ad4f-4813-91a5-2c74ad83e42e req-6f2685f5-e032-4875-a4e6-9c461d6fd215 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:03.888447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-60f9a944-ad4f-4813-91a5-2c74ad83e42e req-6f2685f5-e032-4875-a4e6-9c461d6fd215 service nova] Creating event network-vif-plugged:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h2-846219-13 Jul 25 16:09:03.897638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-60f9a944-ad4f-4813-91a5-2c74ad83e42e req-6f2685f5-e032-4875-a4e6-9c461d6fd215 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166260 Jul 25 16:09:03.898584 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 596/1237] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:03.910444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3938a44-17a7-4e5b-aaa4-648f866f673e tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93a205e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:05.693343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:05.739783 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5fa4d100-4066-4313-a201-6dfb59533992 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 2.074518 Jul 25 16:09:05.742160 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 642/1238] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:03 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:05.746826 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3938a44-17a7-4e5b-aaa4-648f866f673e tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/865b331a-fa1d-4bd5-80b5-2196f783ae2b" status: 202 len: 0 microversion: 2.1 time: 1.842395 Jul 25 16:09:05.748300 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 597/1239] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:03 2022] DELETE /compute/v2.1/os-security-groups/865b331a-fa1d-4bd5-80b5-2196f783ae2b => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:05.774249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:05.775027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:05.776825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:05.780657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:05.815939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:05.821894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:05.831632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:05.838867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:05.840000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:05.843038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:05.844717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:05.845971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:06.031872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:06.033714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:06.044333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lazy-loading 'fault' on Instance uuid d985b919-a1e2-4db8-9493-32c6d1fa9ee7 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:09:06.326438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:06.340363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:06.376389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:06.385052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716f20a451c046f29d68d5fe43c35d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c246f2da81744207af71ec9a7309b6c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:06.388950 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b144535b-23f7-46d2-a9ef-4be9d56ed91b tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 200 len: 1352 microversion: 2.21 time: 0.641286 Jul 25 16:09:06.411035 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 643/1240] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:05 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 1352 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:06.552183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:06.570415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:06.576093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:06.578681 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c45b6e4a-59bc-4abc-a571-fcaf405dffe0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1415 microversion: 2.25 time: 0.827434 Jul 25 16:09:06.579666 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 598/1241] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:05 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1415 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:06.595025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-107ec278-7fb5-45fb-9b9c-b402d5b97a80 req-bc1aefb3-9eba-46e4-8e33-a94c46acbd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d985b919-a1e2-4db8-9493-32c6d1fa9ee7", "name": "network-vif-deleted", "tag": "2a47809f-7be7-488f-be91-f127105fc673"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:06.615539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-107ec278-7fb5-45fb-9b9c-b402d5b97a80 req-bc1aefb3-9eba-46e4-8e33-a94c46acbd0e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:06.616643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-107ec278-7fb5-45fb-9b9c-b402d5b97a80 req-bc1aefb3-9eba-46e4-8e33-a94c46acbd0e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:06.647562 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-107ec278-7fb5-45fb-9b9c-b402d5b97a80 req-bc1aefb3-9eba-46e4-8e33-a94c46acbd0e service nova] Creating event network-vif-deleted:2a47809f-7be7-488f-be91-f127105fc673 for instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 on n-h1-846219-13 Jul 25 16:09:06.661894 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-107ec278-7fb5-45fb-9b9c-b402d5b97a80 req-bc1aefb3-9eba-46e4-8e33-a94c46acbd0e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073456 Jul 25 16:09:06.663941 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 599/1242] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:06.677844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bb99023-f55d-48d0-a175-3902171fbf9d tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93f028b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:06.840318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:06.842527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:06.854352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:06.855143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:06.856877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:06.857687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.052423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bb99023-f55d-48d0-a175-3902171fbf9d tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/97edc0bc-ffa2-482a-bf33-0c9d7ddec611" status: 202 len: 0 microversion: 2.1 time: 0.385545 Jul 25 16:09:07.057539 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 600/1243] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:06 2022] DELETE /compute/v2.1/os-security-groups/97edc0bc-ffa2-482a-bf33-0c9d7ddec611 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:07.067160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c1c33821-f12a-4f1b-8094-89adc6148927 req-35fa2bbf-c5ad-41d2-8cff-4ed6a7961131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c047e2-d8dd-4bab-87cc-13dc514d7d58", "name": "network-vif-plugged", "status": "completed", "tag": "8ddf5585-13f6-4f34-8418-5d89099cddbf"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:07.103590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:07.113474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c1c33821-f12a-4f1b-8094-89adc6148927 req-35fa2bbf-c5ad-41d2-8cff-4ed6a7961131 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.115283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c1c33821-f12a-4f1b-8094-89adc6148927 req-35fa2bbf-c5ad-41d2-8cff-4ed6a7961131 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.136287 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b62c2dac-5413-4f6d-b7cb-dce58f0ad010 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.723188 Jul 25 16:09:07.143708 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c1c33821-f12a-4f1b-8094-89adc6148927 req-35fa2bbf-c5ad-41d2-8cff-4ed6a7961131 service nova] Creating event network-vif-plugged:8ddf5585-13f6-4f34-8418-5d89099cddbf for instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 on n-h1-846219-13 Jul 25 16:09:07.146611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 644/1244] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:06 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:07.160399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:07.166285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:07.167457 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c1c33821-f12a-4f1b-8094-89adc6148927 req-35fa2bbf-c5ad-41d2-8cff-4ed6a7961131 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107324 Jul 25 16:09:07.170982 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 601/1245] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:07.181334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.182175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.183378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.184614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.185234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1415fd97-ca0d-4721-9a8c-61f9a91c4724 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93a518b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:07.692190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:07.710216 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1dc6277f-803c-4143-9ad2-fb90a35b81f1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.561301 Jul 25 16:09:07.714920 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 645/1246] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:07 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:07.750273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:07.752098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:07.768190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.769541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.771259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.776089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.803275 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] HTTP exception thrown: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Request method failure captured: Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 HTTP/1.1 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_6g0Swx5PjaXpnNwQ7GS6V7Af__hCS4JuWCFNHW-JEIcgyR9YEJqdiR2b_CFW3sJKQe6A1ZGExwcXYL5F6gUOBTO3eU3ULyhKFWl5-Oesx-DKhL7FZAcHOcmzPeYkF64_X_eF_8S3RkDmLNLxxm2IFFyvRUanvcHp8G30IWHeGxI4 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c246f2da81744207af71ec9a7309b6c0 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c246f2da81744207af71ec9a7309b6c0"}]}] Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c246f2da81744207af71ec9a7309b6c0 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-InstanceActionsV221TestJSON-342949621-project Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 716f20a451c046f29d68d5fe43c35d45 Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-InstanceActionsV221TestJSON-342949621-project Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd985b919-a1e2-4db8-9493-32c6d1fa9ee7'} Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:07.809330 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Returning 404 to user: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c079853b-1ded-49a0-876d-203d34363008 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 404 len: 111 microversion: 2.21 time: 0.093139 Jul 25 16:09:07.818368 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 646/1247] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:07 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:09:07.828151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:07.829513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:07.831317 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1415fd97-ca0d-4721-9a8c-61f9a91c4724 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/086460fb-a11c-41fc-acca-4a444f7dbbb8" status: 202 len: 0 microversion: 2.1 time: 0.658535 Jul 25 16:09:07.833192 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 602/1248] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:07 2022] DELETE /compute/v2.1/os-security-groups/086460fb-a11c-41fc-acca-4a444f7dbbb8 => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:07.841472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '.version_select at 0x7f9d93a40dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:07.842306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:07.844365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.846161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.848345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.849433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.862479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.864084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:07.866941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:07.868060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.017026 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bec250c-8d8e-4158-8704-b91d83e0fbcc tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.181540 Jul 25 16:09:08.018522 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 603/1249] 10.222.0.105 () {60 vars in 1342 bytes} [Mon Jul 25 16:09:07 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7/os-instance-actions => generated 611 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:09:08.027252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ecb3dafe-a6e9-47b0-b1f5-64383d81a5b8 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93a768b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:08.091056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:08.111734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:08.116920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:08.120470 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d81a66a5-63ff-41b4-9d8e-38933a6ce022 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1610 microversion: 2.25 time: 0.298848 Jul 25 16:09:08.122714 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 647/1250] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:07 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1610 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:08.132148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:08.134858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:08.149864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.151038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.152811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.153704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.184626 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] HTTP exception thrown: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Request method failure captured: Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 HTTP/1.1 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r_6g0Swx5PjaXpnNwQ7GS6V7Af__hCS4JuWCFNHW-JEIcgyR9YEJqdiR2b_CFW3sJKQe6A1ZGExwcXYL5F6gUOBTO3eU3ULyhKFWl5-Oesx-DKhL7FZAcHOcmzPeYkF64_X_eF_8S3RkDmLNLxxm2IFFyvRUanvcHp8G30IWHeGxI4 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c246f2da81744207af71ec9a7309b6c0 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c246f2da81744207af71ec9a7309b6c0"}]}] Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c246f2da81744207af71ec9a7309b6c0 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-InstanceActionsV221TestJSON-342949621-project Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 716f20a451c046f29d68d5fe43c35d45 Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-InstanceActionsV221TestJSON-342949621-project Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd985b919-a1e2-4db8-9493-32c6d1fa9ee7'} Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:09:08.188412 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.195542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.199159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Returning 404 to user: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:08.200840 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24d5a1f3-76c3-4956-87c4-130c1c91a795 tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 404 len: 111 microversion: 2.21 time: 0.076055 Jul 25 16:09:08.201734 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 648/1251] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:09:08 2022] DELETE /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:09:08.208650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:08.209554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:08.217566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.218726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.219859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.220546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.423323 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-86193e81-9718-4493-a677-03e974ac3b4a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.219884 Jul 25 16:09:08.432765 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 649/1252] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:09:08 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:09:08.439638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:08.440469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:08.448132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.448862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.449935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.450547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.893715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ecb3dafe-a6e9-47b0-b1f5-64383d81a5b8 tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/b2184d84-71e8-418e-9ff0-b4fb278bd81e" status: 202 len: 0 microversion: 2.1 time: 0.873001 Jul 25 16:09:08.896323 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 604/1253] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:08 2022] DELETE /compute/v2.1/os-security-groups/b2184d84-71e8-418e-9ff0-b4fb278bd81e => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:08.909782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:08.911336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] [instance: d985b919-a1e2-4db8-9493-32c6d1fa9ee7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:08.932719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.935972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.938441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:08.939625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:08.978262 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] HTTP exception thrown: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Request method failure captured: Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 HTTP/1.1 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r_6g0Swx5PjaXpnNwQ7GS6V7Af__hCS4JuWCFNHW-JEIcgyR9YEJqdiR2b_CFW3sJKQe6A1ZGExwcXYL5F6gUOBTO3eU3ULyhKFWl5-Oesx-DKhL7FZAcHOcmzPeYkF64_X_eF_8S3RkDmLNLxxm2IFFyvRUanvcHp8G30IWHeGxI4 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c246f2da81744207af71ec9a7309b6c0 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c246f2da81744207af71ec9a7309b6c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c246f2da81744207af71ec9a7309b6c0"}]}] Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c246f2da81744207af71ec9a7309b6c0 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-342949621 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-InstanceActionsV221TestJSON-342949621-project Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 716f20a451c046f29d68d5fe43c35d45 Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-InstanceActionsV221TestJSON-342949621-project Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd985b919-a1e2-4db8-9493-32c6d1fa9ee7'} Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.985876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. Jul 25 16:09:08.995080 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:09:09.001766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] Returning 404 to user: Instance d985b919-a1e2-4db8-9493-32c6d1fa9ee7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:09.004824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a78f5bd1-2744-45d9-bb15-45e4ceda9fed tempest-InstanceActionsV221TestJSON-342949621 tempest-InstanceActionsV221TestJSON-342949621-project] 10.222.0.105 "GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7" status: 404 len: 111 microversion: 2.21 time: 0.106129 Jul 25 16:09:09.005122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:09.013233 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 605/1254] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:08 2022] GET /compute/v2.1/servers/d985b919-a1e2-4db8-9493-32c6d1fa9ee7 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:09:09.026525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:09.042679 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc567e25-d0f9-4216-b976-9050812c0dc3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.600450 Jul 25 16:09:09.046372 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 650/1255] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:08 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:09.048328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:09.059960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:09.062273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:09.064036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:09.064958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:09.076500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65020656-ca13-4a20-b7cc-95834fa2533e tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] Calling method '.version_select at 0x7f9d93574d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:09.459631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:09.485166 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8185fb19-f35a-404a-a0d8-bdc03557a2a5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1319 microversion: 2.1 time: 0.468806 Jul 25 16:09:09.487145 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 606/1256] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:09 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:09.908616 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65020656-ca13-4a20-b7cc-95834fa2533e tempest-SecurityGroupRulesTestJSON-1048269420 tempest-SecurityGroupRulesTestJSON-1048269420-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/58cd36ef-ab03-42a3-bc81-c69181f0b546" status: 202 len: 0 microversion: 2.1 time: 0.855906 Jul 25 16:09:09.911026 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 651/1257] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:09 2022] DELETE /compute/v2.1/os-security-groups/58cd36ef-ab03-42a3-bc81-c69181f0b546 => generated 0 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:10.079198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:10.080697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:10.097350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:10.098129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:10.099916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:10.100679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:10.508123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:10.514004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:10.515408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:10.520155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e926c2b8-3532-4014-9296-4a5295d7eab1 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.445979 Jul 25 16:09:10.523856 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 607/1258] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:10 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:10.542082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:10.553053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:10.554973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:10.555972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:10.990845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:11.012965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-584a2c01-8c16-40c6-a33f-ef982db06017 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1506 microversion: 2.1 time: 0.506828 Jul 25 16:09:11.032723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 652/1259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:10 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:11.064847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:11.066016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:11.082663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.086401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.087860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.088603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.128386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-38b788b5-758e-47e4-b0a8-a6cc8c15af3d req-c2e3333e-d492-4bfc-a64e-2a214b063a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:11.148670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lazy-loading 'flavor' on Instance uuid 36c047e2-d8dd-4bab-87cc-13dc514d7d58 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:09:11.156898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-38b788b5-758e-47e4-b0a8-a6cc8c15af3d req-c2e3333e-d492-4bfc-a64e-2a214b063a03 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.160459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-38b788b5-758e-47e4-b0a8-a6cc8c15af3d req-c2e3333e-d492-4bfc-a64e-2a214b063a03 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.201301 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-38b788b5-758e-47e4-b0a8-a6cc8c15af3d req-c2e3333e-d492-4bfc-a64e-2a214b063a03 service nova] Creating event network-changed:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h2-846219-13 Jul 25 16:09:11.232492 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-38b788b5-758e-47e4-b0a8-a6cc8c15af3d req-c2e3333e-d492-4bfc-a64e-2a214b063a03 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108499 Jul 25 16:09:11.234593 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 653/1260] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:11.561754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:11.563252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:11.566853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:11.572216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.572926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.573976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.574574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.593866 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1045aaec-f744-49e2-a6e1-1137a7e90170 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58/action" status: 202 len: 0 microversion: 2.1 time: 0.541296 Jul 25 16:09:11.597963 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 608/1261] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:09:11 2022] POST /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:11.618892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:11.619931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:11.638458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.639794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.640898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:11.641706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:11.953339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:11.979662 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-27aa3791-7807-42d4-9839-5ed3f13478ce tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.424226 Jul 25 16:09:11.993536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 654/1262] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:11 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:12.075781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:12.089586 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-58269673-16c1-40e5-94cb-935de08aad97 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.477164 Jul 25 16:09:12.090969 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 609/1263] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:11 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:13.005519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:13.009945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:13.025957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:13.027206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:13.029083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:13.030196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:13.112925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:13.113956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:13.143555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:13.144295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:13.145461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:13.146109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:13.303834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:13.316982 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ccedde3-1b09-4bca-8447-607c93ee42da tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.316736 Jul 25 16:09:13.318025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 655/1264] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:12 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:13.378893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:13.388400 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91f5e778-01d3-47c6-b639-80cf759caf0b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.278484 Jul 25 16:09:13.391419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 610/1265] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:13 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:14.340072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:14.340890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:14.348908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:14.350169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:14.351012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:14.352057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:14.410983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:14.412001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:14.414786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=59 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:14.427517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:14.427956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:14.428753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:14.429218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:14.576499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:14.588241 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aa1a57d8-7915-40af-919c-e67121ee2ee6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.251982 Jul 25 16:09:14.589467 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 656/1266] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:14 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:14.637713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:14.646374 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68b813d9-9433-4126-8139-b6d30c18aa8c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.239284 Jul 25 16:09:14.647099 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 611/1267] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:14 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:15.616508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:15.617414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:15.642416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:15.643099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:15.644860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:15.645870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:15.669150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:15.670933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:15.684841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:15.687255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:15.688285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:15.691018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:16.225883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:16.261076 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-608ff3eb-fbe1-45f8-b1c8-2b0e24fff155 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.641922 Jul 25 16:09:16.269611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 657/1268] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:15 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:16.369540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:16.378898 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c22ff387-46d7-4632-b55e-458078f1facb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.714005 Jul 25 16:09:16.387117 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 612/1269] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:15 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:17.359240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:17.362348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:17.403968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:17.405983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:17.410591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:17.412220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:17.417664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:17.418395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:17.430977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:17.435541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:17.438790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:17.440659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:17.915956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:17.938430 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8c4a385-467b-429f-b0a6-4692cb614c8f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.630255 Jul 25 16:09:17.939742 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 658/1270] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:17 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:18.883599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:18.927533 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce0f545c-0c9e-49a8-84d1-b9fcaf819c36 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 1.513677 Jul 25 16:09:18.933770 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 613/1271] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:17 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:18.976402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:18.984014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:18.998443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:19.000706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:19.002012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:19.006887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:19.493979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:19.507807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-589fd817-db8a-446c-a7df-ce00ad54df15 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.535212 Jul 25 16:09:19.508987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 659/1272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:18 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:19.960005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:19.961266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:19.971541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:19.983982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:19.985014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:19.985503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:20.318522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:20.336372 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-450b1a93-d71e-478b-b879-9fabda952e02 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.381641 Jul 25 16:09:20.338169 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 614/1273] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:19 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:20.535511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:20.536616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:20.555218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:20.556007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:20.558239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:20.559030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:20.855806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:20.877324 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-284dde66-3a9e-4cf6-9657-a8d824cfd4eb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.348808 Jul 25 16:09:20.878730 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 660/1274] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:20 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:21.364050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:21.366590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:21.396503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:21.397329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:21.403090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:21.406393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:21.918953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:21.921333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:21.935055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:21.936258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:21.938628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:21.939604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:21.971027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:21.993659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e42266b-3a86-4561-8070-54df487e382e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.631249 Jul 25 16:09:21.996952 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 615/1275] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:21 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:22.365637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:22.376538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-602cdaba-944e-46e0-b104-da1fa26638d0 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.465146 Jul 25 16:09:22.385000 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 661/1276] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:21 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:23.027565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:23.029060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:23.068435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:23.068972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:23.069978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:23.070464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:23.368300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:23.382056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25f8dedf-0cba-4e59-b61c-33c7ed7c995e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.362696 Jul 25 16:09:23.382680 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 616/1277] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:23 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:23.412285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:23.413807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:23.439568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:23.440323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:23.441714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:23.442153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:23.652208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:23.667330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cdb1922a-b0ce-4019-ab53-5fa91c86592b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1481 microversion: 2.1 time: 0.261405 Jul 25 16:09:23.670492 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 662/1278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:23 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1481 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:24.411527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:24.412918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:24.426171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:24.433662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:24.435471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:24.438559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:24.449771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:24.697134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:24.698636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:24.744323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:24.747913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:24.751306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:24.751874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:25.067762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:25.080865 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55ea62c3-cd74-4209-bdce-e58757b920ec tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.675894 Jul 25 16:09:25.082195 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 617/1279] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:24 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:25.198974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:25.217216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:25.217859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:25.221640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:25.226499 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e13a3a9d-92f1-4977-a0e4-167512478f07 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1480 microversion: 2.1 time: 0.536235 Jul 25 16:09:25.229888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 663/1280] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:24 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1480 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:25.247213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:25.248032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:25.249135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:25.249969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:25.928107 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30758ca1-e680-4968-af98-21715c0b35af tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1818 microversion: 2.1 time: 0.717247 Jul 25 16:09:25.944585 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 618/1281] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:25 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1818 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:25.969609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ceb17bb8-21a8-4ee8-a998-900a08500ce3 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:25.974532 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:09:25.974532 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:09:25.976541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ceb17bb8-21a8-4ee8-a998-900a08500ce3 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:25.977270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ceb17bb8-21a8-4ee8-a998-900a08500ce3 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:25.978348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ceb17bb8-21a8-4ee8-a998-900a08500ce3 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:25.979116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ceb17bb8-21a8-4ee8-a998-900a08500ce3 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:26.037820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ceb17bb8-21a8-4ee8-a998-900a08500ce3 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.072198 Jul 25 16:09:26.040142 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 664/1282] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:09:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:09:26.121254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:26.122863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:26.161140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:26.164319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:26.170893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:26.171655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:26.234444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c9e4cd39-aa34-4700-a01d-5ffbb1738a91 req-91bd0b2e-b022-4c61-a5c7-be1bb24dd032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "name": "network-vif-unplugged", "status": "completed", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:26.279833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c9e4cd39-aa34-4700-a01d-5ffbb1738a91 req-91bd0b2e-b022-4c61-a5c7-be1bb24dd032 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:26.281833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c9e4cd39-aa34-4700-a01d-5ffbb1738a91 req-91bd0b2e-b022-4c61-a5c7-be1bb24dd032 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:26.331288 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c9e4cd39-aa34-4700-a01d-5ffbb1738a91 req-91bd0b2e-b022-4c61-a5c7-be1bb24dd032 service nova] Creating event network-vif-unplugged:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h1-846219-13 Jul 25 16:09:26.342015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-c9e4cd39-aa34-4700-a01d-5ffbb1738a91 req-91bd0b2e-b022-4c61-a5c7-be1bb24dd032 service nova] Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:09:26.366800 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c9e4cd39-aa34-4700-a01d-5ffbb1738a91 req-91bd0b2e-b022-4c61-a5c7-be1bb24dd032 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151766 Jul 25 16:09:26.369785 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 665/1283] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:09:26.401452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:26.403114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:26.416449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:26.417782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:26.419276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:26.420120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:27.485968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:27.501463 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0492a084-884d-4bed-a0a2-f10bdaed29e2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1480 microversion: 2.1 time: 1.129782 Jul 25 16:09:27.502375 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 666/1284] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:26 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1480 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:27.518065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:27.543819 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-039f05d8-a75f-46a7-be3e-9599edc2432f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 1.429756 Jul 25 16:09:27.564260 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 619/1285] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:26 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:28.470386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a151ee9a-3553-4f4d-b24b-8ea3c0c04b0a req-58287156-4de6-4e0a-a6ec-2ff482622565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:28.488798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a151ee9a-3553-4f4d-b24b-8ea3c0c04b0a req-58287156-4de6-4e0a-a6ec-2ff482622565 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:28.496337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a151ee9a-3553-4f4d-b24b-8ea3c0c04b0a req-58287156-4de6-4e0a-a6ec-2ff482622565 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:28.529225 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a151ee9a-3553-4f4d-b24b-8ea3c0c04b0a req-58287156-4de6-4e0a-a6ec-2ff482622565 service nova] Creating event network-changed:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h1-846219-13 Jul 25 16:09:28.539041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:28.540530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:28.560412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:28.566275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-a151ee9a-3553-4f4d-b24b-8ea3c0c04b0a req-58287156-4de6-4e0a-a6ec-2ff482622565 service nova] Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:09:28.567350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:28.573298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:28.574179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:28.618618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a151ee9a-3553-4f4d-b24b-8ea3c0c04b0a req-58287156-4de6-4e0a-a6ec-2ff482622565 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152071 Jul 25 16:09:28.619689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 667/1286] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:28.639764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:28.642029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:28.668244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:28.668922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:28.672162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:28.673225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:29.038352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:29.048746 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f0b5c7cf-2ce2-47e7-8d84-f33d1b67327a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1480 microversion: 2.1 time: 0.514752 Jul 25 16:09:29.050151 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 620/1287] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:28 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1480 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:29.066250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:29.075826 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e190ada8-5548-4eb0-8804-d69e11a2f30d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.454190 Jul 25 16:09:29.077007 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 668/1288] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:28 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:29.442602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d8093ad-812f-428d-aade-d07267958d44", "device": "/dev/xvdb"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:29.446875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:29.455125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:29.455733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:29.456646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:29.457477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:30.076588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:30.077688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:30.087334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:30.087919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:30.088869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:30.089583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:30.339694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:30.359359 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-165279d5-c6dc-4f76-af4c-b86cc81c99cc tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1478 microversion: 2.1 time: 0.289496 Jul 25 16:09:30.360404 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 669/1289] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:30 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1478 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:30.370862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:30.372629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:30.384748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:30.385823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:30.387293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:30.388180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:30.611335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:30.625160 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fac1eb68-4521-44b3-990c-1567152796e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.263117 Jul 25 16:09:30.626607 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 670/1290] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:30 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:31.388255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:31.394979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:31.420936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:31.431438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:31.449860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:31.451310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:31.998850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:32.013581 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b52b739a-067d-4093-9088-06fb62f70cf2 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1478 microversion: 2.1 time: 0.633322 Jul 25 16:09:32.029681 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 671/1291] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:31 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1478 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:32.050987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:32.052479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:32.064326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:32.065602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:32.067464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:32.068852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:32.506347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:32.539785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e2f6ec6-34c7-44d5-beed-1690a078038f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.506850 Jul 25 16:09:32.546431 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 672/1292] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:32 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:33.053957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:33.054583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:33.074529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:33.074974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:33.080852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:33.081735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:33.427173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:33.439953 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5579df58-3b44-4dbb-92a9-e288ceec6247 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1478 microversion: 2.1 time: 0.388173 Jul 25 16:09:33.453165 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 673/1293] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:33 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1478 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:33.563037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53ff278f-4862-4ce0-89e6-65fd5892e232 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "POST /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.126938 Jul 25 16:09:33.564951 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 621/1294] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:09:29 2022] POST /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 194 bytes in 4130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:33.587390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:33.593895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:33.650941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:33.652506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:33.656023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:33.657420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:34.490601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:34.499317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:34.509903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:34.525727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:34.532417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:34.533035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:34.533587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:34.546897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d6fda9c-d45d-4e1c-bbde-7cc701a3838e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.970147 Jul 25 16:09:34.578911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 674/1295] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:33 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:35.217737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:35.233711 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41a5d0d2-eda8-4262-90f7-2d81418a5a7c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1475 microversion: 2.1 time: 0.753217 Jul 25 16:09:35.236661 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 622/1296] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:34 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1475 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:35.257926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:35.259109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:35.266510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:35.267287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:35.268655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:35.269306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:35.473910 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c6d35309-b38b-4d13-be48-4f2a995cbf53 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "POST /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230/action" status: 202 len: 0 microversion: 2.1 time: 0.219626 Jul 25 16:09:35.493775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:35.495030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 675/1297] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:09:35 2022] POST /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:09:35.497033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:35.508596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:35.509443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:35.510558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:35.511475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:35.593232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:35.595307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:35.614146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:35.615847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:35.617016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:35.618689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:36.003501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:36.492588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:36.532975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d23adf0-a271-428a-8035-a33b7cb5dd97 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 1.050030 Jul 25 16:09:36.552268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 623/1298] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:35 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:36.647183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:36.665485 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf5feb39-1852-4c8d-a04b-fa8600cd50f8 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 1.077218 Jul 25 16:09:36.677747 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 676/1299] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:35 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:37.581026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:37.581787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:37.609864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:37.610443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:37.611539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:37.612070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:37.710830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:37.711692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:37.736514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:37.736982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:37.749763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:37.751185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:38.726175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:38.740191 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53092b30-cfaf-4e56-a770-0e09ee8df835 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 1.164837 Jul 25 16:09:38.753563 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 624/1300] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:37 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:38.764141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8253e243-d8cf-45ed-83f2-0ce562c09207 req-171c6449-301e-4a14-b014-80f1bf9d33a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "name": "network-vif-plugged", "status": "completed", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:38.789883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8253e243-d8cf-45ed-83f2-0ce562c09207 req-171c6449-301e-4a14-b014-80f1bf9d33a2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:38.791465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8253e243-d8cf-45ed-83f2-0ce562c09207 req-171c6449-301e-4a14-b014-80f1bf9d33a2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:38.825661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8253e243-d8cf-45ed-83f2-0ce562c09207 req-171c6449-301e-4a14-b014-80f1bf9d33a2 service nova] Creating event network-vif-plugged:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h1-846219-13 Jul 25 16:09:38.841855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-8253e243-d8cf-45ed-83f2-0ce562c09207 req-171c6449-301e-4a14-b014-80f1bf9d33a2 service nova] Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:09:38.875683 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8253e243-d8cf-45ed-83f2-0ce562c09207 req-171c6449-301e-4a14-b014-80f1bf9d33a2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120615 Jul 25 16:09:38.877052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 625/1301] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:38.880252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:38.901449 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ae3ffdd-bd99-4563-bf5f-8da3c0657e21 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 1.194294 Jul 25 16:09:38.903190 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 677/1302] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:37 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:39.766123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:39.767089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:39.783730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:39.788577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:39.789893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:39.792853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:39.921551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1906360491", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:40.093580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] validate_networks() for [('772d42f0-328d-4c98-8730-4f6263eb1e55', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:09:40.373214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:40.383143 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d62f7926-0d9c-4dc1-8e97-a77c18786b12 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 0.621436 Jul 25 16:09:40.398024 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 678/1303] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:39 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:40.404367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:40.405383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:40.413971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:40.414817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:40.416013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:40.416799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:41.596948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:41.613037 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-95d8e91c-d977-4ddc-9b91-3af5342f207b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 1.213732 Jul 25 16:09:41.615457 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 679/1304] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:40 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:41.653771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:41.657428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:41.664775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=58 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:41.667177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:41.668046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:41.669311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:41.669962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:41.676650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:42.616758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:42.630941 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e5100fa4-45dc-4b67-8074-cceba9583b38 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 0.992154 Jul 25 16:09:42.635387 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 680/1305] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:41 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:42.654728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:42.658339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:42.675062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:42.676036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:42.677363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:42.678197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:43.447106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:09:43.447718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:09:43.448427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:09:43.448847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:09:43.449289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:09:43.475877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:43.476127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:43.477962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:43.482291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:43.483162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:43.497857 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bb48bb10-645a-4163-846c-dd44f9c47aae tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.860869 Jul 25 16:09:43.498579 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 681/1306] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:42 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:43.552129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Getting quotas for project 7bd36be87b9d404ea0126c2046f31845. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:09:43.572324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Getting quotas for user fa99685f6e9645beb76617f1d0fdbae3 and project 7bd36be87b9d404ea0126c2046f31845. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:09:43.612986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:09:43.619558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:09:43.761609 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-334bed10-6e47-4cee-ba11-79a6c60191fa tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.418529 Jul 25 16:09:43.768176 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 626/1307] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:09:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 4426 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:09:43.786428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-60a17289-ecf9-4aa0-ab46-508de5cd5cce req-0da0d00f-365d-4367-9a3d-56b0a7a42c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "name": "network-vif-unplugged", "status": "completed", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:43.823830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-60a17289-ecf9-4aa0-ab46-508de5cd5cce req-0da0d00f-365d-4367-9a3d-56b0a7a42c72 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:43.826143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-60a17289-ecf9-4aa0-ab46-508de5cd5cce req-0da0d00f-365d-4367-9a3d-56b0a7a42c72 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:43.860058 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-60a17289-ecf9-4aa0-ab46-508de5cd5cce req-0da0d00f-365d-4367-9a3d-56b0a7a42c72 service nova] Creating event network-vif-unplugged:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h2-846219-13 Jul 25 16:09:43.873493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-60a17289-ecf9-4aa0-ab46-508de5cd5cce req-0da0d00f-365d-4367-9a3d-56b0a7a42c72 service nova] Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:09:43.907881 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-60a17289-ecf9-4aa0-ab46-508de5cd5cce req-0da0d00f-365d-4367-9a3d-56b0a7a42c72 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137530 Jul 25 16:09:43.910943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 627/1308] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:43.931558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:43.934551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:43.964171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:43.964793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:43.970459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:43.971196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:43.977208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Calling method '.version_select at 0x7f9da4af3af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:44.079532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:09:44.080976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Neutron security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:09:44.082289 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] HTTP exception thrown: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.082289 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Request method failure captured: Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 HTTP/1.1 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBGaLlRqAMJ06aNm_Zd-Rb7jQE2k-Ksu7SOoUDrvBdfjAW4v1PEJ4u_q0uvF2vvNSx-ljxW3dgrpJWQb3LRgRRNMj7yX-Z54aUQYD1hwYkER9ZSX_GS3d5VHJEAsDbXU0hpaU1Y-ViuwJSjJvFe5RQPKKXpxYVeDcOv2oQG9BCG0h8 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_07ae2e59abb8406e8cc719150cd5e628"}]}] Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 04afb69b3c594b4facea310c727e889d Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '2dc0cd55-1085-4952-bdd4-4dcb7dcbd963'} Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:09:44.086964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Returning 404 to user: Security group 2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 does not exist Jul 25 16:09:44.093369 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-3e2703b7-bb1c-4956-90b4-dd96ba3468c7'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:44.101206 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97765b26-18f6-4b68-be5b-adbf874510e3 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/2dc0cd55-1085-4952-bdd4-4dcb7dcbd963" status: 404 len: 194 microversion: 2.1 time: 0.579984 Jul 25 16:09:44.103585 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 682/1309] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:43 2022] DELETE /compute/v2.1/os-security-groups/2dc0cd55-1085-4952-bdd4-4dcb7dcbd963 => generated 194 bytes in 590 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:09:44.117239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba3d01a4-a859-4890-b806-efbbbedddfb9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:44.117846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ba3d01a4-a859-4890-b806-efbbbedddfb9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:44.313351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ba3d01a4-a859-4890-b806-efbbbedddfb9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:44.323072 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ba3d01a4-a859-4890-b806-efbbbedddfb9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1221 microversion: 2.1 time: 0.218477 Jul 25 16:09:44.337030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 683/1310] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:44 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:44.370709 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-22871c9f-482d-4ad8-b366-9ca87097bae6 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.026775 Jul 25 16:09:44.383736 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 684/1311] 10.222.0.105 () {58 vars in 1169 bytes} [Mon Jul 25 16:09:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:09:44.398616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-01e02808-02c4-45bc-956e-e56526a243f6 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Calling method '.version_select at 0x7f9d9357b1f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:44.430324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:44.474878 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09eee50c-896c-44ed-a893-5c617cc8748b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 0.562221 Jul 25 16:09:44.498472 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 628/1312] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:43 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:44.520458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:44.522686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:44.535209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:44.575222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:44.580063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:44.581663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:44.587033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:45.207136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:45.262702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9a1d4bdb-8898-4594-86a2-5262e73a00b5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1512 microversion: 2.1 time: 0.725383 Jul 25 16:09:45.263419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 629/1313] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:44 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:45.356544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd734336-aa58-4ec0-87b5-bcd24c92bda2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:45.364668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd734336-aa58-4ec0-87b5-bcd24c92bda2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:45.398015 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-01e02808-02c4-45bc-956e-e56526a243f6 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.006057 Jul 25 16:09:45.399024 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 685/1314] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:09:44 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:45.420278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fadeb4f6-51a0-412e-bffc-85c79f71c31b tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Calling method '.version_select at 0x7f9da4b171f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:45.796003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cd734336-aa58-4ec0-87b5-bcd24c92bda2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:45.824626 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cd734336-aa58-4ec0-87b5-bcd24c92bda2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1221 microversion: 2.1 time: 0.478873 Jul 25 16:09:45.830991 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 630/1315] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:45 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1221 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:45.842357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:45.844230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:45.889866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:45.894414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:45.898672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:45.900357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:46.245018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-fadeb4f6-51a0-412e-bffc-85c79f71c31b tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:09:46.246149 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-fadeb4f6-51a0-412e-bffc-85c79f71c31b tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 25 16:09:46.246149 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fadeb4f6-51a0-412e-bffc-85c79f71c31b tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Request method failure captured: Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/0db7bba1-ea13-49b8-bbc2-6eb6992e2e03 HTTP/1.1 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBGaLlRqAMJ06aNm_Zd-Rb7jQE2k-Ksu7SOoUDrvBdfjAW4v1PEJ4u_q0uvF2vvNSx-ljxW3dgrpJWQb3LRgRRNMj7yX-Z54aUQYD1hwYkER9ZSX_GS3d5VHJEAsDbXU0hpaU1Y-ViuwJSjJvFe5RQPKKXpxYVeDcOv2oQG9BCG0h8 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_07ae2e59abb8406e8cc719150cd5e628"}]}] Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 04afb69b3c594b4facea310c727e889d Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: exception: Insufficient rights for removing default security group. Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0db7bba1-ea13-49b8-bbc2-6eb6992e2e03'} Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:09:46.255003 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] Jul 25 16:09:46.263677 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.272802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fadeb4f6-51a0-412e-bffc-85c79f71c31b tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 25 16:09:46.272802 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-96bf35de-201d-477c-b7bb-beac076095de'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:46.272802 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fadeb4f6-51a0-412e-bffc-85c79f71c31b tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/0db7bba1-ea13-49b8-bbc2-6eb6992e2e03" status: 400 len: 182 microversion: 2.1 time: 0.855413 Jul 25 16:09:46.280908 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 686/1316] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:09:45 2022] DELETE /compute/v2.1/os-security-groups/0db7bba1-ea13-49b8-bbc2-6eb6992e2e03 => generated 182 bytes in 870 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:09:46.345505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-bc6042f8-2a55-48bd-ad19-284856942525 req-38ad4d76-801a-4a9b-b59b-eaf5e7ea1783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:46.405893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bc6042f8-2a55-48bd-ad19-284856942525 req-38ad4d76-801a-4a9b-b59b-eaf5e7ea1783 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:46.406849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bc6042f8-2a55-48bd-ad19-284856942525 req-38ad4d76-801a-4a9b-b59b-eaf5e7ea1783 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:46.449941 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-bc6042f8-2a55-48bd-ad19-284856942525 req-38ad4d76-801a-4a9b-b59b-eaf5e7ea1783 service nova] Creating event network-changed:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h2-846219-13 Jul 25 16:09:46.466221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:46.466540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-bc6042f8-2a55-48bd-ad19-284856942525 req-38ad4d76-801a-4a9b-b59b-eaf5e7ea1783 service nova] Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:09:46.482608 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-bc6042f8-2a55-48bd-ad19-284856942525 req-38ad4d76-801a-4a9b-b59b-eaf5e7ea1783 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180003 Jul 25 16:09:46.483313 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 687/1317] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:46.497130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Calling method '.version_select at 0x7f9da4b143a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:46.498926 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23af629a-75da-40d1-8423-2e0c69ab5b5d tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 0.664254 Jul 25 16:09:46.500021 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 631/1318] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:45 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:46.532808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:46.554195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:46.583598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:46.586678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:46.589706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:46.590829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:46.614806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:09:46.615629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Neutron security group adb94fff-275f-4ed9-97ce-4688adf8e1ae not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:09:46.616310 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] HTTP exception thrown: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.616310 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Request method failure captured: Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-security-groups/adb94fff-275f-4ed9-97ce-4688adf8e1ae HTTP/1.1 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBGaLlRqAMJ06aNm_Zd-Rb7jQE2k-Ksu7SOoUDrvBdfjAW4v1PEJ4u_q0uvF2vvNSx-ljxW3dgrpJWQb3LRgRRNMj7yX-Z54aUQYD1hwYkER9ZSX_GS3d5VHJEAsDbXU0hpaU1Y-ViuwJSjJvFe5RQPKKXpxYVeDcOv2oQG9BCG0h8 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_07ae2e59abb8406e8cc719150cd5e628"}]}] Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 04afb69b3c594b4facea310c727e889d Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'adb94fff-275f-4ed9-97ce-4688adf8e1ae'} Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:09:46.619148 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] Jul 25 16:09:46.624469 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.629435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Returning 404 to user: Security group adb94fff-275f-4ed9-97ce-4688adf8e1ae does not exist Jul 25 16:09:46.629435 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-2ae4d8a9-d194-4c15-bbbd-1071355785fd'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:46.630676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c73d7ae3-4860-428f-a640-dad74fc99bf0 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/adb94fff-275f-4ed9-97ce-4688adf8e1ae" status: 404 len: 194 microversion: 2.1 time: 0.145266 Jul 25 16:09:46.631486 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 688/1319] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:09:46 2022] GET /compute/v2.1/os-security-groups/adb94fff-275f-4ed9-97ce-4688adf8e1ae => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:09:46.644864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Action: 'update', calling method: .version_select at 0x7f9d9357b040>, body: {"security_group": {"name": "tempest-sg-1940846422", "description": "tempest-description-1756034737"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:46.844437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:09:46.846456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Neutron security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:09:46.847519 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] HTTP exception thrown: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.847519 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Request method failure captured: Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/os-security-groups/5d182f2e-32ec-44e2-a2f1-f7fdce805734 HTTP/1.1 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 102 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBGaLlRqAMJ06aNm_Zd-Rb7jQE2k-Ksu7SOoUDrvBdfjAW4v1PEJ4u_q0uvF2vvNSx-ljxW3dgrpJWQb3LRgRRNMj7yX-Z54aUQYD1hwYkER9ZSX_GS3d5VHJEAsDbXU0hpaU1Y-ViuwJSjJvFe5RQPKKXpxYVeDcOv2oQG9BCG0h8 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/07ae2e59abb8406e8cc719150cd5e628"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_07ae2e59abb8406e8cc719150cd5e628"}]}] Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 07ae2e59abb8406e8cc719150cd5e628 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438 Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 04afb69b3c594b4facea310c727e889d Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2003734438-project Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: {"security_group": {"name": "tempest-sg-1940846422", "description": "tempest-description-1756034737"}} Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5d182f2e-32ec-44e2-a2f1-f7fdce805734', 'body': {'security_group': {'name': 'tempest-sg-1940846422', 'description': 'tempest-description-1756034737'}}} Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:09:46.851500 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] Returning 404 to user: Security group 5d182f2e-32ec-44e2-a2f1-f7fdce805734 does not exist Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-e46ccb6a-18f5-438e-880a-f56c3a9f2af6'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:46.858484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4cd6da7-b566-4c0e-ab07-1f2efd934733 tempest-SecurityGroupsNegativeTestJSON-2003734438 tempest-SecurityGroupsNegativeTestJSON-2003734438-project] 10.222.0.105 "PUT /compute/v2.1/os-security-groups/5d182f2e-32ec-44e2-a2f1-f7fdce805734" status: 404 len: 194 microversion: 2.1 time: 0.213337 Jul 25 16:09:46.868492 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 689/1320] 10.222.0.105 () {60 vars in 1295 bytes} [Mon Jul 25 16:09:46 2022] PUT /compute/v2.1/os-security-groups/5d182f2e-32ec-44e2-a2f1-f7fdce805734 => generated 194 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:09:46.887209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:46.893052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:46.924713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:46.926018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:46.927684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:46.938399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:47.384106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:47.401366 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-177b44d5-2457-4ad2-a80d-192ab9738ba7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1281 microversion: 2.1 time: 0.531190 Jul 25 16:09:47.425073 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 690/1321] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:46 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1281 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:47.483179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:47.488511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:47.509319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:47.523202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:47.527893 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f4a99df-4ed7-446d-bbb8-8a4f958ec65c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1533 microversion: 2.1 time: 1.020524 Jul 25 16:09:47.536297 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 632/1322] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:46 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1533 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:47.538911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:47.550750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:47.551333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:47.558444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:47.563746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:47.582505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:47.600610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:47.608440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:47.609273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:48.473334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid c89f1679-8eed-4efc-b90b-9de768bb23d3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:09:48.515749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49cbd575-0c52-468b-a185-109d9dc88e70 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 2349 microversion: 2.25 time: 1.075575 Jul 25 16:09:48.519842 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 691/1323] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:09:47 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 2349 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:09:48.533741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:48.535836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:48.554629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:48.563715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:48.570338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:48.571395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:48.843757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:48.864936 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da3a1f5b-018f-4486-9a82-4e5d5501559c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1281 microversion: 2.1 time: 0.335732 Jul 25 16:09:48.879382 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 692/1324] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:48 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1281 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:48.883562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:48.888130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fedd5dc-c54f-4eba-b0f2-ff417bea906b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:48.896137 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:09:48.896137 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:09:48.898118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fedd5dc-c54f-4eba-b0f2-ff417bea906b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:48.905364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fedd5dc-c54f-4eba-b0f2-ff417bea906b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:48.907247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fedd5dc-c54f-4eba-b0f2-ff417bea906b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:48.915029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fedd5dc-c54f-4eba-b0f2-ff417bea906b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:48.952349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4879ed5-611e-4201-8c5e-1cb07e17f7d6 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1474 microversion: 2.1 time: 1.412442 Jul 25 16:09:48.965142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 633/1325] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:47 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1474 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:48.984140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:48.986031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:49.000508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:49.001447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:49.003360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:49.003583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:49.008493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fedd5dc-c54f-4eba-b0f2-ff417bea906b tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.127559 Jul 25 16:09:49.010423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 693/1326] 10.222.0.105 () {60 vars in 1222 bytes} [Mon Jul 25 16:09:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:09:49.378166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-164709023", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:49.420398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:49.426479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:49.449837 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea7ca241-ef6e-40fa-968c-d915672e0a29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1533 microversion: 2.1 time: 0.486349 Jul 25 16:09:49.452751 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 634/1327] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:48 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1533 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:49.529567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:09:49.834003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c054ea2b-00f2-44ff-b84a-50ae0b99f082 req-133df87b-70e8-45e0-aa75-10dcf087e4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c047e2-d8dd-4bab-87cc-13dc514d7d58", "name": "network-vif-plugged", "status": "completed", "tag": "8ddf5585-13f6-4f34-8418-5d89099cddbf"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:49.865887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c054ea2b-00f2-44ff-b84a-50ae0b99f082 req-133df87b-70e8-45e0-aa75-10dcf087e4c9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:49.867272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c054ea2b-00f2-44ff-b84a-50ae0b99f082 req-133df87b-70e8-45e0-aa75-10dcf087e4c9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:49.915521 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c054ea2b-00f2-44ff-b84a-50ae0b99f082 req-133df87b-70e8-45e0-aa75-10dcf087e4c9 service nova] Creating event network-vif-plugged:8ddf5585-13f6-4f34-8418-5d89099cddbf for instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 on n-h1-846219-13 Jul 25 16:09:49.931360 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c054ea2b-00f2-44ff-b84a-50ae0b99f082 req-133df87b-70e8-45e0-aa75-10dcf087e4c9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100519 Jul 25 16:09:49.932610 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 635/1328] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:49.941788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:49.942602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:49.952933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:49.953432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:49.954833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:49.955608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:50.233142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:50.254328 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f067aa1-f73b-47f9-8498-33adc92b8491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1279 microversion: 2.1 time: 0.320096 Jul 25 16:09:50.257969 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 636/1329] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:49 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1279 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:50.272645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:50.275517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:50.324231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:50.328422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:50.336121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:50.336744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:50.537046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:09:50.537873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:09:50.538052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:09:50.538386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:09:50.538803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:09:50.560866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:50.561529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:50.562472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:50.562919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:50.622823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Getting quotas for project 28c1fe0b11a64534b2cf7f32cf1667ca. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:09:50.636574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Getting quotas for user b0d4e20c5b6c4daa9a3127438be07934 and project 28c1fe0b11a64534b2cf7f32cf1667ca. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:09:50.670256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:09:50.672747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:09:50.775913 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a8dc5c1-1104-460e-9395-bf5dde05f3d8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.764057 Jul 25 16:09:50.776493 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 694/1330] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:09:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:09:50.786977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:50.790018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:50.797270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:50.813765 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-724fe081-a594-4934-a154-651ca7c5c986 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1467 microversion: 2.1 time: 0.547679 Jul 25 16:09:50.814796 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 637/1331] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:50 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1467 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:50.823912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:50.825045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:50.826497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e71e5af-12b6-4256-a5a4-6c0c75784f28 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:50.827462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e71e5af-12b6-4256-a5a4-6c0c75784f28 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:50.827866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:50.828645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:51.001605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e71e5af-12b6-4256-a5a4-6c0c75784f28 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:51.016105 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e71e5af-12b6-4256-a5a4-6c0c75784f28 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1222 microversion: 2.1 time: 0.198868 Jul 25 16:09:51.018046 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 638/1332] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:50 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:51.350325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:51.360679 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34488059-b812-42f2-8a3e-7939c2bc4a06 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.581734 Jul 25 16:09:51.379698 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 695/1333] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:50 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:51.404327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:51.404956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:51.434980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:51.438788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:51.439980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:51.442745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:51.614984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:51.632495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-faa0fb0c-a805-4f68-acee-416147c0f764 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1279 microversion: 2.1 time: 0.246930 Jul 25 16:09:51.640972 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 696/1334] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:51 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:51.656268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:51.657245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:51.668922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:51.669716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:51.670684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:51.671284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.029493 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc8d82c8-fe88-4358-9c9d-8719e963078d tempest-MigrationsAdminTest-1673509893 tempest-MigrationsAdminTest-1673509893-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1620 microversion: 2.1 time: 1.009404 Jul 25 16:09:52.032111 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 639/1335] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:51 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1620 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:52.078358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac1591e9-41f6-419c-8da4-aa348ffb6c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:52.081426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ac1591e9-41f6-419c-8da4-aa348ffb6c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:52.084672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:52.100125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:52.125140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.129230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.131658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.132792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.303722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac1591e9-41f6-419c-8da4-aa348ffb6c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:52.311667 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac1591e9-41f6-419c-8da4-aa348ffb6c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1222 microversion: 2.1 time: 0.250960 Jul 25 16:09:52.319146 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 697/1336] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:52 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:52.348601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:09:52.390368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:52.391039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:52.416046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.420710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.427273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.428476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.574050 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5aba3216-5b49-4860-9604-1e196d31ebaa tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "DELETE /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 204 len: 0 microversion: 2.1 time: 0.499595 Jul 25 16:09:52.580175 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 640/1337] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:09:52 2022] DELETE /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:09:52.586263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:52.586973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:52.606578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.614125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.614924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.615363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.865550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:52.868603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:52.878962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ed43829-17e8-466e-b55d-033547f0dd62 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.496396 Jul 25 16:09:52.880300 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 698/1338] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:52 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:52.886108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:52.887186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:52.888378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c60ecc9d-d5eb-4403-8b87-fa510f0c09b4 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1473 microversion: 2.1 time: 0.306267 Jul 25 16:09:52.896816 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 641/1339] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:52 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1473 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:52.905975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.907238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:52.908879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:52.910033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.153021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:53.154528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:53.169339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.182063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.183292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.183900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.234485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:53.243719 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78856fec-a824-48f1-919f-f14d50ca83e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1321 microversion: 2.1 time: 0.361954 Jul 25 16:09:53.254966 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 699/1340] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:52 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:53.359875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:53.360494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:53.374253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.375026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.377425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.378181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.527970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:53.570808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:53.601549 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06baa2a4-6f3b-40ab-9ed4-7d54de8df12e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1282 microversion: 2.1 time: 0.248225 Jul 25 16:09:53.602490 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 700/1341] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:53 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1282 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:53.607725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-53b3f634-2859-4dc8-8e3f-38704e463915 req-5c32f75d-10cb-40ff-ac08-4e87e0263cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "name": "network-vif-plugged", "status": "completed", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:53.626807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-53b3f634-2859-4dc8-8e3f-38704e463915 req-5c32f75d-10cb-40ff-ac08-4e87e0263cf9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.627257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-53b3f634-2859-4dc8-8e3f-38704e463915 req-5c32f75d-10cb-40ff-ac08-4e87e0263cf9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.649231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c24f702-28a0-44b5-b610-e23b11652f7e tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1864 microversion: 2.1 time: 0.498338 Jul 25 16:09:53.652124 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 642/1342] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:53 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1864 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:09:53.663926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6f69437-5922-4230-9690-62c8be85cb4e", "device": "/dev/xvdb"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:53.668949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-53b3f634-2859-4dc8-8e3f-38704e463915 req-5c32f75d-10cb-40ff-ac08-4e87e0263cf9 service nova] Creating event network-vif-plugged:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h2-846219-13 Jul 25 16:09:53.671221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:53.686229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.690027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-53b3f634-2859-4dc8-8e3f-38704e463915 req-5c32f75d-10cb-40ff-ac08-4e87e0263cf9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086166 Jul 25 16:09:53.690688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 701/1343] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:53.697780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.701636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-13", "block_migration": true, "disk_over_commit": false}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:53.702926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.705386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:53.705587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.712885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.713669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.714959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:53.718880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:53.750901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lazy-loading 'flavor' on Instance uuid 01318d40-8f22-4197-a911-5fb6b6c06a76 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:09:53.765263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Going to try to live migrate instance to n-h2-846219-13 {{(pid=119599) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:09:54.402105 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5ca1209b-94a3-409d-99ff-d3c785774dc5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "POST /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.748029 Jul 25 16:09:54.403926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 643/1344] 10.222.0.105 () {62 vars in 1369 bytes} [Mon Jul 25 16:09:53 2022] POST /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:09:54.484937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:54.487890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:54.536509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:54.538634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:54.541999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:54.547190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:56.494942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:56.525762 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-826aa74b-f775-4349-8935-9797102a68c5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 2.104036 Jul 25 16:09:56.527616 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 644/1345] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:54 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:56.548567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:56.549745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:56.592777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:56.596312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:56.598162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:56.602195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:57.391437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:57.400829 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9fcd58d-f54d-4a40-9d94-891279c6ab78 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 200 len: 1473 microversion: 2.1 time: 0.871789 Jul 25 16:09:57.401921 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 645/1346] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:56 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 1473 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:57.431167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:57.432469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:57.464771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:57.465544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:57.466999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:57.489519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:58.430830 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b6ef5df-a102-49ce-bc4b-020e55d25f20 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/action" status: 202 len: 0 microversion: 2.1 time: 4.735266 Jul 25 16:09:58.436295 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 702/1347] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:09:53 2022] POST /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/action => generated 0 bytes in 4739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:09:58.446298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:58.458765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:58.486386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:58.498262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:58.512656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:58.521652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:58.529364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:58.532767 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f9f93d8-b335-4440-bcc7-246c964a54bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1321 microversion: 2.1 time: 1.121004 Jul 25 16:09:58.544188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 646/1348] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:57 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1321 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:58.566940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0316a16e-8d75-4db0-be2e-da0ea8694ac1 req-f73793ed-52bc-4cfb-bdda-da2562079096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:58.607157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0316a16e-8d75-4db0-be2e-da0ea8694ac1 req-f73793ed-52bc-4cfb-bdda-da2562079096 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:58.608841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0316a16e-8d75-4db0-be2e-da0ea8694ac1 req-f73793ed-52bc-4cfb-bdda-da2562079096 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:58.646603 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0316a16e-8d75-4db0-be2e-da0ea8694ac1 req-f73793ed-52bc-4cfb-bdda-da2562079096 service nova] Creating event network-changed:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:09:58.657892 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0316a16e-8d75-4db0-be2e-da0ea8694ac1 req-f73793ed-52bc-4cfb-bdda-da2562079096 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111694 Jul 25 16:09:58.661053 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 647/1349] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:09:58.674881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:58.676109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:58.688015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:58.689201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:58.690795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:58.691713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:59.676355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:59.701805 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36fd21e8-d5d0-423f-b41b-0b03bb501881 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 1.264773 Jul 25 16:09:59.702900 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 703/1350] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:58 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:59.722275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:59.723772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 59a1fc55-193a-4d0b-9715-c14bef72a230] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:59.747546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:59.758816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:09:59.766528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:59.768383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:59.778531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:59.792279 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a63ad127-115f-45a0-a159-f6904cbccd7a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 1.127811 Jul 25 16:09:59.809904 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 648/1351] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:58 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:09:59.836455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:09:59.837994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:09:59.872058 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] HTTP exception thrown: Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 could not be found. Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Request method failure captured: Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 HTTP/1.1 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7z5Y15EB_5NQN9ygiCkiN_BfoUV5HgV-Pfn7ACII1GmBGbZ3SJ5fGxmAaP5ELOR9DJeEWA2oJBAaU-w82NJ3FLgvRxPugR9avWxpU4PIhtcwwRElD8c31JUgRMpL0vglrkoTEbYtic_D1nMt7Tl7nZt8sFTv3GZUI2DvkdsA2ifEs Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d9f0fc04dc474012a154839ce32e979d"}]}] Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MigrationsAdminTest-1285478579 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 797cc3e401c3492187cd37395c534d3c Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 could not be found. Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '59a1fc55-193a-4d0b-9715-c14bef72a230'} Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 could not be found. Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 could not be found. Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:09:59.876164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 could not be found. Jul 25 16:09:59.884817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:09:59.889935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:59.889935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:59.891588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Returning 404 to user: Instance 59a1fc55-193a-4d0b-9715-c14bef72a230 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:09:59.897696 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf1fd616-9bc9-4194-957f-158032184676 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230" status: 404 len: 111 microversion: 2.1 time: 0.182445 Jul 25 16:09:59.898076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:59.899346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:09:59.910303 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 704/1352] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:59 2022] GET /compute/v2.1/servers/59a1fc55-193a-4d0b-9715-c14bef72a230 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:09:59.936252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-cf1cce5a-971b-4952-8d28-1b29f41beebe req-e86b7aeb-ac23-4f9b-bed8-aa9c07079ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a1fc55-193a-4d0b-9715-c14bef72a230", "name": "network-vif-deleted", "tag": "df163020-12d0-4b74-9ab5-d5b5ec00b713"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:09:59.968422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cf1cce5a-971b-4952-8d28-1b29f41beebe req-e86b7aeb-ac23-4f9b-bed8-aa9c07079ba1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:09:59.969215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cf1cce5a-971b-4952-8d28-1b29f41beebe req-e86b7aeb-ac23-4f9b-bed8-aa9c07079ba1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:00.037770 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-cf1cce5a-971b-4952-8d28-1b29f41beebe req-e86b7aeb-ac23-4f9b-bed8-aa9c07079ba1 service nova] Creating event network-vif-deleted:df163020-12d0-4b74-9ab5-d5b5ec00b713 for instance 59a1fc55-193a-4d0b-9715-c14bef72a230 on n-h2-846219-13 Jul 25 16:10:00.070576 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-cf1cce5a-971b-4952-8d28-1b29f41beebe req-e86b7aeb-ac23-4f9b-bed8-aa9c07079ba1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157531 Jul 25 16:10:00.071902 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 705/1353] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:00.096824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:00.101491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:00.134699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:00.135950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:00.137487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:00.150267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:00.234879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:00.585501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:00.960077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:00.977731 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db75ca2e-13ea-472d-bc25-5436c28e41bf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 1.161388 Jul 25 16:10:00.979467 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 649/1354] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:09:59 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:00.992491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:00.995581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:01.010374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:01.013978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:01.015141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:01.015780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:01.020912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:01.099289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:01.110140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:01.241429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:01.259826 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2bf4b95-70e4-494d-915f-fa8b575ebe67 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1321 microversion: 2.1 time: 1.186486 Jul 25 16:10:01.266435 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 706/1355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:00 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1321 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:01.283773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:01.289395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:01.289816 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7cca5c49-4ccc-4fcb-9a07-f9aa72b6157a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 204 len: 0 microversion: 2.1 time: 0.305237 Jul 25 16:10:01.298257 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 650/1356] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:00 2022] DELETE /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:01.312419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:01.313130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:01.313884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:01.318093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:01.318869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:01.319000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:01.343624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:01.349084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:01.351078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:01.354119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:01.982903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:02.009864 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d055151-ffca-47a5-92fe-86834dbab2c8 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.728201 Jul 25 16:10:02.009864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 707/1357] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:01 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:02.018043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:02.019801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:02.029364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.031847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:02.037141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.040518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:02.280714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:02.292049 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0cace371-6a05-4c3c-854a-f9c30b749c58 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.988702 Jul 25 16:10:02.292690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 651/1358] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:01 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:02.308936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:02.311000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:02.313232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:02.337269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.337717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:02.338534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.338968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:02.773314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:02.788166 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-595c50b8-b4ad-4615-aaaf-3ff8760c39a0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.494218 Jul 25 16:10:02.794213 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 652/1359] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:02 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:02.806822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4003da7c-f77c-4b29-b9aa-a05948d6f434 req-ce3dcd56-f292-4598-8646-c550f8dbd2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa82002-d0f6-4378-bed5-9b1370a33d58", "tag": "4ed59899-2281-450e-8eca-ca341378848e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:02.842539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4003da7c-f77c-4b29-b9aa-a05948d6f434 req-ce3dcd56-f292-4598-8646-c550f8dbd2ed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.845397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4003da7c-f77c-4b29-b9aa-a05948d6f434 req-ce3dcd56-f292-4598-8646-c550f8dbd2ed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:02.852225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:02.872258 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f6abc32-4233-4bee-82fd-5c9836dd653b tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1537 microversion: 2.1 time: 0.871923 Jul 25 16:10:02.874742 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 708/1360] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:01 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1537 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:02.885617 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4003da7c-f77c-4b29-b9aa-a05948d6f434 req-ce3dcd56-f292-4598-8646-c550f8dbd2ed service nova] Creating event network-changed:4ed59899-2281-450e-8eca-ca341378848e for instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 on n-h1-846219-13 Jul 25 16:10:02.893917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:02.900607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:02.918793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.921579 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4003da7c-f77c-4b29-b9aa-a05948d6f434 req-ce3dcd56-f292-4598-8646-c550f8dbd2ed service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122977 Jul 25 16:10:02.922973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:02.923925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:02.927042 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 653/1361] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:02.930134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:03.046126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:03.048523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:03.072259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:03.078294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:03.081902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:03.088532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:03.570166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:03.609120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-587c90f2-5b5c-40d2-8a2c-f430b45f27a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1321 microversion: 2.1 time: 0.723056 Jul 25 16:10:03.610279 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 709/1362] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:02 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:03.636858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:03.641136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:03.689023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:03.689417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:03.690230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:03.690669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:03.709554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:03.718408 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc5528be-7830-4eb3-90b5-d6407daa87b6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.691183 Jul 25 16:10:03.729808 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 654/1363] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:03 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:03.820901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:03.822444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:03.850884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:03.851335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:03.852295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:03.852744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:04.487840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:04.510769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:04.514154 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b937c2a7-c534-402a-8caf-7e94bc422d63 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.895643 Jul 25 16:10:04.516877 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 710/1364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:03 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:04.528285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:04.529797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:04.530041 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2a3d1c6e-df0c-4ebd-8310-0ba8994fc0a8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.710203 Jul 25 16:10:04.541128 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 655/1365] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:03 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:04.577513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:04.579278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:04.580725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:04.582275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:04.631883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:04.632966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:04.646332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:04.648561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:04.649566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:04.653244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:04.751150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:04.779771 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-caa288ab-1130-4481-b758-a610f4227ba3 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1495 microversion: 2.1 time: 0.260517 Jul 25 16:10:04.808837 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 711/1366] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:04 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1495 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:04.836238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:04.846364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:04.865315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:04.867747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:04.870376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:04.872972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:05.207967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:05.223868 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3585176f-4bf1-4116-8c4c-5625708c3912 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1321 microversion: 2.1 time: 0.596450 Jul 25 16:10:05.238743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:05.239251 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 656/1367] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:04 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:10:05.244471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-50030e08-ca2c-42f5-a33b-d057a7bf7635 req-17c06b36-1375-4d59-9301-b70c2791d58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac37fa7-5dbd-493e-b8f7-5787456f41ea", "name": "network-vif-deleted", "tag": "77f50b14-e743-420e-aaae-7d503b7ff4fa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:05.248894 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c13877d-a6c0-4f81-8e20-20b7afb1ee02 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.437940 Jul 25 16:10:05.255913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-50030e08-ca2c-42f5-a33b-d057a7bf7635 req-17c06b36-1375-4d59-9301-b70c2791d58a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:05.256662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-50030e08-ca2c-42f5-a33b-d057a7bf7635 req-17c06b36-1375-4d59-9301-b70c2791d58a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:05.262324 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 712/1368] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:04 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:05.285787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-50030e08-ca2c-42f5-a33b-d057a7bf7635 req-17c06b36-1375-4d59-9301-b70c2791d58a service nova] Creating event network-vif-deleted:77f50b14-e743-420e-aaae-7d503b7ff4fa for instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea on n-h1-846219-13 Jul 25 16:10:05.294944 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-50030e08-ca2c-42f5-a33b-d057a7bf7635 req-17c06b36-1375-4d59-9301-b70c2791d58a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056585 Jul 25 16:10:05.297043 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 657/1369] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:05.545084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:05.545947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:05.573554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:05.574954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:05.592919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:05.593704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:05.597373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:05.598016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:05.598540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:05.598997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:05.599750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:05.607836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:05.990783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:06.009509 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-182ae53c-7934-4fe9-a513-5270e244ecc9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.444450 Jul 25 16:10:06.010356 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 658/1370] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:05 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:10:06.027112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f5f00ecb-74ca-4d6d-ba5c-c98031f3b176 req-7492924c-cf9a-4ccc-99e8-680616ad1f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "name": "network-vif-plugged", "status": "completed", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:06.088821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f5f00ecb-74ca-4d6d-ba5c-c98031f3b176 req-7492924c-cf9a-4ccc-99e8-680616ad1f38 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.097826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f5f00ecb-74ca-4d6d-ba5c-c98031f3b176 req-7492924c-cf9a-4ccc-99e8-680616ad1f38 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.124124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:06.128111 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f5f00ecb-74ca-4d6d-ba5c-c98031f3b176 req-7492924c-cf9a-4ccc-99e8-680616ad1f38 service nova] Creating event network-vif-plugged:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:10:06.139011 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f5f00ecb-74ca-4d6d-ba5c-c98031f3b176 req-7492924c-cf9a-4ccc-99e8-680616ad1f38 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123977 Jul 25 16:10:06.148262 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 659/1371] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:06.160660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:06.164082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:06.176074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.176996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.178490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.179201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.179571 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-217f1f11-9599-45ca-8f1e-30d06666f9ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.637069 Jul 25 16:10:06.180998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 713/1372] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:05 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:06.253597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:06.258591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:06.319912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.321257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.331276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.336487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.461597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:06.492290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48f51254-fa04-4269-8499-4ce6b498757c tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 200 len: 1495 microversion: 2.1 time: 0.342360 Jul 25 16:10:06.495859 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 660/1373] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:06 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 1495 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:06.508031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:06.508663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:06.521351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.537936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.540077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:06.546502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:06.802483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:06.816948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31457bf3-7ef8-4ae9-841b-4deea306274c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1321 microversion: 2.1 time: 0.568476 Jul 25 16:10:06.818285 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 714/1374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:06 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:06.939259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:06.951722 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac95b4cd-8b08-4c35-aa37-1aaa650fbced tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.454365 Jul 25 16:10:06.956445 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 661/1375] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:06 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:07.059331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:07.059959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:07.079655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.080746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.083284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.091620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.219123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:07.220036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:07.236921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.238363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.239539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.240912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.827675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:07.851034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:07.881845 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6bac24a0-8f2d-43df-8539-df293e2f8454 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.668126 Jul 25 16:10:07.892544 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 662/1376] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:07 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:07.895246 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d36a2fc-0d28-4e50-aa23-8faa39699041 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.844283 Jul 25 16:10:07.933275 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 715/1377] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:07 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:07.945323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:07.947917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:07.949383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 6ac37fa7-5dbd-493e-b8f7-5787456f41ea] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:07.954483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:07.974506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.976570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.977976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.979836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.980865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.989876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:07.991769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:07.992792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:08.046138 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] HTTP exception thrown: Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea could not be found. Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Request method failure captured: Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea HTTP/1.1 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r7z5Y15EB_5NQN9ygiCkiN_BfoUV5HgV-Pfn7ACII1GmBGbZ3SJ5fGxmAaP5ELOR9DJeEWA2oJBAaU-w82NJ3FLgvRxPugR9avWxpU4PIhtcwwRElD8c31JUgRMpL0vglrkoTEbYtic_D1nMt7Tl7nZt8sFTv3GZUI2DvkdsA2ifEs Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d9f0fc04dc474012a154839ce32e979d"}]}] Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 797cc3e401c3492187cd37395c534d3c Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea could not be found. Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6ac37fa7-5dbd-493e-b8f7-5787456f41ea'} Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea could not be found. Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea could not be found. Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:08.050167 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea could not be found. Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:08.073647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Returning 404 to user: Instance 6ac37fa7-5dbd-493e-b8f7-5787456f41ea could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:08.077340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-36e6e917-40c7-4203-b299-9a477ffd3863 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea" status: 404 len: 111 microversion: 2.1 time: 0.174702 Jul 25 16:10:08.084180 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 663/1378] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:07 2022] GET /compute/v2.1/servers/6ac37fa7-5dbd-493e-b8f7-5787456f41ea => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:10:08.093498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:08.095173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:08.116599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:08.122527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:08.123982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:08.124870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:08.715003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:08.729408 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9b9a548-2ae8-470c-8c94-449537715c03 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.642469 Jul 25 16:10:08.731246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 664/1379] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:08 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:08.740740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-76ce5044-6fb7-4050-a8ce-81887845f2bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '.version_select at 0x7f9d93a0ce50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:08.801627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-76ce5044-6fb7-4050-a8ce-81887845f2bb tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38290664" status: 202 len: 0 microversion: 2.1 time: 0.068810 Jul 25 16:10:08.804307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 665/1380] 10.222.0.105 () {58 vars in 1220 bytes} [Mon Jul 25 16:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38290664 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:10:08.918210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:08.920137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:08.932025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:08.936662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:08.937842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:08.938477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:09.133402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:09.146683 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b56546d2-a801-4c2e-9736-9ce81d8c1153 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.211392 Jul 25 16:10:09.152947 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 716/1381] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:07 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:09.166711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:09.179101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:09.216651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:09.217301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:09.221380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:09.224777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:09.806398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:09.817153 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0fa0edea-5877-4099-a62d-44256883b28a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.904576 Jul 25 16:10:09.837453 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 666/1382] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:08 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:09.855338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-450175311", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:09.977993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] validate_networks() for [('772d42f0-328d-4c98-8730-4f6263eb1e55', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:10:10.878374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:10.911557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-086a6fa8-6bb7-41d0-b62b-4ef435bfb980 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 1.751799 Jul 25 16:10:10.916872 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 717/1383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:09 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:10.932401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:10.940291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:10.953602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:10.954383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:10.961770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:10.963008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:11.719163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:11.734497 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c6bd1a3f-7a48-4694-9512-3ab4271c922b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.807042 Jul 25 16:10:11.736516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 718/1384] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:10 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:11.750156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:11.750959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:11.770700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:11.778294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:11.779085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:11.784961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:11.786222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:12.620963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:12.680173 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ce34850-7c6b-4b2d-b724-2770c63b2cd1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.940345 Jul 25 16:10:12.700831 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 719/1385] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:11 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:12.706766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:12.708936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:12.743142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:12.747929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:12.749025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:12.753588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.018121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:10:13.019413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:10:13.020478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:10:13.021168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:10:13.021919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:10:13.042222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.045816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.047047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.051260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.126977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Getting quotas for project 7bd36be87b9d404ea0126c2046f31845. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:10:13.156409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:13.157966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Getting quotas for user fa99685f6e9645beb76617f1d0fdbae3 and project 7bd36be87b9d404ea0126c2046f31845. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:10:13.207155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:10:13.210811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:13.217636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:10:13.258211 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6e4454c-890e-40b9-adcd-8099ef0a6532 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.554634 Jul 25 16:10:13.263926 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 720/1386] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:12 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:13.299481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:13.318194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:13.363143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.363627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.371645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.373289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.394817 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-644af3ae-a90c-4a25-a7cb-3a233308e49a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.550830 Jul 25 16:10:13.396124 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 667/1387] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:10:09 2022] POST /compute/v2.1/servers => generated 382 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:10:13.444075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:13.444879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:13.481855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.487494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.489322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.490399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.542706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:13.652048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:13.762491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a348c215-2d9b-418b-b8f4-2e006a2990e8 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 204 len: 0 microversion: 2.1 time: 0.360548 Jul 25 16:10:13.765689 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 668/1388] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:13 2022] DELETE /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:13.789401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-925f5f3a-7774-413b-b5e2-c30c4949868b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:13.795080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-925f5f3a-7774-413b-b5e2-c30c4949868b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:13.871301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:13.902976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b849320e-1eaa-4777-93de-509421e74952 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.634200 Jul 25 16:10:13.921089 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 721/1389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:13 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:13.954759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:13.955682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:13.974413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.979034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:13.985196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:13.985849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:14.052897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-925f5f3a-7774-413b-b5e2-c30c4949868b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:14.068623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-925f5f3a-7774-413b-b5e2-c30c4949868b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1220 microversion: 2.1 time: 0.292159 Jul 25 16:10:14.070944 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 669/1390] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:13 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1220 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:14.106381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:14.107836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:14.119440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:14.128557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:14.129784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:14.131114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:14.503532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:14.516550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid c89f1679-8eed-4efc-b90b-9de768bb23d3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:14.568816 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e228f53-1dbd-4a5e-bf1f-6b21d8e2a145 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 2427 microversion: 2.25 time: 0.646388 Jul 25 16:10:14.573516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 722/1391] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:13 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 2427 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:14.595636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:14.596268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:14.606470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:14.607235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:14.608007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:14.608168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:14.608701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:14.635689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-317229c8-6bd6-4986-9d8e-5049aa1457cb tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.542933 Jul 25 16:10:14.637950 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 670/1392] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:14 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:14.660739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:14.663810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:14.688885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:14.690996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:14.696112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:14.696510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.034575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:15.065562 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc28c4b2-effc-4b99-a27b-b36db8c0c54e tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1471 microversion: 2.1 time: 0.490700 Jul 25 16:10:15.080543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 723/1393] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:14 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:15.117382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6ee341c4-7b2e-46d6-85fb-40ff5e5a8be9 req-579f67ef-cc7e-4b46-b917-6198907e6a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa82002-d0f6-4378-bed5-9b1370a33d58", "name": "network-vif-plugged", "status": "completed", "tag": "4ed59899-2281-450e-8eca-ca341378848e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:15.141817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6ee341c4-7b2e-46d6-85fb-40ff5e5a8be9 req-579f67ef-cc7e-4b46-b917-6198907e6a1b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.143083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6ee341c4-7b2e-46d6-85fb-40ff5e5a8be9 req-579f67ef-cc7e-4b46-b917-6198907e6a1b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.192412 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6ee341c4-7b2e-46d6-85fb-40ff5e5a8be9 req-579f67ef-cc7e-4b46-b917-6198907e6a1b service nova] Creating event network-vif-plugged:4ed59899-2281-450e-8eca-ca341378848e for instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 on n-h1-846219-13 Jul 25 16:10:15.203863 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6ee341c4-7b2e-46d6-85fb-40ff5e5a8be9 req-579f67ef-cc7e-4b46-b917-6198907e6a1b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107306 Jul 25 16:10:15.205655 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 724/1394] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:15.215427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:15.222872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-13", "block_migration": "auto"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:15.229323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:15.230672 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84cf00cc-75e2-43fa-8712-eba850432d57 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.583896 Jul 25 16:10:15.231364 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 671/1395] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:14 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:15.244356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.245823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.248016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.249817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.262035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:15.263168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:15.294177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.294630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.295422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.295887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.370395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'flavor' on Instance uuid c89f1679-8eed-4efc-b90b-9de768bb23d3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:15.421924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Going to try to live migrate instance to n-h1-846219-13 {{(pid=119599) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:10:15.832680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:15.845843 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a53c7fc4-653c-43ab-bd6f-fd618650abc0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.613245 Jul 25 16:10:15.849588 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 672/1396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:15 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:15.861005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:15.861646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:15.922879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.924857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:15.929901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:15.930617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:16.225224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:16.243124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e11eb4aa-955f-4495-be73-f3db7f83452d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1272 microversion: 2.1 time: 0.389323 Jul 25 16:10:16.244166 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 673/1397] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:15 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:16.271907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:16.274785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:16.296676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:16.297224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:16.299230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:16.301164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:16.686210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:16.709584 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3bbbf08d-1eb8-4540-8e7c-7a3cbfc5193e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.445824 Jul 25 16:10:16.710911 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 674/1398] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:16 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:16.716280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:16.717875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:16.726976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:16.728528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:16.729804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:16.730503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:17.006063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:17.020284 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7a155a77-f557-4af7-a0f9-5de713ee4610 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1471 microversion: 2.1 time: 0.303215 Jul 25 16:10:17.033141 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 675/1399] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:16 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:17.035451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:17.038411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:17.079353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:17.080074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:17.081459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:17.091254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:17.530382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:17.550315 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b065cdd-140e-4d23-a3ad-1678d167a687 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.521908 Jul 25 16:10:17.553191 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 676/1400] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:17 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:17.564709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:17.566748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:17.586997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:17.591448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:17.592981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:17.594752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:17.865713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:17.882212 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de3a7a0e-253f-47f8-bc91-0c4022c17a68 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1322 microversion: 2.1 time: 0.326384 Jul 25 16:10:17.884045 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 677/1401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:17 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:17.904595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:17.906038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:17.916421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:17.917490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:17.918922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:17.919634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:18.050929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:18.068034 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aae1ab04-e912-489d-88b0-18ddf6d3f4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1278 microversion: 2.1 time: 0.182259 Jul 25 16:10:18.087954 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 678/1402] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:17 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:18.102609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:18.103401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:18.126769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:18.130108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:18.131933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:18.134249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:18.482810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:18.495395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c96b91c-308e-4eea-bbcc-1ed75702fa8a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.407471 Jul 25 16:10:18.496564 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 679/1403] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:18 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:18.501993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:18.502872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:18.510278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:18.511065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:18.512078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:18.512702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:18.762959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:18.778604 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69d5df04-765a-4cc2-86d9-a7fe0b95bc9f tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1471 microversion: 2.1 time: 0.279747 Jul 25 16:10:18.783761 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 680/1404] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:18 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:18.793756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:18.794493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:18.804389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:18.805138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:18.805876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:18.806641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:19.048737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:19.067462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-434bf99e-3cae-4266-b886-47fba4b94f40 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.282244 Jul 25 16:10:19.069695 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 681/1405] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:18 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:19.075317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:19.076016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:19.083172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:19.083710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:19.084686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:19.085294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:19.382451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:19.409675 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-95ec3bb7-3de4-4b4d-bfac-32a859641f08 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1471 microversion: 2.1 time: 0.338299 Jul 25 16:10:19.422202 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 682/1406] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:19 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:19.422202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:19.422202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:19.429766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:19.430227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:19.432625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:19.433063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:19.662696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:19.672982 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6815a516-5ebc-4266-aa86-03daca6c070b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1278 microversion: 2.1 time: 0.259486 Jul 25 16:10:19.689010 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 683/1407] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:19 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:20.202521 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a471fdba-d57e-460d-8263-517e774fa366 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/action" status: 202 len: 0 microversion: 2.25 time: 4.993190 Jul 25 16:10:20.203275 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 725/1408] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:10:15 2022] POST /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/action => generated 0 bytes in 4997 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:20.208968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:20.210504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:20.255359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.255863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.256735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.257198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.470046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-560097135", "block_migration": true, "disk_over_commit": false}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:20.474139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:20.503792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.504702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.505799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.506492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.623302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lazy-loading 'flavor' on Instance uuid 5fa82002-d0f6-4378-bed5-9b1370a33d58 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:20.656431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Going to try to live migrate instance to tempest-host-560097135 {{(pid=119598) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:10:20.675114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] HTTP exception thrown: Compute host tempest-host-560097135 could not be found. Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Request method failure captured: Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58/action HTTP/1.1 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 106 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBMWwHc9czpjUHyLwq5PLmceOQ8aXSIQXO4BG-I5EFoGzhEDkUe6qTzC4klP-c6lq8iyfp8aYVlfuNCIgVnIEa1cg0IVnX6PYwmqp3oQuGROcUVJxY6xtyHdYtAmIUFu7etWapatM-50PLYGcnazROR_Oju7qZYqIU1nz4kWQVTlWE Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d7c7491acfb5492da38188d166dc9e49 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveMigrationNegativeTest-891336219 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d7c7491acfb5492da38188d166dc9e49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d7c7491acfb5492da38188d166dc9e49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d7c7491acfb5492da38188d166dc9e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d7c7491acfb5492da38188d166dc9e49"}]}] Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveMigrationNegativeTest-891336219 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d7c7491acfb5492da38188d166dc9e49 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-891336219 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveMigrationNegativeTest-891336219-project-admin Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a047d3cb77074386b7b9803350647b64 Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveMigrationNegativeTest-891336219-project-admin Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: {"os-migrateLive": {"host": "tempest-host-560097135", "block_migration": true, "disk_over_commit": false}} Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: exception: Compute host tempest-host-560097135 could not be found. Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5fa82002-d0f6-4378-bed5-9b1370a33d58', 'body': {'os-migrateLive': {'host': 'tempest-host-560097135', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 25 16:10:20.686365 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-560097135 could not be found. Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-560097135 could not be found. Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-560097135 could not be found. Jul 25 16:10:20.692463 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:20.697749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Returning 400 to user: Compute host tempest-host-560097135 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:20.701045 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9802a959-0c5a-4f7c-9eb9-c9011d011982 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58/action" status: 400 len: 99 microversion: 2.1 time: 1.010139 Jul 25 16:10:20.708161 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 684/1409] 10.222.0.105 () {60 vars in 1284 bytes} [Mon Jul 25 16:10:19 2022] POST /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58/action => generated 99 bytes in 1016 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:20.718762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3ccffd62-e65e-4c1d-80fd-9bafc5c280ae req-a6fd786d-0627-4ca4-8404-bb91bec9ae9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba754468-b0f7-4418-8813-23048902169f", "name": "network-vif-deleted", "tag": "2d0ff43e-5c97-48f9-b953-4d64885d233d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:20.745462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3ccffd62-e65e-4c1d-80fd-9bafc5c280ae req-a6fd786d-0627-4ca4-8404-bb91bec9ae9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.746487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3ccffd62-e65e-4c1d-80fd-9bafc5c280ae req-a6fd786d-0627-4ca4-8404-bb91bec9ae9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.754473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:20.768894 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b4efbea-ee6a-4905-85ca-d9760c94eb7c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.564441 Jul 25 16:10:20.769539 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 726/1410] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:20 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:20.785198 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3ccffd62-e65e-4c1d-80fd-9bafc5c280ae req-a6fd786d-0627-4ca4-8404-bb91bec9ae9b service nova] Creating event network-vif-deleted:2d0ff43e-5c97-48f9-b953-4d64885d233d for instance ba754468-b0f7-4418-8813-23048902169f on n-h1-846219-13 Jul 25 16:10:20.791195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:20.793218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:20.796850 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3ccffd62-e65e-4c1d-80fd-9bafc5c280ae req-a6fd786d-0627-4ca4-8404-bb91bec9ae9b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087152 Jul 25 16:10:20.805814 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 685/1411] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:20.815761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.817843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.820313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.821668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.823860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:20.831537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:20.856127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.858066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.862082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.863952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.908332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:20.974109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:20.980721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:20.983638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lazy-loading 'fault' on Instance uuid ba754468-b0f7-4418-8813-23048902169f {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:21.083702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:21.091668 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aafd1e65-9474-4053-8986-2458c3dd76ad tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 200 len: 1306 microversion: 2.1 time: 0.317318 Jul 25 16:10:21.106467 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 727/1412] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:20 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 1306 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:21.113366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:21.115023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:21.123976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:21.124744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:21.125761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:21.128837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:21.364582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:21.373338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a53c04e6-a62f-41d3-9acd-98b354f38f53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.565675 Jul 25 16:10:21.373933 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 686/1413] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:20 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:21.410270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:21.411204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:21.428937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:21.429683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:21.430688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:21.431407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:21.563684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:21.578530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:21.584661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:21.589385 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99072e1f-c315-4d7d-b366-edb7102dd9ce tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.480112 Jul 25 16:10:21.592383 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 728/1414] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:21 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:21.604136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:21.605648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:21.619115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:21.622254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:21.624391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:21.626905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:21.966120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:21.985700 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4cf408d-5b78-4799-8a5c-2ef0f1e9c1fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.588246 Jul 25 16:10:21.986332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 687/1415] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:21 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:21.997043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:21.999983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:22.014576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.019886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.021017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.021685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.037846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:22.046967 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cac02055-b016-4ca5-b2e4-1fbf7109387a tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1471 microversion: 2.1 time: 0.453006 Jul 25 16:10:22.064732 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 729/1416] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:21 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1471 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:22.118054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:22.119031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: ba754468-b0f7-4418-8813-23048902169f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:22.127305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.128070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.140573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.143080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.192493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] HTTP exception thrown: Instance ba754468-b0f7-4418-8813-23048902169f could not be found. Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Request method failure captured: Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f HTTP/1.1 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7z5Y15EB_5NQN9ygiCkiN_BfoUV5HgV-Pfn7ACII1GmBGbZ3SJ5fGxmAaP5ELOR9DJeEWA2oJBAaU-w82NJ3FLgvRxPugR9avWxpU4PIhtcwwRElD8c31JUgRMpL0vglrkoTEbYtic_D1nMt7Tl7nZt8sFTv3GZUI2DvkdsA2ifEs Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d9f0fc04dc474012a154839ce32e979d"}]}] Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 797cc3e401c3492187cd37395c534d3c Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance ba754468-b0f7-4418-8813-23048902169f could not be found. Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'ba754468-b0f7-4418-8813-23048902169f'} Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba754468-b0f7-4418-8813-23048902169f could not be found. Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba754468-b0f7-4418-8813-23048902169f could not be found. Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:22.201041 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba754468-b0f7-4418-8813-23048902169f could not be found. Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Returning 404 to user: Instance ba754468-b0f7-4418-8813-23048902169f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-472549cb-c12e-4b24-9ff3-7c7074ee1954 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f" status: 404 len: 111 microversion: 2.1 time: 0.090146 Jul 25 16:10:22.207628 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 730/1417] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:22 2022] GET /compute/v2.1/servers/ba754468-b0f7-4418-8813-23048902169f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:10:22.213892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1775896651", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:22.302538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:10:22.556560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:22.567912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78fa368f-7ffb-431f-b1dd-f3d6dd2ea3db tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1528 microversion: 2.1 time: 0.577523 Jul 25 16:10:22.585852 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 688/1418] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:21 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1528 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:22.592041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:22.595237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:22.603417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.603866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.604667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.605127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.685569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:22.712190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:10:22.712804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:10:22.713291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:10:22.713878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:10:22.714294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:10:22.727903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.728576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.729639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.733967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.774465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Getting quotas for project 28c1fe0b11a64534b2cf7f32cf1667ca. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:10:22.786510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Getting quotas for user b0d4e20c5b6c4daa9a3127438be07934 and project 28c1fe0b11a64534b2cf7f32cf1667ca. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:10:22.817066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:10:22.819454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:10:22.853407 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-349ff73e-db46-472f-bed8-c65f10f33b8a tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 204 len: 0 microversion: 2.1 time: 0.275831 Jul 25 16:10:22.853892 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 689/1419] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:22 2022] DELETE /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:22.860957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:22.868139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:22.883413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.884127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.885021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.885849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.907140 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-486f53cc-f694-4be7-b80c-909d9ee7bdb7 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.699576 Jul 25 16:10:22.908695 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 731/1420] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:10:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:10:22.915672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:22.916656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:22.925401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.926773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:22.928123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:22.928729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:23.085609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:23.542058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:23.557077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:23.560995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:23.569212 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b36c987-f3e4-439b-bf4a-8be1e8bbc2d9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.658986 Jul 25 16:10:23.570254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 732/1421] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:22 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:23.582963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:23.586353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:23.596629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:23.615929 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9baf92b3-b7d8-47d2-ba51-e6de3c109bbb tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.753400 Jul 25 16:10:23.618867 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 690/1422] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:22 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:23.624233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-141ec922-8af6-4a70-a822-d8206bd49926 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:23.629700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:23.630524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:23.634513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:23.635381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:23.641385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-141ec922-8af6-4a70-a822-d8206bd49926 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:23.940419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-141ec922-8af6-4a70-a822-d8206bd49926 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:23.951309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-141ec922-8af6-4a70-a822-d8206bd49926 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1223 microversion: 2.1 time: 0.330676 Jul 25 16:10:23.965216 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 691/1423] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:23 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1223 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:23.990104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:23.995893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:24.013524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.017959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.021077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.026395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.214847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:24.225773 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fa4f54c9-a292-4561-a247-dda3b706b707 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1472 microversion: 2.1 time: 0.649983 Jul 25 16:10:24.226460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 733/1424] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:23 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1472 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:24.240331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fa5beda1-b186-4a41-b87d-5af6ad4a78c0 req-60111db3-020b-4431-bda1-2088d2d53c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7615cee-3cb3-4712-b6c0-2b4d54eba252", "tag": "bf7d9253-2eba-4bbf-9c8d-cd6a0617531d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:24.261918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fa5beda1-b186-4a41-b87d-5af6ad4a78c0 req-60111db3-020b-4431-bda1-2088d2d53c3d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.267615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fa5beda1-b186-4a41-b87d-5af6ad4a78c0 req-60111db3-020b-4431-bda1-2088d2d53c3d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.300854 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fa5beda1-b186-4a41-b87d-5af6ad4a78c0 req-60111db3-020b-4431-bda1-2088d2d53c3d service nova] Creating event network-changed:bf7d9253-2eba-4bbf-9c8d-cd6a0617531d for instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 on n-h2-846219-13 Jul 25 16:10:24.312660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fa5beda1-b186-4a41-b87d-5af6ad4a78c0 req-60111db3-020b-4431-bda1-2088d2d53c3d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079109 Jul 25 16:10:24.317549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 734/1425] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:24.329554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:24.335149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:24.352907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.353684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.354875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.355586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.426932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:24.446498 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0c82f6c-66fc-4493-b418-2a24cb2e96e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.476207 Jul 25 16:10:24.462435 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 692/1426] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:23 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:24.604929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:24.617618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:24.625586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.626577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.630839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.632001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.721336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:24.735534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aafa22a2-da8d-483b-8127-41f777b144e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1510 microversion: 2.1 time: 0.410017 Jul 25 16:10:24.737735 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 735/1427] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:24 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:24.747806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:24.749014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:24.760059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.760837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:24.761860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:24.762661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:25.377614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:25.401381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:25.410155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:25.427795 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94230b77-d36e-45cf-8a75-bdd33ae9a78f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.833192 Jul 25 16:10:25.430902 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 693/1428] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:24 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:25.444396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:25.447315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:25.508228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:25.511917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:25.517050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:25.518410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:25.788393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:25.801716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-779d7262-8853-40e4-be96-ce27a0d6c5bf tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1281 microversion: 2.1 time: 0.367308 Jul 25 16:10:25.816549 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 694/1429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:25 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1281 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:25.829689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:25.832857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:25.844816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:25.845638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:25.848093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:25.848758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:25.942716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:25.943175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:25.946924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lazy-loading 'fault' on Instance uuid 2dfbc09e-4c5b-48c5-9422-1c12520e3386 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:26.049724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:26.061985 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eae3c8c5-e0d0-450f-828e-ed58f1ada4be tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 1.321701 Jul 25 16:10:26.067228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 736/1430] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:24 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:26.080437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797cc3e401c3492187cd37395c534d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f0fc04dc474012a154839ce32e979d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:26.083805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:26.084929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:26.103006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.103926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.104289 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba9f24e8-9ea5-4761-b44e-5a7d788bfcef tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 200 len: 1307 microversion: 2.1 time: 0.286352 Jul 25 16:10:26.105675 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 695/1431] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:25 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:26.106984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.108762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.117419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:26.122769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:26.136853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.144512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.145785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.149433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.463925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:26.477017 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1c68be07-2a29-4368-b796-cf6c6b61307f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.408174 Jul 25 16:10:26.477913 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 737/1432] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:26 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:26.505665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0168bb86-6bd7-4dfb-beac-e35361fdd241 req-7d6fced0-f0fb-40b8-ab4c-cdab4b181cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfbc09e-4c5b-48c5-9422-1c12520e3386", "name": "network-vif-deleted", "tag": "bfac8b30-b4a5-49c8-bf39-2782f7de06de"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:26.541364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0168bb86-6bd7-4dfb-beac-e35361fdd241 req-7d6fced0-f0fb-40b8-ab4c-cdab4b181cfe service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.542032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0168bb86-6bd7-4dfb-beac-e35361fdd241 req-7d6fced0-f0fb-40b8-ab4c-cdab4b181cfe service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.558247 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0168bb86-6bd7-4dfb-beac-e35361fdd241 req-7d6fced0-f0fb-40b8-ab4c-cdab4b181cfe service nova] Creating event network-vif-deleted:bfac8b30-b4a5-49c8-bf39-2782f7de06de for instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 on n-h1-846219-13 Jul 25 16:10:26.574841 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0168bb86-6bd7-4dfb-beac-e35361fdd241 req-7d6fced0-f0fb-40b8-ab4c-cdab4b181cfe service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083264 Jul 25 16:10:26.579998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 738/1433] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:26.587390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:26.588694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:26.608057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.608677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.609531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:26.609968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:26.644660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:26.654682 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-29b8a7cd-ea54-47c6-b193-6f098908121a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1510 microversion: 2.1 time: 0.547469 Jul 25 16:10:26.656681 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 696/1434] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:26 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:26.662437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1124060423", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "c3f310b2-7d4b-46ff-8525-014185c19329"}, {"uuid": "0ba37d30-3dee-4510-8c0d-fc15b62a2ffd"}, {"uuid": "c3f310b2-7d4b-46ff-8525-014185c19329"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:26.769542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] validate_networks() for [('c3f310b2-7d4b-46ff-8525-014185c19329', None, None, None, None, None), ('0ba37d30-3dee-4510-8c0d-fc15b62a2ffd', None, None, None, None, None), ('c3f310b2-7d4b-46ff-8525-014185c19329', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:10:27.742812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:27.758087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:27.774471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:27.781833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0fc27c8-bb07-43bb-ac70-a68c209f9d8e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 1.199934 Jul 25 16:10:27.788512 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 739/1435] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:26 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:27.805277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:27.816370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:27.835209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:27.845923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:27.847253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:27.847883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:27.853489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:28.108118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:28.122300 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0253587f-37a1-4482-9c67-b48fbe7a01c0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1281 microversion: 2.1 time: 0.332056 Jul 25 16:10:28.130924 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 740/1436] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:27 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1281 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:28.158903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:28.164007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:28.186755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:28.187741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:28.190039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:28.190731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:28.817741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:28.838591 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fcc22225-995d-402c-9565-3a406b539b94 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.705129 Jul 25 16:10:28.839562 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 741/1437] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:28 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:28.852176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:28.852823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] [instance: 2dfbc09e-4c5b-48c5-9422-1c12520e3386] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:28.866723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:28.867182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:28.868033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:28.868472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:28.902046 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] HTTP exception thrown: Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 could not be found. Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Request method failure captured: Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 HTTP/1.1 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r7z5Y15EB_5NQN9ygiCkiN_BfoUV5HgV-Pfn7ACII1GmBGbZ3SJ5fGxmAaP5ELOR9DJeEWA2oJBAaU-w82NJ3FLgvRxPugR9avWxpU4PIhtcwwRElD8c31JUgRMpL0vglrkoTEbYtic_D1nMt7Tl7nZt8sFTv3GZUI2DvkdsA2ifEs Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d9f0fc04dc474012a154839ce32e979d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d9f0fc04dc474012a154839ce32e979d"}]}] Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: d9f0fc04dc474012a154839ce32e979d Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MigrationsAdminTest-1285478579 Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 797cc3e401c3492187cd37395c534d3c Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MigrationsAdminTest-1285478579-project Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 could not be found. Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '2dfbc09e-4c5b-48c5-9422-1c12520e3386'} Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 could not be found. Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 could not be found. Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:28.904869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 could not be found. Jul 25 16:10:28.910202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:28.914561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] Returning 404 to user: Instance 2dfbc09e-4c5b-48c5-9422-1c12520e3386 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:28.920083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-672340f9-fd81-4d2d-8e56-70841789ca89 tempest-MigrationsAdminTest-1285478579 tempest-MigrationsAdminTest-1285478579-project] 10.222.0.105 "GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386" status: 404 len: 111 microversion: 2.1 time: 0.076598 Jul 25 16:10:28.922504 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 742/1438] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:28 2022] GET /compute/v2.1/servers/2dfbc09e-4c5b-48c5-9422-1c12520e3386 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:10:28.936432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-14411035-5775-4029-840c-6c720dc1de11 req-fc4811ac-6e99-4689-8987-62fbb64422d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c047e2-d8dd-4bab-87cc-13dc514d7d58", "name": "network-vif-unplugged", "status": "completed", "tag": "8ddf5585-13f6-4f34-8418-5d89099cddbf"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:28.962830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-14411035-5775-4029-840c-6c720dc1de11 req-fc4811ac-6e99-4689-8987-62fbb64422d5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:28.963346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-14411035-5775-4029-840c-6c720dc1de11 req-fc4811ac-6e99-4689-8987-62fbb64422d5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:28.991293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.server_external_events [req-14411035-5775-4029-840c-6c720dc1de11 req-fc4811ac-6e99-4689-8987-62fbb64422d5 service nova] Unable to find a host for instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58. Dropping event network-vif-unplugged {{(pid=119599) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 16:10:28.992120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-14411035-5775-4029-840c-6c720dc1de11 req-fc4811ac-6e99-4689-8987-62fbb64422d5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067898 Jul 25 16:10:28.993164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 743/1439] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 16:10:29.000473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:29.005847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:29.022282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:29.024909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:29.026820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:29.028828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:29.716195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:29.727784 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-827ad3a6-d19b-44fd-8954-1e0175b77964 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.733495 Jul 25 16:10:29.730516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 744/1440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:28 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:29.741243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:29.765035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:29.818001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:29.845129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:29.846841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:29.850242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:30.420903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:30.451964 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d784651-31d3-49f3-b2a9-bdfda9e2c203 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 200 len: 1453 microversion: 2.1 time: 0.720255 Jul 25 16:10:30.465140 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 745/1441] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:29 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 1453 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:30.470836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:30.478482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:30.499618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:30.502580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:30.503539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:30.504765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:31.009008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:31.071051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:31.080801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:31.082277 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38d0b694-51ba-4bff-a346-10db6ef1a6c0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.615686 Jul 25 16:10:31.092691 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 746/1442] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:30 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:31.118418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:31.124689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:31.205000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:31.208948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:31.216988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:31.217580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:31.810869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:10:31.811678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:10:31.812348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:10:31.813021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:10:31.813757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:10:31.853814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:31.855025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:31.856645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:31.857646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:31.939127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Getting quotas for project 789a10dc64a7414b992e80d535bd72d1. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:10:31.959554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Getting quotas for user c424061ccba84b9fb38ec72e5d5f4213 and project 789a10dc64a7414b992e80d535bd72d1. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:10:32.007019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:10:32.012956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:10:32.147203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:32.183700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:32.199812 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4dfcc4b2-bd29-43b7-a799-5dcf524081ea tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.541625 Jul 25 16:10:32.201999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 697/1443] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:10:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 5544 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:10:32.208800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-39c2d5b0-7746-42d5-9be7-2cad41752964 req-36c2f49f-45ae-49f5-a84c-7e2b6eb33ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "name": "network-vif-unplugged", "status": "completed", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:32.227102 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2cdbef8-6a16-4cab-8063-950c6d9ccab1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1323 microversion: 2.1 time: 1.130867 Jul 25 16:10:32.243834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-39c2d5b0-7746-42d5-9be7-2cad41752964 req-36c2f49f-45ae-49f5-a84c-7e2b6eb33ace service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.244802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-39c2d5b0-7746-42d5-9be7-2cad41752964 req-36c2f49f-45ae-49f5-a84c-7e2b6eb33ace service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:32.245481 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 747/1444] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:31 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1323 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:32.262843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:32.267849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:32.287445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.288638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-39c2d5b0-7746-42d5-9be7-2cad41752964 req-36c2f49f-45ae-49f5-a84c-7e2b6eb33ace service nova] Creating event network-vif-unplugged:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h1-846219-13 Jul 25 16:10:32.290453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:32.291514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.295960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:32.303035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-39c2d5b0-7746-42d5-9be7-2cad41752964 req-36c2f49f-45ae-49f5-a84c-7e2b6eb33ace service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096794 Jul 25 16:10:32.304898 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 698/1445] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:32.313716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:32.320403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:32.335937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.337560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:32.339864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.344264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:32.468156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:32.488033 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Working on deleting snapshot adcf7fcc-35d3-4d6c-a060-f8c7436ed1bc from shelved instance... Jul 25 16:10:32.751861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:32.762479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:32.788922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8632870-adf8-469b-b7ac-c24bd56f1fc8 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.540179 Jul 25 16:10:32.789875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 748/1446] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:32 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:32.811676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:32.812658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:32.818323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:32.821254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.822021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:32.823034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:32.824039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.260478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:33.275387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e55c564-34f4-4e9e-aeef-732124253f06 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.472341 Jul 25 16:10:33.283642 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 749/1447] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:32 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:33.296166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:33.296788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:33.333418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.345904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.350307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.351409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.704751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:33.719163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:33.723781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:33.729848 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e0260e2c-770a-4dfb-89ab-891c2a53ec3f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.444850 Jul 25 16:10:33.730723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 750/1448] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:33 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:33.736118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:33.736792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:33.762436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.769883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.771195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.771811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.872420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Doing local delete in cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=119598) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 16:10:33.874413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.875085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.875922 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 16:10:33.885231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] deallocate_for_instance() {{(pid=119598) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 16:10:33.906241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:33.917605 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-720f9039-20c9-45bf-bba8-a4483ee3822a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1213 microversion: 2.1 time: 0.184765 Jul 25 16:10:33.918549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 751/1449] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:33 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:33.936202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:33.937863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:33.949582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.952112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:33.953201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:33.954205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:34.240818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:34.257698 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a0bf2574-4146-40d1-a924-9019fcc312d5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1323 microversion: 2.1 time: 0.332003 Jul 25 16:10:34.258437 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 752/1450] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:33 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:34.273839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:34.285903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:34.294915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:34.300271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:34.304612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:34.305683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:34.655053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:34.663343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-424bc059-0148-4091-bafa-8ee1e79fc963 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.403880 Jul 25 16:10:34.663927 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 753/1451] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:34 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:34.668918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-992eedbc-5621-4647-9fed-e72fd1d6122b req-40cb50e8-6883-4e51-b939-c186a9c228db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7615cee-3cb3-4712-b6c0-2b4d54eba252", "name": "network-vif-plugged", "status": "completed", "tag": "bf7d9253-2eba-4bbf-9c8d-cd6a0617531d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:34.679129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-992eedbc-5621-4647-9fed-e72fd1d6122b req-40cb50e8-6883-4e51-b939-c186a9c228db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:34.679797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-992eedbc-5621-4647-9fed-e72fd1d6122b req-40cb50e8-6883-4e51-b939-c186a9c228db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:34.696053 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-992eedbc-5621-4647-9fed-e72fd1d6122b req-40cb50e8-6883-4e51-b939-c186a9c228db service nova] Creating event network-vif-plugged:bf7d9253-2eba-4bbf-9c8d-cd6a0617531d for instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 on n-h2-846219-13 Jul 25 16:10:34.703816 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-992eedbc-5621-4647-9fed-e72fd1d6122b req-40cb50e8-6883-4e51-b939-c186a9c228db service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038353 Jul 25 16:10:34.705137 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 754/1452] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:34.710754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:34.711490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:34.718478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:34.718929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:34.719709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:34.720145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:34.892060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Updating instance_info_cache with network_info: [] {{(pid=119598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:10:35.008236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:35.021665 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aedd55eb-57c2-41d4-a5dd-0eeba0dd0d8e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.315184 Jul 25 16:10:35.022912 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 755/1453] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:34 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:35.027928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c2c284a6-c702-4a1b-9af2-08f858ebb5d0 req-a49057bb-b940-4c0b-b48f-28bce5590948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}, {"name": "network-changed", "server_uuid": "dc3cfcbf-e280-4466-8e07-f6dd0665fbc7", "tag": "99c6b522-88fc-4862-9049-00c7c9a5744c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:35.046078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c2c284a6-c702-4a1b-9af2-08f858ebb5d0 req-a49057bb-b940-4c0b-b48f-28bce5590948 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.046794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c2c284a6-c702-4a1b-9af2-08f858ebb5d0 req-a49057bb-b940-4c0b-b48f-28bce5590948 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.075339 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c2c284a6-c702-4a1b-9af2-08f858ebb5d0 req-a49057bb-b940-4c0b-b48f-28bce5590948 service nova] Creating event network-changed:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h1-846219-13 Jul 25 16:10:35.076117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c2c284a6-c702-4a1b-9af2-08f858ebb5d0 req-a49057bb-b940-4c0b-b48f-28bce5590948 service nova] Creating event network-changed:99c6b522-88fc-4862-9049-00c7c9a5744c for instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 on n-h1-846219-13 Jul 25 16:10:35.084493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c2c284a6-c702-4a1b-9af2-08f858ebb5d0 req-a49057bb-b940-4c0b-b48f-28bce5590948 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060024 Jul 25 16:10:35.085472 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 756/1454] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:35.106471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:35.237708 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fb2fa10-53d5-41c1-988d-3ea52d5a3109 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 204 len: 0 microversion: 2.1 time: 2.930643 Jul 25 16:10:35.238307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 699/1455] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:32 2022] DELETE /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 0 bytes in 2933 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:35.244795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:35.246279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:35.252554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.262712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.264125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.264609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.316964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c86f6bd7-5bca-4afb-adc8-df083042d1fc tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Action: 'update', calling method: .version_select at 0x7f9da4aeaa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:35.421014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c86f6bd7-5bca-4afb-adc8-df083042d1fc tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.421497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c86f6bd7-5bca-4afb-adc8-df083042d1fc tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.422320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c86f6bd7-5bca-4afb-adc8-df083042d1fc tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.422985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c86f6bd7-5bca-4afb-adc8-df083042d1fc tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.448275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:35.491413 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c86f6bd7-5bca-4afb-adc8-df083042d1fc tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c" status: 200 len: 240 microversion: 2.36 time: 0.404044 Jul 25 16:10:35.492733 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 757/1456] 10.222.0.105 () {62 vars in 1308 bytes} [Mon Jul 25 16:10:35 2022] PUT /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c => generated 240 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:10:35.500896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:35.503910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:35.517038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.518383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.520178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.521308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.547035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:35.559863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:35.563814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:35.577080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dddffb38-649c-4ff0-ae32-808a4c7a1942 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.336067 Jul 25 16:10:35.577749 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 700/1457] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:35 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:35.589696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:35.590691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:35.597563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.598001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.598770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.599408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.614744 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 HTTP/1.1 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '36c047e2-d8dd-4bab-87cc-13dc514d7d58'} Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:35.616621 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8dfd905-0eb3-4afd-b727-302763b3d0a9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 404 len: 111 microversion: 2.1 time: 0.040117 Jul 25 16:10:35.626469 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 701/1458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:35 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:10:35.628248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:35.628248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:35.635618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.636253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.637249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:35.637773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:35.975487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:35.984144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e6cf798-6929-4c5b-910d-089a2107c4d4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1317 microversion: 2.1 time: 0.489874 Jul 25 16:10:35.984875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 758/1459] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:35 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:35.996364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:36.001054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d68b066-cdf6-4b82-b3a1-3988df64359a tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Calling method '.version_select at 0x7f9da4aeaee0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:36.004638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-31d00b12-6bcd-41ab-92a7-a992c110a0f6 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1323 microversion: 2.1 time: 0.382303 Jul 25 16:10:36.005267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 702/1460] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:35 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:36.014023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:36.014980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:36.022539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.023209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.024358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.025032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.091756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d68b066-cdf6-4b82-b3a1-3988df64359a tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.092206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d68b066-cdf6-4b82-b3a1-3988df64359a tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.093007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d68b066-cdf6-4b82-b3a1-3988df64359a tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.093489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d68b066-cdf6-4b82-b3a1-3988df64359a tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.114143 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d68b066-cdf6-4b82-b3a1-3988df64359a tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c/detail" status: 200 len: 672 microversion: 2.36 time: 0.128033 Jul 25 16:10:36.114769 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 759/1461] 10.222.0.105 () {60 vars in 1309 bytes} [Mon Jul 25 16:10:35 2022] GET /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c/detail => generated 672 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:10:36.119579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1506148759", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:36.194388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:10:36.328871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:36.338592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cdac6332-def8-482a-8ef7-5e9bd184a8e9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.332198 Jul 25 16:10:36.339493 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 703/1462] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:36 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:36.344047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:36.344651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:36.351146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.351746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.352520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.352956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.675809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:36.688039 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ba90f5b-15ce-4fbd-8d1d-1b9a9b5eabef tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1320 microversion: 2.1 time: 0.347682 Jul 25 16:10:36.689000 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 704/1463] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:36 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:36.695333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Action: 'update', calling method: .version_select at 0x7f9d93903700>, body: {"quota_set": {"ram": "2048"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:36.773693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.774487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.775693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.776399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.819422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.819875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.820722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.821266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.892110 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e7e197a-74ae-4739-be7a-262687a854c7 tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c?user_id=156140e452ec46998953f299d9fa9579" status: 200 len: 240 microversion: 2.36 time: 0.201503 Jul 25 16:10:36.892675 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 705/1464] 10.222.0.105 () {62 vars in 1389 bytes} [Mon Jul 25 16:10:36 2022] PUT /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c?user_id=156140e452ec46998953f299d9fa9579 => generated 240 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:10:36.899039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:36.899676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:36.906525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.906975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:36.907808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:36.908415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:37.159721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:10:37.160220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:10:37.160733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:10:37.161302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:10:37.161776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:10:37.172722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:37.173204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:37.174021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:37.174465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:37.187264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:37.194172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:10:37.199903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:37.203811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:37.204700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:10:37.205135 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c3ab3fd-16b5-4c0e-9cf9-65c2f650af2c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.311328 Jul 25 16:10:37.217176 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 706/1465] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:36 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:37.217176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-892ec0f2-02f6-4bab-b13a-c6a057033a5b tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] Calling method '.version_select at 0x7f9d9381a160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:37.241013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:10:37.245449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:10:37.324686 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c942b123-6d44-4d48-b170-532f9d9283e1 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.208750 Jul 25 16:10:37.326489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 760/1466] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:10:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:10:37.334271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:37.335361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:37.358164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:37.358908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:37.359954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:37.361444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:37.414375 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-892ec0f2-02f6-4bab-b13a-c6a057033a5b tempest-QuotasAdminTestV236-497565677 tempest-QuotasAdminTestV236-497565677-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c?user_id=156140e452ec46998953f299d9fa9579" status: 200 len: 282 microversion: 2.36 time: 0.204278 Jul 25 16:10:37.421137 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 707/1467] 10.222.0.105 () {60 vars in 1369 bytes} [Mon Jul 25 16:10:37 2022] GET /compute/v2.1/os-quota-sets/8e3cbc37dfca4135aba4eada50b94b2c?user_id=156140e452ec46998953f299d9fa9579 => generated 282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:10:37.433932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:37.451559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:37.458115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:37.486625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:37.487197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:37.488561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:37.495572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.529005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:38.542539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b188554e-3373-4732-8312-886810618aec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1338 microversion: 2.1 time: 1.214197 Jul 25 16:10:38.543865 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 761/1468] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:37 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1338 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:38.562215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-db7a2284-ea42-4f26-b481-edb1b08cd96b req-d1f94d4f-7987-4d89-9a10-944e9e5325d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c047e2-d8dd-4bab-87cc-13dc514d7d58", "name": "network-vif-deleted", "tag": "8ddf5585-13f6-4f34-8418-5d89099cddbf"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:38.584669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-db7a2284-ea42-4f26-b481-edb1b08cd96b req-d1f94d4f-7987-4d89-9a10-944e9e5325d0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.585500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-db7a2284-ea42-4f26-b481-edb1b08cd96b req-d1f94d4f-7987-4d89-9a10-944e9e5325d0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.611298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.server_external_events [req-db7a2284-ea42-4f26-b481-edb1b08cd96b req-d1f94d4f-7987-4d89-9a10-944e9e5325d0 service nova] Unable to find a host for instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58. Dropping event network-vif-deleted {{(pid=119599) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 16:10:38.617490 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-db7a2284-ea42-4f26-b481-edb1b08cd96b req-d1f94d4f-7987-4d89-9a10-944e9e5325d0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.072349 Jul 25 16:10:38.619927 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 762/1469] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 16:10:38.629130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:38.631359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:38.666274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.667150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.669631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.670276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.709930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:38.725592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7a937522-0901-4f1e-ab38-1a7ff8ceb347 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1323 microversion: 2.1 time: 1.291429 Jul 25 16:10:38.726208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 708/1470] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:37 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1323 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:38.734744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:38.736811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:38.755573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.756311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.757298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.757973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.839173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:38.849647 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b15c8b25-5061-430b-b159-46bc0d04d0da tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1271 microversion: 2.1 time: 0.226958 Jul 25 16:10:38.850550 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 763/1471] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:38 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:38.857458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:38.858483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:38.870848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.872120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:38.873214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:38.873871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.022584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:39.037806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1e017064-8229-4815-a040-f60ab6a7684c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.306072 Jul 25 16:10:39.039183 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 709/1472] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:38 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:39.046915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:39.049335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:39.065850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.068161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.070514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.071162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.558698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:39.567553 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e0630ad5-74f0-4ae4-8fa4-dd7c899df61f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1509 microversion: 2.1 time: 0.714930 Jul 25 16:10:39.568675 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 764/1473] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:38 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1509 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:39.576389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:39.577798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:39.588665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.593011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.602882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.603615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.622197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:39.632048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:39.633764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:39.634989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d8f59f8-bd40-47eb-a9f1-1b638bc5494b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.594508 Jul 25 16:10:39.635757 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 710/1474] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:39 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:39.653538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:39.654405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:39.680951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.681634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.688110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.688730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.726960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:39.899445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:39.908503 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2f42720-ef52-4ac4-a7f9-423050136aca tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1338 microversion: 2.1 time: 0.338337 Jul 25 16:10:39.913823 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 765/1475] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:39 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1338 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:39.931634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:39.940714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:39.955271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.956726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.959360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:39.960758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:39.979363 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20179d1e-479a-4fc2-9fa1-1d440d8d0088 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 204 len: 0 microversion: 2.1 time: 0.332451 Jul 25 16:10:39.980432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 711/1476] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:39 2022] DELETE /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:39.987326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:39.988048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:40.004962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:40.005439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:40.006455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:40.007043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:40.286869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:40.305456 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1084629d-9d1e-4943-846b-b8a89d84e93d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1279 microversion: 2.1 time: 0.322129 Jul 25 16:10:40.332181 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 712/1477] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:39 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1279 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:40.350339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:40.351506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:40.364003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:40.368244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:40.369231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:40.369678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:40.761449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:40.772120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-79252673-b76c-41b7-8733-efd90d725231 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1323 microversion: 2.1 time: 0.856516 Jul 25 16:10:40.773876 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 766/1478] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:39 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1323 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:40.779020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:40.780013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:40.800507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:40.802085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:40.805719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:40.806929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:40.982246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:40.995002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-679eb694-bf02-4359-896d-298a959261d6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1515 microversion: 2.1 time: 0.659372 Jul 25 16:10:40.995605 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 713/1479] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:40 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:41.013214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:41.014121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:41.024177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.026483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:41.027406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.027858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:41.032732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:41.273737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:41.304568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c02fa65-00cf-4440-a70b-9b6711649758 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 0.518967 Jul 25 16:10:41.305422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 767/1480] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:40 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:41.310636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:41.318399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:41.328164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.329391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:41.330644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.331826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:41.750662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:41.775690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:41.781194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:41.782901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0902ca0d-86dd-4fcf-adac-0526e033e735 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.786268 Jul 25 16:10:41.790017 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 714/1481] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:40 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:41.794344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:41.795053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:41.803205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.803740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:41.804910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.805261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:41.935516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:41.955400 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b38d337-54f5-4a2d-b34e-a59afaf7df7d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1277 microversion: 2.1 time: 0.170686 Jul 25 16:10:41.957474 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 715/1482] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:41 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:41.971208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cc72aeec-7218-41fa-9f5e-96e89f13dff4 req-f66c3c56-6ff7-4a82-a66e-d35df4574436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3cfcbf-e280-4466-8e07-f6dd0665fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "99c6b522-88fc-4862-9049-00c7c9a5744c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:41.982789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cc72aeec-7218-41fa-9f5e-96e89f13dff4 req-f66c3c56-6ff7-4a82-a66e-d35df4574436 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:41.984027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cc72aeec-7218-41fa-9f5e-96e89f13dff4 req-f66c3c56-6ff7-4a82-a66e-d35df4574436 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:42.001276 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cc72aeec-7218-41fa-9f5e-96e89f13dff4 req-f66c3c56-6ff7-4a82-a66e-d35df4574436 service nova] Creating event network-vif-plugged:99c6b522-88fc-4862-9049-00c7c9a5744c for instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 on n-h1-846219-13 Jul 25 16:10:42.008606 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cc72aeec-7218-41fa-9f5e-96e89f13dff4 req-f66c3c56-6ff7-4a82-a66e-d35df4574436 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048974 Jul 25 16:10:42.011130 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 716/1483] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:42.018513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:42.019459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:42.029395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:42.029832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:42.030709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:42.031250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:42.186728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:42.197322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-802d12d2-cf8c-40d3-9272-886420ecd69a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.890502 Jul 25 16:10:42.197917 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 768/1484] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:41 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:42.220434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:42.221084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:42.234256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:42.236212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:42.237640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:42.238081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:42.804254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:42.820246 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0cc453f3-beeb-4785-8db1-2936d2cae749 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1323 microversion: 2.1 time: 0.801179 Jul 25 16:10:42.834258 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 717/1485] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:42 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1323 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:42.843878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:42.844854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:42.852111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:42.852554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:42.853620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:42.854250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:43.561213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:43.574245 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf29def8-3672-4dfa-890a-b01ee071c4ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 200 len: 1515 microversion: 2.1 time: 1.373114 Jul 25 16:10:43.575187 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 769/1486] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:42 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 1515 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:43.595273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c78a2918-f274-40f8-90c6-9091937d9c99 req-381ed54e-75d5-426e-b60b-bfff222005f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "name": "network-vif-unplugged", "status": "completed", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:43.608733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c78a2918-f274-40f8-90c6-9091937d9c99 req-381ed54e-75d5-426e-b60b-bfff222005f9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:43.609665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c78a2918-f274-40f8-90c6-9091937d9c99 req-381ed54e-75d5-426e-b60b-bfff222005f9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:43.622179 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c78a2918-f274-40f8-90c6-9091937d9c99 req-381ed54e-75d5-426e-b60b-bfff222005f9 service nova] Creating event network-vif-unplugged:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h1-846219-13 Jul 25 16:10:43.627659 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c78a2918-f274-40f8-90c6-9091937d9c99 req-381ed54e-75d5-426e-b60b-bfff222005f9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037443 Jul 25 16:10:43.628575 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 770/1487] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:43.773017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-820f4fc6-1375-49dd-aaa4-26f19b79dce5 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:43.776475 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:43.776475 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:10:43.777838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820f4fc6-1375-49dd-aaa4-26f19b79dce5 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:43.778287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820f4fc6-1375-49dd-aaa4-26f19b79dce5 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:43.779134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820f4fc6-1375-49dd-aaa4-26f19b79dce5 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:43.779561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-820f4fc6-1375-49dd-aaa4-26f19b79dce5 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:43.805071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-820f4fc6-1375-49dd-aaa4-26f19b79dce5 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.175267 Jul 25 16:10:43.805712 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 771/1488] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:10:43 2022] GET /compute/v2.1/os-services => generated 949 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:43.810944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:43.811880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:43.818955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:43.819472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:43.821116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:43.821116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:43.953942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:43.970329 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-825f6949-04f0-46a5-a5c5-c49f6660ed63 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1721 microversion: 2.1 time: 1.134596 Jul 25 16:10:43.970935 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 718/1489] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:42 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1721 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:43.976160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:43.982604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:44.005267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.006943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:44.008325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.009464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:44.802012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:44.820637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:44.822161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:44.824882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:44.827859 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f258bdcd-de1e-4f42-8f7e-77154c32a856 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 1.020461 Jul 25 16:10:44.841129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 772/1490] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:43 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:44.841129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:44.841526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:44.856983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.858131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:44.860063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.861200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:44.875787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ec5a712-5493-4421-8775-2f9305d0f01f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.903483 Jul 25 16:10:44.876731 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 719/1491] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:43 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:44.895474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d83ef2cc-4f41-4f1c-b7c9-b4196222a6e7 req-4434d57d-210a-45dd-8e97-1bb2987a554c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "name": "network-vif-unplugged", "status": "completed", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:44.910886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d83ef2cc-4f41-4f1c-b7c9-b4196222a6e7 req-4434d57d-210a-45dd-8e97-1bb2987a554c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.911670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d83ef2cc-4f41-4f1c-b7c9-b4196222a6e7 req-4434d57d-210a-45dd-8e97-1bb2987a554c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:44.932040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d83ef2cc-4f41-4f1c-b7c9-b4196222a6e7 req-4434d57d-210a-45dd-8e97-1bb2987a554c service nova] Creating event network-vif-unplugged:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h2-846219-13 Jul 25 16:10:44.938100 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d83ef2cc-4f41-4f1c-b7c9-b4196222a6e7 req-4434d57d-210a-45dd-8e97-1bb2987a554c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058952 Jul 25 16:10:44.938582 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 720/1492] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:44.944373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6864a538-e137-4cc8-8ab4-a1a1577e8c10 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:44.947253 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:44.947253 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:10:44.949302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6864a538-e137-4cc8-8ab4-a1a1577e8c10 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.949715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6864a538-e137-4cc8-8ab4-a1a1577e8c10 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:44.951693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6864a538-e137-4cc8-8ab4-a1a1577e8c10 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:44.954133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6864a538-e137-4cc8-8ab4-a1a1577e8c10 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.007055 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6864a538-e137-4cc8-8ab4-a1a1577e8c10 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.066337 Jul 25 16:10:45.009158 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 721/1493] 10.222.0.105 () {58 vars in 1175 bytes} [Mon Jul 25 16:10:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:45.017481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:45.018990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:45.033434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.034517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.036349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.036975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.474357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:45.483607 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53d328f8-7d8a-4dae-b621-64069f081119 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.652384 Jul 25 16:10:45.484684 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 773/1494] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:44 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:45.512679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:45.514042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:45.520907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.521444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.522204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.522713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.540585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 HTTP/1.1 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b7615cee-3cb3-4712-b6c0-2b4d54eba252'} Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:45.543932 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d058dc5a-9bd8-4d5c-be12-c0f5847e489f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 404 len: 111 microversion: 2.1 time: 0.061054 Jul 25 16:10:45.548930 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 774/1495] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:45 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:10:45.555171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:45.555393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:45.564094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.564094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.564699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.565702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.582441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:45.594699 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5323d4b3-b221-4d15-a69c-29d4b520c118 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1471 microversion: 2.1 time: 0.583505 Jul 25 16:10:45.607429 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 722/1496] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:45 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:45.613467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6d5b0d5-4397-4538-9e34-2e00d7e4fc8e tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:45.617202 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:45.617202 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:10:45.619192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d5b0d5-4397-4538-9e34-2e00d7e4fc8e tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.620465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d5b0d5-4397-4538-9e34-2e00d7e4fc8e tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.621514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d5b0d5-4397-4538-9e34-2e00d7e4fc8e tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.622158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d5b0d5-4397-4538-9e34-2e00d7e4fc8e tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.652733 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6d5b0d5-4397-4538-9e34-2e00d7e4fc8e tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.044024 Jul 25 16:10:45.653870 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 723/1497] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:10:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:45.658937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:45.659730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:45.666952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.667535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:45.668408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:45.668926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.140709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:46.150431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:46.166197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e2a0274-5294-4284-86ce-9b96cbc7d5a4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1711 microversion: 2.1 time: 0.616402 Jul 25 16:10:46.167853 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 775/1498] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:45 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1711 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:46.175927 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56bff913-1785-4d6a-a8e0-1ba8603b3d3f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.520713 Jul 25 16:10:46.202202 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 724/1499] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:45 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:46.207640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:46.208242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:46.219786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-489df49c-4a22-4f90-acef-8359b616dcd9 req-408fbd58-13d1-4df1-a56d-715eda83b43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7615cee-3cb3-4712-b6c0-2b4d54eba252", "name": "network-vif-deleted", "tag": "bf7d9253-2eba-4bbf-9c8d-cd6a0617531d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:46.227471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.227953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.233569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.234976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.237180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:46.246429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-489df49c-4a22-4f90-acef-8359b616dcd9 req-408fbd58-13d1-4df1-a56d-715eda83b43c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.247080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-489df49c-4a22-4f90-acef-8359b616dcd9 req-408fbd58-13d1-4df1-a56d-715eda83b43c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.261906 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-489df49c-4a22-4f90-acef-8359b616dcd9 req-408fbd58-13d1-4df1-a56d-715eda83b43c service nova] Creating event network-vif-deleted:bf7d9253-2eba-4bbf-9c8d-cd6a0617531d for instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 on n-h2-846219-13 Jul 25 16:10:46.266964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lazy-loading 'flavor' on Instance uuid dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:46.270045 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-489df49c-4a22-4f90-acef-8359b616dcd9 req-408fbd58-13d1-4df1-a56d-715eda83b43c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064058 Jul 25 16:10:46.271742 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 725/1500] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:46.278969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d56a4d0-ad9c-4083-a201-98dc1df0da2b tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.281758 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:46.281758 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:10:46.283056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d56a4d0-ad9c-4083-a201-98dc1df0da2b tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.283506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d56a4d0-ad9c-4083-a201-98dc1df0da2b tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.284317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d56a4d0-ad9c-4083-a201-98dc1df0da2b tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.284744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d56a4d0-ad9c-4083-a201-98dc1df0da2b tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.318736 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d56a4d0-ad9c-4083-a201-98dc1df0da2b tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?host=n-d-846219-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.044795 Jul 25 16:10:46.328383 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 726/1501] 10.222.0.105 () {58 vars in 1201 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/os-services?host=n-d-846219-13&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:10:46.332926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.337302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:46.344945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.345921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.346930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.347768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.390781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c670641e-4755-4b14-bf59-83197883b502 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.219745 Jul 25 16:10:46.395898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 776/1502] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:10:46 2022] POST /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:10:46.406290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.406290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:46.414320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.415124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.416243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.416854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.823332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:46.832192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:46.833839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:46.835299 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bbaad21-aba3-46e1-8ab5-026bc043a757 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.512684 Jul 25 16:10:46.835847 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 727/1503] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:46.840524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d93ab0c-f092-4069-b16f-334183339da4 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '.version_select at 0x7f9d938f8280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.844638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d93ab0c-f092-4069-b16f-334183339da4 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.845270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d93ab0c-f092-4069-b16f-334183339da4 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.853315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:46.856178 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d93ab0c-f092-4069-b16f-334183339da4 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.019063 Jul 25 16:10:46.856884 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 728/1504] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:46.861950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c0b9322-c53c-4721-999b-9dc12105cae6 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.864474 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:46.864474 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:10:46.865909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c0b9322-c53c-4721-999b-9dc12105cae6 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.866511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c0b9322-c53c-4721-999b-9dc12105cae6 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.867519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c0b9322-c53c-4721-999b-9dc12105cae6 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.868170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c0b9322-c53c-4721-999b-9dc12105cae6 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.871076 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd518a6b-bd13-4331-af7a-3f373cea33c7 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.473633 Jul 25 16:10:46.871911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 777/1505] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:46.885957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.886590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:46.893608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.894470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.895441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.895881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.899001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c0b9322-c53c-4721-999b-9dc12105cae6 tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040931 Jul 25 16:10:46.899704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 729/1506] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:46.911573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f3d8790-2876-40ec-935e-d33c4b42986c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f3d8790-2876-40ec-935e-d33c4b42986c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 163 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": 12345, "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 12345 Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:10:46.916151 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f3d8790-2876-40ec-935e-d33c4b42986c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f3d8790-2876-40ec-935e-d33c4b42986c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017392 Jul 25 16:10:46.922979 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 730/1507] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:10:46 2022] POST /compute/v2.1/servers => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:10:46.929549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:46.930251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:46.939462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.939988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:46.940896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:46.941366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:47.232227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=16 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:47.400859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=32 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:47.706244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:47.728552 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dfd31233-fd4c-4f35-a776-6b0792c3fc1b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1479 microversion: 2.1 time: 0.855283 Jul 25 16:10:47.729225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:47.742854 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 778/1508] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1479 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:47.744270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ed4052d-41a4-43dd-9856-29372f6c617b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.818600 Jul 25 16:10:47.746040 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 731/1509] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:46 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:47.748036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:47.748769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:47.754508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-287c456c-1182-4436-8c39-521fee5f01bf tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:47.755962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:47.756484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:47.757419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:47.757927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:47.763527 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:47.763527 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:10:47.766993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287c456c-1182-4436-8c39-521fee5f01bf tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:47.767747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287c456c-1182-4436-8c39-521fee5f01bf tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:47.767961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:47.770144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287c456c-1182-4436-8c39-521fee5f01bf tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:47.771228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287c456c-1182-4436-8c39-521fee5f01bf tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:47.822207 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-287c456c-1182-4436-8c39-521fee5f01bf tempest-ServicesAdminNegativeTestJSON-2079455788 tempest-ServicesAdminNegativeTestJSON-2079455788-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.073069 Jul 25 16:10:47.830290 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 732/1510] 10.222.0.105 () {58 vars in 1203 bytes} [Mon Jul 25 16:10:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:10:47.839279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:47.839943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:47.847679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:47.848269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:47.849436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:47.849882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.158790 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4a9f22b-f1a2-484a-b1a8-1c088afb8543 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1864 microversion: 2.1 time: 0.414574 Jul 25 16:10:48.159445 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 779/1511] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:47 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1864 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:48.165260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5190aaef-132a-4ac4-9551-3a4ac4aec476 req-4f59970a-c4b1-4a75-ae33-dbbec76fca3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "tag": "4ebcb9d2-6d96-4c11-8361-43a93a3de331"}, {"name": "network-changed", "server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:48.178023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5190aaef-132a-4ac4-9551-3a4ac4aec476 req-4f59970a-c4b1-4a75-ae33-dbbec76fca3a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.178478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5190aaef-132a-4ac4-9551-3a4ac4aec476 req-4f59970a-c4b1-4a75-ae33-dbbec76fca3a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.194056 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5190aaef-132a-4ac4-9551-3a4ac4aec476 req-4f59970a-c4b1-4a75-ae33-dbbec76fca3a service nova] Creating event network-changed:4ebcb9d2-6d96-4c11-8361-43a93a3de331 for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:10:48.194512 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5190aaef-132a-4ac4-9551-3a4ac4aec476 req-4f59970a-c4b1-4a75-ae33-dbbec76fca3a service nova] Creating event network-changed:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h2-846219-13 Jul 25 16:10:48.201994 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5190aaef-132a-4ac4-9551-3a4ac4aec476 req-4f59970a-c4b1-4a75-ae33-dbbec76fca3a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040727 Jul 25 16:10:48.202517 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 780/1512] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:48.230251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:48.241767 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee59fffb-0f47-4036-ac52-7cfbf8064996 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.409472 Jul 25 16:10:48.242515 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 733/1513] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:47 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:48.266544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:48.267821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:48.275733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.276210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.277081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.278025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.372811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bdba0bc9-5245-47aa-b64f-c8653c47286d tempest-ServicesAdminNegativeTestJSON-1516660765 tempest-ServicesAdminNegativeTestJSON-1516660765-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:48.384487 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:48.384487 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:10:48.385770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bdba0bc9-5245-47aa-b64f-c8653c47286d tempest-ServicesAdminNegativeTestJSON-1516660765 tempest-ServicesAdminNegativeTestJSON-1516660765-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e2b378d975564219847051320a6c184b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c812cde6a2f14378b033f02fed511013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bdba0bc9-5245-47aa-b64f-c8653c47286d tempest-ServicesAdminNegativeTestJSON-1516660765 tempest-ServicesAdminNegativeTestJSON-1516660765-project] Request method failure captured: Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sCBnpTXmI1IbVJYxnVteL2xqdMa9sykYVMr3Ah0rFJU6zJYQTDq0AKfJDfrk024vQcyEpGMPxfwHdcBgDPvM_zbc1HSi-yk68lnnw09P9CyMmJB-q3P-NABS1oHHJKRN7VY6HksNbX8EZQ9KBAoRmNDsuN71-vWR7Mm9nDRUDlLHwc Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c812cde6a2f14378b033f02fed511013 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1516660765 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c812cde6a2f14378b033f02fed511013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c812cde6a2f14378b033f02fed511013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c812cde6a2f14378b033f02fed511013"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c812cde6a2f14378b033f02fed511013"}]}] Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1516660765 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c812cde6a2f14378b033f02fed511013 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1516660765 Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServicesAdminNegativeTestJSON-1516660765-project Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e2b378d975564219847051320a6c184b Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1516660765-project Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 16:10:48.387774 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bdba0bc9-5245-47aa-b64f-c8653c47286d tempest-ServicesAdminNegativeTestJSON-1516660765 tempest-ServicesAdminNegativeTestJSON-1516660765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bdba0bc9-5245-47aa-b64f-c8653c47286d tempest-ServicesAdminNegativeTestJSON-1516660765 tempest-ServicesAdminNegativeTestJSON-1516660765-project] 10.222.0.105 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.185569 Jul 25 16:10:48.395581 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 781/1514] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:10:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 187 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:10:48.408232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:48.409643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:48.422516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.423172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.424177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.425044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.871166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:48.886665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:48.888811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:48.890547 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff8513f9-e8ba-4226-85b9-c4326b449dd9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.646412 Jul 25 16:10:48.891749 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 734/1515] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:48 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:48.897445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:48.900358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:48.907661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.908391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:48.909462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:48.910200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.069658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:49.082730 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c47ceb8-5fda-4280-94c4-f5dd5cf3e95c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.683001 Jul 25 16:10:49.083323 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 782/1516] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:48 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:49.094486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:49.096172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:49.104036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.104659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.105634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.106149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.348066 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec4d8a2a-ff93-416d-9768-8993a3cba663 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1864 microversion: 2.1 time: 0.453738 Jul 25 16:10:49.361918 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 735/1517] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:48 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1864 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:49.373170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:49.374070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:49.389070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.389514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.390313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.390750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.404402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:49.425848 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b643719b-39bb-41df-90cd-ce2f03fbd1ce tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.337391 Jul 25 16:10:49.427340 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 783/1518] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:49 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:49.441516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:49.442934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:49.457119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.457776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.459232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.459976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.730027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:49.739711 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0ddc4588-f81e-46c5-81be-f3e43bdb11f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1462 microversion: 2.1 time: 0.375947 Jul 25 16:10:49.755316 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 736/1519] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:49 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1462 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:49.874703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:49.889638 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-014aa365-2cac-4284-870f-b11342a84593 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.461133 Jul 25 16:10:49.908124 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 784/1520] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:49 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:49.913422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:49.920350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:49.957817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.968050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:49.970260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:49.971075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.291873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:50.292354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:50.305469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:50.305929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.306727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:50.307165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.371281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:50.390336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:50.397315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lazy-loading 'services' on Instance uuid 01318d40-8f22-4197-a911-5fb6b6c06a76 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:50.632578 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cd9d4118-7863-4c86-80f8-61b3921590c7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 204 len: 0 microversion: 2.32 time: 0.875278 Jul 25 16:10:50.633331 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 737/1521] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:10:49 2022] DELETE /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:10:50.649575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:50.650609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:50.664635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:50.665203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.666071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:50.666596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.711676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4e59712-967d-46bf-bc35-61f99e1fad16 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "DELETE /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments/4d8093ad-812f-428d-aade-d07267958d44" status: 202 len: 0 microversion: 2.1 time: 0.802111 Jul 25 16:10:50.712533 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 785/1522] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:10:49 2022] DELETE /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments/4d8093ad-812f-428d-aade-d07267958d44 => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:10:50.732854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:50.734121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:50.743314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:50.744146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.745921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:50.746756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:50.981348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.019933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.030898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.043263 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bb8be5bd-db8f-49da-8b0f-6fb9179cf93c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.321988 Jul 25 16:10:51.044215 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 786/1523] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:50 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:51.068793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.073900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.087240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.091106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.092857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.093597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.105664 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ac2bd19-c9b4-46f9-a3ca-f48198580495 tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1615 microversion: 2.1 time: 0.470114 Jul 25 16:10:51.117358 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 738/1524] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:50 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1615 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:51.131793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2be3d90c-11ae-44c4-9be5-74156f17c541 req-e8bd91e3-805a-473d-adc1-4dc12cbb4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4819201-9e0f-47ad-9810-291b09e9aa39", "tag": "c41a840b-f40c-47c6-987b-a9b3e00647ae"}, {"name": "network-changed", "server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "tag": "18e24371-bc13-4a8b-a765-95e167c0193f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:51.168590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2be3d90c-11ae-44c4-9be5-74156f17c541 req-e8bd91e3-805a-473d-adc1-4dc12cbb4f6b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.169351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2be3d90c-11ae-44c4-9be5-74156f17c541 req-e8bd91e3-805a-473d-adc1-4dc12cbb4f6b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.196499 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2be3d90c-11ae-44c4-9be5-74156f17c541 req-e8bd91e3-805a-473d-adc1-4dc12cbb4f6b service nova] Creating event network-changed:c41a840b-f40c-47c6-987b-a9b3e00647ae for instance b4819201-9e0f-47ad-9810-291b09e9aa39 on n-h1-846219-13 Jul 25 16:10:51.198130 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2be3d90c-11ae-44c4-9be5-74156f17c541 req-e8bd91e3-805a-473d-adc1-4dc12cbb4f6b service nova] Creating event network-changed:18e24371-bc13-4a8b-a765-95e167c0193f for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:10:51.208702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2be3d90c-11ae-44c4-9be5-74156f17c541 req-e8bd91e3-805a-473d-adc1-4dc12cbb4f6b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086098 Jul 25 16:10:51.210459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 739/1525] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:51.222094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.223164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.233741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.234552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.235413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.236364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.348644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.360593 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7264253f-4422-4478-b1bb-654887115bd3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.313827 Jul 25 16:10:51.362501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 787/1526] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:51 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:51.369062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.372257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.392775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.392775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.392775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.392775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.438656 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-deaf59e6-1d92-4cd4-8fd0-ec40f419541e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074762 Jul 25 16:10:51.439262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 788/1527] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:10:51 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:51.445280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.446152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.454470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.454917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.456042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.456581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.494571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.504826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.506919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.508292 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0ee87f59-ba6c-4505-9cd2-72843f23371c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2958 microversion: 2.32 time: 0.296118 Jul 25 16:10:51.509256 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 740/1528] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:51 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2958 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:51.513827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b7bc339-28fc-4d11-a24e-52e1c15e464e tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.516560 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:10:51.516560 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:10:51.518360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7bc339-28fc-4d11-a24e-52e1c15e464e tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.518990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7bc339-28fc-4d11-a24e-52e1c15e464e tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.520056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7bc339-28fc-4d11-a24e-52e1c15e464e tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.520687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7bc339-28fc-4d11-a24e-52e1c15e464e tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.556847 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b7bc339-28fc-4d11-a24e-52e1c15e464e tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046504 Jul 25 16:10:51.557691 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 741/1529] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:10:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:51.569723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-13", "block_migration": true, "disk_over_commit": false}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:51.573463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.580445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.580896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.581936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.582416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.610600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Lazy-loading 'flavor' on Instance uuid dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:51.624235 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 while it is in vm_state suspended Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Request method failure captured: Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7/action HTTP/1.1 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 98 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBMWwHc9czpjUHyLwq5PLmceOQ8aXSIQXO4BG-I5EFoGzhEDkUe6qTzC4klP-c6lq8iyfp8aYVlfuNCIgVnIEa1cg0IVnX6PYwmqp3oQuGROcUVJxY6xtyHdYtAmIUFu7etWapatM-50PLYGcnazROR_Oju7qZYqIU1nz4kWQVTlWE Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d7c7491acfb5492da38188d166dc9e49 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveMigrationNegativeTest-891336219 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d7c7491acfb5492da38188d166dc9e49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d7c7491acfb5492da38188d166dc9e49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d7c7491acfb5492da38188d166dc9e49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d7c7491acfb5492da38188d166dc9e49"}]}] Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveMigrationNegativeTest-891336219 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d7c7491acfb5492da38188d166dc9e49 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-891336219 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveMigrationNegativeTest-891336219-project-admin Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a047d3cb77074386b7b9803350647b64 Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveMigrationNegativeTest-891336219-project-admin Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: {"os-migrateLive": {"host": "n-h2-846219-13", "block_migration": true, "disk_over_commit": false}} Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'os-migrateLive' instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 while it is in vm_state suspended Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'dc3cfcbf-e280-4466-8e07-f6dd0665fbc7', 'body': {'os-migrateLive': {'host': 'n-h2-846219-13', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:51.626350 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 while it is in vm_state suspended Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 while it is in vm_state suspended Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 while it is in vm_state suspended {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:51.632007 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9085ee3-7730-41dd-96cf-b86e84d3ba7c tempest-LiveMigrationNegativeTest-891336219 tempest-LiveMigrationNegativeTest-891336219-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7/action" status: 409 len: 155 microversion: 2.1 time: 0.062308 Jul 25 16:10:51.635684 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 742/1530] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:10:51 2022] POST /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7/action => generated 155 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 16:10:51.635847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.638970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.639176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.643611 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d735cdbe-280d-4543-861a-50ab2881fe89 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.203270 Jul 25 16:10:51.644200 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 789/1531] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:51 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:51.645460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.646098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.647103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.647570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.675808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:10:51.765449 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3566676-39e9-42e2-b584-520383f51f55 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "DELETE /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 204 len: 0 microversion: 2.1 time: 0.130405 Jul 25 16:10:51.766057 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 743/1532] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:51 2022] DELETE /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:10:51.776223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:51.776841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:51.783729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.784007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.784752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:51.785216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:51.926363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:51.934055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-95e2422f-210f-425a-8a71-38a84e121a4e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1468 microversion: 2.1 time: 0.162859 Jul 25 16:10:51.934618 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 790/1533] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:51 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:52.080602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:52.081739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:52.092044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.092764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.094093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.094654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.257017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.267952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.273566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.275432 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3397c0c7-e229-4a4f-96ad-b1ee06f9beef tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.200297 Jul 25 16:10:52.276599 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 744/1534] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:10:52.384849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:52.385547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:52.393718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.394231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.395155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.395621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.451897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:52.454578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:52.461330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.462020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.463286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.464452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.499501 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9b3867d-f410-4e8a-80a3-e7e3402d0fcf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052165 Jul 25 16:10:52.500473 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 745/1535] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:10:52.512738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c832e97a-b87e-4a44-81c3-4329728d2c7e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-88643432", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e29bdae4-d2c8-4fbf-80b3-195fda3113c8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:52.577010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.586146 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c832e97a-b87e-4a44-81c3-4329728d2c7e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Block Device e29bdae4-d2c8-4fbf-80b3-195fda3113c8 is not bootable. Jul 25 16:10:52.588654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-662ddc8a-6435-478a-b3c1-8e425ff7a157 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.208453 Jul 25 16:10:52.590429 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 791/1536] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c832e97a-b87e-4a44-81c3-4329728d2c7e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 356 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-88643432", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e29bdae4-d2c8-4fbf-80b3-195fda3113c8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: exception: Block Device e29bdae4-d2c8-4fbf-80b3-195fda3113c8 is not bootable. Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-88643432', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e29bdae4-d2c8-4fbf-80b3-195fda3113c8'}], 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e29bdae4-d2c8-4fbf-80b3-195fda3113c8 is not bootable. Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:52.596567 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e29bdae4-d2c8-4fbf-80b3-195fda3113c8 is not bootable. Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e29bdae4-d2c8-4fbf-80b3-195fda3113c8 is not bootable. Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c832e97a-b87e-4a44-81c3-4329728d2c7e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Block Device e29bdae4-d2c8-4fbf-80b3-195fda3113c8 is not bootable. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c832e97a-b87e-4a44-81c3-4329728d2c7e tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.096735 Jul 25 16:10:52.601081 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 746/1537] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:10:52 2022] POST /compute/v2.1/servers => generated 110 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:10:52.604950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:52.606574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:52.614858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.615516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.616349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:52.616722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.617017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:52.617281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.626269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.626837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.627620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.628052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.904080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.907488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.917154 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-765f8076-28f1-4f09-b1da-1433e4a968d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.307096 Jul 25 16:10:52.918332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 747/1538] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:52.930663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.930663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:52.931546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:52.931546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:52.931867 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a5d44fbf-23df-4ea5-b5ef-12cb787bb5d2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2958 microversion: 2.32 time: 0.332904 Jul 25 16:10:52.931867 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 792/1539] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2958 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:52.932175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.932175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:52.932504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:52.932935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.102234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4335863c-cd94-4756-8625-3a483f7654d4 tempest-TenantUsagesNegativeTestJSON-1443630491 tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin] 10.222.0.105 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T16%3A10%3A52.813686&end=2022-07-26T16%3A10%3A52.813686" status: 404 len: 112 microversion: - time: 0.175943 Jul 25 16:10:53.102942 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 793/1540] 10.222.0.105 () {58 vars in 1321 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T16%3A10%3A52.813686&end=2022-07-26T16%3A10%3A52.813686 => generated 112 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:10:53.108580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.109361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:53.116094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.116840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.117761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.118273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.142407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.151729 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c2e681f-8a4d-4061-ab05-93bdaab976ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.232147 Jul 25 16:10:53.152343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 748/1541] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:52 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:53.157596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.158222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:53.165246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.165687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.166711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.167147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.361998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.372960 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-067a8616-3b37-49b9-920b-04c4e653b937 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.268117 Jul 25 16:10:53.387557 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 794/1542] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:53.387557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28ff11ac-f178-4299-8245-741d33389aa5 tempest-TenantUsagesNegativeTestJSON-1443630491 tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin] Calling method '.version_select at 0x7f9d938f0550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.387557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-28ff11ac-f178-4299-8245-741d33389aa5 tempest-TenantUsagesNegativeTestJSON-1443630491 tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28ff11ac-f178-4299-8245-741d33389aa5 tempest-TenantUsagesNegativeTestJSON-1443630491 tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin] Request method failure captured: Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-simple-tenant-usage/b8aefb1e8be849e9be25c1d4eb493b84?start=2022-07-26T16%3A10%3A52.813686&end=2022-07-24T16%3A10%3A52.813686 HTTP/1.1 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sCMny50i_tWcoE9iaoadYqrcJLr4ikuiFMIzzGdI2eh9sws6eiEEpSMAxzW2dgyhw_ACEDa4LAg4eEl7qrArtdDJs4UAffdHjtLs9ZgWu2zzP3nWFbze7jMcZEIf3UIyI4I4WOGeuQHkQLC2czXBEXwxBr11jBch-OkPrpqrJRgtOY Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: ce299ef56e9f4627a2b3ce7b40243970 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1443630491 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ce299ef56e9f4627a2b3ce7b40243970"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ce299ef56e9f4627a2b3ce7b40243970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ce299ef56e9f4627a2b3ce7b40243970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ce299ef56e9f4627a2b3ce7b40243970"}]}] Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1443630491 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: ce299ef56e9f4627a2b3ce7b40243970 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1443630491 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c29730bad00446efa7b30326225fcbc2 Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid start time. The start time cannot occur after the end time. Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b8aefb1e8be849e9be25c1d4eb493b84'} Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 25 16:10:53.389601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:53.394045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28ff11ac-f178-4299-8245-741d33389aa5 tempest-TenantUsagesNegativeTestJSON-1443630491 tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:53.394045 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-28ff11ac-f178-4299-8245-741d33389aa5 tempest-TenantUsagesNegativeTestJSON-1443630491 tempest-TenantUsagesNegativeTestJSON-1443630491-project-admin] 10.222.0.105 "GET /compute/v2.1/os-simple-tenant-usage/b8aefb1e8be849e9be25c1d4eb493b84?start=2022-07-26T16%3A10%3A52.813686&end=2022-07-24T16%3A10%3A52.813686" status: 400 len: 111 microversion: 2.1 time: 0.018240 Jul 25 16:10:53.395727 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 795/1543] 10.222.0.105 () {58 vars in 1417 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/os-simple-tenant-usage/b8aefb1e8be849e9be25c1d4eb493b84?start=2022-07-26T16%3A10%3A52.813686&end=2022-07-24T16%3A10%3A52.813686 => generated 111 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:10:53.403154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5af86dd3-ba33-4478-bc2b-158da72577cc req-00ca0a8f-0c8b-4298-9ea2-04725756c244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "tag": "2a00e4b0-1132-484f-bd5d-07498b1da714"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:53.410555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.419139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5af86dd3-ba33-4478-bc2b-158da72577cc req-00ca0a8f-0c8b-4298-9ea2-04725756c244 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.419881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5af86dd3-ba33-4478-bc2b-158da72577cc req-00ca0a8f-0c8b-4298-9ea2-04725756c244 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.427755 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d18e7178-38bb-4273-a3a2-9161c1fcd685 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1468 microversion: 2.1 time: 0.273666 Jul 25 16:10:53.441224 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 749/1544] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1468 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:53.442179 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5af86dd3-ba33-4478-bc2b-158da72577cc req-00ca0a8f-0c8b-4298-9ea2-04725756c244 service nova] Creating event network-changed:2a00e4b0-1132-484f-bd5d-07498b1da714 for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:10:53.451929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.452373 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5af86dd3-ba33-4478-bc2b-158da72577cc req-00ca0a8f-0c8b-4298-9ea2-04725756c244 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053902 Jul 25 16:10:53.452635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:53.454423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 796/1545] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:53.464296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.465622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.469263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.471005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.668985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b80f23c5-a565-4e18-81c3-5cf19c009d7f tempest-TenantUsagesNegativeTestJSON-1274927906 tempest-TenantUsagesNegativeTestJSON-1274927906-project] Calling method '.version_select at 0x7f9d938ed940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.681674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b80f23c5-a565-4e18-81c3-5cf19c009d7f tempest-TenantUsagesNegativeTestJSON-1274927906 tempest-TenantUsagesNegativeTestJSON-1274927906-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e1a13165ec5b4a6eab082605cae5d711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aefb1e8be849e9be25c1d4eb493b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b80f23c5-a565-4e18-81c3-5cf19c009d7f tempest-TenantUsagesNegativeTestJSON-1274927906 tempest-TenantUsagesNegativeTestJSON-1274927906-project] Request method failure captured: Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T16%3A10%3A52.813686&end=2022-07-26T16%3A10%3A52.813686&detailed=1 HTTP/1.1 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sCL_ozw0i4oY5u3ZaFVZy60toiMkuHBR_xCrqX5mOGlTW95sOIg5azF9z-96VubNLrcjJwXHlEoJxUFy8LVmX2_5kRQTNuc13eWX1ZhgJQ0vahtscTEoDJR_TxjNbJT_mutA4xwFNgwL6SJciK03faA5N-da6QRM4CMC97DBbhlx_Q Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b8aefb1e8be849e9be25c1d4eb493b84 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1274927906 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b8aefb1e8be849e9be25c1d4eb493b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b8aefb1e8be849e9be25c1d4eb493b84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b8aefb1e8be849e9be25c1d4eb493b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b8aefb1e8be849e9be25c1d4eb493b84"}]}] Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1274927906 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b8aefb1e8be849e9be25c1d4eb493b84 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1274927906 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TenantUsagesNegativeTestJSON-1274927906-project Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e1a13165ec5b4a6eab082605cae5d711 Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1274927906-project Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:10:53.685534 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 16:10:53.694927 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:53.699293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b80f23c5-a565-4e18-81c3-5cf19c009d7f tempest-TenantUsagesNegativeTestJSON-1274927906 tempest-TenantUsagesNegativeTestJSON-1274927906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:53.701320 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b80f23c5-a565-4e18-81c3-5cf19c009d7f tempest-TenantUsagesNegativeTestJSON-1274927906 tempest-TenantUsagesNegativeTestJSON-1274927906-project] 10.222.0.105 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T16%3A10%3A52.813686&end=2022-07-26T16%3A10%3A52.813686&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.244892 Jul 25 16:10:53.710200 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 797/1546] 10.222.0.105 () {58 vars in 1340 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T16%3A10%3A52.813686&end=2022-07-26T16%3A10%3A52.813686&detailed=1 => generated 123 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:10:53.724400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.738406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:53.748508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:53.751970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.757646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.764652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.768256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.769658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.770298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.775332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:53.783322 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3789f23-f4a0-454a-aded-16d280925b03 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.339841 Jul 25 16:10:53.786464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 750/1547] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:53.796827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.802122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:53.812705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:53.827367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.828314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.829352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.829962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.867450 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ae7fc24-8ae9-47ad-a51b-78a9675d7985 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153923 Jul 25 16:10:53.880051 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 798/1548] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:53.957976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:53.959975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:53.975010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.975780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:53.977123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:53.977871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:54.644992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:54.661924 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45181b9d-6325-487f-9916-78f4a0f5fd87 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.873938 Jul 25 16:10:54.675615 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 751/1549] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:54.675615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:54.675615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:54.683086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:54.683537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:54.684886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:54.684886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:54.965087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:55.007107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:55.017447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:55.020490 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0b93d16-05f5-40a1-bbee-e845c2d63b2a tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2958 microversion: 2.32 time: 1.068420 Jul 25 16:10:55.036353 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 799/1550] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:53 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2958 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:55.076365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:55.077871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:55.099833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:55.100829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:55.103081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:55.103951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:55.150973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:55.929888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:55.943557 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7e7460ca-233f-4af1-a76b-e8e74cf4b24b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 1.279419 Jul 25 16:10:55.959852 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 752/1551] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:54 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:55.968922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:55.970612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:55.981058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:55.981886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:55.983143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:55.983911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:56.007351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:56.057773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:56.071664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f01fb5bb-db37-4b37-b38f-340b391dc03e tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1468 microversion: 2.1 time: 1.033012 Jul 25 16:10:56.086444 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 800/1552] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:55 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1468 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:56.104240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:56.107174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:56.128320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:56.130668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:56.135690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:56.144165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:56.221673 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9fce358d-b354-4d23-ae0a-6471774ce56b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132961 Jul 25 16:10:56.224236 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 801/1553] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:10:56 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:56.234661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:56.236209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:56.244869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:56.245809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:56.247194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:56.248205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:56.648022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:56.664925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:56.673422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:56.675775 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-131ea4ee-2047-4666-b904-5f99a2098b2b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.714088 Jul 25 16:10:56.690364 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 753/1554] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:55 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:56.699396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:56.700920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:56.731503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:56.732599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:56.734237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:56.744993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:57.587057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:57.608145 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e0a01618-81fb-4573-8583-9e6710576f9f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 1.380990 Jul 25 16:10:57.613522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 802/1555] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:56 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:57.626279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a168f4f7-5bff-4806-95bd-aadca9fc2607 req-e47e2161-a01d-4249-9764-d8f52ebaacd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4819201-9e0f-47ad-9810-291b09e9aa39", "name": "network-vif-plugged", "status": "completed", "tag": "c41a840b-f40c-47c6-987b-a9b3e00647ae"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:57.667780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a168f4f7-5bff-4806-95bd-aadca9fc2607 req-e47e2161-a01d-4249-9764-d8f52ebaacd6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:57.668445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a168f4f7-5bff-4806-95bd-aadca9fc2607 req-e47e2161-a01d-4249-9764-d8f52ebaacd6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:57.704516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a168f4f7-5bff-4806-95bd-aadca9fc2607 req-e47e2161-a01d-4249-9764-d8f52ebaacd6 service nova] Creating event network-vif-plugged:c41a840b-f40c-47c6-987b-a9b3e00647ae for instance b4819201-9e0f-47ad-9810-291b09e9aa39 on n-h1-846219-13 Jul 25 16:10:57.716142 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a168f4f7-5bff-4806-95bd-aadca9fc2607 req-e47e2161-a01d-4249-9764-d8f52ebaacd6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098842 Jul 25 16:10:57.730952 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 803/1556] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:57.742255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:57.751504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:57.759067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:57.761515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:57.779083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:57.779937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.154995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:58.198813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:58.220265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:58.222811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe51fab0-47b8-42df-9049-01631945cbb6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2937 microversion: 2.32 time: 1.530810 Jul 25 16:10:58.223872 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 754/1557] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:56 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2937 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:58.253062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:58.264579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:58.293444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.299120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.300166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.305386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.408472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.410202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.411024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lazy-loading 'fault' on Instance uuid dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:10:58.597627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:58.613335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:58.634626 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6aacb634-c0ab-4250-b856-e8cc77b076f5 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 200 len: 1313 microversion: 2.1 time: 0.402162 Jul 25 16:10:58.636871 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 755/1558] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:58 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:58.640597 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b049a334-7e66-4e1a-8892-ebe6e2e44965 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.906903 Jul 25 16:10:58.647130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:58.654305 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 804/1559] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:57 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:58.655520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:58.672570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-12557ce4-041a-4e1a-b854-70cc66d4859b req-f54118e8-f0c9-4bbf-b468-1f92b6202502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3cfcbf-e280-4466-8e07-f6dd0665fbc7", "name": "network-vif-deleted", "tag": "99c6b522-88fc-4862-9049-00c7c9a5744c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:58.691267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.692132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.695052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.700179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.703058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-12557ce4-041a-4e1a-b854-70cc66d4859b req-f54118e8-f0c9-4bbf-b468-1f92b6202502 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.708839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-12557ce4-041a-4e1a-b854-70cc66d4859b req-f54118e8-f0c9-4bbf-b468-1f92b6202502 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.734675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-12557ce4-041a-4e1a-b854-70cc66d4859b req-f54118e8-f0c9-4bbf-b468-1f92b6202502 service nova] Creating event network-vif-deleted:99c6b522-88fc-4862-9049-00c7c9a5744c for instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 on n-h1-846219-13 Jul 25 16:10:58.747873 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-12557ce4-041a-4e1a-b854-70cc66d4859b req-f54118e8-f0c9-4bbf-b468-1f92b6202502 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091021 Jul 25 16:10:58.749117 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 805/1560] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:58.754804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:58.762210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:58.782139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.782694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.783497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.783939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.816690 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f2dd3f1b-f7d8-4b94-9eaa-37ea08424fbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177023 Jul 25 16:10:58.817334 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 756/1561] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:10:58 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:58.840575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:58.845758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:58.864076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.864525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:58.865386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:58.868273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.186904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.208809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.210865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.212337 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f8c8efb-744d-40a5-b195-a0570fff2372 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.461832 Jul 25 16:10:59.213200 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 806/1562] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:58 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:10:59.239409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.248578 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b2db5c6c-ffc5-4064-95af-15ac0c12e81d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.423310 Jul 25 16:10:59.257023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:59.257776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:59.263017 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 757/1563] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:58 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:10:59.267018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.273569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.274762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.275325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.611886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.626165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.628137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:10:59.629623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-66a17105-b436-4f3f-86cb-de2167db4cfa tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2870 microversion: 2.32 time: 0.376807 Jul 25 16:10:59.633980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e2f50410-97cd-499f-8c4d-dbda7673af03 req-47408e03-adb4-45fd-8cb1-e2de4ada7ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-deleted", "tag": "a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:10:59.642531 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 807/1564] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:10:59 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2870 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:10:59.662871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e2f50410-97cd-499f-8c4d-dbda7673af03 req-47408e03-adb4-45fd-8cb1-e2de4ada7ce1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.663136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e2f50410-97cd-499f-8c4d-dbda7673af03 req-47408e03-adb4-45fd-8cb1-e2de4ada7ce1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.677881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:59.678795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: dc3cfcbf-e280-4466-8e07-f6dd0665fbc7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:59.703292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.704450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.710540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.711271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.724101 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e2f50410-97cd-499f-8c4d-dbda7673af03 req-47408e03-adb4-45fd-8cb1-e2de4ada7ce1 service nova] Creating event network-vif-deleted:a733d1fa-5ea0-4ad0-8842-3b8a2d9e29de for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:10:59.747313 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e2f50410-97cd-499f-8c4d-dbda7673af03 req-47408e03-adb4-45fd-8cb1-e2de4ada7ce1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118256 Jul 25 16:10:59.749292 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 758/1565] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:10:59.780046 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] HTTP exception thrown: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 could not be found. Jul 25 16:10:59.781546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:59.782755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Request method failure captured: Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 HTTP/1.1 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBKQpQbLzyPW83q8r29Ag-eF96Ppk1XNfmZxRDjfkvArav6diEZTLBucx6oeUj8nqSmjQVE1wp1l5ZG22JOMPYar6tDDl8GWyNgMIFbQjgEI1-uoGoi25NTxKIqZnyskMwCdtu1MDN-F79fEIXxDPpcUO7Hsber4pOID9Mw70uNgmM Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28c1fe0b11a64534b2cf7f32cf1667ca Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-LiveMigrationNegativeTest-1102239833 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28c1fe0b11a64534b2cf7f32cf1667ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28c1fe0b11a64534b2cf7f32cf1667ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28c1fe0b11a64534b2cf7f32cf1667ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28c1fe0b11a64534b2cf7f32cf1667ca"}]}] Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-LiveMigrationNegativeTest-1102239833 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28c1fe0b11a64534b2cf7f32cf1667ca Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1102239833 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-LiveMigrationNegativeTest-1102239833-project Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b0d4e20c5b6c4daa9a3127438be07934 Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-LiveMigrationNegativeTest-1102239833-project Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 could not be found. Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'dc3cfcbf-e280-4466-8e07-f6dd0665fbc7'} Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 could not be found. Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 could not be found. Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:10:59.783872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 could not be found. Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Returning 404 to user: Instance dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4faaea4c-64a1-44f7-ae51-dacdebc5499f tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7" status: 404 len: 111 microversion: 2.1 time: 0.114662 Jul 25 16:10:59.792618 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 808/1566] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:59 2022] GET /compute/v2.1/servers/dc3cfcbf-e280-4466-8e07-f6dd0665fbc7 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:10:59.802403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:10:59.803101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.803575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.804642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.807380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:10:59.809277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.824160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.824912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.829615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:10:59.830339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:10:59.918875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:11:00.102390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30988aae-93e6-4009-a0ff-3c48ca85a2e0 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 204 len: 0 microversion: 2.1 time: 0.309970 Jul 25 16:11:00.106114 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 809/1567] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:10:59 2022] DELETE /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:11:00.118138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:00.120780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:00.138312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.138771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.139591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.140027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.189243 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a72123b-91d2-40d4-9922-90f1534595d3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084328 Jul 25 16:11:00.196316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 810/1568] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:11:00 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:00.205538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a3101d7e-d5f8-4bc7-abc2-481e465a6dc8 req-6d0157ba-a257-4a99-9749-2719a6beb240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-unplugged", "status": "completed", "tag": "2e157acc-e2f3-40b4-a6bc-e64dd00fd338"}, {"server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "name": "network-vif-unplugged", "status": "completed", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:00.230433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:00.232785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a3101d7e-d5f8-4bc7-abc2-481e465a6dc8 req-6d0157ba-a257-4a99-9749-2719a6beb240 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.233839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a3101d7e-d5f8-4bc7-abc2-481e465a6dc8 req-6d0157ba-a257-4a99-9749-2719a6beb240 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.244425 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e3996d4-e18b-4768-8a1d-22d89e438823 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.488876 Jul 25 16:11:00.245214 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 759/1569] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:10:59 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:00.266991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a3101d7e-d5f8-4bc7-abc2-481e465a6dc8 req-6d0157ba-a257-4a99-9749-2719a6beb240 service nova] Creating event network-vif-unplugged:2e157acc-e2f3-40b4-a6bc-e64dd00fd338 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:00.267554 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a3101d7e-d5f8-4bc7-abc2-481e465a6dc8 req-6d0157ba-a257-4a99-9749-2719a6beb240 service nova] Creating event network-vif-unplugged:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h2-846219-13 Jul 25 16:11:00.271180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:00.273688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:00.285197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a3101d7e-d5f8-4bc7-abc2-481e465a6dc8 req-6d0157ba-a257-4a99-9749-2719a6beb240 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.087013 Jul 25 16:11:00.286151 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 811/1570] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:00.289339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.289793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.290577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.291009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.293121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:00.293833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:00.302142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.303326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.305697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.306156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.668048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:00.682492 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b6110ddf-263c-4964-b778-6368bb36c3e1 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1477 microversion: 2.1 time: 0.426493 Jul 25 16:11:00.684874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 760/1571] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:00 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:00.689867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:00.697413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:00.708600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:00.713745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:00.718978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:00.720741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.721423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.722597 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d939698d-2766-4a64-8830-344f8f64c946 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 0.433778 Jul 25 16:11:00.723426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.724039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.731833 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 812/1572] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:00 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:00.750479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:00.751691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:00.770364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.778636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:00.782216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:00.784383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:01.435925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:01.461692 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-866943ba-af49-46d1-b8e9-f23dae7b29df tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1319 microversion: 2.1 time: 0.760980 Jul 25 16:11:01.462947 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 761/1573] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:00 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1319 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:01.468366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:01.482801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:01.500844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:01.501632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:01.502609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:01.503240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:01.554674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=19 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:01.589993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-29ca92b2-ac03-4a42-98d7-25962d1c09dc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124967 Jul 25 16:11:01.599446 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 762/1574] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:11:01 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:01.606782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:01.619269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:01.635404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:01.638418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:01.641773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:01.642523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:01.897880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:01.917594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:01.920715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:01.924934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f24030b4-4b25-4ffb-aaac-a291bae27665 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2584 microversion: 2.32 time: 1.191704 Jul 25 16:11:01.944091 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 813/1575] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:00 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2584 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:01.950627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:01.951700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:01.965130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:01.966260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:01.967208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:01.967918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:02.173276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:02.181778 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-301e8415-ab1f-4e2e-945e-57be302d6806 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.580485 Jul 25 16:11:02.185164 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 763/1576] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:01 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:02.199306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:02.200434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:02.217033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:02.217567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:02.218470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:02.219001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:03.604685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:03.622046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:03.624510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:03.630368 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0589a561-c8ba-423f-9b91-44da2aee7d48 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 1.443198 Jul 25 16:11:03.632430 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 764/1577] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:02 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:03.646685 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:11:03.646685 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 (ip 10.222.0.105) !!! Jul 25 16:11:03.656101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a199acd7-a1eb-4c58-8452-5774e3cb5d73 req-288fe1d5-ee77-487d-8657-709e8a64e84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-deleted", "tag": "aec77042-8500-4693-86bd-08fddf0e26b2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:03.715733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a199acd7-a1eb-4c58-8452-5774e3cb5d73 req-288fe1d5-ee77-487d-8657-709e8a64e84d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:03.716489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a199acd7-a1eb-4c58-8452-5774e3cb5d73 req-288fe1d5-ee77-487d-8657-709e8a64e84d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:03.773569 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a199acd7-a1eb-4c58-8452-5774e3cb5d73 req-288fe1d5-ee77-487d-8657-709e8a64e84d service nova] Creating event network-vif-deleted:aec77042-8500-4693-86bd-08fddf0e26b2 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:03.780639 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a199acd7-a1eb-4c58-8452-5774e3cb5d73 req-288fe1d5-ee77-487d-8657-709e8a64e84d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136739 Jul 25 16:11:03.781761 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 765/1578] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:03.788846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6c974af2-367a-43d8-80b9-b80dbc8e645e req-9da873c3-ac8d-4258-87fd-909ad663fa54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-unplugged", "status": "completed", "tag": "00cd520c-d4cc-4ec4-b596-47c08b95c9be"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-unplugged", "status": "completed", "tag": "5b988b11-3679-472a-be08-27a931119843"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:03.803493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:03.806344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6c974af2-367a-43d8-80b9-b80dbc8e645e req-9da873c3-ac8d-4258-87fd-909ad663fa54 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:03.806799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6c974af2-367a-43d8-80b9-b80dbc8e645e req-9da873c3-ac8d-4258-87fd-909ad663fa54 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:03.848541 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6c974af2-367a-43d8-80b9-b80dbc8e645e req-9da873c3-ac8d-4258-87fd-909ad663fa54 service nova] Creating event network-vif-unplugged:00cd520c-d4cc-4ec4-b596-47c08b95c9be for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:03.849326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6c974af2-367a-43d8-80b9-b80dbc8e645e req-9da873c3-ac8d-4258-87fd-909ad663fa54 service nova] Creating event network-vif-unplugged:5b988b11-3679-472a-be08-27a931119843 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:03.870413 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6c974af2-367a-43d8-80b9-b80dbc8e645e req-9da873c3-ac8d-4258-87fd-909ad663fa54 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.086754 Jul 25 16:11:03.871457 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 766/1579] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:04.195031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:04.224367 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fde9df37-ecce-4814-a42a-ec68b5afda6b tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1477 microversion: 2.1 time: 2.271475 Jul 25 16:11:04.225445 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 814/1580] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:01 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1477 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:04.246635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:04.251372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:04.278749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.279845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.281444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.282356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.352147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:04.353135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:04.361744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.362462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.363694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.364298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.378420 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34a2d050-a0eb-4e75-ad62-0f16154afa53 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150904 Jul 25 16:11:04.407377 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 815/1581] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:11:04 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76/os-volume_attachments => generated 25 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:11:04.421280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:04.422604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:04.434234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.435208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.436519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.438564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.789070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:04.806812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:04.811736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:04.813034 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a6f296a-60ab-42de-a8dd-029004e7c128 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 2265 microversion: 2.32 time: 0.403527 Jul 25 16:11:04.820929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 816/1582] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:04 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 2265 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:04.845471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4ee16c9-38bd-4c62-a512-7a9af20e15c0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1890319023", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "984a5010-f259-40b9-952b-c497908cc5d8", "destination_type": "local"}, {"source_type": "volume", "uuid": "2c107baf-eefe-4f92-af2f-36c8b51bfd9d", "destination_type": "invalid"}], "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4ee16c9-38bd-4c62-a512-7a9af20e15c0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 495 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1890319023", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "984a5010-f259-40b9-952b-c497908cc5d8", "destination_type": "local"}, {"source_type": "volume", "uuid": "2c107baf-eefe-4f92-af2f-36c8b51bfd9d", "destination_type": "invalid"}], "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1890319023', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '984a5010-f259-40b9-952b-c497908cc5d8', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2c107baf-eefe-4f92-af2f-36c8b51bfd9d', 'destination_type': 'invalid'}], 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:04.851547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 16:11:04.856290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:04.858977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4ee16c9-38bd-4c62-a512-7a9af20e15c0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:04.860196 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4ee16c9-38bd-4c62-a512-7a9af20e15c0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.025626 Jul 25 16:11:04.860974 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 817/1583] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:04 2022] POST /compute/v2.1/servers => generated 155 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:04.873589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:04.874665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:04.899142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.899937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:04.902698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:04.903368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:05.305429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:05.321043 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c577438-525b-4168-850b-0891d9b21e0d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1506 microversion: 2.1 time: 1.448014 Jul 25 16:11:05.334466 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 767/1584] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:03 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1506 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:05.341141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:05.342107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:05.367209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:05.368159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:05.369276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:05.370377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:06.445033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:06.457683 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-83f257d1-0bc1-4905-a0ba-51c27e83be11 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 1.589817 Jul 25 16:11:06.460243 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 818/1585] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:04 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:06.468634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:06.469574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:06.500602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:06.502222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:06.504984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:06.507396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:06.516774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:07.271856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.287733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.291938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.293347 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ddca437f-6d86-403b-8cdf-5016e29bd862 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 1.956464 Jul 25 16:11:07.316454 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 768/1586] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:05 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:07.323246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:07.324191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:07.331861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.333300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.335115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.335792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.424670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.425463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.426210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lazy-loading 'fault' on Instance uuid 5fa82002-d0f6-4378-bed5-9b1370a33d58 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:07.436222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.465135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-19682b5e-1910-4019-b69c-79f866cf9723 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.002262 Jul 25 16:11:07.471218 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 819/1587] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:06 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:07.516526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0831333-19da-49d9-840a-da9823b06ec4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:07.541163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0831333-19da-49d9-840a-da9823b06ec4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.541630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0831333-19da-49d9-840a-da9823b06ec4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.546321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d4e20c5b6c4daa9a3127438be07934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c1fe0b11a64534b2cf7f32cf1667ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.556437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98862c78-3096-4d40-97dc-7060cac86c04 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 200 len: 1312 microversion: 2.1 time: 0.237663 Jul 25 16:11:07.557045 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 769/1588] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:07 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:07.564353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:07.565232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:07.591024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.599806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.602102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.603739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.712866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0831333-19da-49d9-840a-da9823b06ec4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:11:07.744241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.759893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.761474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:07.762774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de6c16d0-46f5-4112-a0de-ca256767775d tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.202208 Jul 25 16:11:07.766213 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 770/1589] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:07 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:07.774419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-deleted", "tag": "5b988b11-3679-472a-be08-27a931119843"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-deleted", "tag": "00cd520c-d4cc-4ec4-b596-47c08b95c9be"}, {"server_uuid": "e96437cc-0bf2-4825-bda3-de5fb2446977", "name": "network-vif-deleted", "tag": "2e157acc-e2f3-40b4-a6bc-e64dd00fd338"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:07.797291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.809566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.851587 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] Creating event network-vif-deleted:5b988b11-3679-472a-be08-27a931119843 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:07.856809 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] Creating event network-vif-deleted:00cd520c-d4cc-4ec4-b596-47c08b95c9be for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:07.858157 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0831333-19da-49d9-840a-da9823b06ec4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39/action" status: 202 len: 0 microversion: 2.1 time: 0.371372 Jul 25 16:11:07.862468 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 820/1590] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:11:07 2022] POST /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:11:07.865594 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] Creating event network-vif-deleted:2e157acc-e2f3-40b4-a6bc-e64dd00fd338 for instance e96437cc-0bf2-4825-bda3-de5fb2446977 on n-h2-846219-13 Jul 25 16:11:07.881972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a385d6ea-cdfe-4245-b325-7cb9f6032410 req-cbd2e43e-2d4d-49ea-aa8b-cf85d9fdb30e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.111820 Jul 25 16:11:07.889667 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 771/1591] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:07.890854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-af21ed6d-fc1d-486b-9f6f-0b6dd3f7bfce req-603e2bdb-7557-4f0d-91ba-323c282c1d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa82002-d0f6-4378-bed5-9b1370a33d58", "name": "network-vif-deleted", "tag": "4ed59899-2281-450e-8eca-ca341378848e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:07.901360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:07.907184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:07.919784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-af21ed6d-fc1d-486b-9f6f-0b6dd3f7bfce req-603e2bdb-7557-4f0d-91ba-323c282c1d83 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.920959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-af21ed6d-fc1d-486b-9f6f-0b6dd3f7bfce req-603e2bdb-7557-4f0d-91ba-323c282c1d83 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.931432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.933036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.934184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.934842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.939195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:07.946268 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-af21ed6d-fc1d-486b-9f6f-0b6dd3f7bfce req-603e2bdb-7557-4f0d-91ba-323c282c1d83 service nova] Creating event network-vif-deleted:4ed59899-2281-450e-8eca-ca341378848e for instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 on n-h1-846219-13 Jul 25 16:11:07.959117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-af21ed6d-fc1d-486b-9f6f-0b6dd3f7bfce req-603e2bdb-7557-4f0d-91ba-323c282c1d83 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091498 Jul 25 16:11:07.959738 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 821/1592] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:07.976204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:07.977245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:07.988830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.989716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:07.992587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:07.993040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:08.594030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:08.609447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c45bbfc4-137a-468e-ba43-5657357190fe tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.716343 Jul 25 16:11:08.628840 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 772/1593] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:07 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:08.642776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-681b0759-8a66-4639-bd68-238a0f821e37 req-7e4d31cd-3a51-42ab-93a8-0ccc12956e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "name": "network-vif-plugged", "status": "completed", "tag": "2a00e4b0-1132-484f-bd5d-07498b1da714"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:08.669392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-681b0759-8a66-4639-bd68-238a0f821e37 req-7e4d31cd-3a51-42ab-93a8-0ccc12956e2a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:08.670988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-681b0759-8a66-4639-bd68-238a0f821e37 req-7e4d31cd-3a51-42ab-93a8-0ccc12956e2a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:08.706738 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-681b0759-8a66-4639-bd68-238a0f821e37 req-7e4d31cd-3a51-42ab-93a8-0ccc12956e2a service nova] Creating event network-vif-plugged:2a00e4b0-1132-484f-bd5d-07498b1da714 for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:11:08.718113 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-681b0759-8a66-4639-bd68-238a0f821e37 req-7e4d31cd-3a51-42ab-93a8-0ccc12956e2a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084598 Jul 25 16:11:08.718618 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 773/1594] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:08.739049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:08.740568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:08.762685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:08.763842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:08.765720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:08.767339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:08.888541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:08.899383 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c270b6e6-4993-45ea-821e-3f5a649a3366 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.938155 Jul 25 16:11:08.917298 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 822/1595] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:07 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:08.947967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:08.949789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:08.960273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:08.964148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:08.965426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:08.967544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:09.695773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:09.708331 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cb7c0979-a1da-4be4-a169-852e962071cd tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 0.988357 Jul 25 16:11:09.709673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 774/1596] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:08 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:09.716069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:09.717219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] [instance: 5fa82002-d0f6-4378-bed5-9b1370a33d58] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:09.727841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:09.729019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:09.733810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:09.736583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:09.756702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] HTTP exception thrown: Instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 could not be found. Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Request method failure captured: Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 HTTP/1.1 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBKQpQbLzyPW83q8r29Ag-eF96Ppk1XNfmZxRDjfkvArav6diEZTLBucx6oeUj8nqSmjQVE1wp1l5ZG22JOMPYar6tDDl8GWyNgMIFbQjgEI1-uoGoi25NTxKIqZnyskMwCdtu1MDN-F79fEIXxDPpcUO7Hsber4pOID9Mw70uNgmM Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 28c1fe0b11a64534b2cf7f32cf1667ca Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveMigrationNegativeTest-1102239833 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28c1fe0b11a64534b2cf7f32cf1667ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28c1fe0b11a64534b2cf7f32cf1667ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28c1fe0b11a64534b2cf7f32cf1667ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28c1fe0b11a64534b2cf7f32cf1667ca"}]}] Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveMigrationNegativeTest-1102239833 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 28c1fe0b11a64534b2cf7f32cf1667ca Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1102239833 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveMigrationNegativeTest-1102239833-project Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b0d4e20c5b6c4daa9a3127438be07934 Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveMigrationNegativeTest-1102239833-project Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 could not be found. Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5fa82002-d0f6-4378-bed5-9b1370a33d58'} Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 could not be found. Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 could not be found. Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:09.759834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 could not be found. Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.767146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] Returning 404 to user: Instance 5fa82002-d0f6-4378-bed5-9b1370a33d58 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:09.770834 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-882533dd-34d2-424f-9d29-b3551889b201 tempest-LiveMigrationNegativeTest-1102239833 tempest-LiveMigrationNegativeTest-1102239833-project] 10.222.0.105 "GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58" status: 404 len: 111 microversion: 2.1 time: 0.059463 Jul 25 16:11:09.776054 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 775/1597] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:09 2022] GET /compute/v2.1/servers/5fa82002-d0f6-4378-bed5-9b1370a33d58 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:09.786579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:09.787782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:09.796456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:09.797952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:09.799326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:09.800415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:09.956968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:09.967231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:09.971188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:09.973212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:09.975180 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bf3a5e2e-5041-4419-8850-9ac116233ccc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1816 microversion: 2.25 time: 1.054681 Jul 25 16:11:09.977154 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 823/1598] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:08 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1816 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:09.984072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90a1d9ea-7b2a-4ec1-98df-a95b60c88db6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-488952863", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90a1d9ea-7b2a-4ec1-98df-a95b60c88db6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 491 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-488952863", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-488952863', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.991210 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 16:11:09.994758 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:09.999488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90a1d9ea-7b2a-4ec1-98df-a95b60c88db6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:10.001058 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90a1d9ea-7b2a-4ec1-98df-a95b60c88db6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.021789 Jul 25 16:11:10.002012 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 824/1599] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:09 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:10.006576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:10.008211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:10.009709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:10.011140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:10.017821 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b539798d-1d2a-43b3-b0ce-94d90002bc40 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.236714 Jul 25 16:11:10.019869 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 776/1600] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:09 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:10.021799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:10.022497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:10.023547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:10.024163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:10.049421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:10.053936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:10.083433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:10.089281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:10.093053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:10.093875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:10.775798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:10.788694 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-553f9397-d4db-4d15-b703-7b8bc4b817df tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.785200 Jul 25 16:11:10.789391 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 825/1601] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:10 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:10.800657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:10.805699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:10.819219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:10.823216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:10.828344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:10.829073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:10.980556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:10.989812 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3881d6d2-9086-46f8-bbf7-39c69f2942c7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.956351 Jul 25 16:11:11.017960 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 777/1602] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:10 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:11.052161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cca413af-806c-4168-8707-feaaaf7ac874 req-8ecb20a0-c721-417f-a3be-050af4da59b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "name": "network-vif-plugged", "status": "completed", "tag": "4ebcb9d2-6d96-4c11-8361-43a93a3de331"}, {"server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "name": "network-vif-plugged", "status": "completed", "tag": "18e24371-bc13-4a8b-a765-95e167c0193f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:11.081220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cca413af-806c-4168-8707-feaaaf7ac874 req-8ecb20a0-c721-417f-a3be-050af4da59b1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.081791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cca413af-806c-4168-8707-feaaaf7ac874 req-8ecb20a0-c721-417f-a3be-050af4da59b1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:11.109318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cca413af-806c-4168-8707-feaaaf7ac874 req-8ecb20a0-c721-417f-a3be-050af4da59b1 service nova] Creating event network-vif-plugged:4ebcb9d2-6d96-4c11-8361-43a93a3de331 for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:11:11.109871 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cca413af-806c-4168-8707-feaaaf7ac874 req-8ecb20a0-c721-417f-a3be-050af4da59b1 service nova] Creating event network-vif-plugged:18e24371-bc13-4a8b-a765-95e167c0193f for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:11:11.128142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cca413af-806c-4168-8707-feaaaf7ac874 req-8ecb20a0-c721-417f-a3be-050af4da59b1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105038 Jul 25 16:11:11.128769 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 778/1603] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:11.139826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:11.140670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:11.160849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.162963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:11.165024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.167547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:11.705449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:11.735993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04a77e3e-285e-4a44-ada1-65109a2c88ad tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.603050 Jul 25 16:11:11.741442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 779/1604] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:11 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:11.753500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:11.754469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:11.780914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.781412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:11.789174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.789522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:11.863787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:11.894437 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8dfc816e-7a98-4ad8-a34e-1d72ef8b41b2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 1.095280 Jul 25 16:11:11.896488 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 826/1605] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:10 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:11.921400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:11.922873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:11.984210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.991087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:11.993827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:11.995727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:12.371831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:12.402721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:12.413632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:12.419943 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9458ca62-a0e3-4ee5-a928-9f55b0c548ec tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.521796 Jul 25 16:11:12.439861 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 827/1606] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:11 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:12.441906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:12.449335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:12.455362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:12.463795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:12.470485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:12.472423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:12.473944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:12.476677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:12.477176 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-937d7436-e72e-4a5d-9d86-00747083cc79 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1806 microversion: 2.25 time: 0.731569 Jul 25 16:11:12.477596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:12.477895 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 780/1607] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:11 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1806 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:12.504729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59853847-ffd0-4e02-b7e9-22b3fc8ec980 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59853847-ffd0-4e02-b7e9-22b3fc8ec980 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 416 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.512919 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:11:12.520207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:12.527550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59853847-ffd0-4e02-b7e9-22b3fc8ec980 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:12.530467 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59853847-ffd0-4e02-b7e9-22b3fc8ec980 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.042870 Jul 25 16:11:12.532755 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 781/1608] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:12 2022] POST /compute/v2.1/servers => generated 619 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:12.559493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-759375e8-f645-4136-bcbd-23c12d5f6854 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '.version_select at 0x7f9d938f8790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:12.567037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-759375e8-f645-4136-bcbd-23c12d5f6854 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:12.571038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-759375e8-f645-4136-bcbd-23c12d5f6854 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:12.640779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-759375e8-f645-4136-bcbd-23c12d5f6854 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 2809 microversion: 2.25 time: 0.092620 Jul 25 16:11:12.641869 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 782/1609] 10.222.0.105 () {60 vars in 1189 bytes} [Mon Jul 25 16:11:12 2022] GET /compute/v2.1/os-migrations => generated 2809 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:12.681043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:12.688696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:12.712636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:12.713784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:12.715170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:12.716050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.134973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:13.145842 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81f38ac4-0770-46a0-89e2-7c4e8fe194f4 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1359 microversion: 2.1 time: 0.704328 Jul 25 16:11:13.150621 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 828/1610] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:12 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1359 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:13.162529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:13.168080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:13.191793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:13.204516 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92db0d0c-80af-4e97-a37d-27fe9de2d7bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.554892 Jul 25 16:11:13.222144 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 783/1611] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:12 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:13.244181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:13.244979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.246602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:13.247662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.248213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:13.253267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:13.277913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:13.281330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.282559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:13.283421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.800940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:13.813528 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9c73b2c-435c-4275-bac9-a2259338ed59 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 0.583789 Jul 25 16:11:13.823849 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 784/1612] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:13 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:13.842919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:13.857004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:13.876687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:13.877479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.879129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:13.881009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:13.949808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid c89f1679-8eed-4efc-b90b-9de768bb23d3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:14.021944 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36a74017-940e-4c8d-b66c-14114d150bd2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 2427 microversion: 2.25 time: 0.868707 Jul 25 16:11:14.025343 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 829/1613] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:13 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 2427 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:14.035149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:14.035836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:14.043412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.045060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.046365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.047098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.366146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:14.383145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:14.384703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:14.391254 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9260064f-9f9c-4ff8-b4d8-b4082de257e7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.364532 Jul 25 16:11:14.392542 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 830/1614] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:14 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:14.398622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:14.399818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:14.410477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.412061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.413739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.414365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.431492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:14.451877 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0c9ef21-0ca8-4636-968c-2718e1b34e97 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.626042 Jul 25 16:11:14.475815 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 785/1615] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:13 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:14.494864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:14.495946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:14.510765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.511701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.513381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.514480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.871958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:14.880987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid c89f1679-8eed-4efc-b90b-9de768bb23d3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:14.901030 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-defff244-1cdb-4aef-b298-52209395ec87 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1810 microversion: 2.1 time: 0.423345 Jul 25 16:11:14.909846 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 786/1616] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:14 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1810 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:14.923678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:14.929689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:14.950873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.954421 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bb7fd1f6-bf5e-4810-9910-8c0ecaf61749 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 2427 microversion: 2.25 time: 0.549143 Jul 25 16:11:14.955679 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 831/1617] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:14 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 2427 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:14.962218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:14.963869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea9c9bc8-8466-418e-b988-fcb7479197ba tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606303741", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": -1, "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:14.968161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:14.970720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.027756 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ea9c9bc8-8466-418e-b988-fcb7479197ba tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Flavor -1 could not be found. Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea9c9bc8-8466-418e-b988-fcb7479197ba tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 205 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606303741", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": -1, "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor -1 could not be found. Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-606303741', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': -1, 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:15.054553 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 25 16:11:15.062963 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:15.072344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea9c9bc8-8466-418e-b988-fcb7479197ba tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:15.098516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea9c9bc8-8466-418e-b988-fcb7479197ba tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.141514 Jul 25 16:11:15.104508 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 832/1618] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:14 2022] POST /compute/v2.1/servers => generated 73 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:15.129762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:15.130646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:15.140267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.141353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.143781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.144560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.179396 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7b504c3-47f4-4616-8392-de85368d9a4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462/ips" status: 200 len: 219 microversion: 2.1 time: 0.073259 Jul 25 16:11:15.180802 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 833/1619] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:11:15 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462/ips => generated 219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:15.195411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:15.196721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:15.208786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.211821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.226102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.229233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.602134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:15.614318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc7ccf20-0f5a-4cfd-b809-d77842c1405e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 0.702521 Jul 25 16:11:15.620456 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 787/1620] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:14 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:15.635405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:15.637829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:15.659958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.660422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.661336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.661773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.730640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:11:15.886456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:15.898401 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c9589b8-a00d-4fda-a942-a35c44489c9f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.716176 Jul 25 16:11:15.915251 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 834/1621] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:15 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:15.939820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:15.942625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:15.963060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.963767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.967532 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-05c25fe7-c877-4563-9426-639a35880da7 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "DELETE /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 204 len: 0 microversion: 2.1 time: 0.342995 Jul 25 16:11:15.968149 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 788/1622] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:11:15 2022] DELETE /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:11:15.969317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:15.970110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:15.989628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:15.991131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:16.010475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:16.011640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:16.013624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:16.015201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:16.199663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:16.213558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:16.220915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:16.222580 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac5dfc32-01f2-4520-8dc9-8787597d822c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.253077 Jul 25 16:11:16.241989 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 789/1623] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:15 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:16.251531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:16.252212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lazy-loading 'services' on Instance uuid c89f1679-8eed-4efc-b90b-9de768bb23d3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:16.257402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:16.269329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:16.270227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:16.271255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:16.271920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:16.516173 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aca1a2dd-d090-44ad-9850-07e25e4eb02c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments/b6f69437-5922-4230-9690-62c8be85cb4e" status: 202 len: 0 microversion: 2.25 time: 0.601110 Jul 25 16:11:16.518791 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 835/1624] 10.222.0.105 () {60 vars in 1462 bytes} [Mon Jul 25 16:11:15 2022] DELETE /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments/b6f69437-5922-4230-9690-62c8be85cb4e => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:11:16.531843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:16.533986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:16.564247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:16.564900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:16.570324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:16.573425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:16.584691 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38dc34fb-bd95-4a8e-93a2-3a86595e89ea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.341282 Jul 25 16:11:16.586588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:16.587043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:16.594527 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 790/1625] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:16 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:16.671025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:17.022188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:17.031334 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d1840fd-201a-41fa-ac99-9c0b18eb5e26 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1816 microversion: 2.1 time: 0.510911 Jul 25 16:11:17.045135 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 836/1626] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:16 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1816 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:17.045135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:17.045135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:17.067112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.067583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.068530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.069002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.118837 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f736166-ab2d-4c0b-acb9-1d56bb1d67f6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085001 Jul 25 16:11:17.119805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 837/1627] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:17 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:17.126987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:17.126987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:17.138336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.139089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.139903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.140332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.352942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:17.379681 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12a5d32c-3312-4a06-baa4-5cc55b58a54f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 0.256686 Jul 25 16:11:17.380900 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 838/1628] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:17 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:17.408219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba672a4c-3476-48ed-92ea-758870723ea7 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Action: 'create', calling method: .version_select at 0x7f9d93961e50>, body: {"pool": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:17.414385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae1e1afa-0c51-4813-9a04-1e0ecb67ec19 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-106618347", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae1e1afa-0c51-4813-9a04-1e0ecb67ec19 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 172 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-106618347", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-106618347', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi -1 Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:11:17.443352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae1e1afa-0c51-4813-9a04-1e0ecb67ec19 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:17.449133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ae1e1afa-0c51-4813-9a04-1e0ecb67ec19 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.066529 Jul 25 16:11:17.453686 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 839/1629] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:17 2022] POST /compute/v2.1/servers => generated 145 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:17.468751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:17.469412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:17.490634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.491168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.491998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.492433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.632742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:17.661571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:17.672503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:17.674786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8673c7af-ed5b-4a9a-b4ce-b917761f60c2 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.215966 Jul 25 16:11:17.695497 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 840/1630] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:17 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:17.709062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:17.710041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:17.718923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.719999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:17.721656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:17.722369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:18.314267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:18.349915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-132cedff-077d-4e90-a28e-ac34fefaa06a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.651982 Jul 25 16:11:18.354968 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 841/1631] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:17 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:18.373938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:18.375912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:18.412284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:18.413343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:18.415341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:18.421847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:18.830664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:18.853139 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bdeda697-e940-462b-9bc7-162a335dcc4f tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1816 microversion: 2.1 time: 0.496286 Jul 25 16:11:18.865422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 842/1632] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:18 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1816 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:18.877562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:18.893612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:18.904410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:18.908813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:18.913465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:18.914028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:18.995760 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89b1848f-6356-4869-9602-42a0951d261a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123405 Jul 25 16:11:18.999735 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 843/1633] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:18 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:19.393233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3934232-e42e-4c9a-9f22-62592b59736a tempest-NetworksTest-572769835 tempest-NetworksTest-572769835-project-admin] Calling method '.version_select at 0x7f9d938ac5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:19.821441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3934232-e42e-4c9a-9f22-62592b59736a tempest-NetworksTest-572769835 tempest-NetworksTest-572769835-project-admin] 10.222.0.105 "GET /compute/v2.1/os-networks" status: 200 len: 11464 microversion: 2.1 time: 0.822266 Jul 25 16:11:19.823040 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 844/1634] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:11:18 2022] GET /compute/v2.1/os-networks => generated 11464 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:19.831424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:19.832219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:19.848966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:19.851704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:19.854489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:19.856013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:20.353822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:20.375459 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7d44736f-0e5a-4509-b5b4-63c87ef3ae80 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.549633 Jul 25 16:11:20.380088 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 845/1635] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:19 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:20.388504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:20.390930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:20.415316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:20.416016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:20.418217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:20.420733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:20.968027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:20.982233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b98c3971-7518-4187-a629-dbe5337cdca5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 0.600289 Jul 25 16:11:20.983689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 846/1636] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:20 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:20.998626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:21.006765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:21.030136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.031038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.032567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.037413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.381743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba672a4c-3476-48ed-92ea-758870723ea7 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.785913 Jul 25 16:11:21.382571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 791/1637] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:11:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:21.392038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0c121355-0cf4-4f35-8457-f461e3800657 req-6d1280e1-5bbc-4b5a-9aae-36a35b96fbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "name": "network-vif-deleted", "tag": "2a00e4b0-1132-484f-bd5d-07498b1da714"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:21.436406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:21.440832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0c121355-0cf4-4f35-8457-f461e3800657 req-6d1280e1-5bbc-4b5a-9aae-36a35b96fbcb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.444898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0c121355-0cf4-4f35-8457-f461e3800657 req-6d1280e1-5bbc-4b5a-9aae-36a35b96fbcb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.473181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:21.476112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:21.478347 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ed72900f-9784-4a22-9f33-bc254357680b tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.492129 Jul 25 16:11:21.479848 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 847/1638] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:20 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:21.482596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0c121355-0cf4-4f35-8457-f461e3800657 req-6d1280e1-5bbc-4b5a-9aae-36a35b96fbcb service nova] Creating event network-vif-deleted:2a00e4b0-1132-484f-bd5d-07498b1da714 for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:11:21.485867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-587616df-33c6-4e2e-b412-d32a50b1f61b tempest-NetworksTest-572769835 tempest-NetworksTest-572769835-project-admin] Calling method '.version_select at 0x7f9d935213a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:21.504593 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0c121355-0cf4-4f35-8457-f461e3800657 req-6d1280e1-5bbc-4b5a-9aae-36a35b96fbcb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116594 Jul 25 16:11:21.505254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 792/1639] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:21.522418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:21.523141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:21.562161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.576187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.588660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.588660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.656548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-587616df-33c6-4e2e-b412-d32a50b1f61b tempest-NetworksTest-572769835 tempest-NetworksTest-572769835-project-admin] 10.222.0.105 "GET /compute/v2.1/os-networks/e0cd9471-7058-498f-87a9-12c5f12ddc15" status: 200 len: 652 microversion: 2.1 time: 0.175157 Jul 25 16:11:21.657369 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 848/1640] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:11:21 2022] GET /compute/v2.1/os-networks/e0cd9471-7058-498f-87a9-12c5f12ddc15 => generated 652 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:21.666247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:21.671672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.672279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.672903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lazy-loading 'fault' on Instance uuid 51d019ec-819c-46bc-af42-857b8c12c462 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:21.678938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:21.698754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.699200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.719601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:21.720058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:21.736404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:21.749527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e171aa2-e2ae-433d-9352-f284f7dfe835 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 200 len: 1307 microversion: 2.1 time: 0.236531 Jul 25 16:11:21.750901 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 793/1641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:21 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:21.772807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77976354-450c-43d8-b66e-2ce9d8352464 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1848289245", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:21.779968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-77976354-450c-43d8-b66e-2ce9d8352464 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77976354-450c-43d8-b66e-2ce9d8352464 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 216 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1848289245", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1848289245', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:21.783453 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 16:11:21.790634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:21.795708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77976354-450c-43d8-b66e-2ce9d8352464 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:21.797255 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77976354-450c-43d8-b66e-2ce9d8352464 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.044404 Jul 25 16:11:21.797460 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17498c30-be4b-4c80-8325-e907f0e27c0d tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134439 Jul 25 16:11:21.800643 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 849/1642] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:21 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:21.803301 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 794/1643] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:21 2022] POST /compute/v2.1/servers => generated 123 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:21.812670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2374f90a-aff3-417c-9e16-0862fe976654 tempest-NetworksTest-572769835 tempest-NetworksTest-572769835-project-admin] Calling method '.version_select at 0x7f9d93788dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:21.818594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb1b953c-9f8d-432b-af0c-8137ee9ca5f0 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Calling method '.version_select at 0x7f9d93521790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:22.193989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2374f90a-aff3-417c-9e16-0862fe976654 tempest-NetworksTest-572769835 tempest-NetworksTest-572769835-project-admin] 10.222.0.105 "GET /compute/v2.1/os-networks" status: 200 len: 11464 microversion: 2.1 time: 0.389031 Jul 25 16:11:22.194673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 795/1644] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:11:21 2022] GET /compute/v2.1/os-networks => generated 11464 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:22.203097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:22.203733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:22.238230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:22.238474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb1b953c-9f8d-432b-af0c-8137ee9ca5f0 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips/12bb41d8-4b00-45e0-a2be-95dd10f14f1d" status: 200 len: 142 microversion: 2.1 time: 0.431783 Jul 25 16:11:22.240054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:22.240937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:22.241410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:22.252767 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 850/1645] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:11:21 2022] GET /compute/v2.1/os-floating-ips/12bb41d8-4b00-45e0-a2be-95dd10f14f1d => generated 142 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:22.262250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:22.263536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:22.277601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:22.281306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:22.282423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:22.288340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:22.289317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:22.644865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:22.656146 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1823be46-23ec-4363-b75f-d4d3b9eece2e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1516 microversion: 2.1 time: 0.401687 Jul 25 16:11:22.661147 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 851/1646] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:22 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:22.677970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6566fbb7-5ce5-4e45-875f-87ebb65d231b tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Calling method '.version_select at 0x7f9d93e6dd30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:22.758260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:22.770285 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cc5c8d17-ab59-445c-bbe2-183ba96dd67a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.574231 Jul 25 16:11:22.783856 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 796/1647] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:22 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:22.794143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:22.794767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:22.820504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:22.822164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:22.824262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:22.831248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:22.970265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:22.983532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:22.993926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:22.995899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87457f92-b1ef-49af-93d7-9ee095083bda tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.222306 Jul 25 16:11:23.003208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 797/1648] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:22 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:23.019747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:23.020998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:23.042717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:23.045724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:23.046983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:23.047518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:23.104186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6566fbb7-5ce5-4e45-875f-87ebb65d231b tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.441514 Jul 25 16:11:23.105478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 852/1649] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:11:22 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:23.113687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:23.115624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:23.118945 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] HTTP exception thrown: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Request method failure captured: Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 HTTP/1.1 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBsGqm-qS1DgPreVnxkXIJTPJ8w_wOvk57T2KcGpVNLrToTEZp7BcxWDVcLVFvwv4feC0kmZYEgE0eX-0bvUoLLjogow5-F2wqI2Li2JiIELxqAf8TwjtvWjwYIdFg7LewHVWCQa1871rVZ41eM4DGPFCJ4QavIt7K81LbcQ5_tVzM Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_789a10dc64a7414b992e80d535bd72d1"}]}] Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestMultiNic-442899734 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestMultiNic-442899734-project Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c424061ccba84b9fb38ec72e5d5f4213 Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestMultiNic-442899734-project Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '51d019ec-819c-46bc-af42-857b8c12c462'} Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:23.127274 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:11:23.136574 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:23.139780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:23.140383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:23.143579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Returning 404 to user: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:23.160124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:23.162382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:23.163048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2dd0ee07-bd48-4030-9cf4-472da1d5c08d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 404 len: 111 microversion: 2.1 time: 0.155927 Jul 25 16:11:23.172763 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 798/1650] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:23 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:23.184695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:23.205323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:23.239846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:23.241373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:23.242856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:23.243738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:23.344861 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd38bc48-309e-4c30-a4d4-27eef7ed3a52 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.168471 Jul 25 16:11:23.347802 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 799/1651] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:23 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:23.362135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f31c1dd7-28af-4d1c-a571-d8e229c28276 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Calling method '.version_select at 0x7f9d938f8d30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:24.972709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:24.983035 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dec82059-3ed5-4af9-90ba-b1a000388154 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.876167 Jul 25 16:11:24.997729 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 853/1652] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:23 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:25.023538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-54b08532-c8d3-46b1-ae0e-bcb213d940ff req-c2bb7393-7662-4cac-8b21-8fede4b8ba51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "name": "network-vif-deleted", "tag": "18e24371-bc13-4a8b-a765-95e167c0193f"}, {"server_uuid": "51d019ec-819c-46bc-af42-857b8c12c462", "name": "network-vif-deleted", "tag": "4ebcb9d2-6d96-4c11-8361-43a93a3de331"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:25.067707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-54b08532-c8d3-46b1-ae0e-bcb213d940ff req-c2bb7393-7662-4cac-8b21-8fede4b8ba51 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:25.068780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-54b08532-c8d3-46b1-ae0e-bcb213d940ff req-c2bb7393-7662-4cac-8b21-8fede4b8ba51 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:25.097305 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-54b08532-c8d3-46b1-ae0e-bcb213d940ff req-c2bb7393-7662-4cac-8b21-8fede4b8ba51 service nova] Creating event network-vif-deleted:18e24371-bc13-4a8b-a765-95e167c0193f for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:11:25.099896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-54b08532-c8d3-46b1-ae0e-bcb213d940ff req-c2bb7393-7662-4cac-8b21-8fede4b8ba51 service nova] Creating event network-vif-deleted:4ebcb9d2-6d96-4c11-8361-43a93a3de331 for instance 51d019ec-819c-46bc-af42-857b8c12c462 on n-h2-846219-13 Jul 25 16:11:25.112855 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-54b08532-c8d3-46b1-ae0e-bcb213d940ff req-c2bb7393-7662-4cac-8b21-8fede4b8ba51 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113429 Jul 25 16:11:25.123076 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 854/1653] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:25.131272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:25.135017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:25.160142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:25.163370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:25.170445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:25.171298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:25.699936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:25.710296 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-285c7558-5df6-41f8-8488-f9cca0a9b7b6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1493 microversion: 2.1 time: 0.583987 Jul 25 16:11:25.711929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 855/1654] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:25 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1493 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:25.731194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:25.732412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:25.743510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:25.745742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:25.750497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:25.753062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:25.924810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:25.947832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:25.957328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:25.959025 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3257165d-4001-4981-a048-35333dc2b6fd tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.245497 Jul 25 16:11:25.972721 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 856/1655] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:25 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:25.985499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:25.988061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:26.007288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:26.007544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:26.008280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:26.008714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:26.085523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea243f95-eb10-4838-a0bf-a3c7291e5259 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120835 Jul 25 16:11:26.091438 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 857/1656] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:25 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:26.093919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d7b56cc-6b45-486b-a66f-d3c63818b64a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-629103595", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-key-1653604470", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:26.215946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-5d7b56cc-6b45-486b-a66f-d3c63818b64a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] validate_networks() for [('772d42f0-328d-4c98-8730-4f6263eb1e55', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:11:26.589001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f31c1dd7-28af-4d1c-a571-d8e229c28276 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/12bb41d8-4b00-45e0-a2be-95dd10f14f1d" status: 202 len: 0 microversion: 2.1 time: 3.237066 Jul 25 16:11:26.590255 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 800/1657] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:11:23 2022] DELETE /compute/v2.1/os-floating-ips/12bb41d8-4b00-45e0-a2be-95dd10f14f1d => generated 0 bytes in 3240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:11:26.598245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:26.598748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:26.606606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:26.607060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:26.608241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:26.608851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:26.641013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:11:26.814754 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1335e98c-8ef5-4246-bdca-7b7d8387bdba tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 204 len: 0 microversion: 2.1 time: 0.223169 Jul 25 16:11:26.815336 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 801/1658] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:11:26 2022] DELETE /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:11:26.830936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a20feb95-2064-4b67-83b1-6c56a82e346a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Action: 'create', calling method: .version_select at 0x7f9d938f8310>, body: {"pool": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:26.845027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-5d7b56cc-6b45-486b-a66f-d3c63818b64a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Invalid key_name provided. Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d7b56cc-6b45-486b-a66f-d3c63818b64a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 246 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-629103595", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-key-1653604470", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid key_name provided. Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-629103595', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'key_name': 'tempest-key-1653604470', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1653604470 not found for user fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:26.850324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 25 16:11:26.856069 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:26.862033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d7b56cc-6b45-486b-a66f-d3c63818b64a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid key_name provided. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:26.863287 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d7b56cc-6b45-486b-a66f-d3c63818b64a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.775154 Jul 25 16:11:26.864386 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 858/1659] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:26 2022] POST /compute/v2.1/servers => generated 70 bytes in 777 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:26.877487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:26.879750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:26.886654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:26.887490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:26.888844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:26.889554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:27.338999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:27.341726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:27.354563 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9331b5fc-4fa4-4012-a663-26904b9ce51b tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1499 microversion: 2.1 time: 0.488714 Jul 25 16:11:27.365679 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 859/1660] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:26 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1499 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:27.377067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:27.377067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:27.391783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:27.393699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:27.398320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:27.399946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:27.812410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:27.826156 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-daea30a3-239d-4df4-b31a-7344aae5f7a8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.468592 Jul 25 16:11:27.846078 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 860/1661] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:27 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:27.856525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:27.857297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:27.866071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:27.866688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:27.867617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:27.868341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:28.047148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:28.063497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:28.069666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:28.072091 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9141798-234a-4651-9bcc-c67bdef90866 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.223666 Jul 25 16:11:28.074462 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 861/1662] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:27 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:28.079824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:28.082684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:28.097642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:28.098516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:28.098915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:28.099359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:28.207824 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9185d2cd-a471-4b40-a09e-7fd2b4de4f26 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131236 Jul 25 16:11:28.212685 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 862/1663] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:28 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:28.223542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:28.224583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:28.248268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:28.248871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:28.250878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:28.251334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:28.859284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:28.868195 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6354abbe-1afa-4d67-9175-384882c084cd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.657821 Jul 25 16:11:28.884209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 863/1664] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:28 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:28.889297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:28.890106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:28.903884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:28.904705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:28.906188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:28.906837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:29.529195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:29.552332 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d0037b6-2b09-4caa-9de6-adc9be45238c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 200 len: 1457 microversion: 2.1 time: 0.656213 Jul 25 16:11:29.553540 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 864/1665] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:28 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 1457 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:29.558618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:29.559622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:29.579810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:29.584858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:29.586227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:29.590215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:29.867395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:29.878168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:29.880824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:29.882897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90684d33-e185-41cf-92bb-32911749763c tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.328178 Jul 25 16:11:29.883501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 865/1666] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:29 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:29.905926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aaa886b5-ce6a-487e-94a0-489d81905a60 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-283194951", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:30.136861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-aaa886b5-ce6a-487e-94a0-489d81905a60 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Neutron security group does_not_exist not found {{(pid=119599) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 25 16:11:30.137743 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-aaa886b5-ce6a-487e-94a0-489d81905a60 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aaa886b5-ce6a-487e-94a0-489d81905a60 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 257 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-283194951", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-283194951', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 25 16:11:30.149162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.154515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aaa886b5-ce6a-487e-94a0-489d81905a60 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:30.158976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aaa886b5-ce6a-487e-94a0-489d81905a60 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.255671 Jul 25 16:11:30.158976 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 866/1667] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:29 2022] POST /compute/v2.1/servers => generated 106 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:30.161405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:30.163861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:30.184656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.184834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.185599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.186040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.251573 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-184e971b-c0ec-4596-951e-377e706a10b6 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096038 Jul 25 16:11:30.256872 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 867/1668] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:30 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:11:30.267573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e70dfabf-ebe5-4c2e-b4b4-0884e3981182 req-59f90413-7f65-45b9-9377-1bef0d0ede08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4819201-9e0f-47ad-9810-291b09e9aa39", "name": "network-vif-deleted", "tag": "c41a840b-f40c-47c6-987b-a9b3e00647ae"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:30.290058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e70dfabf-ebe5-4c2e-b4b4-0884e3981182 req-59f90413-7f65-45b9-9377-1bef0d0ede08 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.290543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e70dfabf-ebe5-4c2e-b4b4-0884e3981182 req-59f90413-7f65-45b9-9377-1bef0d0ede08 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.322387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e70dfabf-ebe5-4c2e-b4b4-0884e3981182 req-59f90413-7f65-45b9-9377-1bef0d0ede08 service nova] Creating event network-vif-deleted:c41a840b-f40c-47c6-987b-a9b3e00647ae for instance b4819201-9e0f-47ad-9810-291b09e9aa39 on n-h1-846219-13 Jul 25 16:11:30.327559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e70dfabf-ebe5-4c2e-b4b4-0884e3981182 req-59f90413-7f65-45b9-9377-1bef0d0ede08 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069332 Jul 25 16:11:30.328506 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 868/1669] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:30.333825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:30.334543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:30.341366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.341816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.342790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.343393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.725106 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a20feb95-2064-4b67-83b1-6c56a82e346a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.900879 Jul 25 16:11:30.728172 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 802/1670] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:11:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:30.748258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:30.752326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:30.776566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.777980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.780187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:30.782467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:30.819084 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 HTTP/1.1 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b4819201-9e0f-47ad-9810-291b09e9aa39'} Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:30.821846 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:11:30.826465 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:30.832383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:30.835176 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80654f3c-bf93-4f1e-82a1-4e78eea0e825 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 404 len: 111 microversion: 2.1 time: 0.104680 Jul 25 16:11:30.839289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 803/1671] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:30 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:30.851951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-36069160-a5c4-4e56-8547-9a3377476650 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Calling method '.version_select at 0x7f9d93a0c820>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:31.011426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:31.020153 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17567168-13e2-41f0-aab2-e8f5ad96e32b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.690345 Jul 25 16:11:31.048207 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 869/1672] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:30 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:31.055967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:31.069327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:31.082719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:31.082865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:31.083669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:31.084115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:31.939982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:31.978881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:31.984758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:31.986880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e036368b-9ab8-46eb-9abb-4a19d9e8ced7 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.937170 Jul 25 16:11:32.013610 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 870/1673] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:31 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:32.032933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1565331476", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "59969ae6-2925-402a-a38d-e30aabceb98d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:32.173856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] validate_networks() for [('59969ae6-2925-402a-a38d-e30aabceb98d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:11:33.740596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:11:33.742094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:11:33.742865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:11:33.743517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:11:33.744366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:11:33.759808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:33.760694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:33.762718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:33.763495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:33.795772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:11:33.804364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Getting quotas for user 7b0b085c0e7c4bbfb89aaf2caf4d72d7 and project 2a3fe79f1cbe41bab6260130a1ff89df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:11:33.828518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:11:33.835277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:11:33.936556 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a317a14-000b-4525-9ebe-29d19ff55ef6 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.920693 Jul 25 16:11:33.943746 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 871/1674] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:11:33.951021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:33.952300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:33.960430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:33.960882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:33.962067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:33.965624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:34.384491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-36069160-a5c4-4e56-8547-9a3377476650 tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d" status: 202 len: 0 microversion: 2.1 time: 3.543538 Jul 25 16:11:34.385426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 804/1675] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:11:30 2022] DELETE /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d => generated 0 bytes in 3545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:11:34.392059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:34.400789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:34.405970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:34.429502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:34.432097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:34.435441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:34.437233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:34.458642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:34.469577 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2eeeb69-5a39-4607-877e-8b11351a7cf5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.524523 Jul 25 16:11:34.473901 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 872/1676] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:33 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:34.483499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:34.493400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:34.507002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:34.518117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:34.524672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:34.525323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:34.541223 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-421a33c4-2721-47d6-9326-963e6cf83c8f tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.152136 Jul 25 16:11:34.544458 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 805/1677] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:11:34 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:34.702278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:34.727267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:34.729207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:34.730775 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7bce76b-076e-467e-a05f-c3a2d4121b98 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.255440 Jul 25 16:11:34.732328 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 873/1678] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:34 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:34.742411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-611e7b10-6d25-4966-810d-7acb2f38e9e3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:34.748002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-611e7b10-6d25-4966-810d-7acb2f38e9e3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:34.852884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-611e7b10-6d25-4966-810d-7acb2f38e9e3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:34.868731 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-611e7b10-6d25-4966-810d-7acb2f38e9e3 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1219 microversion: 2.1 time: 0.134878 Jul 25 16:11:34.870210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 874/1679] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:34 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:34.888676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-477085362", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "7addf2ab-27e4-47cf-a1ee-245d4bb01c6c"}, {"uuid": "d153c557-a393-490d-905c-d5761a87af9e"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:34.976001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-258455414", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": "none"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:35.000461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] validate_networks() for [('7addf2ab-27e4-47cf-a1ee-245d4bb01c6c', None, None, None, None, None), ('d153c557-a393-490d-905c-d5761a87af9e', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:11:35.155796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:11:35.157846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:11:35.158488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:11:35.158904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:11:35.159386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:11:35.203944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:35.204498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:35.208767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:35.209268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:35.280950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Getting quotas for project f292eb18b00648bebd64571e091222e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:11:35.302812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Getting quotas for user e1a62b173cb8413db1e5c914c46e66ef and project f292eb18b00648bebd64571e091222e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:11:35.334573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:11:35.338431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:11:35.459854 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ded68ef-3698-4137-85ad-f8cab7682d20 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.75 time: 0.913370 Jul 25 16:11:35.462093 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 806/1680] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:11:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:11:35.467626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b370e76d-7cfb-4935-8ee8-98895fbc888a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Calling method '.version_select at 0x7f9d93a40ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:35.673953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-b370e76d-7cfb-4935-8ee8-98895fbc888a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5922909d-ee55-458a-8d41-c8a5c663226d could not be found", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:11:35.675081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b370e76d-7cfb-4935-8ee8-98895fbc888a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] HTTP exception thrown: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b370e76d-7cfb-4935-8ee8-98895fbc888a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Request method failure captured: Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d HTTP/1.1 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sCk9OkE2KBQMgzSS7AKgn8w5w-b7XygsWUNfHmjv_2_Ar9CWSgMqtalvjNL-Xgf7UqwWPNaiGgk0u_R6qgjuOGWfsKXsEbbNXR5H5TOOaL3Ob3dAh9JqiOjjciMrstT24dRCsCYBk1FtXGra9O9kt6KddD_WuPETUZHWibcQEEvdzg Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 6d4fdf768fc343518d3f3013e4d34275 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsTestJSON-2099233813 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6d4fdf768fc343518d3f3013e4d34275"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6d4fdf768fc343518d3f3013e4d34275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/6d4fdf768fc343518d3f3013e4d34275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_6d4fdf768fc343518d3f3013e4d34275"}]}] Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsTestJSON-2099233813 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 6d4fdf768fc343518d3f3013e4d34275 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2099233813 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsTestJSON-2099233813-project Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 0030a600270246dea458c91165a017ee Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsTestJSON-2099233813-project Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: exception: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5922909d-ee55-458a-8d41-c8a5c663226d'} Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5922909d-ee55-458a-8d41-c8a5c663226d could not be found Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b3afe3a-e316-48c6-a585-f691a07b760c'] Jul 25 16:11:35.678257 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d. Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:35.683177 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.686597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b370e76d-7cfb-4935-8ee8-98895fbc888a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Returning 404 to user: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:35.687731 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b370e76d-7cfb-4935-8ee8-98895fbc888a tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "GET /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d" status: 404 len: 111 microversion: 2.1 time: 0.224105 Jul 25 16:11:35.688831 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 807/1681] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:11:35 2022] GET /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:35.714658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6255357-9691-4be8-8726-b9b42908aacf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:35.717054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6255357-9691-4be8-8726-b9b42908aacf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b017438a-6724-4b45-8bc3-11b686ec4562] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:35.741715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f6255357-9691-4be8-8726-b9b42908aacf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b017438a-6724-4b45-8bc3-11b686ec4562 could not be found. Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6255357-9691-4be8-8726-b9b42908aacf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/b017438a-6724-4b45-8bc3-11b686ec4562 HTTP/1.1 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b017438a-6724-4b45-8bc3-11b686ec4562 could not be found. Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b017438a-6724-4b45-8bc3-11b686ec4562'} Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b017438a-6724-4b45-8bc3-11b686ec4562 could not be found. Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b017438a-6724-4b45-8bc3-11b686ec4562 could not be found. Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.761025 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b017438a-6724-4b45-8bc3-11b686ec4562 could not be found. Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:35.766512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6255357-9691-4be8-8726-b9b42908aacf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b017438a-6724-4b45-8bc3-11b686ec4562 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:35.769677 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6255357-9691-4be8-8726-b9b42908aacf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b017438a-6724-4b45-8bc3-11b686ec4562" status: 404 len: 111 microversion: 2.1 time: 0.074162 Jul 25 16:11:35.773861 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 808/1682] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:11:35 2022] DELETE /compute/v2.1/servers/b017438a-6724-4b45-8bc3-11b686ec4562 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:35.789717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e45366ab-f8ca-40cf-96a8-de49d151c357 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:35.792735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e45366ab-f8ca-40cf-96a8-de49d151c357 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:36.019156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e45366ab-f8ca-40cf-96a8-de49d151c357 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:36.033002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e45366ab-f8ca-40cf-96a8-de49d151c357 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:36.046224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e45366ab-f8ca-40cf-96a8-de49d151c357 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:36.092732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e45366ab-f8ca-40cf-96a8-de49d151c357 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "PUT /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1361 microversion: 2.75 time: 0.317502 Jul 25 16:11:36.100109 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 809/1683] 10.222.0.105 () {62 vars in 1302 bytes} [Mon Jul 25 16:11:35 2022] PUT /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:36.128552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0bd962d-0428-4aa7-af6e-c7d7e9190b9e tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Calling method '.version_select at 0x7f9d93a0c5e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:36.245625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-e0bd962d-0428-4aa7-af6e-c7d7e9190b9e tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5922909d-ee55-458a-8d41-c8a5c663226d could not be found", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:11:36.246354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e0bd962d-0428-4aa7-af6e-c7d7e9190b9e tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] HTTP exception thrown: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0bd962d-0428-4aa7-af6e-c7d7e9190b9e tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Request method failure captured: Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d HTTP/1.1 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sCk9OkE2KBQMgzSS7AKgn8w5w-b7XygsWUNfHmjv_2_Ar9CWSgMqtalvjNL-Xgf7UqwWPNaiGgk0u_R6qgjuOGWfsKXsEbbNXR5H5TOOaL3Ob3dAh9JqiOjjciMrstT24dRCsCYBk1FtXGra9O9kt6KddD_WuPETUZHWibcQEEvdzg Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 6d4fdf768fc343518d3f3013e4d34275 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsTestJSON-2099233813 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6d4fdf768fc343518d3f3013e4d34275"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/6d4fdf768fc343518d3f3013e4d34275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/6d4fdf768fc343518d3f3013e4d34275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_6d4fdf768fc343518d3f3013e4d34275"}]}] Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsTestJSON-2099233813 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 6d4fdf768fc343518d3f3013e4d34275 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2099233813 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsTestJSON-2099233813-project Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 0030a600270246dea458c91165a017ee Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsTestJSON-2099233813-project Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: exception: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5922909d-ee55-458a-8d41-c8a5c663226d'} Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5922909d-ee55-458a-8d41-c8a5c663226d could not be found Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce2a2ea8-e773-4741-b249-56f6a607e475'] Jul 25 16:11:36.248213 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d. Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0bd962d-0428-4aa7-af6e-c7d7e9190b9e tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] Returning 404 to user: Floating IP not found for ID 5922909d-ee55-458a-8d41-c8a5c663226d {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:36.254040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0bd962d-0428-4aa7-af6e-c7d7e9190b9e tempest-FloatingIPsTestJSON-2099233813 tempest-FloatingIPsTestJSON-2099233813-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d" status: 404 len: 111 microversion: 2.1 time: 0.148124 Jul 25 16:11:36.260453 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 810/1684] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:11:36 2022] DELETE /compute/v2.1/os-floating-ips/5922909d-ee55-458a-8d41-c8a5c663226d => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:36.270737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:36.271368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:36.287515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:36.287969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:36.288764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:36.294370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:36.668519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:36.689495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:36.708204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:36.709848 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-846ac4be-510b-408c-8aba-1132e0035c05 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.453110 Jul 25 16:11:36.729826 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 811/1685] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:36 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:36.749277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:36.750872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:36.766818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:36.771085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:36.772264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:36.772894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.437206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:37.460002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07babcd5-dad7-409c-97ab-afc7c764b1e9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.724250 Jul 25 16:11:37.462677 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 812/1686] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:36 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:37.480377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:37.486189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:37.525515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:11:37.526599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:11:37.527523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:11:37.528666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:11:37.529611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:11:37.541833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.542712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.556712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.557619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.572327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.573513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.580344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.581783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.668232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Getting quotas for project 789a10dc64a7414b992e80d535bd72d1. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:11:37.688015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Getting quotas for user c424061ccba84b9fb38ec72e5d5f4213 and project 789a10dc64a7414b992e80d535bd72d1. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:11:37.713442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:11:37.723791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:11:37.772012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:37.798495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17a05a4c-f16a-44b0-a073-9e4509dbad1f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1277 microversion: 2.1 time: 0.317902 Jul 25 16:11:37.799587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 813/1687] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:37 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1277 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:37.814790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:37.816114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:37.834552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.836538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.844017 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ba7ba7c-845d-4019-9c70-8299ab4122ce tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.972180 Jul 25 16:11:37.847623 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 875/1688] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 2977 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:11:37.851542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.859078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.864523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:37.866915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:37.900093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.908988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:37.911273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:37.915177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:38.302763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.341024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.343672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.396238 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-06b219d4-4ef6-4cf8-9997-b72cfc1b31ee tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1413 microversion: 2.75 time: 0.594436 Jul 25 16:11:38.396851 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 814/1689] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:37 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1413 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:38.427653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:38.429560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:38.469363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:38.471054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:38.472898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:38.473481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:38.514825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.535372 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d11d0edf-4bb6-4271-8007-e081ef79a292 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.685917 Jul 25 16:11:38.543305 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 876/1690] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:37 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:38.565305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b681ec11-56c5-4ac8-9a3a-c133988ad97a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:38.565974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b681ec11-56c5-4ac8-9a3a-c133988ad97a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:38.675422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.698693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.703798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.706943 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a14beaec-8739-4aeb-9dd9-15d7c4333f50 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.297401 Jul 25 16:11:38.713044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 815/1691] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:38 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:38.721075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1b43224-7b10-4f1e-b93b-51c45211f9d0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:38.722111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1b43224-7b10-4f1e-b93b-51c45211f9d0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:11:38.722871 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d1b43224-7b10-4f1e-b93b-51c45211f9d0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1b43224-7b10-4f1e-b93b-51c45211f9d0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 9223372036854775808 could not be found. Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '9223372036854775808'} Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:38.724934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:38.732425 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:38.732425 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:38.732425 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:38.732425 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 25 16:11:38.732425 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:38.749441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1b43224-7b10-4f1e-b93b-51c45211f9d0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:38.758861 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1b43224-7b10-4f1e-b93b-51c45211f9d0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.044051 Jul 25 16:11:38.761135 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 816/1692] 10.222.0.105 () {58 vars in 1193 bytes} [Mon Jul 25 16:11:38 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:11:38.790123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:38.794271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:38.831791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b681ec11-56c5-4ac8-9a3a-c133988ad97a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:38.832634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:38.836101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:38.838036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:38.839238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b681ec11-56c5-4ac8-9a3a-c133988ad97a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1216 microversion: 2.1 time: 0.294502 Jul 25 16:11:38.839392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:38.839847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 877/1693] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:38 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1216 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:38.859732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:38.860469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:38.893158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:38.895984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:38.897057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:38.898594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.203041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:39.229416 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5242dcf7-3928-417a-9bb3-c26ecc604379 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1277 microversion: 2.1 time: 0.383772 Jul 25 16:11:39.236966 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 878/1694] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:38 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1277 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:39.278048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:39.291234 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6288d464-8a1f-41bb-af7e-7590b7cd6d14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.525605 Jul 25 16:11:39.293255 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 817/1695] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:38 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:39.316033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:39.316915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:39.327474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.328325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.335558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.336742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.422688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:39.423477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:39.442931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.444344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.453588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.455919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.829220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:39.840037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:39.849151 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f639bb2e-d135-41a4-b343-04ae7aac7ab6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.537233 Jul 25 16:11:39.857059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:39.861600 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 879/1696] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:39 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:39.871852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:39.877986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:39.878851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:39.883717 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3fc99882-1cd5-47a0-9a21-4f0c7de6578a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1419 microversion: 2.75 time: 0.466229 Jul 25 16:11:39.884321 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 818/1697] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:39 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1419 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:11:39.911274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.913594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.920264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:39.923821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.924889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:39.930287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.955354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.955863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.956668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:39.957127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:39.962040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:40.100120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:40.110812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:40.112456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:40.125874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-62bfe031-54a4-4a1e-858f-c0143edd6d13 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1609 microversion: 2.32 time: 0.255658 Jul 25 16:11:40.145668 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 880/1698] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:39 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1609 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:40.155075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7f308b5-3e0a-47e0-8e21-156060ef76ca tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:40.156027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c7f308b5-3e0a-47e0-8e21-156060ef76ca tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Failed to fetch instance by id -1 {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:11:40.156830 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c7f308b5-3e0a-47e0-8e21-156060ef76ca tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance -1 could not be found. Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7f308b5-3e0a-47e0-8e21-156060ef76ca tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance -1 could not be found. Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '-1'} Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:40.159091 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:40.163831 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:40.163831 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:40.163831 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 25 16:11:40.163831 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:40.167719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7f308b5-3e0a-47e0-8e21-156060ef76ca tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:40.168896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c7f308b5-3e0a-47e0-8e21-156060ef76ca tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.021656 Jul 25 16:11:40.170056 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 881/1699] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:11:40 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:11:40.186574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:40.191077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:40.205744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:40.213395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.214186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.215329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.216529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.240566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4e3ce9b-540e-4e22-8e42-aa9f846e9b43 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1268 microversion: 2.1 time: 0.350865 Jul 25 16:11:40.241433 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 819/1700] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:39 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1268 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:40.270163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:40.271595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:40.273999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:40.289600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.290408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.291653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.292709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.791073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:40.801969 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ccb58e6e-8cf3-4474-bd61-e373d7595a45 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1319 microversion: 2.1 time: 0.538582 Jul 25 16:11:40.815557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:40.816277 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 820/1701] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:40 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:40.818310 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2413a173-ce98-43d0-8f64-4dd7594f5418 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.638016 Jul 25 16:11:40.819345 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 882/1702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:40 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:40.845764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:40.846403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:40.852666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.855777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.856617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.857127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.916188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:40.916873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:40.948872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.950264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:40.957436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:40.959741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.366241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.398536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.409493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.435555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12637ac3-5771-40e3-975a-d70a893c0c3b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1419 microversion: 2.75 time: 0.524837 Jul 25 16:11:41.449151 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 883/1703] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:40 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1419 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:11:41.449151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:41.449151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:41.453494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.454533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.457202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.457933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.461503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.475213 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91f4bc9c-99b6-4d29-8906-495fdee584e7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.634018 Jul 25 16:11:41.475811 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 821/1704] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:40 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:11:41.482138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:41.488330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:41.497386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:41.506800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.507763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.508967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lazy-loading 'fault' on Instance uuid e96437cc-0bf2-4825-bda3-de5fb2446977 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:41.511546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.517381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.518366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.519285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.583471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.595244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.598488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2cb53e4c0dd4b37bbb40fdc1d2ff652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9995a32f65804fe6aba424fb23bdd0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.602761 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2ff5ef4-5892-4c88-8c18-415d9271f3c3 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 200 len: 1376 microversion: 2.32 time: 0.162071 Jul 25 16:11:41.605767 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 884/1705] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:41 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:41.617733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-10c7ef3d-d96d-4fa6-a4ad-8627b8f00a0a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:41.618573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-10c7ef3d-d96d-4fa6-a4ad-8627b8f00a0a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b70688dc-480e-4a92-9c1e-07e5e5d53164] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:41.631969 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-10c7ef3d-d96d-4fa6-a4ad-8627b8f00a0a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b70688dc-480e-4a92-9c1e-07e5e5d53164 could not be found. Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-10c7ef3d-d96d-4fa6-a4ad-8627b8f00a0a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/b70688dc-480e-4a92-9c1e-07e5e5d53164/action HTTP/1.1 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 19 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: {"forceDelete": {}} Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b70688dc-480e-4a92-9c1e-07e5e5d53164 could not be found. Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b70688dc-480e-4a92-9c1e-07e5e5d53164', 'body': {'forceDelete': {}}} Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70688dc-480e-4a92-9c1e-07e5e5d53164 could not be found. Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70688dc-480e-4a92-9c1e-07e5e5d53164 could not be found. Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:41.647620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:41.653129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:41.653129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:41.653129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70688dc-480e-4a92-9c1e-07e5e5d53164 could not be found. Jul 25 16:11:41.653129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:41.655364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-10c7ef3d-d96d-4fa6-a4ad-8627b8f00a0a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b70688dc-480e-4a92-9c1e-07e5e5d53164 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:41.656435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-10c7ef3d-d96d-4fa6-a4ad-8627b8f00a0a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/b70688dc-480e-4a92-9c1e-07e5e5d53164/action" status: 404 len: 111 microversion: 2.1 time: 0.049436 Jul 25 16:11:41.657919 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 885/1706] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:11:41 2022] POST /compute/v2.1/servers/b70688dc-480e-4a92-9c1e-07e5e5d53164/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:41.667277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:41.671207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:41.687625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.695871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.700172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:41.709151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:41.711781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:41.728241 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c04710d-77b1-4361-a0a8-92079bddfec9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1274 microversion: 2.1 time: 0.249584 Jul 25 16:11:41.728896 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 822/1707] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:41 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:41.803717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1468808094", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "934be3e8-a3dc-4628-bdcf-841c71054ba0"}], "block_device_mapping_v2": [{"uuid": "de1ba50c-4bde-437a-b3b0-f7c22b0564f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:41.890838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] validate_networks() for [('934be3e8-a3dc-4628-bdcf-841c71054ba0', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:11:42.137941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:42.147671 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5638179-f196-4662-80a5-110183c96beb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.485487 Jul 25 16:11:42.148457 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 886/1708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:41 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:42.161495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:42.162159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:42.173524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:42.174590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:42.175469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:42.176125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.146473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:43.160606 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4b5b197-746e-461c-9bf5-bbd01877f874 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1319 microversion: 2.1 time: 1.011225 Jul 25 16:11:43.176467 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 887/1709] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:42 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1319 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:43.181946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:43.190754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:43.210850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:43.211589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.212606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:43.213229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.878287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:43.893946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:11:43.894533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:11:43.895231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:11:43.895651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:11:43.896064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:11:43.906250 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b771903a-69d1-4156-b07c-4a03c55c75e4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.727383 Jul 25 16:11:43.929875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 888/1710] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:43 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:43.935015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:43.935554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.936500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:43.936850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.948880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:43.951179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:43.967639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:43.968706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.969774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:43.970919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:43.991049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:11:44.000581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Getting quotas for user d8d1e6f3591a4c4ea97eadbd97954916 and project 0638463dadea48a0b7650229ad028a90. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:11:44.088884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:11:44.091324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de1ba50c-4bde-437a-b3b0-f7c22b0564f8',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:11:44.100674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.116622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.118883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.130213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-55a48213-a051-4a0b-9191-dc32631ac7d2 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1440 microversion: 2.75 time: 0.198804 Jul 25 16:11:44.131747 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 889/1711] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:43 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1440 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:44.146184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5fd4adf3-3908-4a70-be26-0684013ce60c req-ec3d13a3-737c-4685-9ced-91989f8a274a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a333c0-d8b8-410a-b649-6d35a8509ef1", "tag": "57703021-2cbe-411c-99a3-b34a5fcd0689"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:44.158079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5fd4adf3-3908-4a70-be26-0684013ce60c req-ec3d13a3-737c-4685-9ced-91989f8a274a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.158828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5fd4adf3-3908-4a70-be26-0684013ce60c req-ec3d13a3-737c-4685-9ced-91989f8a274a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.175268 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5fd4adf3-3908-4a70-be26-0684013ce60c req-ec3d13a3-737c-4685-9ced-91989f8a274a service nova] Creating event network-changed:57703021-2cbe-411c-99a3-b34a5fcd0689 for instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 on n-h2-846219-13 Jul 25 16:11:44.183591 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5fd4adf3-3908-4a70-be26-0684013ce60c req-ec3d13a3-737c-4685-9ced-91989f8a274a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049796 Jul 25 16:11:44.184633 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 890/1712] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:44.196834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:44.197582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:44.209945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.210389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.211169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.211629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.228079 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] HTTP exception thrown: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Request method failure captured: Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 HTTP/1.1 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r8MTU45fG1LpGik9PhMw0hw6l12Qr3uZ6bJ0jpZQJFEiyH4WR3PO7uDXsW9hhTVGaibt0XJUo30Zqv7wqzREmp414NqBpHcDH4Oz-SQb-JAxH5AAjfnYqujOLiQsEvRFaPnzUQdCMfSJ9zZ_GQJUXQEpMBiAp2SfTt-2Lf794MmITU Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9995a32f65804fe6aba424fb23bdd0d3 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9995a32f65804fe6aba424fb23bdd0d3"}]}] Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9995a32f65804fe6aba424fb23bdd0d3 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TaggedBootDevicesTest-1738484441-project Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c2cb53e4c0dd4b37bbb40fdc1d2ff652 Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TaggedBootDevicesTest-1738484441-project Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'e96437cc-0bf2-4825-bda3-de5fb2446977'} Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.230095 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.234951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Returning 404 to user: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:44.235632 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-442b150a-5ce6-4f89-b650-4f9868019c32 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 404 len: 111 microversion: 2.32 time: 0.049776 Jul 25 16:11:44.237067 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 891/1713] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:44 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:44.244011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:44.245142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:44.251964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.252712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.254572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.255348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.322307 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cb3ca89b-8399-4cdd-a1cd-e3b0db559dc7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.522520 Jul 25 16:11:44.323230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 823/1714] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:11:44.329262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3a9c0333-5530-42b4-bb60-c025d9dc7737 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:44.331904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3a9c0333-5530-42b4-bb60-c025d9dc7737 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: e5fc22e4-63c3-498c-a524-a2615ea8dbfa] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:44.339173 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3a9c0333-5530-42b4-bb60-c025d9dc7737 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance e5fc22e4-63c3-498c-a524-a2615ea8dbfa could not be found. Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3a9c0333-5530-42b4-bb60-c025d9dc7737 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/e5fc22e4-63c3-498c-a524-a2615ea8dbfa/action HTTP/1.1 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 39 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: {"os-getConsoleOutput": {"length": 10}} Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance e5fc22e4-63c3-498c-a524-a2615ea8dbfa could not be found. Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'e5fc22e4-63c3-498c-a524-a2615ea8dbfa', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fc22e4-63c3-498c-a524-a2615ea8dbfa could not be found. Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fc22e4-63c3-498c-a524-a2615ea8dbfa could not be found. Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.342048 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fc22e4-63c3-498c-a524-a2615ea8dbfa could not be found. Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3a9c0333-5530-42b4-bb60-c025d9dc7737 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance e5fc22e4-63c3-498c-a524-a2615ea8dbfa could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3a9c0333-5530-42b4-bb60-c025d9dc7737 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/e5fc22e4-63c3-498c-a524-a2615ea8dbfa/action" status: 404 len: 111 microversion: 2.1 time: 0.019136 Jul 25 16:11:44.346867 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 824/1715] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:11:44 2022] POST /compute/v2.1/servers/e5fc22e4-63c3-498c-a524-a2615ea8dbfa/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:44.349572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:44.353127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:44.361872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.362267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.364700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.365151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.476436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:11:44.476999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:11:44.477593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:11:44.478277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:11:44.478945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:11:44.606957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:44.615591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.616540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.617859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.618851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.844713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.856545 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ffe76076-78d3-4ede-953e-cc28c45a3a54 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1316 microversion: 2.1 time: 0.618684 Jul 25 16:11:44.866335 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 892/1716] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:44 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:44.871549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:44.874217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:44.882292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.883307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.884459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:44.885004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:44.897674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.911482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.936982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:44.947218 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d7e648a-9e94-473b-b4ac-37f82d5beffc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "POST /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5/action" status: 202 len: 1497 microversion: 2.75 time: 0.601952 Jul 25 16:11:44.948359 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 825/1717] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:11:44 2022] POST /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5/action => generated 1497 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Jul 25 16:11:44.955237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09a4cce9-2aca-4745-9643-49805cd99b51 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '.version_select at 0x7f9d939dd820>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:45.004371 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09a4cce9-2aca-4745-9643-49805cd99b51 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163248459" status: 204 len: 0 microversion: 2.32 time: 0.054466 Jul 25 16:11:45.006395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 826/1718] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163248459 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:11:45.013610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40a6c294-436e-4a70-9e9c-82343844d780 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:45.014602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40a6c294-436e-4a70-9e9c-82343844d780 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:45.219080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40a6c294-436e-4a70-9e9c-82343844d780 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:45.228478 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40a6c294-436e-4a70-9e9c-82343844d780 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1056 microversion: 2.1 time: 0.220457 Jul 25 16:11:45.228932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 827/1719] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:45 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1056 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:45.243181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:45.243842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:45.261273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.261722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.262513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.262940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.604598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:45.635239 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d03d9846-f756-44e4-99c5-0e0c87de86a4 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1319 microversion: 2.1 time: 0.766471 Jul 25 16:11:45.636771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 893/1720] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:44 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:45.645646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:45.647116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:45.660746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.661989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.663705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.664723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.758316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:45.770634 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-18ee02d0-5125-4809-8351-390834b4f3a1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.540560 Jul 25 16:11:45.771679 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 828/1721] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:45 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:45.796247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:45.796871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:45.817259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.818366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.820553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.822442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.837470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:45.855782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:45.857931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:45.869148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a57adbe4-fee4-4653-9129-fa2246b0907e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.230427 Jul 25 16:11:45.874560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 894/1722] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:45 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:45.879710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:45.880818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:45.904526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.905246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:45.906288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:45.907526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:46.962252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:46.971803 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-646b97d6-1895-4961-b8a5-696726555fa5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.182968 Jul 25 16:11:46.972380 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 829/1723] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:45 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:46.989998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:46.990616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:46.996876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:46.997634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:46.998630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:46.999255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:47.014594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:47.044369 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f3bbc2a3-8b85-48a4-ac82-cc0c88615785 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 1.168114 Jul 25 16:11:47.047162 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 895/1724] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:45 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:47.093591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:47.094323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:47.128296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:47.129605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:47.133349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:47.136939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:47.301362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:47.311362 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22728c17-9cff-4d61-94fc-6d2ece86fe65 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1172 microversion: 2.1 time: 0.337848 Jul 25 16:11:47.318252 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 830/1725] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:46 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1172 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:47.339733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:47.347354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:47.361961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:47.362499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:47.363360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:47.363866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:47.530756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:47.550967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:47.557481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:47.574422 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89119306-9635-4ab4-909f-dbdd992619c1 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.253437 Jul 25 16:11:47.576459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 831/1726] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:47 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:47.588363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-936eff38-f1d0-47d6-9922-2c4a9c563fdc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:47.594600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-936eff38-f1d0-47d6-9922-2c4a9c563fdc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 0f583617-01c4-46e9-ad20-7c5123453344] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:47.609745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:47.625704 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-936eff38-f1d0-47d6-9922-2c4a9c563fdc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 0f583617-01c4-46e9-ad20-7c5123453344 could not be found. Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-936eff38-f1d0-47d6-9922-2c4a9c563fdc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/0f583617-01c4-46e9-ad20-7c5123453344 HTTP/1.1 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 0f583617-01c4-46e9-ad20-7c5123453344 could not be found. Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '0f583617-01c4-46e9-ad20-7c5123453344'} Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f583617-01c4-46e9-ad20-7c5123453344 could not be found. Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f583617-01c4-46e9-ad20-7c5123453344 could not be found. Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:47.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:47.632755 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:47.632755 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:47.632755 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:47.632755 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f583617-01c4-46e9-ad20-7c5123453344 could not be found. Jul 25 16:11:47.632755 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:47.636150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-936eff38-f1d0-47d6-9922-2c4a9c563fdc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 0f583617-01c4-46e9-ad20-7c5123453344 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:47.636522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:47.649631 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-936eff38-f1d0-47d6-9922-2c4a9c563fdc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/0f583617-01c4-46e9-ad20-7c5123453344" status: 404 len: 111 microversion: 2.1 time: 0.070009 Jul 25 16:11:47.652115 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 832/1727] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:47 2022] GET /compute/v2.1/servers/0f583617-01c4-46e9-ad20-7c5123453344 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:47.666804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:47.667586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:47.689054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:47.689938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:47.691007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:47.691838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.008672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:48.040426 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd77134c-e75a-4b0c-b785-072e9ff81dce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1319 microversion: 2.1 time: 0.991240 Jul 25 16:11:48.050881 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 896/1728] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:47 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1319 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:48.098594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:48.103016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:48.130689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:48.132956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.134779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:48.136204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.399413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:48.415750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6783ab9c-b0b2-47ff-8bc4-92b2f2f103fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.758860 Jul 25 16:11:48.417729 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 833/1729] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:47 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:11:48.429063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:48.432670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:48.447979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:48.448440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.449441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:48.449781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.685926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:48.699506 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe7888e3-94be-48f8-9680-b1389748a47f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1172 microversion: 2.1 time: 0.278244 Jul 25 16:11:48.734597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 834/1730] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:48 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1172 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:48.763002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:48.763975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:48.787045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:48.787536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.792864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:48.794068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:48.839289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=16 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:49.073512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:49.085997 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0fd92f81-ce21-4da2-bf87-a8c07836b7b5 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 1.012097 Jul 25 16:11:49.098425 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 897/1731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:48 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:49.101246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:49.102200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:49.117423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:49.117958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:49.118830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:49.119340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:49.318795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:49.343085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:49.346147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:49.365539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18b870cd-e85d-4014-99dc-94f0e1d3733d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.275147 Jul 25 16:11:49.366204 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 898/1732] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:49 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:49.379227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:49.379860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:49.407751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:49.409733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:49.413532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:49.414546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:49.485727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:49.495170 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b262ea0-3e1d-4d09-83ee-e2d29026d1a4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.757742 Jul 25 16:11:49.496426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 835/1733] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:48 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:49.642148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d9b93c7-04c2-4789-802e-4b4797cc8f17 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-896698686", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d9b93c7-04c2-4789-802e-4b4797cc8f17 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 237 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-896698686", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-896698686', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.671673 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 16:11:49.679848 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:49.684064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d9b93c7-04c2-4789-802e-4b4797cc8f17 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:49.684551 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d9b93c7-04c2-4789-802e-4b4797cc8f17 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.046382 Jul 25 16:11:49.685949 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 836/1734] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:49.696049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:49.698100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:49.729032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:49.729852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:49.730861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:49.731840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:50.629203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:50.647198 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-98e8b90b-d728-4754-8d26-dab5c7dc082d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1319 microversion: 2.1 time: 1.278415 Jul 25 16:11:50.648547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 899/1735] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:49 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1319 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:50.662111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:50.667078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:50.697221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:50.699722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:50.700860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:50.702306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:50.856853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:50.867956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7be30412-7579-4812-80ec-c5983a9b71fc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.177688 Jul 25 16:11:50.895817 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 837/1736] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:49 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:11:50.901834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-923921e6-a4b5-4b34-b943-f67999dc179a req-be1be4ae-620b-4fe6-80f7-1f2f5cc767fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a333c0-d8b8-410a-b649-6d35a8509ef1", "name": "network-vif-plugged", "status": "completed", "tag": "57703021-2cbe-411c-99a3-b34a5fcd0689"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:50.914944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-923921e6-a4b5-4b34-b943-f67999dc179a req-be1be4ae-620b-4fe6-80f7-1f2f5cc767fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:50.915929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-923921e6-a4b5-4b34-b943-f67999dc179a req-be1be4ae-620b-4fe6-80f7-1f2f5cc767fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:50.941004 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-923921e6-a4b5-4b34-b943-f67999dc179a req-be1be4ae-620b-4fe6-80f7-1f2f5cc767fd service nova] Creating event network-vif-plugged:57703021-2cbe-411c-99a3-b34a5fcd0689 for instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 on n-h2-846219-13 Jul 25 16:11:50.963206 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-923921e6-a4b5-4b34-b943-f67999dc179a req-be1be4ae-620b-4fe6-80f7-1f2f5cc767fd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065652 Jul 25 16:11:50.964846 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 838/1737] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:50.972636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:50.974771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:50.997713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:50.998851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:50.999960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:51.000696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.278321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:52.334056 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59277be0-c558-4978-a11a-57a72823c672 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1214 microversion: 2.1 time: 1.683631 Jul 25 16:11:52.336336 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 900/1738] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:50 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1214 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:52.363260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-55808916-1eb3-4538-9049-9a66350e9308 req-db1919c5-19e7-4f10-90d1-28e4a586762a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "tag": "11bfa616-1150-4fc3-86b9-ea5d448d4114"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:52.388833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-55808916-1eb3-4538-9049-9a66350e9308 req-db1919c5-19e7-4f10-90d1-28e4a586762a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.389936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-55808916-1eb3-4538-9049-9a66350e9308 req-db1919c5-19e7-4f10-90d1-28e4a586762a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.410708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:52.419662 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-55808916-1eb3-4538-9049-9a66350e9308 req-db1919c5-19e7-4f10-90d1-28e4a586762a service nova] Creating event network-changed:11bfa616-1150-4fc3-86b9-ea5d448d4114 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:11:52.456829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:52.463738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-55808916-1eb3-4538-9049-9a66350e9308 req-db1919c5-19e7-4f10-90d1-28e4a586762a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091315 Jul 25 16:11:52.476176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 901/1739] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:52.488192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:52.503694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:52.504361 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e38e129-1d49-4589-9358-87908fa11aa1 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 1.537690 Jul 25 16:11:52.505183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:52.527185 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 839/1740] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:50 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:52.527185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:52.527185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:52.535061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.539573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.542737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.549971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.569462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.569970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.577696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.578181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.793437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:52.841877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:52.845000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:52.868886 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dec4cf14-3dd0-4743-a347-1412623e4b72 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.385539 Jul 25 16:11:52.883228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 902/1741] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:52 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:52.922282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:52.923264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:52.938659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.939760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:52.945541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:52.946096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:53.514561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:53.584979 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-311d386a-4a4e-421c-8b5c-768046f3222e tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1506 microversion: 2.1 time: 0.697397 Jul 25 16:11:53.654494 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 903/1742] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:52 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1506 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:53.683340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:53.683915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:53.701610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:53.702059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:53.706583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:53.709971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:53.715027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:53.741646 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed16cdca-bb2a-482c-be66-81979ee856d8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.226534 Jul 25 16:11:53.744278 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 840/1743] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:52 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:53.798685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:53.803171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:53.822490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:53.824208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:53.829887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:53.830595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:53.975167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:55.059670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:55.093079 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c08598f-1ec6-4f57-8eb0-15295bc1f9b9 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1214 microversion: 2.1 time: 1.435785 Jul 25 16:11:55.097272 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 904/1744] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:53 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1214 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:55.128256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:55.132747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:55.154995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.159875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.166326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.167694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.185391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:55.204018 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed4ddcb4-77a3-42c7-9e6e-64680bb0a4ec tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 1.455948 Jul 25 16:11:55.206419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 841/1745] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:53 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:55.222497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:55.224938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:55.235338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=16 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:55.253942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.254898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.257056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lazy-loading 'flavor' on Instance uuid 44a333c0-d8b8-410a-b649-6d35a8509ef1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:11:55.258486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.259087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.530860 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82e15c55-5309-42f6-9743-6bfacec029ed tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "POST /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.431706 Jul 25 16:11:55.532856 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 905/1746] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:11:55 2022] POST /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:11:55.565047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4bdf603-aea7-4140-817d-a5039037b062 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-208165705", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4bdf603-aea7-4140-817d-a5039037b062 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 234 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-208165705", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-208165705', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.577602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 16:11:55.583516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:55.587524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4bdf603-aea7-4140-817d-a5039037b062 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:55.589187 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4bdf603-aea7-4140-817d-a5039037b062 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.054631 Jul 25 16:11:55.590289 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 906/1747] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:11:55 2022] POST /compute/v2.1/servers => generated 133 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:55.604254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ec094af3-6a45-4a76-a59f-3fedbf4746f7 req-cc35f166-0500-4290-8fb2-b1ba20659353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "tag": "9c1532f8-84c0-425c-9ef1-fafa75c95e89"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:55.627776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ec094af3-6a45-4a76-a59f-3fedbf4746f7 req-cc35f166-0500-4290-8fb2-b1ba20659353 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.628903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ec094af3-6a45-4a76-a59f-3fedbf4746f7 req-cc35f166-0500-4290-8fb2-b1ba20659353 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.680458 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ec094af3-6a45-4a76-a59f-3fedbf4746f7 req-cc35f166-0500-4290-8fb2-b1ba20659353 service nova] Creating event network-changed:9c1532f8-84c0-425c-9ef1-fafa75c95e89 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:11:55.692340 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ec094af3-6a45-4a76-a59f-3fedbf4746f7 req-cc35f166-0500-4290-8fb2-b1ba20659353 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099735 Jul 25 16:11:55.694279 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 907/1748] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:55.704723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:55.712575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:55.726696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.727027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:55.729923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.732236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.733144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.743141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:55.745695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:55.758097 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-47ec00b5-8674-489b-9e22-f9f45318b12b tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.547726 Jul 25 16:11:55.758707 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 842/1749] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:55 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:55.764390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:55.765281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:55.774747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.775480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:55.776957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:55.777938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:56.281782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:56.291669 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f675db71-6174-472b-8433-435aefeff1a0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.531687 Jul 25 16:11:56.297961 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 843/1750] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:55 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:56.303103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:56.303691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:56.311021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:56.314065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:56.315577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:56.316244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:56.509315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:56.520175 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3209b988-aeac-4143-b0f5-3f6d6a92875f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1514 microversion: 2.1 time: 0.823941 Jul 25 16:11:56.521551 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 908/1751] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:55 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1514 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:56.530003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:56.531255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:56.542309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:56.544383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:56.545889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:56.546544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:56.839257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:56.852739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92e9aa0c-9086-4da8-ac52-82c60abe38b6 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.553185 Jul 25 16:11:56.855013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 844/1752] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:56 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:56.870544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:56.872980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:56.892376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:56.893673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:56.894974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:56.898457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.051112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:57.065786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d531847f-cc32-4268-bf54-45462fc190aa tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.541371 Jul 25 16:11:57.067173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 909/1753] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:56 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:57.078420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:57.081973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:57.098152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.098939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.099948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.100550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.136729 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] HTTP exception thrown: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Request method failure captured: Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 HTTP/1.1 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r8MTU45fG1LpGik9PhMw0hw6l12Qr3uZ6bJ0jpZQJFEiyH4WR3PO7uDXsW9hhTVGaibt0XJUo30Zqv7wqzREmp414NqBpHcDH4Oz-SQb-JAxH5AAjfnYqujOLiQsEvRFaPnzUQdCMfSJ9zZ_GQJUXQEpMBiAp2SfTt-2Lf794MmITU Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9995a32f65804fe6aba424fb23bdd0d3 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9995a32f65804fe6aba424fb23bdd0d3"}]}] Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9995a32f65804fe6aba424fb23bdd0d3 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TaggedBootDevicesTest-1738484441-project Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c2cb53e4c0dd4b37bbb40fdc1d2ff652 Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TaggedBootDevicesTest-1738484441-project Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'e96437cc-0bf2-4825-bda3-de5fb2446977'} Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:57.139002 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.145051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.147160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Returning 404 to user: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:57.148548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4a39c5dd-d0d6-4adf-afba-4bf59fcd4290 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 404 len: 111 microversion: 2.32 time: 0.079967 Jul 25 16:11:57.149734 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 910/1754] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:11:57 2022] DELETE /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:57.175780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:57.183736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:57.196209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.205077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.206216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.206998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.373364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:57.383445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:57.387256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:57.401136 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e81ae459-b3f4-489d-bb3b-402f76d60e45 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.249257 Jul 25 16:11:57.402732 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 911/1755] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:57 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:57.411666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:57.417457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] [instance: e96437cc-0bf2-4825-bda3-de5fb2446977] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:57.430475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.435642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.436850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.437521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.467768 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] HTTP exception thrown: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Request method failure captured: Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 HTTP/1.1 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r8MTU45fG1LpGik9PhMw0hw6l12Qr3uZ6bJ0jpZQJFEiyH4WR3PO7uDXsW9hhTVGaibt0XJUo30Zqv7wqzREmp414NqBpHcDH4Oz-SQb-JAxH5AAjfnYqujOLiQsEvRFaPnzUQdCMfSJ9zZ_GQJUXQEpMBiAp2SfTt-2Lf794MmITU Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9995a32f65804fe6aba424fb23bdd0d3 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9995a32f65804fe6aba424fb23bdd0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9995a32f65804fe6aba424fb23bdd0d3"}]}] Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9995a32f65804fe6aba424fb23bdd0d3 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1738484441 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TaggedBootDevicesTest-1738484441-project Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c2cb53e4c0dd4b37bbb40fdc1d2ff652 Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TaggedBootDevicesTest-1738484441-project Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'e96437cc-0bf2-4825-bda3-de5fb2446977'} Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.473536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] Returning 404 to user: Instance e96437cc-0bf2-4825-bda3-de5fb2446977 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-723e6c46-bb11-4b22-9631-6992c1cc34e6 tempest-TaggedBootDevicesTest-1738484441 tempest-TaggedBootDevicesTest-1738484441-project] 10.222.0.105 "GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977" status: 404 len: 111 microversion: 2.32 time: 0.071264 Jul 25 16:11:57.479805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 912/1756] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:57 2022] GET /compute/v2.1/servers/e96437cc-0bf2-4825-bda3-de5fb2446977 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:11:57.543450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:57.544466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:57.563504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.566918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.570354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.571038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.575258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:57.593608 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-202bc8a0-1ecc-423d-828a-1ee7aa9aa6b6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.733418 Jul 25 16:11:57.612338 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 845/1757] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:56 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:57.636087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-136a79dc-a772-4bc4-89ac-03118f01831f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:57.636801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-136a79dc-a772-4bc4-89ac-03118f01831f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: ad2554a1-0503-47a4-9a1d-604b0cf01c00] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:57.650178 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-136a79dc-a772-4bc4-89ac-03118f01831f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance ad2554a1-0503-47a4-9a1d-604b0cf01c00 could not be found. Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-136a79dc-a772-4bc4-89ac-03118f01831f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/ad2554a1-0503-47a4-9a1d-604b0cf01c00/action HTTP/1.1 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 13 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: {"pause": {}} Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance ad2554a1-0503-47a4-9a1d-604b0cf01c00 could not be found. Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'ad2554a1-0503-47a4-9a1d-604b0cf01c00', 'body': {'pause': {}}} Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2554a1-0503-47a4-9a1d-604b0cf01c00 could not be found. Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2554a1-0503-47a4-9a1d-604b0cf01c00 could not be found. Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:11:57.663087 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2554a1-0503-47a4-9a1d-604b0cf01c00 could not be found. Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-136a79dc-a772-4bc4-89ac-03118f01831f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance ad2554a1-0503-47a4-9a1d-604b0cf01c00 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-136a79dc-a772-4bc4-89ac-03118f01831f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/ad2554a1-0503-47a4-9a1d-604b0cf01c00/action" status: 404 len: 111 microversion: 2.1 time: 0.050713 Jul 25 16:11:57.668644 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 846/1758] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:11:57 2022] POST /compute/v2.1/servers/ad2554a1-0503-47a4-9a1d-604b0cf01c00/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:11:57.688591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:57.692127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:57.718964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.719414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:57.720289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:57.720729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.097724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:58.108984 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa9c905e-66bc-40c6-9909-4b11f6a09ed2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.437283 Jul 25 16:11:58.111370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 847/1759] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:57 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:58.132440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:58.136369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-abc6094b-40ca-4910-9ef0-b2c3fc5dcb44 req-af58a9ce-e7be-4e31-a50a-bdeed0dfea76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d67bbb-da10-4f92-b74d-b4fedc9620c8", "tag": "395c36bb-f161-42c2-a622-8d78cf8abfaa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:58.145651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b8013c6-b2c1-4505-994c-e44ca73f835f tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1497 microversion: 2.1 time: 0.603376 Jul 25 16:11:58.146308 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 913/1760] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:57 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1497 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:11:58.158371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:58.159309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:58.170492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-abc6094b-40ca-4910-9ef0-b2c3fc5dcb44 req-af58a9ce-e7be-4e31-a50a-bdeed0dfea76 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.171331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-abc6094b-40ca-4910-9ef0-b2c3fc5dcb44 req-af58a9ce-e7be-4e31-a50a-bdeed0dfea76 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.172785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.178847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.179814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.180275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.195207 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-abc6094b-40ca-4910-9ef0-b2c3fc5dcb44 req-af58a9ce-e7be-4e31-a50a-bdeed0dfea76 service nova] Creating event network-changed:395c36bb-f161-42c2-a622-8d78cf8abfaa for instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 on n-h1-846219-13 Jul 25 16:11:58.202270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-abc6094b-40ca-4910-9ef0-b2c3fc5dcb44 req-af58a9ce-e7be-4e31-a50a-bdeed0dfea76 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074184 Jul 25 16:11:58.203785 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 848/1761] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:11:58.210876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:58.211729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:58.218752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.219578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.220709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.221421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.622811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:58.635582 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93992ffc-b862-4350-87bb-2df306e1c713 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.487896 Jul 25 16:11:58.640136 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 914/1762] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:58 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:58.649966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:58.658099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:58.660362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:58.669579 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7efdf49e-9ebb-41c1-be09-69e86c125c07 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.464075 Jul 25 16:11:58.671598 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 849/1763] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:58 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:58.683385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:58.684348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:58.687710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.688162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.689009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.694907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.695746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.710123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:58.710867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.714273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:58.775168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:11:58.981036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-edbbe220-f199-43a8-a09f-b7bf146a88ce tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 204 len: 0 microversion: 2.1 time: 0.302320 Jul 25 16:11:58.982583 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 850/1764] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:11:58 2022] DELETE /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:11:58.988977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:58.993012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:59.009320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.009912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.010755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.011191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.186264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:59.203852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:59.209002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:59.227799 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38f48b68-4f8c-4b06-a6ab-ff469dd87080 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.242598 Jul 25 16:11:59.229988 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 851/1765] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:11:58 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:11:59.239575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:59.241880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:59.254191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.262083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.263453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.264108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.299848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:11:59.312030 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-180c0df3-9328-4a7c-8cc6-f5a96e58b7e3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.670057 Jul 25 16:11:59.320192 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 915/1766] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:58 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:11:59.333330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:11:59.333856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:59.341291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.341740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.342517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.343142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.463130 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3804e5ba-56ca-4ff9-9558-6dd97de179f5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 202 len: 0 microversion: 2.1 time: 0.133571 Jul 25 16:11:59.463803 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 916/1767] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:11:59 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:11:59.476375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:11:59.478553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:11:59.488369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.489432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:11:59.494175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:11:59.495264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:00.587933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:00.598387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12f7cf62-68f0-493e-a3ce-b653075944e1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1514 microversion: 2.1 time: 1.127357 Jul 25 16:12:00.617321 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 917/1768] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:59 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1514 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:00.622586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:00.644162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:00.662304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:00.662900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:00.669620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:00.671034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:00.809441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:00.827872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1fab47f0-721d-4551-89fb-b2798095fee2 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1503 microversion: 2.1 time: 1.593261 Jul 25 16:12:00.829663 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 852/1769] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:11:59 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1503 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:00.842028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:00.854271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:00.874846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:00.876596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:00.883358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:00.885425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:01.529161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:01.545182 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7821486f-8166-4274-a78c-5f91444e0781 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.711953 Jul 25 16:12:01.546953 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 853/1770] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:00 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:01.561668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:01.562559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:01.579321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:01.581254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:01.581814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:01.584549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:01.587452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:01.589219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:01.601213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-33192a6d-02a4-42b2-a754-091345c82458 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.982270 Jul 25 16:12:01.622068 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 918/1771] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:00 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:01.635395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:01.636474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:01.698476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:01.699268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:01.703173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:01.703867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:01.724715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:01.735906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:01.740274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:01.756437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14846e27-41f0-4ae2-b7e1-421c15675aa9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.207639 Jul 25 16:12:01.757958 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 854/1772] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:01 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:01.850249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:01.851602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:01.858974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:01.859639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:01.860663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:01.861765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.074266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0b085c0e7c4bbfb89aaf2caf4d72d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a3fe79f1cbe41bab6260130a1ff89df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:02.089748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59aab1db-20c3-45d1-b823-f5af3a6b5b60 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 200 len: 1461 microversion: 2.1 time: 0.237648 Jul 25 16:12:02.100351 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 855/1773] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:01 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 1461 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:02.115315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b2d5947d-80ca-4ad9-9a55-9f9befa95c86 req-b4fb1007-ee67-4dd4-93ed-4f0103f3393e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a333c0-d8b8-410a-b649-6d35a8509ef1", "name": "network-vif-deleted", "tag": "57703021-2cbe-411c-99a3-b34a5fcd0689"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:02.153083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b2d5947d-80ca-4ad9-9a55-9f9befa95c86 req-b4fb1007-ee67-4dd4-93ed-4f0103f3393e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.184535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b2d5947d-80ca-4ad9-9a55-9f9befa95c86 req-b4fb1007-ee67-4dd4-93ed-4f0103f3393e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.224790 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b2d5947d-80ca-4ad9-9a55-9f9befa95c86 req-b4fb1007-ee67-4dd4-93ed-4f0103f3393e service nova] Creating event network-vif-deleted:57703021-2cbe-411c-99a3-b34a5fcd0689 for instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 on n-h2-846219-13 Jul 25 16:12:02.248540 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b2d5947d-80ca-4ad9-9a55-9f9befa95c86 req-b4fb1007-ee67-4dd4-93ed-4f0103f3393e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135203 Jul 25 16:12:02.249823 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 856/1774] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:02.372253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:02.385379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f9189c1-f932-458d-a726-9be71b6024f9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1494 microversion: 2.1 time: 0.761129 Jul 25 16:12:02.387814 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 919/1775] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:01 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1494 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:02.408900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:02.409691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:02.420540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.426941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.427922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.428456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.466906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:02.472114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'pause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state paused Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 13 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: {"pause": {}} Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'pause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state paused Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'pause': {}}} Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state paused. Cannot pause while the instance is in this state. Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state paused Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:02.474375 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state paused Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'pause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state paused {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4908826d-b032-4135-afae-d620189e2679 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 143 microversion: 2.1 time: 0.073449 Jul 25 16:12:02.480163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 857/1776] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:02 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 143 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:12:02.488424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:02.489460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:02.503788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.505220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.506200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.506800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.566503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:02.567127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:02.596351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.599864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.601059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.602462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.709307 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-39ead652-9e32-435b-82c3-a100bdb63033 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 202 len: 0 microversion: 2.1 time: 0.226888 Jul 25 16:12:02.728742 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 920/1777] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:02 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:12:02.748328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:02.767882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:02.796687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.797200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:02.799424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:02.799868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.069056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.080740 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-63a5f530-63e7-4782-bc8b-903bbd098c45 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.517709 Jul 25 16:12:03.083464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 858/1778] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:02 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:12:03.095659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:03.096545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:03.119025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.119793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.121502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.122718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.141839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.156747 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75c43bcb-00b0-4683-a931-b6f0e881367c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.426050 Jul 25 16:12:03.159876 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 921/1779] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:02 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:03.183413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:03.184082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:03.212853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.215083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.217520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.218059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.384268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.398636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.408079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.433161 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6172360b-a09b-4417-a7d7-c2dae2cdf243 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.260254 Jul 25 16:12:03.434086 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 922/1780] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:03 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:03.449280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:03.450369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:03.458102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.463016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.464847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.465569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.503820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 HTTP/1.1 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '44a333c0-d8b8-410a-b649-6d35a8509ef1'} Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:03.511799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.516504 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.522388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.527146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:03.531865 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f8798eba-d9ba-4e04-aa42-2734d11b9dde tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.446927 Jul 25 16:12:03.545817 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 859/1781] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:03 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:03.548600 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-73cceeba-fe9a-4de3-9656-8e1f5a68af05 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 404 len: 111 microversion: 2.1 time: 0.111856 Jul 25 16:12:03.553472 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 923/1782] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:03 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:03.565936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:03.566502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:03.577537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.586074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.586935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.587385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.766312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-840182528", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "d124b9b5-749a-4e38-a154-d92ec9769aab"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:03.864062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:03.873226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] validate_networks() for [('d124b9b5-749a-4e38-a154-d92ec9769aab', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:12:03.892223 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0eff100-915c-4a3b-b03b-ded066cc2cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.330902 Jul 25 16:12:03.892832 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 924/1783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:03 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:12:03.908109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:03.908815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:03.936775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.937346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.938306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:03.955155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:03.985746 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 HTTP/1.1 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '44a333c0-d8b8-410a-b649-6d35a8509ef1'} Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:03.987829 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.006706 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.012814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:04.016465 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6db867f3-79d3-45e8-9a55-2e7221d6c29c tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 404 len: 111 microversion: 2.1 time: 0.122033 Jul 25 16:12:04.018737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 925/1784] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:03 2022] DELETE /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:04.033424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:04.048857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:04.074577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.075141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.076535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.077125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.099370 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252/action HTTP/1.1 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 28 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: {"reboot": {"type": "SOFT"}} Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b7615cee-3cb3-4712-b6c0-2b4d54eba252', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:04.102294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:04.106945 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.110190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:04.111618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07ee87f0-d4a7-4e13-9a70-f1620698bfc8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252/action" status: 404 len: 111 microversion: 2.1 time: 0.091813 Jul 25 16:12:04.112944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 926/1785] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:04 2022] POST /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:04.121310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:04.122662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 44a333c0-d8b8-410a-b649-6d35a8509ef1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:04.131077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.131837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.132804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.133416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.163525 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 HTTP/1.1 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '44a333c0-d8b8-410a-b649-6d35a8509ef1'} Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:04.165597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. Jul 25 16:12:04.172270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:04.181369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 44a333c0-d8b8-410a-b649-6d35a8509ef1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:04.186654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-70aaa8e2-adc8-445b-ab36-fabd89356615 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1" status: 404 len: 111 microversion: 2.1 time: 0.072066 Jul 25 16:12:04.190905 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 927/1786] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:04 2022] GET /compute/v2.1/servers/44a333c0-d8b8-410a-b649-6d35a8509ef1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:04.203687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:04.206915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:04.227333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.229518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.231825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.234169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.839500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:04.880245 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25fa52be-afcf-4f4a-a215-24b4ff23c7ac tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.689650 Jul 25 16:12:04.884244 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 928/1787] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:04 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:04.900236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:04.901422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:04.906024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:04.931837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.941243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.947517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.948514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.950117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:12:04.950706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:12:04.951103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:12:04.951568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:12:04.951991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:12:04.972575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.972937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:04.973796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:04.982223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.078646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Getting quotas for project c5ec8469484346eea5bf6667fd6a05af. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:12:05.098398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Getting quotas for user b3ad9e29364a42e3a6c2ce3bc38edb5f and project c5ec8469484346eea5bf6667fd6a05af. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:12:05.176167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:12:05.179473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:12:05.279517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:05.296039 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c7fed24-edbf-4775-bba0-faa3e1aaf66c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.407712 Jul 25 16:12:05.297427 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 929/1788] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:04 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:05.303682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:05.304568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:05.313252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:05.314019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.314989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:05.316027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.357166 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5b3653cc-7379-4678-a8c8-ad86ee1b7901 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.808138 Jul 25 16:12:05.372738 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 860/1789] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:12:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:12:05.392971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:05.394415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:05.436919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:05.438345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.450641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:05.451983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.520229 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 HTTP/1.1 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b4819201-9e0f-47ad-9810-291b09e9aa39'} Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:05.523814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:05.534834 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:05.543996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:05.569347 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e773ea5-6be4-49fa-ba61-60caa78cc6e5 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 404 len: 111 microversion: 2.1 time: 0.194177 Jul 25 16:12:05.572353 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 861/1790] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:05 2022] DELETE /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:05.584692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:05.591049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:05.621458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:05.622456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.624382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:05.636499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:05.933255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:05.968632 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c944fcf0-3414-40db-8d65-6ab6fc7500e3 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.669431 Jul 25 16:12:05.976951 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 930/1791] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:05 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:06.013942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.015400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.071829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.082301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.083906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.084683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.116076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:06.143218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:06.153540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:06.178423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9913340e-f572-455e-ac5e-2675ab6b51c7 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.603936 Jul 25 16:12:06.179892 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 862/1792] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:05 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:06.197047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1dd00879-382d-437f-95e9-7ac03f5343c9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.198190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1dd00879-382d-437f-95e9-7ac03f5343c9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.329131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1dd00879-382d-437f-95e9-7ac03f5343c9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:06.336772 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1dd00879-382d-437f-95e9-7ac03f5343c9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1235 microversion: 2.1 time: 0.155376 Jul 25 16:12:06.337407 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 863/1793] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:06 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1235 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:06.360952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.362398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: b4819201-9e0f-47ad-9810-291b09e9aa39] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.397778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.398841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.404277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.406314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.456469 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 HTTP/1.1 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b4819201-9e0f-47ad-9810-291b09e9aa39'} Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.458640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. Jul 25 16:12:06.464650 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.466878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance b4819201-9e0f-47ad-9810-291b09e9aa39 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:06.469829 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09828bcc-e6da-4e56-b20b-0a41a3c46586 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39" status: 404 len: 111 microversion: 2.1 time: 0.125354 Jul 25 16:12:06.471033 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 864/1794] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:06 2022] GET /compute/v2.1/servers/b4819201-9e0f-47ad-9810-291b09e9aa39 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:06.480787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.481911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.490415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.491165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.492229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.493358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.513528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:06.529314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ab29bc7-ffe4-4fdb-9747-9c29b7d49778 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.550352 Jul 25 16:12:06.530026 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 931/1795] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:05 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:06.547321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.548242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.573439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.574562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.575679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.576379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.622555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 HTTP/1.1 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '36c047e2-d8dd-4bab-87cc-13dc514d7d58'} Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:06.625155 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.632119 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.634733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:06.635970 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7762a08e-cadc-4bb9-9113-1321df1c8fac tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 404 len: 111 microversion: 2.1 time: 0.104448 Jul 25 16:12:06.640428 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 932/1796] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:06 2022] DELETE /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:06.646641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-16ae6d01-a977-402e-bb5e-5a44ca8f12d7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:06.651017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-16ae6d01-a977-402e-bb5e-5a44ca8f12d7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: d9b34cf3-2884-4c9c-8c50-f921c5ca539c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.667672 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-16ae6d01-a977-402e-bb5e-5a44ca8f12d7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance d9b34cf3-2884-4c9c-8c50-f921c5ca539c could not be found. Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-16ae6d01-a977-402e-bb5e-5a44ca8f12d7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/d9b34cf3-2884-4c9c-8c50-f921c5ca539c/action HTTP/1.1 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 28 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: {"reboot": {"type": "SOFT"}} Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d9b34cf3-2884-4c9c-8c50-f921c5ca539c could not be found. Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd9b34cf3-2884-4c9c-8c50-f921c5ca539c', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b34cf3-2884-4c9c-8c50-f921c5ca539c could not be found. Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b34cf3-2884-4c9c-8c50-f921c5ca539c could not be found. Jul 25 16:12:06.672190 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b34cf3-2884-4c9c-8c50-f921c5ca539c could not be found. Jul 25 16:12:06.677162 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.682009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-16ae6d01-a977-402e-bb5e-5a44ca8f12d7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance d9b34cf3-2884-4c9c-8c50-f921c5ca539c could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:06.688681 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-16ae6d01-a977-402e-bb5e-5a44ca8f12d7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/d9b34cf3-2884-4c9c-8c50-f921c5ca539c/action" status: 404 len: 111 microversion: 2.1 time: 0.046473 Jul 25 16:12:06.690006 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 933/1797] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:06 2022] POST /compute/v2.1/servers/d9b34cf3-2884-4c9c-8c50-f921c5ca539c/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:06.702678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.704006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 36c047e2-d8dd-4bab-87cc-13dc514d7d58] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.720657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.725136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.726204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.733683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.767874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 HTTP/1.1 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '36c047e2-d8dd-4bab-87cc-13dc514d7d58'} Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.771487 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. Jul 25 16:12:06.777486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.781913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 36c047e2-d8dd-4bab-87cc-13dc514d7d58 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:06.783618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3aaceb35-f566-4311-9c72-8e0cc842ac94 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58" status: 404 len: 111 microversion: 2.1 time: 0.092393 Jul 25 16:12:06.789357 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 934/1798] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:06 2022] GET /compute/v2.1/servers/36c047e2-d8dd-4bab-87cc-13dc514d7d58 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:06.829019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.834570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.860839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:06.876350 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a069d718-3714-487a-ad67-722e729f901a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.403852 Jul 25 16:12:06.881004 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 865/1799] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:06 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:06.894199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.896574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.900761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.903634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.906146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.906668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.918796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.920398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.921739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.928884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.959259 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe HTTP/1.1 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'eaa11af2-1b5a-4c22-b916-9d53e152cffe'} Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:06.961835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5ebfcf2a-e612-4a9e-a7ac-b764aea14a82 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 404 len: 111 microversion: 2.1 time: 0.077873 Jul 25 16:12:06.969481 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 866/1800] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:06 2022] DELETE /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:06.974106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:06.974751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: eaa11af2-1b5a-4c22-b916-9d53e152cffe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:06.988502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.988946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:06.994481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:06.995247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.026537 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe HTTP/1.1 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'eaa11af2-1b5a-4c22-b916-9d53e152cffe'} Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:07.028286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance eaa11af2-1b5a-4c22-b916-9d53e152cffe could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:07.034756 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14fd2bc2-437f-4d04-9284-20e0839ec425 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe" status: 404 len: 111 microversion: 2.1 time: 0.060834 Jul 25 16:12:07.049410 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 867/1801] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:06 2022] GET /compute/v2.1/servers/eaa11af2-1b5a-4c22-b916-9d53e152cffe => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:07.056672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:07.058326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:07.071065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:07.078460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.078912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.080757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.082564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.319692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:07.344819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc3bd89f-85e1-4b7e-9a4c-4acb3c7d58dc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.552496 Jul 25 16:12:07.346056 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 935/1802] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:06 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:07.352170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad05b7ef-ddce-40cd-8b90-218c8b5a0d29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:07.353214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ad05b7ef-ddce-40cd-8b90-218c8b5a0d29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:07.362702 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ad05b7ef-ddce-40cd-8b90-218c8b5a0d29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad05b7ef-ddce-40cd-8b90-218c8b5a0d29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b HTTP/1.1 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3e3b5b68-02b9-4784-ae83-24c9b40f655b'} Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.364834 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:07.370624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:07.372536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad05b7ef-ddce-40cd-8b90-218c8b5a0d29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:07.374094 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad05b7ef-ddce-40cd-8b90-218c8b5a0d29 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b" status: 404 len: 111 microversion: 2.1 time: 0.026660 Jul 25 16:12:07.374863 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 936/1803] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:07 2022] DELETE /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:07.380714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:07.381946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:07.391694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.394876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.398956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.399725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.425063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:07.447147 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1163b9ff-6051-4843-99e6-2b133235288e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.394958 Jul 25 16:12:07.462118 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 868/1804] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:07 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:07.483457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:07.484812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:07.497939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:07.509002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:07.511512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:07.518439 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d70ef848-4020-439a-bb22-380d84488d0a tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.142190 Jul 25 16:12:07.519626 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 937/1805] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:07 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:07.524396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:07.525433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:07.532349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.533170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.534102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.534677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.536637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.537457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.561123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:07.561123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:07.984158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:08.014989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-452261c0-cbfe-4d14-b10b-5fb201b1a2a2 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1287 microversion: 2.1 time: 0.549311 Jul 25 16:12:08.016836 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 869/1806] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:07 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1287 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:08.031820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c263da3-d14c-431b-a589-6769ce571304 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:08.034652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c263da3-d14c-431b-a589-6769ce571304 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 3e3b5b68-02b9-4784-ae83-24c9b40f655b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:08.045242 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-8c263da3-d14c-431b-a589-6769ce571304 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c263da3-d14c-431b-a589-6769ce571304 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b HTTP/1.1 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '3e3b5b68-02b9-4784-ae83-24c9b40f655b'} Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:08.047181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c263da3-d14c-431b-a589-6769ce571304 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 3e3b5b68-02b9-4784-ae83-24c9b40f655b could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c263da3-d14c-431b-a589-6769ce571304 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b" status: 404 len: 111 microversion: 2.1 time: 0.031826 Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 870/1807] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:08 2022] GET /compute/v2.1/servers/3e3b5b68-02b9-4784-ae83-24c9b40f655b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:08.061822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-65830439", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ac4d8f52-90dc-4983-890c-821ba313bf21"}], "block_device_mapping_v2": [{"uuid": "644356eb-4415-47fd-8bb1-0989f812f05d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:08.161492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] validate_networks() for [('ac4d8f52-90dc-4983-890c-821ba313bf21', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:12:08.252385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:08.281145 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0f4562af-c325-40d1-9b3e-edd62f42e038 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.759868 Jul 25 16:12:08.282281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 938/1808] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:07 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:08.298407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4332332c-db20-4caf-8816-474dededcd8e req-a764a4b4-8815-4cb8-a472-755d1e440ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "name": "network-vif-plugged", "status": "completed", "tag": "11bfa616-1150-4fc3-86b9-ea5d448d4114"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:08.320499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4332332c-db20-4caf-8816-474dededcd8e req-a764a4b4-8815-4cb8-a472-755d1e440ed4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:08.337420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4332332c-db20-4caf-8816-474dededcd8e req-a764a4b4-8815-4cb8-a472-755d1e440ed4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:08.394293 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4332332c-db20-4caf-8816-474dededcd8e req-a764a4b4-8815-4cb8-a472-755d1e440ed4 service nova] Creating event network-vif-plugged:11bfa616-1150-4fc3-86b9-ea5d448d4114 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:12:08.425747 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4332332c-db20-4caf-8816-474dededcd8e req-a764a4b4-8815-4cb8-a472-755d1e440ed4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136213 Jul 25 16:12:08.430209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 939/1809] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:08.465054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:08.474450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:08.499470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:08.500619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:08.513997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:08.515472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.168777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:09.199641 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc7a9df2-8b47-4a7f-9b32-b29ff847484c tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.764691 Jul 25 16:12:09.201138 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 940/1810] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:08 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:09.220911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:09.234974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:09.264631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.265455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.266885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.267634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.328539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:09.331040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252/action HTTP/1.1 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 65 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b7615cee-3cb3-4712-b6c0-2b4d54eba252', 'body': {'rebuild': {'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8'}}} Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 16:12:09.334718 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:09.343965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:09.349565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ab6e309-9a6e-4f7d-b32a-b70948cfa4cb tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252/action" status: 404 len: 111 microversion: 2.1 time: 0.136953 Jul 25 16:12:09.359044 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 941/1811] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:09 2022] POST /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252/action => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:09.382096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:09.383679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:09.416587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.417427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.419187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.419988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.598101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:12:09.599799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:12:09.602308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:12:09.603390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:12:09.604111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:12:09.632963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.634037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.635307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.636980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.691926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:12:09.718434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Getting quotas for user f3a2bf8f94f44b78a80c37bc8b370726 and project c2d3ce22679e4ac284a29ee1c6302ab8. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:12:09.861627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:09.882725 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fb4dddd5-4a41-4f28-a0a5-6f59cfbd9356 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.521793 Jul 25 16:12:09.886761 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 942/1812] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:09 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:09.911745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:09.914314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:09.943519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.960835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:12:09.961207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:09.963486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='644356eb-4415-47fd-8bb1-0989f812f05d',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:12:09.964587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:09.971608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:10.298490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:10.340855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:10.347161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:10.361917 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9d6e3009-c540-4991-81a9-48f8aee3eea5 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.469291 Jul 25 16:12:10.363157 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 943/1813] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:09 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:10.383584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:10.387271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:10.400240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:10.401253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:10.403219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:10.404367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:10.447470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e46c903e-dc98-4f73-bcf9-da99a6916bdf tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 2.395251 Jul 25 16:12:10.454655 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 871/1814] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:12:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:12:10.469759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:10.477849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:10.506729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:10.507402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:10.509089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:10.509465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:10.674288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:10.694874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cbe21982-cdeb-4264-ad64-9a3f6d3ab2c1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1293 microversion: 2.1 time: 0.328785 Jul 25 16:12:10.695893 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 944/1815] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:10 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1293 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:10.701215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:10.714098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:10.721472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:10.733370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:10.736345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:10.736909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:11.157455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:11.174895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48a32fbf-d6ba-4e16-be25-1a178acc35e8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.716464 Jul 25 16:12:11.176277 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 872/1816] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:10 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:11.195367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f6cb0a1-2f95-4118-8541-621c84ea7de0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:11.199911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0f6cb0a1-2f95-4118-8541-621c84ea7de0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:11.258331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:11.270625 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f9a9c90b-abef-47db-80a6-0e1064b9abd8 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1337 microversion: 2.1 time: 0.573239 Jul 25 16:12:11.279932 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 945/1817] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:10 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1337 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:11.286365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9d28d300-ea16-4f33-8b96-344f9b4989a3 req-ae003291-45b2-405e-88d8-cfb0ec1a49cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "name": "network-vif-plugged", "status": "completed", "tag": "9c1532f8-84c0-425c-9ef1-fafa75c95e89"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:11.301244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9d28d300-ea16-4f33-8b96-344f9b4989a3 req-ae003291-45b2-405e-88d8-cfb0ec1a49cb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:11.303126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9d28d300-ea16-4f33-8b96-344f9b4989a3 req-ae003291-45b2-405e-88d8-cfb0ec1a49cb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:11.320532 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9d28d300-ea16-4f33-8b96-344f9b4989a3 req-ae003291-45b2-405e-88d8-cfb0ec1a49cb service nova] Creating event network-vif-plugged:9c1532f8-84c0-425c-9ef1-fafa75c95e89 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:12:11.327645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9d28d300-ea16-4f33-8b96-344f9b4989a3 req-ae003291-45b2-405e-88d8-cfb0ec1a49cb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045514 Jul 25 16:12:11.329185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 946/1818] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:11.352808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:11.360120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f6cb0a1-2f95-4118-8541-621c84ea7de0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:11.372195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:11.384142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f6cb0a1-2f95-4118-8541-621c84ea7de0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:11.396519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f6cb0a1-2f95-4118-8541-621c84ea7de0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:11.400028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:11.401297 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f6cb0a1-2f95-4118-8541-621c84ea7de0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1105 microversion: 2.25 time: 0.220493 Jul 25 16:12:11.429706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:11.430659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:11.432936 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 873/1819] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:11 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1105 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:11.440703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:11.454523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:11.461994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:11.488230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:11.491115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:11.492900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:11.496598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:12.122585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:12.138799 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a15cefa5-c821-452f-8b4d-85beaef05d1d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.703967 Jul 25 16:12:12.144333 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 874/1820] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:11 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:12.163679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:12.166750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:12.186638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:12.187447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:12.188817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:12.190292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:12.985078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:13.012077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:13.016180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:13.060393 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-66ea11fd-0dd5-41c4-8697-7e9b83e1e64d tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.914235 Jul 25 16:12:13.079007 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 875/1821] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:12 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:13.097835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:13.098460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:13.117053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:13.117549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:13.125480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:13.130038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:13.143978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:13.168663 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-01fabf0e-c9ac-4106-ad30-567f19e6f73b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 1.831373 Jul 25 16:12:13.174341 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 947/1822] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:11 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:13.194995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-780825ff-1e42-4de9-9930-5be7ed254f21 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:13.213380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-780825ff-1e42-4de9-9930-5be7ed254f21 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 27488588-77c5-4ba9-8dcb-d7b2cba32e81] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:13.237834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-780825ff-1e42-4de9-9930-5be7ed254f21 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 27488588-77c5-4ba9-8dcb-d7b2cba32e81 could not be found. Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-780825ff-1e42-4de9-9930-5be7ed254f21 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/27488588-77c5-4ba9-8dcb-d7b2cba32e81/action HTTP/1.1 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 65 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 27488588-77c5-4ba9-8dcb-d7b2cba32e81 could not be found. Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '27488588-77c5-4ba9-8dcb-d7b2cba32e81', 'body': {'rebuild': {'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8'}}} Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27488588-77c5-4ba9-8dcb-d7b2cba32e81 could not be found. Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:12:13.239656 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27488588-77c5-4ba9-8dcb-d7b2cba32e81 could not be found. Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27488588-77c5-4ba9-8dcb-d7b2cba32e81 could not be found. Jul 25 16:12:13.249034 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:13.254356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-780825ff-1e42-4de9-9930-5be7ed254f21 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 27488588-77c5-4ba9-8dcb-d7b2cba32e81 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:13.255363 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-780825ff-1e42-4de9-9930-5be7ed254f21 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/27488588-77c5-4ba9-8dcb-d7b2cba32e81/action" status: 404 len: 111 microversion: 2.1 time: 0.078162 Jul 25 16:12:13.255982 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 948/1823] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:13 2022] POST /compute/v2.1/servers/27488588-77c5-4ba9-8dcb-d7b2cba32e81/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:13.282769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:13.287278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:13.300049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:13.300496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:13.317582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:13.318545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.467367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:14.486522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2456ce4-5931-4213-bede-934cd08eb3c5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 1.400590 Jul 25 16:12:14.487737 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 876/1824] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:13 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:14.500041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:14.519379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:14.523744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:14.545086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.545815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.549024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.549507 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-60862f7b-e3c3-42a0-b2ed-6fe7a21d6437 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1673 microversion: 2.1 time: 1.280450 Jul 25 16:12:14.551781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.553593 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 949/1825] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:13 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1673 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:14.564928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:14.584815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:14.609080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.615558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.622344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.623634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.803069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:14.831922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:14.833952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:14.835347 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-76495411-75e3-4901-9b6c-fd77df6567e4 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1252 microversion: 2.25 time: 0.346053 Jul 25 16:12:14.843067 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 877/1826] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:14 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1252 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:14.848342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-45d7924a-5447-4c8a-b75e-d020a17a41ed req-de36dc4b-1621-4a17-a194-b8a9aa54e47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d67bbb-da10-4f92-b74d-b4fedc9620c8", "name": "network-vif-plugged", "status": "completed", "tag": "395c36bb-f161-42c2-a622-8d78cf8abfaa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:14.880019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-45d7924a-5447-4c8a-b75e-d020a17a41ed req-de36dc4b-1621-4a17-a194-b8a9aa54e47c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.880778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-45d7924a-5447-4c8a-b75e-d020a17a41ed req-de36dc4b-1621-4a17-a194-b8a9aa54e47c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.905792 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-45d7924a-5447-4c8a-b75e-d020a17a41ed req-de36dc4b-1621-4a17-a194-b8a9aa54e47c service nova] Creating event network-vif-plugged:395c36bb-f161-42c2-a622-8d78cf8abfaa for instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 on n-h1-846219-13 Jul 25 16:12:14.924020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-45d7924a-5447-4c8a-b75e-d020a17a41ed req-de36dc4b-1621-4a17-a194-b8a9aa54e47c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079164 Jul 25 16:12:14.929353 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 878/1827] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:14.948706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:14.963595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:14.980206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.984904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:14.986858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:14.989356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:15.323041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:15.345873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:15.352920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:15.377668 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce77ce65-ca5d-4101-afd7-0aee995a007e tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1449 microversion: 2.75 time: 0.446019 Jul 25 16:12:15.396440 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 879/1828] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:14 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1449 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:15.435363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:15.437542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:15.464504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:15.465303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:15.466296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:15.466918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:15.751600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:15.788406 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f765313-16c6-4fc8-a76b-6c8a47b49be5 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.231443 Jul 25 16:12:15.805161 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 950/1829] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:14 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:15.842489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:15.852893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:15.890960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:15.899146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:15.904145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:15.904897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.020306 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7927baa2-795a-46c7-abe1-dd9022390adb tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711/ips" status: 200 len: 180 microversion: 2.1 time: 0.201331 Jul 25 16:12:16.030939 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 951/1830] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:12:15 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711/ips => generated 180 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:16.070462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:16.075965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:16.088940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:16.089424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.100732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:16.101950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.146827 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 HTTP/1.1 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fcc20a92-2837-413c-934b-50d10d25c7c8'} Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:16.148542 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:16.154495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-70470a61-f115-4cd6-b014-5bca3eddf8ad tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 404 len: 111 microversion: 2.1 time: 0.101435 Jul 25 16:12:16.160794 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 952/1831] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:16 2022] DELETE /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:16.180778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:16.181474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:16.205531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:16.255271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.255271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:16.255271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.561693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:16.582619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a610dc8b-0955-45f3-a3f8-5344f227a917 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 1.178044 Jul 25 16:12:16.583660 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 880/1832] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:15 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:16.597046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:16.598916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:16.619495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:16.620364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.621849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:16.629966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:16.926440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:16.932090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:16.963637 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9396ddc9-7638-4bf3-b8b9-4b1a7190cdc4 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.378322 Jul 25 16:12:16.964781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 881/1833] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:16 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:16.970720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:16.971447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:17.000092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.000892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.002168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.002801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.355760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:17.374720 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-164d0b5f-565f-44a5-891a-ce2f298215c4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 1.200643 Jul 25 16:12:17.375370 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 953/1834] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:16 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:17.390242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:17.390242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:17.407415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.407962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.409004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.409622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.516694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:12:17.726903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:17.774070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:17.784085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:17.794311 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24e1a587-54e6-416c-a9e8-7090b5e98911 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1294 microversion: 2.25 time: 0.819508 Jul 25 16:12:17.797896 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 882/1835] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:16 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1294 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:17.814483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:17.816890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: fcc20a92-2837-413c-934b-50d10d25c7c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:17.843111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.844987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34775e28-9a71-4f9f-949d-84f4e1601d17 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 204 len: 0 microversion: 2.1 time: 0.467849 Jul 25 16:12:17.846563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 954/1836] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:17 2022] DELETE /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:12:17.846808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.847942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.851362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.857078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:17.859410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:17.876418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.877708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.879040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:17.879698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:17.916917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 HTTP/1.1 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fcc20a92-2837-413c-934b-50d10d25c7c8'} Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:17.923616 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. Jul 25 16:12:17.928830 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.938338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance fcc20a92-2837-413c-934b-50d10d25c7c8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:17.941446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08a34964-9140-4916-8d8d-20c57121902a tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8" status: 404 len: 111 microversion: 2.1 time: 0.140540 Jul 25 16:12:17.948074 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 883/1837] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:17 2022] GET /compute/v2.1/servers/fcc20a92-2837-413c-934b-50d10d25c7c8 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:17.956514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c824ee4-d3fc-43da-8517-ca826f748074 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:17.964641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c824ee4-d3fc-43da-8517-ca826f748074 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:17.981617 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3c824ee4-d3fc-43da-8517-ca826f748074 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3 could not be found. Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c824ee4-d3fc-43da-8517-ca826f748074 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3/action HTTP/1.1 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 15 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: {"restore": {}} Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3 could not be found. Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3', 'body': {'restore': {}}} Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3 could not be found. Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3 could not be found. Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:17.986799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:17.991767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:17.991767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:17.991767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3 could not be found. Jul 25 16:12:17.991767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:17.994908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c824ee4-d3fc-43da-8517-ca826f748074 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:17.994908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c824ee4-d3fc-43da-8517-ca826f748074 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3/action" status: 404 len: 111 microversion: 2.1 time: 0.045442 Jul 25 16:12:18.004040 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 884/1838] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:17 2022] POST /compute/v2.1/servers/6aa18c75-b7f3-4b16-9b5f-114fd5f2c7d3/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:18.014082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:18.014716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:18.043627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.044893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.051038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.052158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.169293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:18.189873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:18.194894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:18.214199 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c3ab4d6-84b4-4381-bac7-ef6531a2a113 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1455 microversion: 2.75 time: 0.361721 Jul 25 16:12:18.233868 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 955/1839] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:17 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1455 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:18.249761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:18.250942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:18.273227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.275275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.276479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.277205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.510895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:18.523106 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77656096-cfe3-4da8-9219-19038ac1a2c4 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1202 microversion: 2.1 time: 0.517670 Jul 25 16:12:18.537623 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 885/1840] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:18 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1202 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:18.544941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:18.545705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:18.556884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:18.570367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.573284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.576816 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8c26c00a-fb7c-47e9-87eb-0a174523ae4b tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1679 microversion: 2.1 time: 0.341250 Jul 25 16:12:18.578655 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 956/1841] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:18 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:18.595180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.598041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.603113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3dfccc02-9965-428d-83d4-4fce518e542d req-2c5ffa87-309e-45e1-9942-9a54b328f4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9036b3fc-6e37-45ea-a17f-38fd52ae16e1", "tag": "e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:18.623372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3dfccc02-9965-428d-83d4-4fce518e542d req-2c5ffa87-309e-45e1-9942-9a54b328f4ce service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.624785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3dfccc02-9965-428d-83d4-4fce518e542d req-2c5ffa87-309e-45e1-9942-9a54b328f4ce service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.639425 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 HTTP/1.1 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '0b566cfc-f404-4acd-8584-14561ffcdea9'} Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:18.645644 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81b3fd12-cc20-420c-add1-3cb521ce97d9 tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "DELETE /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 404 len: 111 microversion: 2.1 time: 0.109659 Jul 25 16:12:18.660373 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 886/1842] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:18 2022] DELETE /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:18.666567 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3dfccc02-9965-428d-83d4-4fce518e542d req-2c5ffa87-309e-45e1-9942-9a54b328f4ce service nova] Creating event network-changed:e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b for instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 on n-h2-846219-13 Jul 25 16:12:18.669470 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3dfccc02-9965-428d-83d4-4fce518e542d req-2c5ffa87-309e-45e1-9942-9a54b328f4ce service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088756 Jul 25 16:12:18.670646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 957/1843] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:18.674581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:18.678145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:18.680113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6d3ffce2-d108-4c23-8db9-e90622198607 req-7efdf396-8ca1-4d73-b395-fd759d725587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8", "tag": "ce9efd40-53dc-426f-abd9-1caa1078a4b7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:18.692811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6d3ffce2-d108-4c23-8db9-e90622198607 req-7efdf396-8ca1-4d73-b395-fd759d725587 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.693476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6d3ffce2-d108-4c23-8db9-e90622198607 req-7efdf396-8ca1-4d73-b395-fd759d725587 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.695016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.696198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.698209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.700561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.709067 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6d3ffce2-d108-4c23-8db9-e90622198607 req-7efdf396-8ca1-4d73-b395-fd759d725587 service nova] Creating event network-changed:ce9efd40-53dc-426f-abd9-1caa1078a4b7 for instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 on n-h2-846219-13 Jul 25 16:12:18.716891 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6d3ffce2-d108-4c23-8db9-e90622198607 req-7efdf396-8ca1-4d73-b395-fd759d725587 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041416 Jul 25 16:12:18.718410 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 958/1844] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:18.726420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:18.728028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:18.737438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.738281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:18.739303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:18.740211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.040184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:19.046154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:19.065704 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-836e1e60-54ba-4ad9-994b-070f5fe0de8f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.408254 Jul 25 16:12:19.067215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 887/1845] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:18 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:19.069785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3013df82-f3d9-4d43-962f-301255d57487 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 0.345556 Jul 25 16:12:19.071575 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 959/1846] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:18 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:19.078416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:19.082616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:19.084072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] [instance: 0b566cfc-f404-4acd-8584-14561ffcdea9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:19.086549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:19.099075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.102914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.103426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.104341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.105436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.105695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.106122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.106993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.128515 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] HTTP exception thrown: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Request method failure captured: Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 HTTP/1.1 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9re1aMvsQPlK4HrkXvIX30PblEXrATpwFkyeMUqSZBjcflHaAcEZiFI0jp9wQ_VV7qDlFuD-_KY6KUOW39rZAlIZutpKHmLvZBYaXReU901NeOyFGjIHHpw2yVTHTYdO2jO5f6ABMCK2-8P2PrfuhHCqz2umo_lUGZMHMd-DBQd-4 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2a3fe79f1cbe41bab6260130a1ff89df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2a3fe79f1cbe41bab6260130a1ff89df"}]}] Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2a3fe79f1cbe41bab6260130a1ff89df Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1849665955 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 7b0b085c0e7c4bbfb89aaf2caf4d72d7 Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1849665955-project Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '0b566cfc-f404-4acd-8584-14561ffcdea9'} Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:19.131372 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. Jul 25 16:12:19.139399 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:19.141804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] Returning 404 to user: Instance 0b566cfc-f404-4acd-8584-14561ffcdea9 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:19.143293 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc85bc9c-8356-4a82-9c72-220782a9e40d tempest-DeleteServersTestJSON-1849665955 tempest-DeleteServersTestJSON-1849665955-project] 10.222.0.105 "GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9" status: 404 len: 111 microversion: 2.1 time: 0.074201 Jul 25 16:12:19.144736 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 888/1847] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:19 2022] GET /compute/v2.1/servers/0b566cfc-f404-4acd-8584-14561ffcdea9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:19.152736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:19.154130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:19.174369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.175227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.176073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.176512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.504685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:19.508400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:19.521544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:19.538979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:19.540515 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9572fae3-7cee-48f8-b2be-40dc933ab324 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1294 microversion: 2.25 time: 0.466622 Jul 25 16:12:19.541632 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 960/1848] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:19 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1294 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:19.546973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:19.547842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:19.570739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.571522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.576650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:19.598683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.599090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.608081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23ec4aff-c293-4aab-baae-51b9fc5b079f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.460309 Jul 25 16:12:19.608762 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 889/1849] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:19 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:19.628094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:19.628773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:19.662504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.662979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.663920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:19.664450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:19.689913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:20.036349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:20.095533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:20.099272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:20.118778 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-035ae07a-225d-448e-ae2c-648c6adde1bc tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1455 microversion: 2.75 time: 0.575802 Jul 25 16:12:20.119789 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 961/1850] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:19 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1455 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:20.143719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:20.144745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:20.172326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:20.173323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:20.174775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:20.177005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:20.496076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:20.509165 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5dc94334-f294-4c95-bca7-8f7eb3b88b2f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1385 microversion: 2.1 time: 0.897176 Jul 25 16:12:20.512073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 890/1851] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:19 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1385 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:20.520171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:20.520961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:20.530000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:20.531110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:20.532601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:20.533412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:20.597669 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'restore' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 15 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: {"restore": {}} Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'restore' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'restore': {}}} Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state active. Cannot restore while the instance is in this state. Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:20.603835 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:20.610208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:20.610208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:20.610208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:20.610208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:20.610208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:20.614976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'restore' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:20.616296 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d392df9-a36a-41d1-993b-1bbda2c0cbfe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 145 microversion: 2.1 time: 0.102961 Jul 25 16:12:20.617546 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 891/1852] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:20 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 145 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:12:20.624459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:20.625928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:20.633711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:20.634972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:20.636274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:20.636978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.074428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:21.094105 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5315393-01a8-4ae6-be15-42376b67e694 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1679 microversion: 2.1 time: 0.967325 Jul 25 16:12:21.094714 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 962/1853] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:20 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1679 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:21.120444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:21.121819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:21.138961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.145995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.147157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.147915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.290385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:21.307811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-125b7110-c10a-46ea-9173-09cc59092477 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 0.688365 Jul 25 16:12:21.320563 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 892/1854] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:20 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:21.333569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:21.334839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:21.345505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.346337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.348360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.349765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.377438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=16 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:21.828524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:21.841082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:21.842811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:21.844112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-46128205-f8f7-4f38-aaac-43988e1f6104 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1294 microversion: 2.25 time: 0.748128 Jul 25 16:12:21.844811 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 963/1855] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:21 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1294 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:21.874905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:21.875551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:21.896034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.896487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.898008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.898476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.931959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c43c20f7-6d09-4263-917a-463e31f33cbd tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1538 microversion: 2.1 time: 0.608529 Jul 25 16:12:21.946451 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 893/1856] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:21 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1538 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:21.977490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:21.978889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:21.993345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.994166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:21.995962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:21.996813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:22.205915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:22.226811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:22.232402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:22.254448 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37dc6249-8220-4bc2-8495-e86e9856ca97 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1455 microversion: 2.75 time: 0.306089 Jul 25 16:12:22.255328 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 894/1857] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:21 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1455 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:22.280798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:22.293802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:22.310472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:22.311272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:22.312022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:22.312605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:23.261383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:23.288102 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31f63272-b5af-400a-a1ef-1d4de3adc2bc tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.431857 Jul 25 16:12:23.299022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 964/1858] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:21 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:23.313490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:23.314539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:23.326332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:23.332769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:23.334091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:23.334772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:23.813595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:23.844333 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e800ef16-24e7-4979-86f6-e17e8b757675 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1658 microversion: 2.1 time: 0.543231 Jul 25 16:12:23.854941 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 965/1859] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:23 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1658 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:23.865569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:23.866734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:23.884655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:23.885646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:23.886883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:23.891515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.038225 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fba7c2ae-934b-453f-b08b-6cf5afabc818 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1538 microversion: 2.1 time: 1.781522 Jul 25 16:12:24.042847 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 895/1860] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:22 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1538 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:24.066174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:24.068059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:24.087253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.089535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.090684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.091926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.453444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.488919 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15911559-ddb9-44bb-b980-ab9fa3a401a5 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 0.631850 Jul 25 16:12:24.490608 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 966/1861] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:23 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:24.500336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:24.501231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:24.509177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.509968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.510807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.511246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.601759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.619728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.624216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.630317 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-73447769-a81a-46e9-af69-2d6a4e080f6c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1294 microversion: 2.25 time: 0.583890 Jul 25 16:12:24.631993 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 896/1862] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:24 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1294 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:24.639778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:24.641262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:24.649634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.650858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.652605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.656483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.699833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.720805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.723093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1a62b173cb8413db1e5c914c46e66ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f292eb18b00648bebd64571e091222e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:24.730143 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a1d596b-097e-47a6-9c08-1d4fb1e47484 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1440 microversion: 2.75 time: 0.237237 Jul 25 16:12:24.730763 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 967/1863] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:24 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1440 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:24.737753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9914038-8f42-4665-b7e4-5237fbf9aa39 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:24.741674 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:12:24.741674 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:12:24.743648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9914038-8f42-4665-b7e4-5237fbf9aa39 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.744436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9914038-8f42-4665-b7e4-5237fbf9aa39 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.745855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9914038-8f42-4665-b7e4-5237fbf9aa39 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.746617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9914038-8f42-4665-b7e4-5237fbf9aa39 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.779426 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9914038-8f42-4665-b7e4-5237fbf9aa39 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.047122 Jul 25 16:12:24.780557 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 968/1864] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:12:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:24.785771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-aa9fe7de-eb83-473a-b97c-8cad04603109 req-be870a2e-1388-4180-b8a4-fd0388fa1598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "name": "network-vif-unplugged", "status": "completed", "tag": "9c1532f8-84c0-425c-9ef1-fafa75c95e89"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:24.799846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-aa9fe7de-eb83-473a-b97c-8cad04603109 req-be870a2e-1388-4180-b8a4-fd0388fa1598 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.800324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-aa9fe7de-eb83-473a-b97c-8cad04603109 req-be870a2e-1388-4180-b8a4-fd0388fa1598 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.815685 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-aa9fe7de-eb83-473a-b97c-8cad04603109 req-be870a2e-1388-4180-b8a4-fd0388fa1598 service nova] Creating event network-vif-unplugged:9c1532f8-84c0-425c-9ef1-fafa75c95e89 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:12:24.823163 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-aa9fe7de-eb83-473a-b97c-8cad04603109 req-be870a2e-1388-4180-b8a4-fd0388fa1598 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040662 Jul 25 16:12:24.824520 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 969/1865] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:24.832108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-20cf48bf-f82d-4386-ae0d-288ed24b127f req-685235f3-6ee1-478d-95a6-9e90b4f645e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "name": "network-vif-deleted", "tag": "11bfa616-1150-4fc3-86b9-ea5d448d4114"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:24.838594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:24.847075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-20cf48bf-f82d-4386-ae0d-288ed24b127f req-685235f3-6ee1-478d-95a6-9e90b4f645e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:24.847574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-20cf48bf-f82d-4386-ae0d-288ed24b127f req-685235f3-6ee1-478d-95a6-9e90b4f645e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:24.866907 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-20cf48bf-f82d-4386-ae0d-288ed24b127f req-685235f3-6ee1-478d-95a6-9e90b4f645e3 service nova] Creating event network-vif-deleted:11bfa616-1150-4fc3-86b9-ea5d448d4114 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:12:24.877185 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-20cf48bf-f82d-4386-ae0d-288ed24b127f req-685235f3-6ee1-478d-95a6-9e90b4f645e3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048559 Jul 25 16:12:24.877185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 970/1866] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:25.007904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:25.028149 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ceeabf0-b410-4b8e-92a7-a735c0809959 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.394052 Jul 25 16:12:25.030804 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 897/1867] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:24 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:25.049072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-13", "block_migration": false, "disk_over_commit": false}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:25.076117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:25.104856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:25.105936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:25.107035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:25.110251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:25.152265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:25.163420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:25.188906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lazy-loading 'flavor' on Instance uuid 41d67bbb-da10-4f92-b74d-b4fedc9620c8 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:25.197051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:25.198263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:25.203243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:25.204197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:25.216539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Going to try to live migrate instance to n-h2-846219-13 {{(pid=119598) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:12:25.423116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:12:25.432526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:12:25.433296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:12:25.433787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:12:25.435093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:12:25.618518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:25.633803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:25.634280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:25.638191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:25.638191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:26.139421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:26.181286 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cbc00791-9b41-4144-95b8-ab0b35626bc8 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5/action" status: 202 len: 1945 microversion: 2.75 time: 1.302389 Jul 25 16:12:26.182886 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 971/1868] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:12:24 2022] POST /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5/action => generated 1945 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Jul 25 16:12:26.192999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:26.194663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:26.204148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:26.205072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:26.206398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:26.207162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:26.730012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c424061ccba84b9fb38ec72e5d5f4213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789a10dc64a7414b992e80d535bd72d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:26.741011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d1d30bc1-d50c-40dd-b818-7a58e23e290d tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 200 len: 1500 microversion: 2.1 time: 0.555910 Jul 25 16:12:26.755885 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 972/1869] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:26 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 1500 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:26.762113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eede93f-7d94-4c99-9047-f1d19d9af509 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:26.763023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7eede93f-7d94-4c99-9047-f1d19d9af509 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:26.781463 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7eede93f-7d94-4c99-9047-f1d19d9af509 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73 could not be found. Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eede93f-7d94-4c99-9047-f1d19d9af509 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73/action HTTP/1.1 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 14 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: {"resume": {}} Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73 could not be found. Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73', 'body': {'resume': {}}} Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73 could not be found. Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73 could not be found. Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:26.796028 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73 could not be found. Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eede93f-7d94-4c99-9047-f1d19d9af509 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7eede93f-7d94-4c99-9047-f1d19d9af509 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73/action" status: 404 len: 111 microversion: 2.1 time: 0.044555 Jul 25 16:12:26.809906 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 973/1870] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:26 2022] POST /compute/v2.1/servers/c79bcd9c-6e9a-46ea-b0c2-0dfa2ff33b73/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:26.816129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:26.817429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:26.832985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:26.834103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:26.835594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:26.836581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:27.476606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:27.498091 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-deaf01eb-b593-414e-a923-65b1ab0823b1 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 0.686567 Jul 25 16:12:27.507356 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 974/1871] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:26 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:27.519427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:27.522365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:27.547039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:27.547668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:27.550173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:27.550809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:28.406405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:28.433403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:28.438968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:28.440162 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd4a5da8-4120-4ae2-9942-1717397990f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1282 microversion: 2.25 time: 0.926088 Jul 25 16:12:28.445994 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 975/1872] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:27 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1282 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:28.450904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:28.451519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:28.476596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:28.477043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:28.490575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:28.490916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:29.195702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:29.232572 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07610a01-61e5-4ba3-99f7-f748715f7fe9 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.785234 Jul 25 16:12:29.242427 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 976/1873] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:28 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:29.254049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:29.255567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:29.268344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:29.269589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:29.272010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:29.273240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:29.298780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:29.801550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:29.815319 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-43613eca-2b53-43a9-9537-759f9c5e1e36 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.570013 Jul 25 16:12:29.816421 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 977/1874] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:29 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:29.823651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:29.824744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:29.849787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:29.851624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:29.853134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:29.853753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:29.883572 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] HTTP exception thrown: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Request method failure captured: Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 HTTP/1.1 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBsGqm-qS1DgPreVnxkXIJTPJ8w_wOvk57T2KcGpVNLrToTEZp7BcxWDVcLVFvwv4feC0kmZYEgE0eX-0bvUoLLjogow5-F2wqI2Li2JiIELxqAf8TwjtvWjwYIdFg7LewHVWCQa1871rVZ41eM4DGPFCJ4QavIt7K81LbcQ5_tVzM Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_789a10dc64a7414b992e80d535bd72d1"}]}] Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c424061ccba84b9fb38ec72e5d5f4213 Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711'} Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:29.886463 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Returning 404 to user: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:29.892839 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0cbc51c-22e4-4ef6-ae36-b5a8252a9d83 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 404 len: 111 microversion: 2.1 time: 0.073443 Jul 25 16:12:29.898232 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 978/1875] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:29 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:29.904729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2a98b361-dee3-49cb-9b4f-f0a58f7790ac req-0ba5d38f-0500-43c6-9d88-729e20c390fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711", "name": "network-vif-deleted", "tag": "9c1532f8-84c0-425c-9ef1-fafa75c95e89"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:29.919161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2a98b361-dee3-49cb-9b4f-f0a58f7790ac req-0ba5d38f-0500-43c6-9d88-729e20c390fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:29.919870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2a98b361-dee3-49cb-9b4f-f0a58f7790ac req-0ba5d38f-0500-43c6-9d88-729e20c390fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:29.950243 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2a98b361-dee3-49cb-9b4f-f0a58f7790ac req-0ba5d38f-0500-43c6-9d88-729e20c390fd service nova] Creating event network-vif-deleted:9c1532f8-84c0-425c-9ef1-fafa75c95e89 for instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 on n-h2-846219-13 Jul 25 16:12:29.964771 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2a98b361-dee3-49cb-9b4f-f0a58f7790ac req-0ba5d38f-0500-43c6-9d88-729e20c390fd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066589 Jul 25 16:12:29.967081 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 979/1876] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:29.986499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:29.988103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:30.000666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.001548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.003060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.004508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.213036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d5d2b847-97e4-4a6b-b8d3-f4ca92c0bfd5 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8/action" status: 202 len: 0 microversion: 2.1 time: 5.179185 Jul 25 16:12:30.214307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 898/1877] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:25 2022] POST /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8/action => generated 0 bytes in 5182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:12:30.223746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:30.226810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:30.244370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.247760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.251847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.263432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.783568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:30.805420 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad030d14-e973-48f3-8e73-274c1a23ccf7 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 0.830449 Jul 25 16:12:30.816744 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 980/1878] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:29 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:30.835220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c42b1ad5-1063-442e-afc6-ae6cb5160e3d req-980c988c-cbf1-4a7e-bc28-150ec4e23cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8", "name": "network-vif-plugged", "status": "completed", "tag": "ce9efd40-53dc-426f-abd9-1caa1078a4b7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:30.858277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c42b1ad5-1063-442e-afc6-ae6cb5160e3d req-980c988c-cbf1-4a7e-bc28-150ec4e23cc6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.859851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c42b1ad5-1063-442e-afc6-ae6cb5160e3d req-980c988c-cbf1-4a7e-bc28-150ec4e23cc6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.860453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:30.863597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:30.885049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:30.893627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c42b1ad5-1063-442e-afc6-ae6cb5160e3d req-980c988c-cbf1-4a7e-bc28-150ec4e23cc6 service nova] Creating event network-vif-plugged:ce9efd40-53dc-426f-abd9-1caa1078a4b7 for instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 on n-h2-846219-13 Jul 25 16:12:30.896541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:30.902187 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-267bd5d8-80a5-44df-93ba-06c2decd3fda tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1282 microversion: 2.25 time: 0.683572 Jul 25 16:12:30.903302 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 899/1879] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:30 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1282 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:30.916210 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c42b1ad5-1063-442e-afc6-ae6cb5160e3d req-980c988c-cbf1-4a7e-bc28-150ec4e23cc6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093799 Jul 25 16:12:30.917741 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 981/1880] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:30.927335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:30.928628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:30.930329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:30.934680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:30.943161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.944981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.946880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.947931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.957315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.960160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:30.961472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:30.962192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.729483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:31.747964 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b21240e3-ecc9-4113-a0d2-12b81d7f2e7f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.827729 Jul 25 16:12:31.751441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 982/1881] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:30 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:31.762186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:31.763892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:31.775145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:31.776049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.777635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:31.778504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.784805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:31.801245 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34cd115b-a8af-4de3-82c1-1f3cb5022b8c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.881867 Jul 25 16:12:31.822408 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 900/1882] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:30 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:31.836827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:31.838898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:31.853909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:31.856524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.858435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:31.860173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.892266 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'resume' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 14 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: {"resume": {}} Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'resume' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'resume': {}}} Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state active. Cannot resume while the instance is in this state. Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:31.894077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'resume' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bae81c34-be4d-4d22-918d-1a71e0f30b07 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 144 microversion: 2.1 time: 0.068685 Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 901/1883] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:31 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 144 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:31.904127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:31.908646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:31.909087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.909915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:31.910353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:31.964542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:31.988821 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7724de56-61ab-4e07-8270-8dc752e3a342 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.235071 Jul 25 16:12:32.001268 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 983/1884] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:31 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:32.001268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:32.001268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:32.005262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:32.005922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:32.007046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:32.007909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:32.757963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:32.771697 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a88f4acc-17f4-4a3b-9363-5d15d92ebe30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.778938 Jul 25 16:12:32.772888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 984/1885] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:31 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:32.798104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:32.811827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:32.814995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-210ca9a6-a7d0-408f-ab0d-886c92d1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1335 microversion: 2.1 time: 0.917360 Jul 25 16:12:32.816414 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 902/1886] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:31 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1335 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:32.819162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:32.826146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:32.831829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:32.834338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:32.837846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:32.839152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:32.841452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:32.851064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:32.852151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:32.853707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:32.854874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:33.419859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:33.440551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:33.452592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6125d4e2-fb20-47c2-9880-d0bbe192edbc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.634275 Jul 25 16:12:33.453547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:33.473154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 903/1887] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:32 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:33.473154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:33.473154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:33.484041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:33.484783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:33.486006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:33.486629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:33.494626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:33.496891 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e630e565-422f-47f3-844b-a1d689174440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1282 microversion: 2.25 time: 0.692357 Jul 25 16:12:33.513236 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 985/1888] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:32 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1282 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:33.522571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:33.523602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:33.536897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:33.537621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:33.539622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:33.540268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:33.807131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:33.880086 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7563fe24-e091-42ec-bb0f-296603631cad tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.376732 Jul 25 16:12:33.905499 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 986/1889] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:33 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:33.934766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:33.940755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:33.968721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:33.969672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:33.970701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:33.974978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:34.611967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:34.631208 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71936780-5f11-4f4d-ad9b-75854910c01f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.170614 Jul 25 16:12:34.632136 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 904/1890] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:33 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:34.639571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:34.640569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:34.649721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:34.650603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:34.651647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:34.652325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:34.755762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:34.905185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:34.915938 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-461c3972-cf83-4331-8080-3f04ea46494d tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1538 microversion: 2.1 time: 1.007186 Jul 25 16:12:34.922132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 987/1891] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:33 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1538 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:34.931374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:34.933533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:34.946406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:34.948609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:34.950459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:34.951325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:35.523002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:35.548702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4467625b-b78c-4021-9b69-bf95935e67ee tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.915133 Jul 25 16:12:35.549351 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 905/1892] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:34 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:35.600862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14818e60-8f82-48e0-b5d0-5df338443dea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:35.605554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:35.623105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:35.624465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14818e60-8f82-48e0-b5d0-5df338443dea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 160 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "772d42f0-328d-4c98-8730-4f6263eb1e55"}]}} Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': '', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'networks': [{'uuid': '772d42f0-328d-4c98-8730-4f6263eb1e55'}]}}} Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi '' Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:12:35.624632 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:12:35.630980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:35.631904 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad326f5d-9e0b-4cc1-8b7c-3178c8903385 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1282 microversion: 2.25 time: 0.702426 Jul 25 16:12:35.632000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14818e60-8f82-48e0-b5d0-5df338443dea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:35.632000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14818e60-8f82-48e0-b5d0-5df338443dea tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.051860 Jul 25 16:12:35.632000 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 906/1893] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:12:35 2022] POST /compute/v2.1/servers => generated 108 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:12:35.637758 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 988/1894] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:34 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1282 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:35.652498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:35.653326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:35.660436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11eef105-0161-4f20-8fa9-416d67c57416 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'create', calling method: .version_select at 0x7f9d92f0af70>, body: {"pool": "e0cd9471-7058-498f-87a9-12c5f12ddc15"} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:35.694571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:35.712332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:35.722565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:35.723752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:35.729906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:36.061514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:36.159065 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cb7bb464-ee94-4455-94d4-654634f04130 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.512521 Jul 25 16:12:36.163258 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 907/1895] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:35 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:36.189365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:36.218372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:36.260312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:36.260757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:36.262010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:36.265365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:36.982926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:36.995105 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-803bb756-f46b-47b2-9866-198e32bbfb24 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.829431 Jul 25 16:12:36.996023 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 908/1896] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:36 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:37.007766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:37.008896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:37.028134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:37.028834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:37.030927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:37.032876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:37.552717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:37.565010 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2388b6ab-5855-4d43-b91e-fcfeb1a05030 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.567656 Jul 25 16:12:37.566224 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 909/1897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:36 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:37.572613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:37.573472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:37.587870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:37.591020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:37.592223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:37.595865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:38.805296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:38.827642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:38.830237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:38.831582 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-807e4ccc-4396-45ca-8021-d642b71c307c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1282 microversion: 2.25 time: 1.263818 Jul 25 16:12:38.832689 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 910/1898] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:37 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1282 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:38.838867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:38.839711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:38.853395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:38.854370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:38.855632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:38.856386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:38.879230 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] HTTP exception thrown: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Request method failure captured: Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 HTTP/1.1 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBsGqm-qS1DgPreVnxkXIJTPJ8w_wOvk57T2KcGpVNLrToTEZp7BcxWDVcLVFvwv4feC0kmZYEgE0eX-0bvUoLLjogow5-F2wqI2Li2JiIELxqAf8TwjtvWjwYIdFg7LewHVWCQa1871rVZ41eM4DGPFCJ4QavIt7K81LbcQ5_tVzM Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_789a10dc64a7414b992e80d535bd72d1"}]}] Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c424061ccba84b9fb38ec72e5d5f4213 Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711'} Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:38.882584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:38.891876 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:38.904128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Returning 404 to user: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:38.904128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-58106f2a-c7f6-47a2-9f10-cdd087113b0a tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 404 len: 111 microversion: 2.1 time: 0.068817 Jul 25 16:12:38.908088 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 911/1899] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:38 2022] DELETE /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:38.915666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:38.916753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:38.931196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:38.931707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:38.932844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:38.933382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:39.422110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:39.439188 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b1e1466-85c0-40c8-ab45-4ab235f75094 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.529632 Jul 25 16:12:39.439816 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 912/1900] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:38 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:39.461270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:39.462352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:39.479040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:39.484644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:39.485732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:39.486395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:39.862251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:39.949897 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33c3b4bc-2a57-423c-9140-c1f4555d1d6f tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.505561 Jul 25 16:12:39.951102 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 913/1901] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:39 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:39.994904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ed68900f-60f1-4ff5-a774-e73f66248299 req-46220a92-7546-468c-97ee-e3507ad9342b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9036b3fc-6e37-45ea-a17f-38fd52ae16e1", "name": "network-vif-plugged", "status": "completed", "tag": "e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:40.026958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ed68900f-60f1-4ff5-a774-e73f66248299 req-46220a92-7546-468c-97ee-e3507ad9342b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:40.027840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ed68900f-60f1-4ff5-a774-e73f66248299 req-46220a92-7546-468c-97ee-e3507ad9342b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:40.074895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ed68900f-60f1-4ff5-a774-e73f66248299 req-46220a92-7546-468c-97ee-e3507ad9342b service nova] Creating event network-vif-plugged:e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b for instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 on n-h2-846219-13 Jul 25 16:12:40.095560 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ed68900f-60f1-4ff5-a774-e73f66248299 req-46220a92-7546-468c-97ee-e3507ad9342b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120742 Jul 25 16:12:40.097665 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 914/1902] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:40.104873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:40.110360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:40.135816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:40.137949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:40.139725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:40.148367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:40.880901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:40.936200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16bfb688-67b2-4ab2-9022-c48029ade16d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.832697 Jul 25 16:12:40.937582 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 915/1903] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:40 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:40.949924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:40.951116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:40.966629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:40.967835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:40.969570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:40.970528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:40.997034 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] HTTP exception thrown: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Request method failure captured: Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 HTTP/1.1 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBsGqm-qS1DgPreVnxkXIJTPJ8w_wOvk57T2KcGpVNLrToTEZp7BcxWDVcLVFvwv4feC0kmZYEgE0eX-0bvUoLLjogow5-F2wqI2Li2JiIELxqAf8TwjtvWjwYIdFg7LewHVWCQa1871rVZ41eM4DGPFCJ4QavIt7K81LbcQ5_tVzM Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_789a10dc64a7414b992e80d535bd72d1"}]}] Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c424061ccba84b9fb38ec72e5d5f4213 Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711'} Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:41.001605 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. Jul 25 16:12:41.013727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.016955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Returning 404 to user: Instance 6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:41.018924 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b41fcd4-30ba-4f7a-ac29-c39955c54068 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711" status: 404 len: 111 microversion: 2.1 time: 0.074816 Jul 25 16:12:41.027056 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 916/1904] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:40 2022] GET /compute/v2.1/servers/6b39c38c-d688-4c9f-8d9b-2d1cf7fc5711 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:41.039886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62f41995-e53b-48a1-8ba8-83faa7e69c22 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:41.041059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-62f41995-e53b-48a1-8ba8-83faa7e69c22 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 613bb767-997a-4114-8c5a-1348dd3b4f76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:41.052003 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-62f41995-e53b-48a1-8ba8-83faa7e69c22 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 613bb767-997a-4114-8c5a-1348dd3b4f76 could not be found. Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62f41995-e53b-48a1-8ba8-83faa7e69c22 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/613bb767-997a-4114-8c5a-1348dd3b4f76/action HTTP/1.1 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 14 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: {"shelve": {}} Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 613bb767-997a-4114-8c5a-1348dd3b4f76 could not be found. Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '613bb767-997a-4114-8c5a-1348dd3b4f76', 'body': {'shelve': {}}} Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613bb767-997a-4114-8c5a-1348dd3b4f76 could not be found. Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613bb767-997a-4114-8c5a-1348dd3b4f76 could not be found. Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:41.058558 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:41.065850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:41.065850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:41.065850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613bb767-997a-4114-8c5a-1348dd3b4f76 could not be found. Jul 25 16:12:41.065850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.068998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62f41995-e53b-48a1-8ba8-83faa7e69c22 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 613bb767-997a-4114-8c5a-1348dd3b4f76 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:41.070191 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-62f41995-e53b-48a1-8ba8-83faa7e69c22 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/613bb767-997a-4114-8c5a-1348dd3b4f76/action" status: 404 len: 111 microversion: 2.1 time: 0.041605 Jul 25 16:12:41.071331 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 917/1905] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:41 2022] POST /compute/v2.1/servers/613bb767-997a-4114-8c5a-1348dd3b4f76/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:41.079178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:41.081012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:41.119427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.122932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.127231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.132590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.491264 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11eef105-0161-4f20-8fa9-416d67c57416 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.852169 Jul 25 16:12:41.492728 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 989/1906] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:12:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:41.498846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:41.500339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:41.519706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.520721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.522388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.523180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.692236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:41.722812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:41.727880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:41.740356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:41.756501 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e63f22f1-5786-48ba-b70c-2747dfb490f2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1282 microversion: 2.25 time: 0.683621 Jul 25 16:12:41.758743 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 918/1907] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:41 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1282 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:41.768486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:41.768996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:41.783767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.787320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.792513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.793330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.801945 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9883d450-a601-4aaf-bb77-61063b619126 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.306543 Jul 25 16:12:41.805259 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 990/1908] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:41 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:41.811830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:41.812924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:41.827553 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] HTTP exception thrown: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Request method failure captured: Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 HTTP/1.1 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBsGqm-qS1DgPreVnxkXIJTPJ8w_wOvk57T2KcGpVNLrToTEZp7BcxWDVcLVFvwv4feC0kmZYEgE0eX-0bvUoLLjogow5-F2wqI2Li2JiIELxqAf8TwjtvWjwYIdFg7LewHVWCQa1871rVZ41eM4DGPFCJ4QavIt7K81LbcQ5_tVzM Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_789a10dc64a7414b992e80d535bd72d1"}]}] Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c424061ccba84b9fb38ec72e5d5f4213 Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '51d019ec-819c-46bc-af42-857b8c12c462'} Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:41.833758 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Returning 404 to user: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c7f83564-fb33-4ef2-bf3a-c11587920dd9 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "DELETE /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 404 len: 111 microversion: 2.1 time: 0.075709 Jul 25 16:12:41.842107 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 919/1909] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:12:41 2022] DELETE /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:41.848330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.850345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.852876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.853793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.114"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:41.854466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.857061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:41.878641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.881479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.883656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:41.884584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:41.928553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Acquired lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:12:42.397656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:42.411046 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d916587-0acc-4dae-a744-36719bded160 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.602439 Jul 25 16:12:42.415414 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 991/1910] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:41 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:42.429407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:42.431161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] [instance: 51d019ec-819c-46bc-af42-857b8c12c462] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:42.450344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:42.452480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:42.453821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:42.455891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:42.476564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] HTTP exception thrown: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Request method failure captured: Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 HTTP/1.1 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBsGqm-qS1DgPreVnxkXIJTPJ8w_wOvk57T2KcGpVNLrToTEZp7BcxWDVcLVFvwv4feC0kmZYEgE0eX-0bvUoLLjogow5-F2wqI2Li2JiIELxqAf8TwjtvWjwYIdFg7LewHVWCQa1871rVZ41eM4DGPFCJ4QavIt7K81LbcQ5_tVzM Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/789a10dc64a7414b992e80d535bd72d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_789a10dc64a7414b992e80d535bd72d1"}]}] Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 789a10dc64a7414b992e80d535bd72d1 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestMultiNic-442899734 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c424061ccba84b9fb38ec72e5d5f4213 Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestMultiNic-442899734-project Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '51d019ec-819c-46bc-af42-857b8c12c462'} Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:42.479530 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. Jul 25 16:12:42.488389 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:12:42.490944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] Returning 404 to user: Instance 51d019ec-819c-46bc-af42-857b8c12c462 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:42.492187 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-56270601-aca1-4609-8f64-510284e5a000 tempest-ServersTestMultiNic-442899734 tempest-ServersTestMultiNic-442899734-project] 10.222.0.105 "GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462" status: 404 len: 111 microversion: 2.1 time: 0.075359 Jul 25 16:12:42.494154 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 992/1911] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:42 2022] GET /compute/v2.1/servers/51d019ec-819c-46bc-af42-857b8c12c462 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:12:42.500394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:42.501686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:42.508521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:42.509464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:42.511400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:42.512109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:42.966661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:42.978272 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ff02624-a3b5-4e67-a7c7-98391cb557bd tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.481229 Jul 25 16:12:42.987471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 993/1912] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:42 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:42.997821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:42.998304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:43.011670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:43.012719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:43.014169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:43.014797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:43.854267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:43.866464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31fbd54c-a1a8-4e7b-b104-55dcf1991c29 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.877079 Jul 25 16:12:43.884235 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 994/1913] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:42 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:43.895226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:43.896736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:43.905741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:43.906569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:43.907731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:43.908340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:44.479211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:44.490099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:44.492806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:44.494285 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ad92161-ce3c-4726-9885-514721aadff7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1478 microversion: 2.25 time: 0.609016 Jul 25 16:12:44.505901 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 995/1914] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:43 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1478 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:44.505901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:44.505901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:44.516492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:44.518353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:44.519862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:44.521355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:44.678313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:44.697408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:44.743521 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-587295d2-023a-4758-9323-7b72e76dc21d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.244301 Jul 25 16:12:44.744865 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 996/1915] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:44 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:44.754070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:44.754858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:44.764954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:44.765666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:44.770511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:44.771316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:44.824979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lazy-loading 'flavor' on Instance uuid 014fd993-5b27-49d3-a044-1a252cc437a8 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:45.282369 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d66f9924-dd54-476e-8e1f-5c8ce45f73e2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 202 len: 0 microversion: 2.1 time: 0.535611 Jul 25 16:12:45.286281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 997/1916] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:44 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:12:45.301887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:45.308776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:45.324608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:45.325960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:45.330989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:45.331904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:45.740846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Building network info cache for instance {{(pid=119598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:12:45.746839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:45.888118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:45.898089 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f16e7b39-0a6e-4634-9d02-632e5e99ad9e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.606825 Jul 25 16:12:45.904711 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 998/1917] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:45 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:46.175941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7a9e81d4-d21a-4094-b796-fceafbee85ec tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] Calling method '.version_select at 0x7f9d92ffe820>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:46.283957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7a9e81d4-d21a-4094-b796-fceafbee85ec tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.377534 Jul 25 16:12:46.297405 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 999/1918] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:12:45 2022] GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c/defaults => generated 371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:46.602595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:46.603295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:46.617835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:46.619898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:46.621020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:46.621708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:47.012227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:47.050361 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-27f7fcb3-4688-4b98-8912-e21774b2ef84 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1971 microversion: 2.25 time: 0.756149 Jul 25 16:12:47.050950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1000/1919] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:46 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1971 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:47.087401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:47.088593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:47.100503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:47.101255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:47.102376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:47.103009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:47.419422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:47.440373 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07dc3f65-fc7a-4889-8871-ed639ae48073 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1515 microversion: 2.1 time: 0.357606 Jul 25 16:12:47.442487 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1001/1920] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:47 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:47.448940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-32ad3e9c-b0ed-4c5d-9ce4-d3fb2ac90efa req-c6ed67a1-031e-40b4-bddf-0af24f3c40b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8", "tag": "ce9efd40-53dc-426f-abd9-1caa1078a4b7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:47.468557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-32ad3e9c-b0ed-4c5d-9ce4-d3fb2ac90efa req-c6ed67a1-031e-40b4-bddf-0af24f3c40b9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:47.469126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-32ad3e9c-b0ed-4c5d-9ce4-d3fb2ac90efa req-c6ed67a1-031e-40b4-bddf-0af24f3c40b9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:47.515561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-32ad3e9c-b0ed-4c5d-9ce4-d3fb2ac90efa req-c6ed67a1-031e-40b4-bddf-0af24f3c40b9 service nova] Creating event network-changed:ce9efd40-53dc-426f-abd9-1caa1078a4b7 for instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 on n-h2-846219-13 Jul 25 16:12:47.525804 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-32ad3e9c-b0ed-4c5d-9ce4-d3fb2ac90efa req-c6ed67a1-031e-40b4-bddf-0af24f3c40b9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081645 Jul 25 16:12:47.526445 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1002/1921] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:47.532317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:47.533616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:47.541239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:47.541826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:47.542764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:47.543625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:47.731026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Updating instance_info_cache with network_info: [{"id": "ce9efd40-53dc-426f-abd9-1caa1078a4b7", "address": "fa:16:3e:eb:cc:c2", "network": {"id": "d124b9b5-749a-4e38-a154-d92ec9769aab", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-99368756-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c5ec8469484346eea5bf6667fd6a05af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce9efd40-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:12:47.752082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Releasing lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:12:47.754772 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b17a5f2-38ba-408f-9f8a-269de1145906 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action" status: 202 len: 0 microversion: 2.1 time: 5.904382 Jul 25 16:12:47.755568 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 920/1922] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:41 2022] POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action => generated 0 bytes in 5914 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:12:47.771065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49a8ea1b-6e47-4dc2-8d1b-6fc57ed4afb6 tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] Calling method '.version_select at 0x7f9d93aa8b80>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:48.012527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49a8ea1b-6e47-4dc2-8d1b-6fc57ed4afb6 tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c" status: 200 len: 371 microversion: 2.1 time: 0.254905 Jul 25 16:12:48.013220 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 921/1923] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:12:47 2022] GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c => generated 371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:48.020267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:48.020977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:48.045766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:48.046219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:48.054334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:48.054799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:48.692648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:48.747839 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71595b5d-5d0b-4c17-9784-13c34b2b5160 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 1.219990 Jul 25 16:12:48.748488 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1003/1924] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:47 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:48.767061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:48.767856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:48.788813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:48.789702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:48.790807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:48.791519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:48.995664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:49.011751 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40bfd61b-1e33-485e-a1f8-92bc8ac38557 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.997074 Jul 25 16:12:49.013307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 922/1925] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:48 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:49.022304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07668cfe-706e-4e8f-a25c-c611a2ee8000 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'create', calling method: .version_select at 0x7f9da00329d0>, body: {"pool": "e0cd9471-7058-498f-87a9-12c5f12ddc15"} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:49.358431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:49.395117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93e40513-06ae-4af6-b170-67305f900daa tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1971 microversion: 2.25 time: 0.644143 Jul 25 16:12:49.396324 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1004/1926] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:48 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1971 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:49.426144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dd35bc8c-8c64-4413-9673-bb1b5be3318f tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] Calling method '.version_select at 0x7f9d92eca940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:50.109620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dd35bc8c-8c64-4413-9673-bb1b5be3318f tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.710244 Jul 25 16:12:50.121873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1005/1927] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:12:49 2022] GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c/defaults => generated 371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:50.698271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-472759236", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "5158bc42-bdb3-4b68-8404-8ff835ac0788"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:50.806996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] validate_networks() for [('5158bc42-bdb3-4b68-8404-8ff835ac0788', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:12:52.213377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:12:52.216535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:12:52.220510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:12:52.222577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:12:52.223570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:12:52.252437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:52.254514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:52.256086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:52.257816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:52.325784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Getting quotas for project 39dd18d28d79468a8ebb393017af7979. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:12:52.347204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Getting quotas for user a4a4683dfce541c8acff65c7c09e5372 and project 39dd18d28d79468a8ebb393017af7979. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:12:52.452530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:12:52.463678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:12:52.530917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:52.572686 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18cdc85a-559a-4607-95f5-aeedd894e57a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.448314 Jul 25 16:12:52.580320 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1006/1928] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:12:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:12:52.586507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:52.587526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:52.595391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:52.596085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:52.597065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:52.597925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:52.946559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:52.978189 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f62f71b1-edc4-4f22-8231-d8e8441444c6 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1515 microversion: 2.1 time: 0.395803 Jul 25 16:12:52.978990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1007/1929] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:52 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:52.997946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6bd22c11-c722-4428-b234-be4067569722 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:53.000994 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:12:53.000994 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:12:53.010561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bd22c11-c722-4428-b234-be4067569722 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.011026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bd22c11-c722-4428-b234-be4067569722 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.011847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bd22c11-c722-4428-b234-be4067569722 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.012323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bd22c11-c722-4428-b234-be4067569722 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.021617 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07668cfe-706e-4e8f-a25c-c611a2ee8000 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.006391 Jul 25 16:12:53.023940 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 923/1930] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:12:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:53.034321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:53.036187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:53.052834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6bd22c11-c722-4428-b234-be4067569722 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.072860 Jul 25 16:12:53.067874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.067874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.068616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.069051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.072612 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1008/1931] 10.222.0.105 () {60 vars in 1222 bytes} [Mon Jul 25 16:12:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:12:53.078131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:53.078767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:53.097800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.098129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.099050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.099682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.244919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:53.277282 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c936675c-2010-4de8-b72c-6f972c179a9e tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.250040 Jul 25 16:12:53.278633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 924/1932] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:53 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:53.285135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6a6e9f7-ad7d-4c19-a7e3-c1f7351f7313 tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] Calling method '.version_select at 0x7f9d93e4c700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:53.435730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:53.446891 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-382b60da-e754-4808-a81e-6e8dc2aec908 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.372988 Jul 25 16:12:53.448415 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1009/1933] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:53 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:53.475098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-624cb044-b7d4-4523-903d-c5bd20dff393 req-4122ac18-233d-441e-b51a-825f2463aece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d67bbb-da10-4f92-b74d-b4fedc9620c8", "name": "network-vif-unplugged", "status": "completed", "tag": "395c36bb-f161-42c2-a622-8d78cf8abfaa"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:53.515522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-624cb044-b7d4-4523-903d-c5bd20dff393 req-4122ac18-233d-441e-b51a-825f2463aece service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.515974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-624cb044-b7d4-4523-903d-c5bd20dff393 req-4122ac18-233d-441e-b51a-825f2463aece service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.538650 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-624cb044-b7d4-4523-903d-c5bd20dff393 req-4122ac18-233d-441e-b51a-825f2463aece service nova] Creating event network-vif-unplugged:395c36bb-f161-42c2-a622-8d78cf8abfaa for instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 on n-h1-846219-13 Jul 25 16:12:53.548821 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-624cb044-b7d4-4523-903d-c5bd20dff393 req-4122ac18-233d-441e-b51a-825f2463aece service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098063 Jul 25 16:12:53.550344 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1010/1934] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:53.562188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:53.563897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:53.578390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.579743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.581793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.582553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.722288 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6a6e9f7-ad7d-4c19-a7e3-c1f7351f7313 tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c" status: 200 len: 371 microversion: 2.1 time: 0.441684 Jul 25 16:12:53.723745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:53.730529 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 925/1935] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:12:53 2022] GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c => generated 371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:53.736183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.189"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:53.739869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:53.748606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.749046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.750068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.751023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.760059 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34372ee5-3b89-435e-8573-2f3a91cb1dac tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1225 microversion: 2.1 time: 0.207173 Jul 25 16:12:53.773624 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1011/1936] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:53 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1225 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:53.799669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-13", "block_migration": "auto"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:53.805281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:53.807754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Acquired lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:12:53.818069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.819351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.821168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:53.822363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:53.873171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'flavor' on Instance uuid 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:53.891825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Going to try to live migrate instance to n-h1-846219-13 {{(pid=119599) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:12:54.001233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:54.425506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15.", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:12:54.426099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Releasing lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:12:54.426658 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.426658 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Request method failure captured: Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action HTTP/1.1 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 46 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sDTOBAR7Fg_3C-5J1euiToEXZmULnLrmKg50aIS-gZMgJQfnxH1JBrRUwcZUtQmTAGE9ESQFisUTaauB9z-eyeZBhjB_yb6kQSKP4dZydT2RtFH8G0nW4tzbyvZdoaJjzKmZ2MhrQ0i-iQZXxw2xPDA-wqwU4yvVzOiDlmmlOOx0dw Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c5ec8469484346eea5bf6667fd6a05af"}]}] Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b3ad9e29364a42e3a6c2ce3bc38edb5f Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: {"addFloatingIp": {"address": "172.25.4.189"}} Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8', 'body': {'addFloatingIp': {'address': '172.25.4.189'}}} Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:12:54.433511 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] Jul 25 16:12:54.437181 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:12:54.441163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Returning 400 to user: Cannot associate floating IP 172.25.4.189 (f30e9285-bf79-4683-af87-0765d1e1ae2a) with port ce9efd40-53dc-426f-abd9-1caa1078a4b7 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network e0cd9471-7058-498f-87a9-12c5f12ddc15. Jul 25 16:12:54.441163 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-5f11e324-247a-4ece-9d76-b5e36a635858'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:12:54.441163 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86f67403-2aa9-41da-8bdd-f306f42ae4de tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action" status: 400 len: 382 microversion: 2.1 time: 0.704254 Jul 25 16:12:54.441163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 926/1937] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:53 2022] POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action => generated 382 bytes in 707 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:12:54.455232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d58de464-8784-4410-8c5d-130ec7b29fcb tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] Calling method '.version_select at 0x7f9da01b0670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:54.643759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d58de464-8784-4410-8c5d-130ec7b29fcb tempest-QuotasTestJSON-1368064323 tempest-QuotasTestJSON-1368064323-project] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c?user_id=a6ba9f4a2d974e3aadb01eecf47c0127" status: 200 len: 371 microversion: 2.1 time: 0.200636 Jul 25 16:12:54.657568 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 927/1938] 10.222.0.105 () {58 vars in 1328 bytes} [Mon Jul 25 16:12:54 2022] GET /compute/v2.1/os-quota-sets/a7163d0c7c9941a3b234c8d4d446874c?user_id=a6ba9f4a2d974e3aadb01eecf47c0127 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:54.670710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:54.671966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:54.687864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:54.688468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:54.689689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:54.690703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:55.179087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:55.205382 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-be4453b2-c235-47ea-916c-db6d5ff1d059 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1515 microversion: 2.1 time: 0.546362 Jul 25 16:12:55.213165 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 928/1939] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:54 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1515 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:55.221535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:55.222799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:55.237341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:55.238009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:55.239120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:55.239692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:55.372771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:55.414172 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dee10dc0-a6d7-4a8d-ba75-51c0db38b312 tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1932 microversion: 2.75 time: 0.199487 Jul 25 16:12:55.418966 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 929/1940] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:55 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1932 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:55.424535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41bc8eba-1c94-440f-9852-f4e2f9f06fa4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '.version_select at 0x7f9d93c220d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:57.307218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53e5e57f-4156-436a-b1dc-9ae6f233fe65 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1/action" status: 202 len: 0 microversion: 2.25 time: 3.530355 Jul 25 16:12:57.313761 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1012/1941] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:12:53 2022] POST /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1/action => generated 0 bytes in 3539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:12:57.332437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:57.335317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:57.359528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:57.361471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:57.363918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:57.367803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:57.718267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:57.729644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1533089d-278a-48ef-b0b5-dc3595876315 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.412410 Jul 25 16:12:57.731607 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1013/1942] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:57 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:57.758661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:57.759538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:57.767714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:57.768546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:57.769581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:57.770221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:58.535950 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41bc8eba-1c94-440f-9852-f4e2f9f06fa4 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/f30e9285-bf79-4683-af87-0765d1e1ae2a" status: 202 len: 0 microversion: 2.1 time: 3.115153 Jul 25 16:12:58.538537 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 930/1943] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:12:55 2022] DELETE /compute/v2.1/os-floating-ips/f30e9285-bf79-4683-af87-0765d1e1ae2a => generated 0 bytes in 3119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:12:58.554261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:58.567727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-53561962-b567-436d-a215-fa5bb3a6d002 req-26fc12fb-144b-4fb5-8830-804771d92801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d67bbb-da10-4f92-b74d-b4fedc9620c8", "tag": "395c36bb-f161-42c2-a622-8d78cf8abfaa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:58.584378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-09790919-745f-4787-b516-fd679251538e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1321 microversion: 2.1 time: 0.835217 Jul 25 16:12:58.586287 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1014/1944] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:57 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:58.618036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:58.621135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-53561962-b567-436d-a215-fa5bb3a6d002 req-26fc12fb-144b-4fb5-8830-804771d92801 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:58.621821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-53561962-b567-436d-a215-fa5bb3a6d002 req-26fc12fb-144b-4fb5-8830-804771d92801 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:58.624126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:58.638047 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-53561962-b567-436d-a215-fa5bb3a6d002 req-26fc12fb-144b-4fb5-8830-804771d92801 service nova] Creating event network-changed:395c36bb-f161-42c2-a622-8d78cf8abfaa for instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 on n-h1-846219-13 Jul 25 16:12:58.644986 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-53561962-b567-436d-a215-fa5bb3a6d002 req-26fc12fb-144b-4fb5-8830-804771d92801 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103772 Jul 25 16:12:58.646489 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 931/1945] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:12:58.654697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:58.655640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:58.663006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:58.663933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:58.664600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:58.665330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:58.666329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:58.667023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:58.668038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:58.669081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:58.994024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:12:59.074584 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35cdb2c4-5676-4634-b2df-eca558edcb0d tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1938 microversion: 2.75 time: 0.425563 Jul 25 16:12:59.077659 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 932/1946] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:58 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1938 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:59.084025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:59.085110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:59.093485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:59.094552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:59.095730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:59.097455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:59.284858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:59.297564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c7fe10a-5c1b-497c-a1bd-94981db2571b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1515 microversion: 2.1 time: 0.707140 Jul 25 16:12:59.312402 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1015/1947] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:58 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1515 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:12:59.316875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.114"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:12:59.491012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:59.499119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:59.499688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:59.500756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:59.502820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:59.847059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:59.858277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:59.866047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:12:59.867279 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6489768-138a-43f9-8c0f-ee989a217d61 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.787842 Jul 25 16:12:59.868012 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 933/1948] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:12:59 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:12:59.902685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:12:59.903871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:12:59.918722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:59.922668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:12:59.924396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:12:59.925791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:00.486265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Acquired lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:13:00.583906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:00.598450 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1749dab8-2e0c-49ff-b988-0bc73d7976f1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1395 microversion: 2.1 time: 0.709019 Jul 25 16:13:00.599465 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 934/1949] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:12:59 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1395 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:00.606638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:00.607518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:00.625594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:00.628282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:00.630373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:00.631291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:01.198476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:01.211342 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eadfcd9c-dea8-48fe-83d7-7c05ee9df9e9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1321 microversion: 2.1 time: 0.610048 Jul 25 16:13:01.216359 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 935/1950] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:00 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:01.224212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2656cfe2-d672-498a-8958-e77afa35acd9 req-072e26a1-fded-4fca-9f5f-60fe1cdd2e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d67bbb-da10-4f92-b74d-b4fedc9620c8", "name": "network-vif-unplugged", "status": "completed", "tag": "395c36bb-f161-42c2-a622-8d78cf8abfaa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:01.263506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2656cfe2-d672-498a-8958-e77afa35acd9 req-072e26a1-fded-4fca-9f5f-60fe1cdd2e41 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:01.265179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2656cfe2-d672-498a-8958-e77afa35acd9 req-072e26a1-fded-4fca-9f5f-60fe1cdd2e41 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:01.320359 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2656cfe2-d672-498a-8958-e77afa35acd9 req-072e26a1-fded-4fca-9f5f-60fe1cdd2e41 service nova] Creating event network-vif-unplugged:395c36bb-f161-42c2-a622-8d78cf8abfaa for instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 on n-h1-846219-13 Jul 25 16:13:01.362885 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2656cfe2-d672-498a-8958-e77afa35acd9 req-072e26a1-fded-4fca-9f5f-60fe1cdd2e41 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144720 Jul 25 16:13:01.374514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 936/1951] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:01.380308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:01.381414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:01.388524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:01.388970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:01.389798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:01.390403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:02.027927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:13:02.081805 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6056ca66-67c5-4f7c-8cc2-a8fbc2527fde tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1938 microversion: 2.75 time: 0.705326 Jul 25 16:13:02.090781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 937/1952] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:01 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1938 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:02.119911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:02.121408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:02.135705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:02.136137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:02.137040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:02.137499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:02.390632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:02.697042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:02.725372 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe061746-160f-40b0-99a2-e23539a2b644 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1536 microversion: 2.1 time: 0.638630 Jul 25 16:13:02.740129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 938/1953] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:02 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1536 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:03.017772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:03.299358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-442249551", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "3fd3141a-99ac-41fd-a7b9-455858663b07"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:03.463508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] validate_networks() for [('3fd3141a-99ac-41fd-a7b9-455858663b07', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:13:03.753877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Building network info cache for instance {{(pid=119599) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:13:04.614076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:05.997934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:13:05.998823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:13:05.999123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:13:05.999649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:13:06.000228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:13:06.007403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=82 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:06.028584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:06.031225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:06.035786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:06.037338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:06.111978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Getting quotas for project 2cb54814c2994b2e81967b9e4bb66a98. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:06.129207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Getting quotas for user 44147d512d8948dbb8a7f47aec511b16 and project 2cb54814c2994b2e81967b9e4bb66a98. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:06.167749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:13:06.175318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:13:06.345056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-902b2e1c-0a73-40b5-9b73-662c48178071 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.613937 Jul 25 16:13:06.353526 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 939/1954] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:13:02 2022] POST /compute/v2.1/servers => generated 382 bytes in 3625 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:13:06.385979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:06.387710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:06.413008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:06.415506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:06.417561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:06.419545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:07.647618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Updating instance_info_cache with network_info: [{"id": "ce9efd40-53dc-426f-abd9-1caa1078a4b7", "address": "fa:16:3e:eb:cc:c2", "network": {"id": "d124b9b5-749a-4e38-a154-d92ec9769aab", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-99368756-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c5ec8469484346eea5bf6667fd6a05af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce9efd40-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119599) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:13:07.662255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:07.695744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Releasing lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:13:07.697742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:07.704156 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a5a2bdb-b548-4e75-a00b-314ac28e0d01 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action" status: 202 len: 0 microversion: 2.1 time: 8.404268 Jul 25 16:13:07.713429 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1016/1955] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:12:59 2022] POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action => generated 0 bytes in 8414 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:13:07.714525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:07.725352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d12d6b0f-4e26-4445-8d01-b8ea44d5cb89 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 1.361583 Jul 25 16:13:07.731819 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 940/1956] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:06 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:07.771526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:07.774726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:07.792658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:07.794718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:07.798292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:07.799781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.262098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:08.272544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9165a5da-7be5-49b7-9e41-32a366fea7e2 req-1a2589f7-4566-4d82-8560-e94dc94829b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ebf36-2002-442e-9d5c-dcd8aa5e2c8b", "tag": "9b72738c-d065-4ab6-af98-e844f9ab5ace"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:08.277966 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ad55846-9676-4d25-92d1-438b843822ce tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1385 microversion: 2.1 time: 0.540614 Jul 25 16:13:08.280445 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 941/1957] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:07 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1385 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:08.319622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9165a5da-7be5-49b7-9e41-32a366fea7e2 req-1a2589f7-4566-4d82-8560-e94dc94829b0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.320166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9165a5da-7be5-49b7-9e41-32a366fea7e2 req-1a2589f7-4566-4d82-8560-e94dc94829b0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.321272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:08.322916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:08.340724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.341147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9165a5da-7be5-49b7-9e41-32a366fea7e2 req-1a2589f7-4566-4d82-8560-e94dc94829b0 service nova] Creating event network-changed:9b72738c-d065-4ab6-af98-e844f9ab5ace for instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b on n-h1-846219-13 Jul 25 16:13:08.341957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.345033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.346908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.352929 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9165a5da-7be5-49b7-9e41-32a366fea7e2 req-1a2589f7-4566-4d82-8560-e94dc94829b0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625555 Jul 25 16:13:08.353842 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1017/1958] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:08.365942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:08.368959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:08.381073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.381904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.382729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.383170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.396901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:08.601210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] Lazy-loading 'services' on Instance uuid c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:13:08.730908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6db67437-b0f5-4479-ac62-92df0ab7c47a tempest-ServersAdmin275Test-310133348 tempest-ServersAdmin275Test-310133348-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 200 len: 1923 microversion: 2.75 time: 0.373353 Jul 25 16:13:08.755408 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1018/1959] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:08 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 1923 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:08.797224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:08.798390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:08.825743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.829311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:08.836645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:08.839535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:09.355495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:09.365921 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97c7419d-cad1-421c-a111-6b2514ee80a9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1321 microversion: 2.1 time: 1.083586 Jul 25 16:13:09.377908 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 942/1960] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:08 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1321 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:09.394932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:09.397952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:09.433393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:09.434422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:09.436813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:09.440083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:09.848882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:09.896728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8fc1a2ba-4192-4d83-94d4-d080ca48ab51 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1280 microversion: 2.1 time: 0.513504 Jul 25 16:13:09.897967 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 943/1961] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:09 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:09.971861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-659ea852-5537-4335-89ce-205b6b3e036a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '.version_select at 0x7f9da013bee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:11.593729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:11.626109 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e05d5337-6e4e-4d8e-8d1f-61adb4c0cfab tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 2.852574 Jul 25 16:13:11.627333 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1019/1962] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:08 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 2871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:11.661764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17cbed1d-e0c5-4e42-aaea-bb280c23f369 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '.version_select at 0x7f9d92f36a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:11.666593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17cbed1d-e0c5-4e42-aaea-bb280c23f369 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:11.667225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17cbed1d-e0c5-4e42-aaea-bb280c23f369 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:11.695539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17cbed1d-e0c5-4e42-aaea-bb280c23f369 tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 3123 microversion: 2.1 time: 0.066416 Jul 25 16:13:11.696694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1020/1963] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:13:11 2022] GET /compute/v2.1/os-migrations => generated 3123 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:11.714082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:11.715122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:11.726127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:11.738140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:11.739516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:11.740238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:12.669987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:12.703153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:12.712122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:12.720920 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e691935-7c36-468b-9946-05639390ff35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 1.021952 Jul 25 16:13:12.739309 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1021/1964] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:11 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:12.787312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:12.790129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:12.818099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:12.822744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:12.824747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:12.829260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:12.916584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:13.307405 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea033b89-4c3e-44ff-a256-f0e2e2516c75 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 204 len: 0 microversion: 2.75 time: 0.565739 Jul 25 16:13:13.308397 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1022/1965] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:13:12 2022] DELETE /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:13:13.321586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-43d91bd0-39a3-4898-a5b2-b0fe97c6066b req-2e07b9e7-773e-42c2-8da3-f08b93d6843d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "name": "network-vif-plugged", "status": "completed", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:13.360180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-43d91bd0-39a3-4898-a5b2-b0fe97c6066b req-2e07b9e7-773e-42c2-8da3-f08b93d6843d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:13.361206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-43d91bd0-39a3-4898-a5b2-b0fe97c6066b req-2e07b9e7-773e-42c2-8da3-f08b93d6843d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:13.405321 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-43d91bd0-39a3-4898-a5b2-b0fe97c6066b req-2e07b9e7-773e-42c2-8da3-f08b93d6843d service nova] Creating event network-vif-plugged:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:13:13.470791 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-43d91bd0-39a3-4898-a5b2-b0fe97c6066b req-2e07b9e7-773e-42c2-8da3-f08b93d6843d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160107 Jul 25 16:13:13.471646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1023/1966] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:13.478985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:13.479930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:13.537823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:13.541082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:13.542471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:13.543964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:15.363556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:15.405642 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-96742d70-d160-4518-a63f-ab89ebe79ca5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1321 microversion: 2.1 time: 1.930965 Jul 25 16:13:15.406832 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1024/1967] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:13 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1321 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:15.418443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a10094e0-9b3b-4777-8e61-3f69a7942483 req-57f8b427-74dc-4981-b956-1c90cdcb861f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8", "tag": "ce9efd40-53dc-426f-abd9-1caa1078a4b7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:15.456813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a10094e0-9b3b-4777-8e61-3f69a7942483 req-57f8b427-74dc-4981-b956-1c90cdcb861f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:15.459694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a10094e0-9b3b-4777-8e61-3f69a7942483 req-57f8b427-74dc-4981-b956-1c90cdcb861f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:15.536875 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a10094e0-9b3b-4777-8e61-3f69a7942483 req-57f8b427-74dc-4981-b956-1c90cdcb861f service nova] Creating event network-changed:ce9efd40-53dc-426f-abd9-1caa1078a4b7 for instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 on n-h2-846219-13 Jul 25 16:13:15.550176 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a10094e0-9b3b-4777-8e61-3f69a7942483 req-57f8b427-74dc-4981-b956-1c90cdcb861f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140665 Jul 25 16:13:15.551659 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1025/1968] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:15.598310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:15.603359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:15.628874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:15.645845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:15.646776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:15.647229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:16.063067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:16.150718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:16.798925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:16.816753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7d224a11-99f5-4dfb-94ee-1c9edc2534cf tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1328 microversion: 2.1 time: 1.256928 Jul 25 16:13:16.823854 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1026/1969] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:15 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1328 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:16.844839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:16.849964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:16.860631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:16.861482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:16.862699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:16.863366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:16.906547 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-659ea852-5537-4335-89ce-205b6b3e036a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/9b9da444-0e94-41ac-a536-bd7187411fc4" status: 202 len: 0 microversion: 2.1 time: 6.970520 Jul 25 16:13:16.908048 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 944/1970] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:13:09 2022] DELETE /compute/v2.1/os-floating-ips/9b9da444-0e94-41ac-a536-bd7187411fc4 => generated 0 bytes in 7010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:13:16.913883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:16.918837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:16.974788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:16.976342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:16.977951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:16.983439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:17.781946 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-56b5bf52-f6b3-4ebb-b23b-39ab009ff06d tempest-LiveMigrationTest-1976692370 tempest-LiveMigrationTest-1976692370-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1538 microversion: 2.1 time: 0.956570 Jul 25 16:13:17.782797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:17.788010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1027/1971] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:16 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1538 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:17.802721 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a69c389f-c98c-4cd4-a708-8734d7022e4d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.892981 Jul 25 16:13:17.804844 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 945/1972] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:16 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:17.813189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:17.815575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:17.824482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:17.825250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] [instance: c7a020ff-bfb4-4eec-b558-a2f488f0dfb5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:17.844323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:17.847037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:17.849267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:17.851014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:17.855502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:17.857636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:17.863805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:17.864261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:17.895467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] HTTP exception thrown: Instance c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 could not be found. Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Request method failure captured: Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 HTTP/1.1 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sC0IBTZ_Ew-3plax1Gcz0aYwlird33BDi2dmpby0NftLBbrFLNBnqeDsnZVtBtzfUaSty2N09ByZyRxl5xCyrTDho72e7zYjFnvHVUYbcgysu2crVLDARA1EFk83-nSYvb0zvP5NfkiCV5GZlMNwcBFGYvS01GXxpCs8LXaW6Mm-o0 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.75 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f292eb18b00648bebd64571e091222e4 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersAdmin275Test-1003939360 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f292eb18b00648bebd64571e091222e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f292eb18b00648bebd64571e091222e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f292eb18b00648bebd64571e091222e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f292eb18b00648bebd64571e091222e4"}]}] Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersAdmin275Test-1003939360 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f292eb18b00648bebd64571e091222e4 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersAdmin275Test-1003939360 Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersAdmin275Test-1003939360-project Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e1a62b173cb8413db1e5c914c46e66ef Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersAdmin275Test-1003939360-project Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 could not be found. Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'c7a020ff-bfb4-4eec-b558-a2f488f0dfb5'} Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 could not be found. Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 could not be found. Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:17.899930 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 could not be found. Jul 25 16:13:17.907835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:17.910813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] Returning 404 to user: Instance c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:17.912726 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b6fd2f4-798b-4355-afc7-e1f06a2b3ef9 tempest-ServersAdmin275Test-1003939360 tempest-ServersAdmin275Test-1003939360-project] 10.222.0.105 "GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5" status: 404 len: 111 microversion: 2.75 time: 0.121891 Jul 25 16:13:17.920186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1028/1973] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:17 2022] GET /compute/v2.1/servers/c7a020ff-bfb4-4eec-b558-a2f488f0dfb5 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:13:17.927729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:17.928800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:17.941123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:17.941984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:17.943049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:17.943807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.314572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:19.319414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:19.332565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-172dfaf0-f9a2-4f86-b586-dcd6cbd3514b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1321 microversion: 2.1 time: 1.410882 Jul 25 16:13:19.351206 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1029/1974] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:17 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1321 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:19.359740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24a3b9e6-6e00-47f5-a0ac-4551e5293343 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24a3b9e6-6e00-47f5-a0ac-4551e5293343 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Request method failure captured: Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action HTTP/1.1 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 34 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sDTOBAR7Fg_3C-5J1euiToEXZmULnLrmKg50aIS-gZMgJQfnxH1JBrRUwcZUtQmTAGE9ESQFisUTaauB9z-eyeZBhjB_yb6kQSKP4dZydT2RtFH8G0nW4tzbyvZdoaJjzKmZ2MhrQ0i-iQZXxw2xPDA-wqwU4yvVzOiDlmmlOOx0dw Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c5ec8469484346eea5bf6667fd6a05af"}]}] Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b3ad9e29364a42e3a6c2ce3bc38edb5f Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: {"addFloatingIp": {"address": ""}} Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8', 'body': {'addFloatingIp': {'address': ''}}} Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '' Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:13:19.365139 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 16:13:19.369201 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:19.371692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24a3b9e6-6e00-47f5-a0ac-4551e5293343 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:19.372809 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24a3b9e6-6e00-47f5-a0ac-4551e5293343 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action" status: 400 len: 142 microversion: 2.1 time: 0.020246 Jul 25 16:13:19.373918 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1030/1975] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:13:19 2022] POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:13:19.382055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-59571099-dc53-485e-a68c-b2ea94f83595 req-c714488e-ccfe-4498-873c-d04d5dd2bbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ebf36-2002-442e-9d5c-dcd8aa5e2c8b", "name": "network-vif-plugged", "status": "completed", "tag": "9b72738c-d065-4ab6-af98-e844f9ab5ace"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:19.406286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:19.406934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-59571099-dc53-485e-a68c-b2ea94f83595 req-c714488e-ccfe-4498-873c-d04d5dd2bbd6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.407629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-59571099-dc53-485e-a68c-b2ea94f83595 req-c714488e-ccfe-4498-873c-d04d5dd2bbd6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.437180 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-59571099-dc53-485e-a68c-b2ea94f83595 req-c714488e-ccfe-4498-873c-d04d5dd2bbd6 service nova] Creating event network-vif-plugged:9b72738c-d065-4ab6-af98-e844f9ab5ace for instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b on n-h1-846219-13 Jul 25 16:13:19.438623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:19.445777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:19.448859 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c857e6d8-0709-49d5-8adb-dbfc745201b5 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 1.642224 Jul 25 16:13:19.453675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-59571099-dc53-485e-a68c-b2ea94f83595 req-c714488e-ccfe-4498-873c-d04d5dd2bbd6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078234 Jul 25 16:13:19.454619 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 946/1976] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:17 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:19.457034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1031/1977] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:19.465078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:19.473781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:19.475389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:19.479582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:19.494862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.497231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.498082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.499197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.499814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.500587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.502024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.506053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.624758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:19.829692 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d103e52-e269-4b68-a2a9-a598c578146f tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "DELETE /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 204 len: 0 microversion: 2.1 time: 0.371878 Jul 25 16:13:19.838627 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 947/1978] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:13:19 2022] DELETE /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:13:19.853565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:19.863380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:19.878921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.882101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:19.883316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:19.887251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:20.759647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:20.768952 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1fb58ae-8803-4c83-b55b-bdebf003c092 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.928123 Jul 25 16:13:20.788802 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 948/1979] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:19 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:20.805136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:20.822213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:20.858486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:20.861885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:20.865893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:20.869682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:20.904078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:20.923240 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89c60f8d-5061-4ec8-905c-b7f80c46c670 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1328 microversion: 2.1 time: 1.464621 Jul 25 16:13:20.923879 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1032/1980] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:19 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1328 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:20.947037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:20.950297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:20.971128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:20.971848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:20.972902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:20.973832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:20.975131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Acquired lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:13:21.410525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Releasing lock "refresh_cache-5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:13:21.415400 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] HTTP exception thrown: floating IP not found Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Request method failure captured: Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action HTTP/1.1 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 41 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sDTOBAR7Fg_3C-5J1euiToEXZmULnLrmKg50aIS-gZMgJQfnxH1JBrRUwcZUtQmTAGE9ESQFisUTaauB9z-eyeZBhjB_yb6kQSKP4dZydT2RtFH8G0nW4tzbyvZdoaJjzKmZ2MhrQ0i-iQZXxw2xPDA-wqwU4yvVzOiDlmmlOOx0dw Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c5ec8469484346eea5bf6667fd6a05af"}]}] Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b3ad9e29364a42e3a6c2ce3bc38edb5f Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: exception: floating IP not found Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 25 16:13:21.417345 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Returning 404 to user: floating IP not found {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:21.421175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5c1d8192-ecc5-4318-81a5-47b9e8527c4a tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action" status: 404 len: 67 microversion: 2.1 time: 0.627775 Jul 25 16:13:21.434462 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 949/1981] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:13:20 2022] POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action => generated 67 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:13:21.441700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:21.442541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:21.450471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:21.451901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:21.453933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:21.454616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:21.847537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:21.858548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7be56a5d-b430-4b45-93f3-e3669658c07c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1391 microversion: 2.1 time: 0.933552 Jul 25 16:13:21.865023 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1033/1982] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:20 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1391 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:21.874465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:21.875353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:21.892757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:21.893977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:21.905539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:21.906781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:22.272128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:22.290733 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3331f65d-7ca3-48d8-9b25-fef51b5ddfb4 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1321 microversion: 2.1 time: 0.853058 Jul 25 16:13:22.295358 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 950/1983] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:21 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1321 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:22.310513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c22bd474-6fd7-44cc-a947-2c57635674df req-cb2ad530-d152-41b9-912f-25f12c8a5230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8892a659-82f6-46e2-82b1-8ddbb566b85e", "tag": "f19570d6-00a1-4206-a54d-1d8df2e6df96"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:22.344299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c22bd474-6fd7-44cc-a947-2c57635674df req-cb2ad530-d152-41b9-912f-25f12c8a5230 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:22.347519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c22bd474-6fd7-44cc-a947-2c57635674df req-cb2ad530-d152-41b9-912f-25f12c8a5230 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:22.384818 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c22bd474-6fd7-44cc-a947-2c57635674df req-cb2ad530-d152-41b9-912f-25f12c8a5230 service nova] Creating event network-changed:f19570d6-00a1-4206-a54d-1d8df2e6df96 for instance 8892a659-82f6-46e2-82b1-8ddbb566b85e on n-h2-846219-13 Jul 25 16:13:22.403322 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c22bd474-6fd7-44cc-a947-2c57635674df req-cb2ad530-d152-41b9-912f-25f12c8a5230 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104111 Jul 25 16:13:22.405973 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 951/1984] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:22.424423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6c41a67-1559-4bfc-a3e2-b49f2a4cce43 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:22.627383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:22.643808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:22.650325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:22.654052 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de59cc9e-e14b-4296-9f6a-2913ac69c5b2 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.787653 Jul 25 16:13:22.655357 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1034/1985] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:21 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:22.662663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:22.663814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:22.672029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:22.675267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:22.676143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:22.678651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:22.680067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:22.865941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f6c41a67-1559-4bfc-a3e2-b49f2a4cce43 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6c41a67-1559-4bfc-a3e2-b49f2a4cce43 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Request method failure captured: Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action HTTP/1.1 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 44 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sDTOBAR7Fg_3C-5J1euiToEXZmULnLrmKg50aIS-gZMgJQfnxH1JBrRUwcZUtQmTAGE9ESQFisUTaauB9z-eyeZBhjB_yb6kQSKP4dZydT2RtFH8G0nW4tzbyvZdoaJjzKmZ2MhrQ0i-iQZXxw2xPDA-wqwU4yvVzOiDlmmlOOx0dw Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c5ec8469484346eea5bf6667fd6a05af"}]}] Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b3ad9e29364a42e3a6c2ce3bc38edb5f Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: exception: Floating IP not found for address 0.0.0.0. Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 25 16:13:22.868398 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6c41a67-1559-4bfc-a3e2-b49f2a4cce43 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:22.873860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6c41a67-1559-4bfc-a3e2-b49f2a4cce43 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action" status: 404 len: 88 microversion: 2.1 time: 0.462109 Jul 25 16:13:22.877506 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 952/1986] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:13:22 2022] POST /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8/action => generated 88 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:13:22.886289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:22.889491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:22.907308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:22.910270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:22.912449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:22.913057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.202649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:23.223153 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4573e72e-a4d5-44c1-85bd-1637aac19392 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.566298 Jul 25 16:13:23.224501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1035/1987] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:22 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:23.234142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:23.236261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:23.250078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.250544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.261658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.263805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.341338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:23.412119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:23.422244 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6fcccfec-47ed-489b-a2ca-94a1ce23139e tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1328 microversion: 2.1 time: 0.542445 Jul 25 16:13:23.426594 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 953/1988] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:22 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1328 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:23.451545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:23.454597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:23.473420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.474559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.478967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.480220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.577475 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3fdc774-7bd9-45c0-9254-3b8ec0439287 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 204 len: 0 microversion: 2.1 time: 0.348581 Jul 25 16:13:23.581014 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1036/1989] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:13:23 2022] DELETE /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:13:23.601987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:23.602779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:23.630159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.630159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.630159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.630159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.770697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:23.784964 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26de924b-6881-45f6-befc-7af4e6a94552 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1349 microversion: 2.1 time: 0.355231 Jul 25 16:13:23.798441 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 954/1990] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:23 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1349 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:23.807542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:23.810629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:23.818991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.819696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:23.821032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:23.821651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.294642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:24.309901 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ffb688f7-eb3a-4229-823e-cfcd0d0d61d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1510 microversion: 2.1 time: 0.725507 Jul 25 16:13:24.312276 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1037/1991] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:23 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1510 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:24.328084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:24.331168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:24.361418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.365823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.368843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.368843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.388872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:24.402713 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6ef56292-495c-4f16-837c-03ecc0ce137b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1544 microversion: 2.1 time: 0.602657 Jul 25 16:13:24.409953 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 955/1992] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:23 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1544 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:24.457680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:24.459418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:24.479797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.480420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.482394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.483001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.849032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:24.862359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:24.864071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:24.865398 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-55a82b6c-26c7-424c-9afa-cc20fe1b9db9 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.551865 Jul 25 16:13:24.874724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:24.882862 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51ebdfae-4be4-47c4-9ad8-6e9f2bf58dae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.471210 Jul 25 16:13:24.883622 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1038/1993] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:24 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:24.888685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:24.889349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:24.892494 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 956/1994] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:24 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:24.897964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:24.898580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:24.906946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.909590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.911623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.912940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.913616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.914407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:24.918841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:24.919623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:25.262786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:25.279731 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d94b6e3f-a247-442e-9159-1154e123c370 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1510 microversion: 2.1 time: 0.394763 Jul 25 16:13:25.281641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:25.282475 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1039/1995] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:24 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:25.292320 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71417cf7-60cc-4a3f-acec-dc06ea85f8e7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1328 microversion: 2.1 time: 0.398197 Jul 25 16:13:25.292950 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 957/1996] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:24 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:25.294417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3bf086e0-0e2c-4bab-a22c-ac973c9fc341 req-c70b0f4c-7296-4829-b640-8f23a3e5492b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d67bbb-da10-4f92-b74d-b4fedc9620c8", "name": "network-vif-deleted", "tag": "395c36bb-f161-42c2-a622-8d78cf8abfaa"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:25.299153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:25.299787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:25.307172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:25.307928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:25.308772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3bf086e0-0e2c-4bab-a22c-ac973c9fc341 req-c70b0f4c-7296-4829-b640-8f23a3e5492b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:25.309292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3bf086e0-0e2c-4bab-a22c-ac973c9fc341 req-c70b0f4c-7296-4829-b640-8f23a3e5492b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:25.309718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:25.310431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:25.328178 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3bf086e0-0e2c-4bab-a22c-ac973c9fc341 req-c70b0f4c-7296-4829-b640-8f23a3e5492b service nova] Creating event network-vif-deleted:395c36bb-f161-42c2-a622-8d78cf8abfaa for instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 on n-h2-846219-13 Jul 25 16:13:25.334487 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3bf086e0-0e2c-4bab-a22c-ac973c9fc341 req-c70b0f4c-7296-4829-b640-8f23a3e5492b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049761 Jul 25 16:13:25.335760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1040/1997] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:25.461501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:25.489995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f97fe68f-2c5c-4d1c-b669-6d3d16d97ea0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1187 microversion: 2.1 time: 0.179113 Jul 25 16:13:25.492708 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 958/1998] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:25 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1187 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:25.513988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:25.524383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:25.569139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:25.571047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:25.572761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:25.576203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:25.819341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:13:25.820119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:13:25.821869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:13:25.824661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:13:25.825443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:13:25.881391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-128802155", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:25.893153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:25.959718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:13:25.984996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:25.998926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:26.000090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:26.001367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:26.002194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:26.045960 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ecce4fb-7361-4ca6-938c-34e769443cc1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "POST /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b/action" status: 202 len: 1112 microversion: 2.1 time: 0.547839 Jul 25 16:13:26.049902 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 959/1999] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:13:25 2022] POST /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b/action => generated 1112 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:13:26.059198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:26.060428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:26.075866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:26.076838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:26.078148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:26.079470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:27.003154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:27.012002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-635cedfc-fb14-4006-b925-3b9f46f6a09b tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1544 microversion: 2.1 time: 0.959772 Jul 25 16:13:27.012828 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 960/2000] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:26 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1544 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:27.026877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:27.027506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:27.049187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:27.049949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:27.050829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:27.051394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:28.850789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:28.876564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:13:28.877032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:13:28.877471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:13:28.877934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:13:28.878345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:13:28.898159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:28.898582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:28.907599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:28.910314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:28.916828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:28.927234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:28.933006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-201bafe1-9a6b-47d6-ab74-dcf76f219440 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 1.910570 Jul 25 16:13:28.942803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 961/2001] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:27 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:28.957452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:28.960206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:28.979300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:28.981579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:28.983420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:28.985900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:28.987704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:29.002504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:29.075211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:13:29.077822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:13:29.227718 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6655859-0505-47ff-be4f-9ae1a1fd55da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.890491 Jul 25 16:13:29.228912 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1041/2002] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:13:25 2022] POST /compute/v2.1/servers => generated 382 bytes in 3892 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:13:29.234077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:29.235181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:29.244114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:29.246203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:29.248473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:29.249126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:29.615919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:29.638493 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d27cd2ad-4d20-4d7f-a9f1-97cb37162ada tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.692980 Jul 25 16:13:29.652825 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 962/2003] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:28 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:29.652825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:29.652825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:29.681599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:29.690392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:29.691264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:29.691708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:29.859632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:29.892093 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-27e31d64-54ad-4aaf-99d8-caff4f20461d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.658265 Jul 25 16:13:29.893171 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1042/2004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:29 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:29.930464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:29.934047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:29.948235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:29.954102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:29.955101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:29.955842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:30.437063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:30.456667 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1df8212c-3d59-4b9e-9b68-26733845061a tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1187 microversion: 2.1 time: 0.544447 Jul 25 16:13:30.464610 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1043/2005] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:29 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1187 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:30.480755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-33bdc296-c2a0-4e6d-9697-39e888b8f743 req-7cab0dda-68dc-4270-8c36-c6e435f03a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9036b3fc-6e37-45ea-a17f-38fd52ae16e1", "name": "network-vif-unplugged", "status": "completed", "tag": "e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:30.526199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-33bdc296-c2a0-4e6d-9697-39e888b8f743 req-7cab0dda-68dc-4270-8c36-c6e435f03a76 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:30.527975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-33bdc296-c2a0-4e6d-9697-39e888b8f743 req-7cab0dda-68dc-4270-8c36-c6e435f03a76 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:30.546629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:30.564438 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c78dda91-f9f3-47fb-9ea0-6946ba135741 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1328 microversion: 2.1 time: 0.924326 Jul 25 16:13:30.566281 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 963/2006] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:29 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1328 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:30.569415 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-33bdc296-c2a0-4e6d-9697-39e888b8f743 req-7cab0dda-68dc-4270-8c36-c6e435f03a76 service nova] Creating event network-vif-unplugged:e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b for instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 on n-h2-846219-13 Jul 25 16:13:30.573137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:30.574631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:30.588950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:30.593601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:30.595312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:30.596677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:30.602069 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-33bdc296-c2a0-4e6d-9697-39e888b8f743 req-7cab0dda-68dc-4270-8c36-c6e435f03a76 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135742 Jul 25 16:13:30.603421 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1044/2007] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:30.782303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ad9e29364a42e3a6c2ce3bc38edb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec8469484346eea5bf6667fd6a05af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:30.802335 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-193da46f-15de-4399-ae45-7a5668f03338 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 200 len: 1320 microversion: 2.1 time: 0.234556 Jul 25 16:13:30.804723 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 964/2008] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:30 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:30.822483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:30.823534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:30.837130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:30.840779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:30.842198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:30.844529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.005405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:31.059510 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a56250a-96fc-4576-819d-52d8e6c092d3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1216 microversion: 2.1 time: 0.249499 Jul 25 16:13:31.071364 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 965/2009] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:30 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:31.089656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:31.090307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:31.119874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.120345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.121302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.121746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.142369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-210f1b2c-dbfe-4584-9f71-a956b65b0a44 req-d0994334-4dc9-4c88-a725-02a09fdeec18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8892a659-82f6-46e2-82b1-8ddbb566b85e", "name": "network-vif-plugged", "status": "completed", "tag": "f19570d6-00a1-4206-a54d-1d8df2e6df96"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:31.194992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-210f1b2c-dbfe-4584-9f71-a956b65b0a44 req-d0994334-4dc9-4c88-a725-02a09fdeec18 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.195927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-210f1b2c-dbfe-4584-9f71-a956b65b0a44 req-d0994334-4dc9-4c88-a725-02a09fdeec18 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.248131 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-210f1b2c-dbfe-4584-9f71-a956b65b0a44 req-d0994334-4dc9-4c88-a725-02a09fdeec18 service nova] Creating event network-vif-plugged:f19570d6-00a1-4206-a54d-1d8df2e6df96 for instance 8892a659-82f6-46e2-82b1-8ddbb566b85e on n-h2-846219-13 Jul 25 16:13:31.326227 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-210f1b2c-dbfe-4584-9f71-a956b65b0a44 req-d0994334-4dc9-4c88-a725-02a09fdeec18 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.698025 Jul 25 16:13:31.334122 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1045/2010] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:31.355810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:31.359061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:31.408396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.418799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.422377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.425632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.603542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:31.622482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:31.627572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:31.632193 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4fe7412-2680-4b7c-9378-951e5ce00364 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.564460 Jul 25 16:13:31.633203 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 966/2011] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:31 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:31.653276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:31.655300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:31.679720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.680232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:31.681150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:31.681601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.299666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:32.311480 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4719510-e273-431a-bb93-b70d499bc3fe tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.975199 Jul 25 16:13:32.328159 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1046/2012] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:31 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:32.333746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:32.334607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:32.343341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.344063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.346691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.347557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.712267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:32.729847 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81af4c25-b9fe-498f-b89f-fc00d7bd81b1 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1187 microversion: 2.1 time: 0.399698 Jul 25 16:13:32.739719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:32.751578 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1047/2013] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:32 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1187 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:32.757856 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21540a73-9b89-449a-8830-bef7790887db tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 1.121035 Jul 25 16:13:32.758914 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 967/2014] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:31 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:32.766417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:32.767782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:32.769422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:32.770035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] [instance: 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:32.780325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.781218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.784748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.785635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.798761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.809872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.811050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.811630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.842828 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] HTTP exception thrown: Instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 could not be found. Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Request method failure captured: Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 HTTP/1.1 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sDTOBAR7Fg_3C-5J1euiToEXZmULnLrmKg50aIS-gZMgJQfnxH1JBrRUwcZUtQmTAGE9ESQFisUTaauB9z-eyeZBhjB_yb6kQSKP4dZydT2RtFH8G0nW4tzbyvZdoaJjzKmZ2MhrQ0i-iQZXxw2xPDA-wqwU4yvVzOiDlmmlOOx0dw Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c5ec8469484346eea5bf6667fd6a05af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c5ec8469484346eea5bf6667fd6a05af"}]}] Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c5ec8469484346eea5bf6667fd6a05af Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927 Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b3ad9e29364a42e3a6c2ce3bc38edb5f Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 could not be found. Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8'} Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 could not be found. Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 could not be found. Jul 25 16:13:32.847195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 could not be found. Jul 25 16:13:32.850549 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:32.853189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] Returning 404 to user: Instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:32.855324 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b0dfa7a0-2366-49c2-8f63-9a94b0daddf3 tempest-FloatingIPsAssociationNegativeTestJSON-372221927 tempest-FloatingIPsAssociationNegativeTestJSON-372221927-project] 10.222.0.105 "GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8" status: 404 len: 111 microversion: 2.1 time: 0.095357 Jul 25 16:13:32.864645 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 968/2015] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:32 2022] GET /compute/v2.1/servers/5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:13:32.884970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:32.886026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:32.898353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.898977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:32.900171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:32.900767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.164911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.184748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9f759d3-c391-4086-9f66-de192381c0cf tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1278 microversion: 2.1 time: 0.317742 Jul 25 16:13:33.206024 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 969/2016] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:32 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1278 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:33.219976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ae2345fd-7c55-4f20-b786-6c217a6aa92d req-253f24df-42dd-4d4e-a7ed-19ac360f39cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8", "name": "network-vif-deleted", "tag": "ce9efd40-53dc-426f-abd9-1caa1078a4b7"}, {"name": "network-changed", "server_uuid": "9036b3fc-6e37-45ea-a17f-38fd52ae16e1", "tag": "e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:33.241255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ae2345fd-7c55-4f20-b786-6c217a6aa92d req-253f24df-42dd-4d4e-a7ed-19ac360f39cb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.243843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ae2345fd-7c55-4f20-b786-6c217a6aa92d req-253f24df-42dd-4d4e-a7ed-19ac360f39cb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.278087 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ae2345fd-7c55-4f20-b786-6c217a6aa92d req-253f24df-42dd-4d4e-a7ed-19ac360f39cb service nova] Creating event network-vif-deleted:ce9efd40-53dc-426f-abd9-1caa1078a4b7 for instance 5cf94f1a-eb99-4bd2-bf2b-0375f0f269b8 on n-h2-846219-13 Jul 25 16:13:33.279204 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ae2345fd-7c55-4f20-b786-6c217a6aa92d req-253f24df-42dd-4d4e-a7ed-19ac360f39cb service nova] Creating event network-changed:e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b for instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 on n-h2-846219-13 Jul 25 16:13:33.292204 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ae2345fd-7c55-4f20-b786-6c217a6aa92d req-253f24df-42dd-4d4e-a7ed-19ac360f39cb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084030 Jul 25 16:13:33.294275 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 970/2017] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:33.326217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:33.328665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.330349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:33.338350 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53895cb3-16b0-4aa0-a6de-45a315280881 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1328 microversion: 2.1 time: 0.585152 Jul 25 16:13:33.341483 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1048/2018] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:32 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1328 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:33.350855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.353052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.354983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.355988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.357824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:33.359329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:33.382108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.383225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.384375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.384922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.396852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:33.759052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.782432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.783451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.786767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.788410 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a7711c7b-5de6-452d-84ba-1346b8175c13 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.492031 Jul 25 16:13:33.796079 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d9560a2e-8e0b-492c-94e7-d907be42e49d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1531 microversion: 2.1 time: 0.453284 Jul 25 16:13:33.802355 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 971/2019] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:33 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:33.805899 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1049/2020] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:33 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1531 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:33.815320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:33.816266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:33.818527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:33.819149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:33.825255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.826687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.827737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.828789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.842420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.842869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.843659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:33.844093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:33.959548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:33.973640 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-202464a9-7e0b-4edc-bc09-e4dbaa0ecc0c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 200 len: 1187 microversion: 2.1 time: 0.169582 Jul 25 16:13:33.974527 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 972/2021] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:33 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:34.227570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:34.228270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:34.242487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:34.243118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:34.245464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:34.246259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:34.264873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:34.276934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-594ed89c-06ac-4239-873f-b44323e0afb7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.468150 Jul 25 16:13:34.296707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1050/2022] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:33 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:34.380514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:34.381395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:34.392096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:34.392777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:34.393802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:34.394756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:34.395498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:34.409643 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c51951a6-06ff-4ee6-bcb6-59422efea89e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1278 microversion: 2.1 time: 0.184476 Jul 25 16:13:34.421505 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 973/2023] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:34 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:13:34.821353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:34.822371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:34.840333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:34.841212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:34.842273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:34.843005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:35.071993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:35.095906 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b05cb7d-7a30-4247-bde7-593207db4a37 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1526 microversion: 2.1 time: 0.722392 Jul 25 16:13:35.097454 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1051/2024] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:34 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1526 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:13:35.131022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:35.132328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:35.143483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:35.144309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:35.145789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:35.146521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:35.879553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:35.895587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:35.901867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:35.906950 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7b1d884e-104f-457f-8f83-fef3ba294e35 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 1.092183 Jul 25 16:13:35.919615 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 974/2025] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:34 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:13:35.926897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:35.930789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 41d67bbb-da10-4f92-b74d-b4fedc9620c8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:35.951677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:35.959019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:35.960919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:35.962012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:36.013539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] HTTP exception thrown: Instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 could not be found. Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Request method failure captured: Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 HTTP/1.1 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r8S6f_rikKSHNdrMJdejAwSxNqupZ6XWaVREUY7HTyciuKkEjXkGkh4STWJIo4WUwApNQhWJp_ImKrEx5j5KoC3aLIoed3lR43tJOMxyZV9slVUseNGo0wQFS4Cplw8ZIh76erw-CWxM3K6Sn9F8m71NncEMOP1h27IE1guwKnH7oQ Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0638463dadea48a0b7650229ad028a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0638463dadea48a0b7650229ad028a90"}]}] Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveMigrationTest-2009906717 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveMigrationTest-2009906717-project Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: d8d1e6f3591a4c4ea97eadbd97954916 Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveMigrationTest-2009906717-project Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 could not be found. Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '41d67bbb-da10-4f92-b74d-b4fedc9620c8'} Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 could not be found. Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 could not be found. Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:36.025034 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 could not be found. Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Returning 404 to user: Instance 41d67bbb-da10-4f92-b74d-b4fedc9620c8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:36.028436 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cad27885-8973-4dec-957e-e98e26bd09d5 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8" status: 404 len: 111 microversion: 2.1 time: 0.110636 Jul 25 16:13:36.028922 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 975/2026] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:35 2022] GET /compute/v2.1/servers/41d67bbb-da10-4f92-b74d-b4fedc9620c8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:13:36.047060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:36.047901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:36.064137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:36.070932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:36.081398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:36.083236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:36.084001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:36.236434 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] HTTP exception thrown: Action 999 not found Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Request method failure captured: Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e/os-instance-actions/999 HTTP/1.1 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEMIWHRp559dxhsEmpUVg0aiIHXIPPsQ3-0OKPpwni_6-OnMom3tB46LY0nzq7nkOtb0IrF28WBl6TtKxcBBQ67iA4Ni657lLuI7SOG18Ij0kxG3wj3mAdBZhv8mc4CKi-FL9LymJKfeHrWQdf1GrdMIibQBrM_oli4VRrH-qDniJQ Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2cb54814c2994b2e81967b9e4bb66a98 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2cb54814c2994b2e81967b9e4bb66a98"}]}] Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2cb54814c2994b2e81967b9e4bb66a98 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-InstanceActionsNegativeTestJSON-1035378919-project Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 44147d512d8948dbb8a7f47aec511b16 Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1035378919-project Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: exception: Action 999 not found Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '8892a659-82f6-46e2-82b1-8ddbb566b85e', 'id': '999'} Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 25 16:13:36.261971 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:36.265405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Returning 404 to user: Action 999 not found {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:36.267421 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1375b84c-893a-45d1-9359-e68141792176 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.237141 Jul 25 16:13:36.279265 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 976/2027] 10.222.0.105 () {58 vars in 1313 bytes} [Mon Jul 25 16:13:36 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e/os-instance-actions/999 => generated 66 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:13:36.306021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:36.307482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:36.324891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:36.329120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:36.333389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:36.334296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:36.351970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:36.902229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:36.912394 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e30faa5-52a4-4333-abd4-a6792ca9de1f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1513 microversion: 2.1 time: 1.813562 Jul 25 16:13:36.916759 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1052/2028] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:35 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1513 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:36.953302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:36.955364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:36.981080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:36.981811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:36.982795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:36.986387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:37.031721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:37.136255 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99ba421c-463a-48e1-a7a1-079360206a03 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.855013 Jul 25 16:13:37.137401 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 977/2029] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:36 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:37.201996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a36ae18e-4406-43d4-86ee-cc5a4384d6ac tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '.version_select at 0x7f9d93f22a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:37.213645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a36ae18e-4406-43d4-86ee-cc5a4384d6ac tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 707a285b-a02e-4530-a0bd-51bc8bac02df] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:37.238925 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a36ae18e-4406-43d4-86ee-cc5a4384d6ac tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] HTTP exception thrown: Instance 707a285b-a02e-4530-a0bd-51bc8bac02df could not be found. Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a36ae18e-4406-43d4-86ee-cc5a4384d6ac tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Request method failure captured: Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/707a285b-a02e-4530-a0bd-51bc8bac02df/os-instance-actions HTTP/1.1 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEMIWHRp559dxhsEmpUVg0aiIHXIPPsQ3-0OKPpwni_6-OnMom3tB46LY0nzq7nkOtb0IrF28WBl6TtKxcBBQ67iA4Ni657lLuI7SOG18Ij0kxG3wj3mAdBZhv8mc4CKi-FL9LymJKfeHrWQdf1GrdMIibQBrM_oli4VRrH-qDniJQ Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2cb54814c2994b2e81967b9e4bb66a98 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2cb54814c2994b2e81967b9e4bb66a98"}]}] Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2cb54814c2994b2e81967b9e4bb66a98 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-InstanceActionsNegativeTestJSON-1035378919-project Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 44147d512d8948dbb8a7f47aec511b16 Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1035378919-project Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 707a285b-a02e-4530-a0bd-51bc8bac02df could not be found. Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '707a285b-a02e-4530-a0bd-51bc8bac02df'} Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707a285b-a02e-4530-a0bd-51bc8bac02df could not be found. Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:13:37.245438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707a285b-a02e-4530-a0bd-51bc8bac02df could not be found. Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707a285b-a02e-4530-a0bd-51bc8bac02df could not be found. Jul 25 16:13:37.253479 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:13:37.258476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a36ae18e-4406-43d4-86ee-cc5a4384d6ac tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Returning 404 to user: Instance 707a285b-a02e-4530-a0bd-51bc8bac02df could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:37.260567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a36ae18e-4406-43d4-86ee-cc5a4384d6ac tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/707a285b-a02e-4530-a0bd-51bc8bac02df/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.106440 Jul 25 16:13:37.262415 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 978/2030] 10.222.0.105 () {58 vars in 1301 bytes} [Mon Jul 25 16:13:37 2022] GET /compute/v2.1/servers/707a285b-a02e-4530-a0bd-51bc8bac02df/os-instance-actions => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:13:37.279874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-45653f54-1dff-4435-abd9-c5ed4bc1eb72 req-6fa40930-68f9-4743-916f-a7b3383cbb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "name": "network-vif-unplugged", "status": "completed", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:37.331963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-45653f54-1dff-4435-abd9-c5ed4bc1eb72 req-6fa40930-68f9-4743-916f-a7b3383cbb05 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:37.343884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-45653f54-1dff-4435-abd9-c5ed4bc1eb72 req-6fa40930-68f9-4743-916f-a7b3383cbb05 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:37.402452 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-45653f54-1dff-4435-abd9-c5ed4bc1eb72 req-6fa40930-68f9-4743-916f-a7b3383cbb05 service nova] Creating event network-vif-unplugged:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:13:37.408716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-45653f54-1dff-4435-abd9-c5ed4bc1eb72 req-6fa40930-68f9-4743-916f-a7b3383cbb05 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144412 Jul 25 16:13:37.409352 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 979/2031] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:37.414695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:37.415496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:37.436936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:37.437321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:37.438633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:37.439205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.262132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:38.263026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:38.283591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:38.291397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:38.297341 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca7f19f0-26e7-4a18-a568-c0abb82bf9b0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.886675 Jul 25 16:13:38.301320 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d13a6a6f-0370-4af1-aa27-818939772aa1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 1.362384 Jul 25 16:13:38.301556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 980/2032] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:37 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:38.302977 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1053/2033] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:36 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:38.318423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:38.325762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:38.349732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:38.350357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:38.353685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.356166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.357559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.358168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.358316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.359950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.360544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.361583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.457906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:38.715736 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1894ec32-20de-44b9-a8aa-6c6047128b34 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 204 len: 0 microversion: 2.1 time: 0.412873 Jul 25 16:13:38.716758 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 981/2034] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:13:38 2022] DELETE /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:13:38.726055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:38.731082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:38.748506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.749187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.751400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.753166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.814456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:38.826948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78f68a31-8780-42a3-a6ae-40cc526bef56 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1513 microversion: 2.1 time: 0.511322 Jul 25 16:13:38.830958 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1054/2035] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:38 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:38.843938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:38.845544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:38.860825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.864821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.866311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:38.869046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:38.944015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:39.029607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:39.439887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:39.461065 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d13503d-0b81-4ade-a757-523aab1223a1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.739521 Jul 25 16:13:39.462625 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 982/2036] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:38 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:39.476408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:39.479267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:39.502424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:39.503281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:39.504338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:39.504980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:39.614627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:39.629799 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-01335f8b-47aa-4fa2-94e4-5e515756868d tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1532 microversion: 2.1 time: 0.797375 Jul 25 16:13:39.630425 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1055/2037] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:38 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1532 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:39.635372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:39.635988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:39.662903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:39.663441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:39.664469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:39.665294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:40.141123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:40.153864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:40.164418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:40.174508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:40.179920 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ae8e7708-d6af-4c0b-98ac-bc52950929dc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 0.548228 Jul 25 16:13:40.193462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53246273-f9be-4b96-8440-b4d0a421a640 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.715614 Jul 25 16:13:40.193462 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 983/2038] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:39 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:40.204125 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1056/2039] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:39 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:40.206613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cee43c10-6042-4bde-aafa-85ff944cec56 req-c5ebf9bb-90b3-493e-a308-6ed6100341f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9036b3fc-6e37-45ea-a17f-38fd52ae16e1", "name": "network-vif-unplugged", "status": "completed", "tag": "e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:40.226075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:40.232696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:40.241502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cee43c10-6042-4bde-aafa-85ff944cec56 req-c5ebf9bb-90b3-493e-a308-6ed6100341f4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:40.241953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cee43c10-6042-4bde-aafa-85ff944cec56 req-c5ebf9bb-90b3-493e-a308-6ed6100341f4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:40.266994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:40.268785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:40.273959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:40.274487 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cee43c10-6042-4bde-aafa-85ff944cec56 req-c5ebf9bb-90b3-493e-a308-6ed6100341f4 service nova] Creating event network-vif-unplugged:e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b for instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 on n-h2-846219-13 Jul 25 16:13:40.278453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:40.302618 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cee43c10-6042-4bde-aafa-85ff944cec56 req-c5ebf9bb-90b3-493e-a308-6ed6100341f4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111818 Jul 25 16:13:40.326300 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 984/2040] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:40.357924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2a454c44-9ae2-4ef9-be7f-f5c792b8800c req-cf59b0b4-68a6-4af5-9372-d57a112efd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd58fea-6110-43b7-9f72-c20592d5f0d4", "tag": "c461cbf9-148a-4ce9-95bc-865540b15329"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:40.379626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2a454c44-9ae2-4ef9-be7f-f5c792b8800c req-cf59b0b4-68a6-4af5-9372-d57a112efd7a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:40.383003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2a454c44-9ae2-4ef9-be7f-f5c792b8800c req-cf59b0b4-68a6-4af5-9372-d57a112efd7a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:40.416734 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2a454c44-9ae2-4ef9-be7f-f5c792b8800c req-cf59b0b4-68a6-4af5-9372-d57a112efd7a service nova] Creating event network-changed:c461cbf9-148a-4ce9-95bc-865540b15329 for instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 on n-h1-846219-13 Jul 25 16:13:40.425207 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2a454c44-9ae2-4ef9-be7f-f5c792b8800c req-cf59b0b4-68a6-4af5-9372-d57a112efd7a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072465 Jul 25 16:13:40.431530 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 985/2041] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:13:40.484775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:40.486663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:40.511230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:40.512171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:40.518379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:40.519178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:41.939834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:41.973587 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5520fb4-86e8-43e8-8294-4b670ca20074 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 1.490886 Jul 25 16:13:41.991660 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 986/2042] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:40 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:42.004838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:42.006201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:42.029461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:42.029930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:42.037819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:42.041174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:42.382195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:42.391948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c69af40b-ad31-4ce2-97e1-08d7d167de14 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1513 microversion: 2.1 time: 2.186276 Jul 25 16:13:42.392525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1057/2043] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:40 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1513 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:42.439496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:42.444788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:42.472090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:42.475863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:42.478419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:42.478990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:42.945919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:42.958154 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26fc2f88-3d74-49c9-ba58-2ffb22d38ad7 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1532 microversion: 2.1 time: 0.963279 Jul 25 16:13:42.958919 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 987/2044] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:41 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1532 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:42.966410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:42.982499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:43.003689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.004179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.006867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.010014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.126563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:43.137196 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-52dfc8d5-86d9-4d0d-828b-c49314d4f38e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 0.719924 Jul 25 16:13:43.140113 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1058/2045] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:42 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:43.151192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:43.151828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:43.176877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.177361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.178163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.178593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.567994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:43.597543 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9002443f-548e-4f95-a669-a689a720ef5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.439767 Jul 25 16:13:43.598814 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1059/2046] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:43 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:43.603769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:43.604253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:43.605865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:43.612852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:43.617013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.617744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.618605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:43.619064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.619706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.620048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3ed8ab0a-7a55-459e-aa14-6cb9dcdf67ff tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.657801 Jul 25 16:13:43.633243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 988/2047] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:42 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:43.868912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-53cf3c1e-4ada-4450-98a8-17c94ccb4c58 req-1a2b4a1a-e360-400e-97a0-96b1abcb7064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8892a659-82f6-46e2-82b1-8ddbb566b85e", "name": "network-vif-deleted", "tag": "f19570d6-00a1-4206-a54d-1d8df2e6df96"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:43.907914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-53cf3c1e-4ada-4450-98a8-17c94ccb4c58 req-1a2b4a1a-e360-400e-97a0-96b1abcb7064 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:43.908499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-53cf3c1e-4ada-4450-98a8-17c94ccb4c58 req-1a2b4a1a-e360-400e-97a0-96b1abcb7064 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:43.954068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-53cf3c1e-4ada-4450-98a8-17c94ccb4c58 req-1a2b4a1a-e360-400e-97a0-96b1abcb7064 service nova] Creating event network-vif-deleted:f19570d6-00a1-4206-a54d-1d8df2e6df96 for instance 8892a659-82f6-46e2-82b1-8ddbb566b85e on n-h2-846219-13 Jul 25 16:13:43.965684 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-53cf3c1e-4ada-4450-98a8-17c94ccb4c58 req-1a2b4a1a-e360-400e-97a0-96b1abcb7064 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100283 Jul 25 16:13:43.966405 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 989/2048] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:13:43.970866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:43.983790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:43.984593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:43.992247 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c853feba-0c6d-4410-a5b9-e6d7be05d9ff tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1456 microversion: 2.1 time: 0.392022 Jul 25 16:13:43.993496 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1060/2049] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:43 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1456 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:44.000381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.000837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.004745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.006911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.017922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:44.018947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.026282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.027052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.028172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.028776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.176839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44147d512d8948dbb8a7f47aec511b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb54814c2994b2e81967b9e4bb66a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:44.189266 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9045a22-40cf-4ad2-90b1-d66fb30c5112 tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 200 len: 1313 microversion: 2.1 time: 0.212976 Jul 25 16:13:44.190832 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 990/2050] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:43 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:44.196165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:44.197166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.207159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.207830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.208898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.209809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.322273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:44.334633 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c4fb45ad-d2e6-4e4f-87a2-216c616a556b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1456 microversion: 2.1 time: 0.320822 Jul 25 16:13:44.335940 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1061/2051] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:44 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1456 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:44.414816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:44.418403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:44.419332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.427781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.428694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.429742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.430546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.432300 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-496d5524-c213-4f3f-8e41-8aec4702e137 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 0.240158 Jul 25 16:13:44.449600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 991/2052] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:44 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:44.461088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lazy-loading 'flavor' on Instance uuid 014fd993-5b27-49d3-a044-1a252cc437a8 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:13:44.479662 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'shelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state shelved_offloaded Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 14 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: {"shelve": {}} Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'shelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state shelved_offloaded Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'shelve': {}}} Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 25 16:13:44.483569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state shelved_offloaded Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state shelved_offloaded Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'shelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state shelved_offloaded {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aac4b159-cc22-41a3-b49c-0be9cbe9ce2a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 155 microversion: 2.1 time: 0.072160 Jul 25 16:13:44.490539 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1062/2053] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:13:44 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 16:13:44.496063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:44.496651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.504278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.504826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.505680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.506116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.620614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:44.621266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.627783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d59ccba2-dc4e-46b7-803e-41517046ea35 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 202 len: 0 microversion: 2.1 time: 0.136205 Jul 25 16:13:44.629279 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 992/2054] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:13:44 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:13:44.632486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.633214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.634178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.636735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.640084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:44.640801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.650805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.651391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.652277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.653044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.914174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:44.929155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4d67d4de-3be7-42eb-bc7a-c03b9227b4d1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1464 microversion: 2.1 time: 0.294143 Jul 25 16:13:44.932150 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 993/2055] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:44 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:44.946782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:44.949082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:44.950937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:44.961652 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-83b6c28f-76f0-4932-b478-d2bd548ba542 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.344673 Jul 25 16:13:44.962911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1063/2056] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:44 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:13:44.975841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.976350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:44.980142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:44.980758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:45.189180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:45.193179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:45.200309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:45.202078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:45.203305 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-462b74ba-0f52-47e1-aecd-385819be6ec3 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.269952 Jul 25 16:13:45.203864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 994/2057] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:44 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:45.216649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:45.217649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] [instance: 8892a659-82f6-46e2-82b1-8ddbb566b85e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:45.227686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:45.231361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:45.232432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:45.234005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:45.257622 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] HTTP exception thrown: Instance 8892a659-82f6-46e2-82b1-8ddbb566b85e could not be found. Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Request method failure captured: Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e HTTP/1.1 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEMIWHRp559dxhsEmpUVg0aiIHXIPPsQ3-0OKPpwni_6-OnMom3tB46LY0nzq7nkOtb0IrF28WBl6TtKxcBBQ67iA4Ni657lLuI7SOG18Ij0kxG3wj3mAdBZhv8mc4CKi-FL9LymJKfeHrWQdf1GrdMIibQBrM_oli4VRrH-qDniJQ Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2cb54814c2994b2e81967b9e4bb66a98 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2cb54814c2994b2e81967b9e4bb66a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2cb54814c2994b2e81967b9e4bb66a98"}]}] Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2cb54814c2994b2e81967b9e4bb66a98 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1035378919 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-InstanceActionsNegativeTestJSON-1035378919-project Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 44147d512d8948dbb8a7f47aec511b16 Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1035378919-project Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8892a659-82f6-46e2-82b1-8ddbb566b85e could not be found. Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8892a659-82f6-46e2-82b1-8ddbb566b85e'} Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8892a659-82f6-46e2-82b1-8ddbb566b85e could not be found. Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8892a659-82f6-46e2-82b1-8ddbb566b85e could not be found. Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:45.261164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8892a659-82f6-46e2-82b1-8ddbb566b85e could not be found. Jul 25 16:13:45.265293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:45.267147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] Returning 404 to user: Instance 8892a659-82f6-46e2-82b1-8ddbb566b85e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:45.270182 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f760a12d-1ce3-4166-9a31-40986ac099be tempest-InstanceActionsNegativeTestJSON-1035378919 tempest-InstanceActionsNegativeTestJSON-1035378919-project] 10.222.0.105 "GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e" status: 404 len: 111 microversion: 2.1 time: 0.058276 Jul 25 16:13:45.270984 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1064/2058] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:45 2022] GET /compute/v2.1/servers/8892a659-82f6-46e2-82b1-8ddbb566b85e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:13:45.465325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:45.466666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:45.481493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:45.481859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:45.489970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:45.490599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:45.785563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:45.807091 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-309432f3-c688-4e3f-bcbf-81ae061237b0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 0.346028 Jul 25 16:13:45.810258 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 995/2059] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:45 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:45.955584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:45.957016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:45.975190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:45.978318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:45.987450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:45.988926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:45.993481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:46.000682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:46.012046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:46.014952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:46.017430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:46.017875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.166113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:47.175328 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-074386dd-6305-41a4-a749-7f9a5dd26ee3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1464 microversion: 2.1 time: 1.223948 Jul 25 16:13:47.186196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:47.192895 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1065/2060] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:45 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1464 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:47.195800 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7b97025d-93c7-4486-9943-fa0c6c1e26fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 1.212175 Jul 25 16:13:47.201063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:47.202179 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 996/2061] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:45 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:13:47.207925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:47.217646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0eec6ed2-f934-4ba6-85bf-5f9831cf3a1e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93cffa60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:47.233769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:47.234462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.235447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:47.245568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.294739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0eec6ed2-f934-4ba6-85bf-5f9831cf3a1e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/d0905a71-0e84-4db1-a8b4-d9ad5762e8da" status: 200 len: 665 microversion: 2.1 time: 0.091210 Jul 25 16:13:47.295509 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 997/2062] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:13:47 2022] GET /compute/v2.1/images/d0905a71-0e84-4db1-a8b4-d9ad5762e8da => generated 665 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:47.305409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:47.317973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:47.319059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:47.342027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:47.342876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.344040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:47.344702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.415093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:47.570781 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c2a8ced3-487e-48c3-b923-f1c1f7972fc0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "DELETE /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 204 len: 0 microversion: 2.1 time: 0.267843 Jul 25 16:13:47.571772 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 998/2063] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:13:47 2022] DELETE /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:13:47.581007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:47.582018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:47.593224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:47.594279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.595455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:47.596058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:47.847456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:47.859402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:47.867019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:47.868442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e5d0f6c6-cdec-4def-9920-e033834ea845 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1488 microversion: 2.25 time: 0.671288 Jul 25 16:13:47.881125 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1066/2064] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:47 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1488 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:47.886114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35896a56-f1e0-4ba3-b549-a091d5b2d2de tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ea8f70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:47.977370 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35896a56-f1e0-4ba3-b549-a091d5b2d2de tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/d0905a71-0e84-4db1-a8b4-d9ad5762e8da" status: 200 len: 665 microversion: 2.1 time: 0.106303 Jul 25 16:13:47.978410 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1067/2065] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:13:47 2022] GET /compute/v2.1/images/d0905a71-0e84-4db1-a8b4-d9ad5762e8da => generated 665 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:48.007585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:48.012041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:48.029187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:48.030305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:48.031924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:48.032883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:48.389573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:48.431316 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-047f744d-8fc7-435b-99c7-64ab2d573b55 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 0.857725 Jul 25 16:13:48.433531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 999/2066] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:47 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:48.441938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:48.443531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:48.453425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:48.454362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:48.455363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:48.455942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:48.744755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:48.759915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca8377ec-0101-493b-ba87-73ad8f7ef226 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1671 microversion: 2.1 time: 0.777538 Jul 25 16:13:48.769740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1068/2067] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:47 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1671 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:48.796902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:48.801633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:48.827075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:48.827555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:48.828395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:48.828831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:49.044994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:49.059262 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33a37c07-50cc-4a19-8cbb-9893a51adb18 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 0.624262 Jul 25 16:13:49.077318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1000/2068] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:48 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:49.088683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-efc9b752-998e-43e6-8fa5-5f25b0ff8dd9 req-1e5bfcc2-8077-4944-b95b-636d93584752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd58fea-6110-43b7-9f72-c20592d5f0d4", "name": "network-vif-plugged", "status": "completed", "tag": "c461cbf9-148a-4ce9-95bc-865540b15329"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:49.103939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-efc9b752-998e-43e6-8fa5-5f25b0ff8dd9 req-1e5bfcc2-8077-4944-b95b-636d93584752 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:49.104640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-efc9b752-998e-43e6-8fa5-5f25b0ff8dd9 req-1e5bfcc2-8077-4944-b95b-636d93584752 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:49.159433 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-efc9b752-998e-43e6-8fa5-5f25b0ff8dd9 req-1e5bfcc2-8077-4944-b95b-636d93584752 service nova] Creating event network-vif-plugged:c461cbf9-148a-4ce9-95bc-865540b15329 for instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 on n-h1-846219-13 Jul 25 16:13:49.172476 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-efc9b752-998e-43e6-8fa5-5f25b0ff8dd9 req-1e5bfcc2-8077-4944-b95b-636d93584752 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093455 Jul 25 16:13:49.176381 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1001/2069] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:49.187923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:49.192790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:49.215726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:49.218997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:49.236830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:49.237870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:49.656788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:49.671919 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a4ba979-484e-45b0-8b89-2e7c6b9cf4f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.900310 Jul 25 16:13:49.687763 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1069/2070] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:48 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:49.703908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:49.708112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:49.725361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:49.726066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:49.730542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:49.731479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:49.990279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:50.002554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:50.009500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:50.011034 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4af3f15-032c-4a40-bd83-fde7b67b611b tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1478 microversion: 2.25 time: 0.833087 Jul 25 16:13:50.015798 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1002/2071] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:49 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1478 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:50.028975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:50.031125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:50.038914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.039632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:50.041511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.042106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:50.303374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:50.345808 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2046023a-73bf-481e-8a04-5b4149c1cc43 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1320 microversion: 2.1 time: 0.653709 Jul 25 16:13:50.349441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1070/2072] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:49 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1320 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:50.371844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a02f847-1f8c-4382-b668-b4836c6492f2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '.version_select at 0x7f9d92ea8820>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:50.384134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a02f847-1f8c-4382-b668-b4836c6492f2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.388470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a02f847-1f8c-4382-b668-b4836c6492f2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:50.431381 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a02f847-1f8c-4382-b668-b4836c6492f2 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/os-migrations" status: 200 len: 2986 microversion: 2.25 time: 0.075287 Jul 25 16:13:50.447477 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1071/2073] 10.222.0.105 () {60 vars in 1189 bytes} [Mon Jul 25 16:13:50 2022] GET /compute/v2.1/os-migrations => generated 2986 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:50.459515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:50.460678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:50.479173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.482494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:50.483509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.485833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:50.536574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:50.556070 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c29c4c69-ca1b-4dfd-91b9-4f9e4f3024f0 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1671 microversion: 2.1 time: 0.538714 Jul 25 16:13:50.570606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1003/2074] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:50 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1671 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:50.570606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:50.581247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:50.595244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.596024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:50.598405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:50.598888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:51.135163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:51.144839 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d94a3568-b7a8-4630-9cd5-7cfbda5ce383 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 0.696139 Jul 25 16:13:51.151689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1072/2075] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:50 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:51.166069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d1e4bf99-2f46-495d-ae16-c5f3a46d080a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4a1bdc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:51.314261 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d1e4bf99-2f46-495d-ae16-c5f3a46d080a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/96a4e743-9b83-4369-aad6-c6521d749f09" status: 200 len: 665 microversion: 2.1 time: 0.161098 Jul 25 16:13:51.318443 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1073/2076] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:13:51 2022] GET /compute/v2.1/images/96a4e743-9b83-4369-aad6-c6521d749f09 => generated 665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:51.346026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:51.348881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:51.411059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] Lazy-loading 'services' on Instance uuid 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:13:51.433074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:51.436398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:51.440661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:51.445981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:51.498619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8eb4f194-3907-4766-810d-c1ed37556ac6 tempest-LiveAutoBlockMigrationV225Test-114174531 tempest-LiveAutoBlockMigrationV225Test-114174531-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1971 microversion: 2.25 time: 0.938605 Jul 25 16:13:51.499919 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1004/2077] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:50 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1971 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:51.512995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6635d274-9ccb-4819-921c-a23bd7bfb50c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93d4f3a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:51.632516 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6635d274-9ccb-4819-921c-a23bd7bfb50c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/96a4e743-9b83-4369-aad6-c6521d749f09" status: 200 len: 665 microversion: 2.1 time: 0.131052 Jul 25 16:13:51.663298 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1005/2078] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:13:51 2022] GET /compute/v2.1/images/96a4e743-9b83-4369-aad6-c6521d749f09 => generated 665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:51.684091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:51.684717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:51.714746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:51.716062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:51.718545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:51.719844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.230401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:52.257787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:52.262906 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d5074281-2e12-4a9a-a4f5-5a33b63c5bdd tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1469 microversion: 2.1 time: 0.584583 Jul 25 16:13:52.265985 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1006/2079] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:51 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1469 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:52.274780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:52.277514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:52.280649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe3e0511-1327-450b-8911-24f2653e2f76 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.960704 Jul 25 16:13:52.281550 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1074/2080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:51 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:52.302160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:52.316257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.317131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.318171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.319996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.320204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:52.351778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.353690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:52.353844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.365652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.366104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.474353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.474787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.476854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lazy-loading 'fault' on Instance uuid 01318d40-8f22-4197-a911-5fb6b6c06a76 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:13:52.644353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:52.660066 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8981fc43-6995-4791-9715-0116195e4c0a tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "DELETE /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 204 len: 0 microversion: 2.25 time: 0.391568 Jul 25 16:13:52.661862 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1007/2081] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:13:52 2022] DELETE /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:13:52.665779 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4123d292-a5af-431a-932e-98579716ba05 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 200 len: 1328 microversion: 2.1 time: 0.367580 Jul 25 16:13:52.670969 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1075/2082] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:52 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 1328 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:52.678005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:52.679031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3a145d13-287f-4be6-8aa1-869a7760e558 req-929484e8-1336-4a53-b3cb-58021653e893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01318d40-8f22-4197-a911-5fb6b6c06a76", "name": "network-vif-deleted", "tag": "e1424844-e140-44be-a83d-6c7f02860b30"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:52.684056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:52.702054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:52.705426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.705884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3a145d13-287f-4be6-8aa1-869a7760e558 req-929484e8-1336-4a53-b3cb-58021653e893 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.706720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3a145d13-287f-4be6-8aa1-869a7760e558 req-929484e8-1336-4a53-b3cb-58021653e893 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.707547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.712634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.716683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.742813 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3a145d13-287f-4be6-8aa1-869a7760e558 req-929484e8-1336-4a53-b3cb-58021653e893 service nova] Creating event network-vif-deleted:e1424844-e140-44be-a83d-6c7f02860b30 for instance 01318d40-8f22-4197-a911-5fb6b6c06a76 on n-h2-846219-13 Jul 25 16:13:52.753529 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3a145d13-287f-4be6-8aa1-869a7760e558 req-929484e8-1336-4a53-b3cb-58021653e893 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089406 Jul 25 16:13:52.762811 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1008/2083] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:53.117773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:53.134230 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3341989f-cbe0-4ca6-8139-7de85a861337 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 0.461273 Jul 25 16:13:53.149153 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1076/2084] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:52 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:53.154188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:53.154810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:53.175061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.175611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.176483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.176923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.431429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:53.447167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:53.448121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:53.453492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:53.461459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:53.463072 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-352bd933-cb0c-4a3b-9cd5-8e2e35aa2f18 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1484 microversion: 2.25 time: 0.312786 Jul 25 16:13:53.464242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.465742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.467752 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1077/2085] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:53 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1484 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:53.469234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.472163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.481180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:53.482763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:53.497667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.500709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.516188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.517035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:54.662847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:54.676559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04a09bf8-6810-4ad3-912a-79879cffaf5a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 1.206093 Jul 25 16:13:54.691669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1078/2086] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:53 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:54.700138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:54.700768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 01318d40-8f22-4197-a911-5fb6b6c06a76] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:54.731061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:54.731534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:54.732483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:54.741467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:54.776676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] HTTP exception thrown: Instance 01318d40-8f22-4197-a911-5fb6b6c06a76 could not be found. Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Request method failure captured: Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 HTTP/1.1 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r8S6f_rikKSHNdrMJdejAwSxNqupZ6XWaVREUY7HTyciuKkEjXkGkh4STWJIo4WUwApNQhWJp_ImKrEx5j5KoC3aLIoed3lR43tJOMxyZV9slVUseNGo0wQFS4Cplw8ZIh76erw-CWxM3K6Sn9F8m71NncEMOP1h27IE1guwKnH7oQ Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0638463dadea48a0b7650229ad028a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0638463dadea48a0b7650229ad028a90"}]}] Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-LiveMigrationTest-2009906717 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-LiveMigrationTest-2009906717-project Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d8d1e6f3591a4c4ea97eadbd97954916 Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-LiveMigrationTest-2009906717-project Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 01318d40-8f22-4197-a911-5fb6b6c06a76 could not be found. Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '01318d40-8f22-4197-a911-5fb6b6c06a76'} Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01318d40-8f22-4197-a911-5fb6b6c06a76 could not be found. Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01318d40-8f22-4197-a911-5fb6b6c06a76 could not be found. Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:13:54.784483 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01318d40-8f22-4197-a911-5fb6b6c06a76 could not be found. Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Returning 404 to user: Instance 01318d40-8f22-4197-a911-5fb6b6c06a76 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-375b83f3-cdd4-4d66-b460-8cb7c979bd96 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76" status: 404 len: 111 microversion: 2.1 time: 0.094926 Jul 25 16:13:54.789427 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1079/2087] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:54 2022] GET /compute/v2.1/servers/01318d40-8f22-4197-a911-5fb6b6c06a76 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:13:54.803060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:54.806011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:54.823725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:54.829975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:54.831547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:54.846537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:55.076411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5819b97-cf26-4bd0-87fc-30985c452bd5 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1622 microversion: 2.1 time: 2.311790 Jul 25 16:13:55.081234 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1009/2088] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:52 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1622 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:55.113537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b804c285-832a-43c0-973d-caa3984dfdf5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93cff700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:55.223528 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b804c285-832a-43c0-973d-caa3984dfdf5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/17235ecd-bd5b-471d-8912-1ed46e929479" status: 200 len: 665 microversion: 2.1 time: 0.140803 Jul 25 16:13:55.224981 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1010/2089] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:13:55 2022] GET /compute/v2.1/images/17235ecd-bd5b-471d-8912-1ed46e929479 => generated 665 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:55.240253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:55.251787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:55.278859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:55.279305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:55.280207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:55.280686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:55.344185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:55.372081 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-98632459-36e7-4e61-9398-ca2c96f177fd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 0.581627 Jul 25 16:13:55.372861 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1080/2090] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:54 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:55.395380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ef02914-b482-45a5-939b-87d64c6832d7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '.version_select at 0x7f9d92ea8940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:55.493698 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ef02914-b482-45a5-939b-87d64c6832d7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344973232" status: 202 len: 0 microversion: 2.1 time: 0.111435 Jul 25 16:13:55.494701 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1081/2091] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:13:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344973232 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:13:55.508633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-87926247-ec3d-41df-b0d5-1b6cd6fc0dfc req-f08df1d0-c803-4292-a1e4-ed5ad78973a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9036b3fc-6e37-45ea-a17f-38fd52ae16e1", "name": "network-vif-deleted", "tag": "e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:55.555022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:55.556651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-87926247-ec3d-41df-b0d5-1b6cd6fc0dfc req-f08df1d0-c803-4292-a1e4-ed5ad78973a9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:55.557170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-87926247-ec3d-41df-b0d5-1b6cd6fc0dfc req-f08df1d0-c803-4292-a1e4-ed5ad78973a9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:55.572754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:55.595648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:55.603755 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-87926247-ec3d-41df-b0d5-1b6cd6fc0dfc req-f08df1d0-c803-4292-a1e4-ed5ad78973a9 service nova] Creating event network-vif-deleted:e4c966b1-64d0-4f15-9d2c-0aa11a3d2c9b for instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 on n-h1-846219-13 Jul 25 16:13:55.604006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6ebf8336-7270-48bd-aae7-9c8644c025bd tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1267 microversion: 2.25 time: 0.375438 Jul 25 16:13:55.604457 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1011/2092] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:55 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1267 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:55.624196 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-87926247-ec3d-41df-b0d5-1b6cd6fc0dfc req-f08df1d0-c803-4292-a1e4-ed5ad78973a9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127229 Jul 25 16:13:55.624879 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1082/2093] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:55.631689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1300ad0-0895-4d8c-b074-bb1e1ee84941 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: .version_select at 0x7f9da013b3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1913364393", "policies": ["affinity"]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:55.642499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c0d9e85-2a53-4f06-987e-82d17a708779 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92eb4b80>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:55.719056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b1300ad0-0895-4d8c-b074-bb1e1ee84941 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:55.748395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b1300ad0-0895-4d8c-b074-bb1e1ee84941 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:55.760406 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7c0d9e85-2a53-4f06-987e-82d17a708779 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/17235ecd-bd5b-471d-8912-1ed46e929479" status: 200 len: 665 microversion: 2.1 time: 0.131115 Jul 25 16:13:55.761020 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1083/2094] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:13:55 2022] GET /compute/v2.1/images/17235ecd-bd5b-471d-8912-1ed46e929479 => generated 665 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:55.773699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:55.774461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:55.800535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:55.801371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:55.804809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:55.812310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:55.887381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:55.977769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b1300ad0-0895-4d8c-b074-bb1e1ee84941 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:55.993945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b1300ad0-0895-4d8c-b074-bb1e1ee84941 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:56.081290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1300ad0-0895-4d8c-b074-bb1e1ee84941 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.465092 Jul 25 16:13:56.081290 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1012/2095] 10.222.0.105 () {60 vars in 1179 bytes} [Mon Jul 25 16:13:55 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:56.247931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-143081823", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:56.339295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:56.350191 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f685e91-b107-4661-b416-1d67984cb632 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.588010 Jul 25 16:13:56.380755 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1084/2096] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:55 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:56.406785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:56.407537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:56.428397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:13:56.460023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:56.460830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:56.461853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:56.463287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:57.711211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:57.727908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-041b863c-17c4-47a6-bae3-579f617028c2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 1.333745 Jul 25 16:13:57.737313 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1085/2097] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:56 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:13:57.756323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-798043244", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "aa5d2be4-9dee-4dde-a0a9-6268c6c98721"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:57.756661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:13:57.757395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:13:57.758243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:13:57.759289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:13:57.761196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:13:57.806479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:57.807174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:57.808357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:57.808996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:57.819701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:57.833137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Getting quotas for project 8c2edaf68e0742afbe3ce9fb84ad3bcd. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:57.841559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Getting quotas for user c1f25f3683f9450eb919f69ccbe24db7 and project 8c2edaf68e0742afbe3ce9fb84ad3bcd. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:57.861121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:13:57.864703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:13:57.904137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:13:57.955606 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f488c99f-0330-4fa8-b5d6-4e24e1c465aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.712714 Jul 25 16:13:57.956942 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1013/2098] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:13:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:13:57.977755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:57.979451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:58.002451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:58.002901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:58.011585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:58.012075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:58.231668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:58.250933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:58.256298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:58.262031 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c89a17b-3527-4fc3-9149-ff48c6864a07 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1267 microversion: 2.25 time: 0.303508 Jul 25 16:13:58.266185 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1014/2099] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:13:57 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:13:58.285515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:58.286707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:58.298562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:58.299009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:58.299866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:58.300412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:58.612237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:13:58.640613 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ab12625-0850-40c8-b81a-1337ae58e651 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1517 microversion: 2.1 time: 0.372275 Jul 25 16:13:58.655316 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1015/2100] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:13:58 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1517 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:13:58.660844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:58.673909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:13:58.694327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:58.698363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:58.699575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:58.700134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:58.782931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:13:59.011286 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cc45aa65-679f-47c2-a5a8-c612e331804b tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 204 len: 0 microversion: 2.1 time: 0.353925 Jul 25 16:13:59.013460 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1016/2101] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:13:58 2022] DELETE /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:13:59.025267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:13:59.025798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:13:59.026032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:13:59.026442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:13:59.026906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:13:59.029315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1599649738", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:13:59.128427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:13:59.164134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:59.174165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:59.176771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:59.182552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:59.218383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:59.241398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:59.281221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Going to run 2 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:13:59.284335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:13:59.349028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119599) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 25 16:13:59.401650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:59.415863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:59.556172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:59.567519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:59.593893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=69b11802-77ce-40cc-92ae-1cbb91bf4bfe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:13:59.719180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:59.729581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:59.739015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:13:59.739773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:13:59.740438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:13:59.741066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:13:59.741922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:13:59.760519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:59.764829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:59.770251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:59.771025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:59.830485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Getting quotas for project 8c2edaf68e0742afbe3ce9fb84ad3bcd. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:59.856501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Getting quotas for user c1f25f3683f9450eb919f69ccbe24db7 and project 8c2edaf68e0742afbe3ce9fb84ad3bcd. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:13:59.868345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:13:59.913742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:13:59.916807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:14:00.051669 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-318ff08e-b252-4906-810f-5d2b6a629967 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.036266 Jul 25 16:14:00.073565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1017/2102] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:13:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:14:00.081038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:00.095463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:00.122218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:00.122674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:00.123488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:00.123915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:00.433863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:00.513600 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a0dc5178-b831-45c2-aee0-49256fbc362a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.760965 Jul 25 16:14:00.521484 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1086/2103] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:13:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 2769 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:14:00.527383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:00.528444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:00.548126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:00.549405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:00.550216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:00.550656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:01.753466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:01.766596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e457976-8ec3-4fc4-ae4f-b964d2d7388a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 1.691655 Jul 25 16:14:01.769020 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1018/2104] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:00 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:01.783757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:01.786032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:01.803695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:01.804105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:01.807359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:01.808228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.002627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:02.026138 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ce7f957-6e54-4224-b733-dead4c06acd7 tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1487 microversion: 2.1 time: 1.502592 Jul 25 16:14:02.042699 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1087/2105] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:00 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1487 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:02.073944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:02.076405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:02.097429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:02.102288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.105766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:02.107298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.121891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:02.134857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:02.139203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:02.144644 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d211d8b-f8fe-4a43-b35a-ffacdfef20dc tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1267 microversion: 2.25 time: 0.372551 Jul 25 16:14:02.145703 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1019/2106] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:01 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1267 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:14:02.152583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:02.158071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:02.175137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:02.175974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.176977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:02.177654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.303734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:02.318228 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0a207671-18d4-42c6-971f-6292f7f4eb45 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1274 microversion: 2.1 time: 0.168214 Jul 25 16:14:02.320055 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1020/2107] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:02 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:02.330689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:02.343835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:02.351294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Searching by: {'deleted': False, 'project_id': 'b0327cf82312473da90dfaf13e95fcea'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:14:02.370411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:02.371811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.379570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:02.381219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:02.827326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:14:03.235561 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c26926ad-81fc-4e0e-af51-7fa863cf68ae tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 1007 microversion: 2.1 time: 0.912908 Jul 25 16:14:03.236927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1021/2108] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:14:02 2022] GET /compute/v2.1/servers => generated 1007 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:03.242295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:03.243183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:03.250798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:03.251565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:03.253412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:03.254051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:04.169900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:04.196250 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-626f54a5-88e8-4449-9e0f-7c70c62de4af tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1523 microversion: 2.1 time: 2.148435 Jul 25 16:14:04.219745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1088/2109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:02 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1523 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:04.240733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:04.243861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:04.270540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:04.271917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:04.277730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:04.281168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:04.359194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:04.398624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:04.414278 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-351f4958-45a5-4809-8e6e-792d7490e491 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 1.175872 Jul 25 16:14:04.415521 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1022/2110] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:03 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:04.424393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:04.429541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:04.448079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:04.450684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:04.451669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:04.456848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:04.818797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:04.831736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:04.841915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:04.847226 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-660385aa-70b5-486e-b7ac-00cb04e12931 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 200 len: 1267 microversion: 2.25 time: 0.430406 Jul 25 16:14:04.850637 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1023/2111] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:04 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 1267 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:14:04.862782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:04.867390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:04.885540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:04.887594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:04.890149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:04.893645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:05.378553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:05.390441 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11549953-4932-41aa-af7a-a9b52535aab7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1292 microversion: 2.1 time: 0.538155 Jul 25 16:14:05.407678 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1024/2112] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:04 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1292 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:05.414210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4e03b21a-1c3f-4c28-9d01-b60d9729647e req-98789e2c-2051-46de-b0f2-dfa218c91088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ebf36-2002-442e-9d5c-dcd8aa5e2c8b", "name": "network-vif-unplugged", "status": "completed", "tag": "9b72738c-d065-4ab6-af98-e844f9ab5ace"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:05.450525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4e03b21a-1c3f-4c28-9d01-b60d9729647e req-98789e2c-2051-46de-b0f2-dfa218c91088 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:05.452480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4e03b21a-1c3f-4c28-9d01-b60d9729647e req-98789e2c-2051-46de-b0f2-dfa218c91088 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:05.507653 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4e03b21a-1c3f-4c28-9d01-b60d9729647e req-98789e2c-2051-46de-b0f2-dfa218c91088 service nova] Creating event network-vif-unplugged:9b72738c-d065-4ab6-af98-e844f9ab5ace for instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b on n-h1-846219-13 Jul 25 16:14:05.525755 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4e03b21a-1c3f-4c28-9d01-b60d9729647e req-98789e2c-2051-46de-b0f2-dfa218c91088 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115983 Jul 25 16:14:05.532337 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1025/2113] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:05.543388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:05.546006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:05.559573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:05.563939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:05.565857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:05.568337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:05.624828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:05.649306 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f843711-b1c5-410e-ac70-d8bee25b52cc tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 200 len: 1487 microversion: 2.1 time: 1.427806 Jul 25 16:14:05.654060 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1089/2114] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:04 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 1487 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:05.677578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:05.679441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:05.716493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:05.726695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:05.728197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:05.730080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:06.373797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:06.393350 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6be9f2b0-bad5-4fb8-97bc-6590a5b57cda tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1280 microversion: 2.1 time: 0.858750 Jul 25 16:14:06.393972 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1026/2115] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:05 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1280 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:06.403113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:06.414062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:06.421695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:06.426465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:06.427598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:06.428325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:07.832299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:07.846557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e6f5128-d8fb-4bdf-9308-42251c8ccb86 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1523 microversion: 2.1 time: 2.186780 Jul 25 16:14:07.847469 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1090/2116] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:05 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1523 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:07.860894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:07.865228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 9036b3fc-6e37-45ea-a17f-38fd52ae16e1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:07.888859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:07.891384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:07.895437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:07.899159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:07.900590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:07.938259 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] HTTP exception thrown: Instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 could not be found. Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Request method failure captured: Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 HTTP/1.1 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9daNs3zEt_obbpF2048Puk4mazR4nsIqtJ04zgimqeGmyrPuuvjeh5WY07ori7ZrpMAJyhYjJQQ7kzfyjAMr-H9ebAqUjTESfReWudZQMNcFoXccWcmW7cRPaYADj-Tl331I_nPTCVFHS1QNAc32DCe_4lMf30vlB1nxnY_zt2HzE Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c2d3ce22679e4ac284a29ee1c6302ab8"}]}] Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f3a2bf8f94f44b78a80c37bc8b370726 Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 could not be found. Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '9036b3fc-6e37-45ea-a17f-38fd52ae16e1'} Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 could not be found. Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 could not be found. Jul 25 16:14:07.940137 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 could not be found. Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Returning 404 to user: Instance 9036b3fc-6e37-45ea-a17f-38fd52ae16e1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:07.945193 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5652772-2297-4241-9950-cc8209b8ef49 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1" status: 404 len: 111 microversion: 2.25 time: 0.093238 Jul 25 16:14:07.950557 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1091/2117] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:07 2022] GET /compute/v2.1/servers/9036b3fc-6e37-45ea-a17f-38fd52ae16e1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:14:07.983694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:07.991153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:08.021590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.023972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.026572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.027037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.075636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:08.084725 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ee3938e-5f94-47c2-94a0-2ea07f23b66b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 1.685941 Jul 25 16:14:08.089797 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1027/2118] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:06 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:08.123589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:08.124478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: 7ef093c5-a8cb-41da-8470-de3992e69eae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:08.142385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.148239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.149441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.157190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.206040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] HTTP exception thrown: Instance 7ef093c5-a8cb-41da-8470-de3992e69eae could not be found. Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Request method failure captured: Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae HTTP/1.1 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r8S6f_rikKSHNdrMJdejAwSxNqupZ6XWaVREUY7HTyciuKkEjXkGkh4STWJIo4WUwApNQhWJp_ImKrEx5j5KoC3aLIoed3lR43tJOMxyZV9slVUseNGo0wQFS4Cplw8ZIh76erw-CWxM3K6Sn9F8m71NncEMOP1h27IE1guwKnH7oQ Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0638463dadea48a0b7650229ad028a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0638463dadea48a0b7650229ad028a90"}]}] Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveMigrationTest-2009906717 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveMigrationTest-2009906717-project Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: d8d1e6f3591a4c4ea97eadbd97954916 Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveMigrationTest-2009906717-project Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 7ef093c5-a8cb-41da-8470-de3992e69eae could not be found. Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7ef093c5-a8cb-41da-8470-de3992e69eae'} Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef093c5-a8cb-41da-8470-de3992e69eae could not be found. Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef093c5-a8cb-41da-8470-de3992e69eae could not be found. Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:08.208223 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef093c5-a8cb-41da-8470-de3992e69eae could not be found. Jul 25 16:14:08.211850 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:08.215826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Returning 404 to user: Instance 7ef093c5-a8cb-41da-8470-de3992e69eae could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:08.218162 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6575b7d1-71c8-4523-b9d9-c4aec1e56c1d tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae" status: 404 len: 111 microversion: 2.1 time: 0.125915 Jul 25 16:14:08.226655 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1028/2119] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:08 2022] GET /compute/v2.1/servers/7ef093c5-a8cb-41da-8470-de3992e69eae => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:14:08.234867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-efcd14c5-df3f-4e98-ac24-27aa72df6b1d req-47ca73f4-c739-4383-81ef-51c265f48c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef093c5-a8cb-41da-8470-de3992e69eae", "name": "network-vif-deleted", "tag": "87c6104c-1dca-43c8-a238-cf56d2ce686e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:08.263831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-efcd14c5-df3f-4e98-ac24-27aa72df6b1d req-47ca73f4-c739-4383-81ef-51c265f48c06 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.264762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-efcd14c5-df3f-4e98-ac24-27aa72df6b1d req-47ca73f4-c739-4383-81ef-51c265f48c06 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.277431 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-efcd14c5-df3f-4e98-ac24-27aa72df6b1d req-47ca73f4-c739-4383-81ef-51c265f48c06 service nova] Creating event network-vif-deleted:87c6104c-1dca-43c8-a238-cf56d2ce686e for instance 7ef093c5-a8cb-41da-8470-de3992e69eae on n-h1-846219-13 Jul 25 16:14:08.284451 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-efcd14c5-df3f-4e98-ac24-27aa72df6b1d req-47ca73f4-c739-4383-81ef-51c265f48c06 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055737 Jul 25 16:14:08.285470 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1029/2120] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:08.297774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:08.298886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:08.314327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.322748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.330925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.331742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.430136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:08.440430 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-021dacec-1466-4112-82b5-2b2b4fab8c87 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1280 microversion: 2.1 time: 0.486437 Jul 25 16:14:08.444716 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1092/2121] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:07 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1280 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:08.466501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a14f1745-a453-458e-8c80-293595d0ae8c req-6fb1476c-a6b4-454b-aa6c-c3c4b7e4f0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ebf36-2002-442e-9d5c-dcd8aa5e2c8b", "name": "network-vif-plugged", "status": "completed", "tag": "9b72738c-d065-4ab6-af98-e844f9ab5ace"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:08.504331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a14f1745-a453-458e-8c80-293595d0ae8c req-6fb1476c-a6b4-454b-aa6c-c3c4b7e4f0b3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.511336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a14f1745-a453-458e-8c80-293595d0ae8c req-6fb1476c-a6b4-454b-aa6c-c3c4b7e4f0b3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.563042 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a14f1745-a453-458e-8c80-293595d0ae8c req-6fb1476c-a6b4-454b-aa6c-c3c4b7e4f0b3 service nova] Creating event network-vif-plugged:9b72738c-d065-4ab6-af98-e844f9ab5ace for instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b on n-h1-846219-13 Jul 25 16:14:08.573634 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a14f1745-a453-458e-8c80-293595d0ae8c req-6fb1476c-a6b4-454b-aa6c-c3c4b7e4f0b3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127087 Jul 25 16:14:08.576171 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1093/2122] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:08.583052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:08.584057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:08.593305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.594135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.595195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.596047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.653683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:08.657936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:14:08.691136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c79b709-c684-42cc-b990-725e49484df6 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1280 microversion: 2.1 time: 0.403058 Jul 25 16:14:08.695158 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1030/2123] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:08 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1280 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:08.891796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:08.892962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:08.941826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.942630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:08.944084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:08.951242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:09.032696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:09.091163 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b898d22a-c7c0-421f-bbe5-a1b721eb0ebf tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 204 len: 0 microversion: 2.1 time: 0.512570 Jul 25 16:14:09.098595 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1094/2124] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:14:08 2022] DELETE /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:14:09.126917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:09.132686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:09.168121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:09.171724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:09.173369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:09.189601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:09.206777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:09.883281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=20 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:10.341205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:10.359263 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8a000497-b5bf-437a-b361-69daadfe569e tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1504 microversion: 2.1 time: 1.256312 Jul 25 16:14:10.360708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1095/2125] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:09 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1504 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:10.374053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:10.378654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:10.397590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:10.398524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:10.399525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:10.400128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:10.453370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=22 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:10.686949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:10.722360 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-63bf9396-96b8-4caa-8fbe-0cff629f67e5 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1523 microversion: 2.1 time: 1.835175 Jul 25 16:14:10.726847 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1031/2126] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:08 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1523 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:10.739457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:10.740159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:10.760969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:10.763363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:10.767266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:10.767719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:11.044438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:11.072130 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5071ac41-8611-47ce-bc91-2a0ed34929ae tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 0.705633 Jul 25 16:14:11.083929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1096/2127] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:10 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:11.137688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:11.141348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:11.178022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:11.182423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:11.185166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:11.185166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:11.886182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:11.904079 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af48dc11-79b0-4da2-b157-c1151fb97835 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1280 microversion: 2.1 time: 0.818246 Jul 25 16:14:11.922468 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1097/2128] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:11 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1280 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:11.967545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6bb92ce4-4e1f-444b-903c-e4e8e9d4773c req-c2fd2ab5-9ba4-4989-a0a1-445cc443208c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "name": "network-vif-plugged", "status": "completed", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:11.981657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6bb92ce4-4e1f-444b-903c-e4e8e9d4773c req-c2fd2ab5-9ba4-4989-a0a1-445cc443208c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:11.982033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6bb92ce4-4e1f-444b-903c-e4e8e9d4773c req-c2fd2ab5-9ba4-4989-a0a1-445cc443208c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.007825 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6bb92ce4-4e1f-444b-903c-e4e8e9d4773c req-c2fd2ab5-9ba4-4989-a0a1-445cc443208c service nova] Creating event network-vif-plugged:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:14:12.030561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6bb92ce4-4e1f-444b-903c-e4e8e9d4773c req-c2fd2ab5-9ba4-4989-a0a1-445cc443208c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105363 Jul 25 16:14:12.031619 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1098/2129] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:12.466232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:12.501109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-bbd334b9-e857-4b3f-9cba-e61f36808285 req-984c546a-d338-48b2-9658-b517ffb5e10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10982b1-78ba-45a9-830f-6a54e6329bc5", "name": "network-vif-deleted", "tag": "02843094-4646-4668-a0b7-2e3e843957fd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:12.518046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b6f525b-0976-4d23-9b0f-da8d39ec6f7c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1322 microversion: 2.1 time: 1.789656 Jul 25 16:14:12.518761 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1032/2130] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:10 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1322 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:12.575930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bbd334b9-e857-4b3f-9cba-e61f36808285 req-984c546a-d338-48b2-9658-b517ffb5e10a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:12.581872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:12.583355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bbd334b9-e857-4b3f-9cba-e61f36808285 req-984c546a-d338-48b2-9658-b517ffb5e10a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.585934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:12.612538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:12.636140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:12.642914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.648909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:12.651009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.655298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-bbd334b9-e857-4b3f-9cba-e61f36808285 req-984c546a-d338-48b2-9658-b517ffb5e10a service nova] Creating event network-vif-deleted:02843094-4646-4668-a0b7-2e3e843957fd for instance b10982b1-78ba-45a9-830f-6a54e6329bc5 on n-h1-846219-13 Jul 25 16:14:12.682101 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-bbd334b9-e857-4b3f-9cba-e61f36808285 req-984c546a-d338-48b2-9658-b517ffb5e10a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.647658 Jul 25 16:14:12.686667 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1099/2131] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:12.710981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:12.711704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:12.732525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:12.732977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.741336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:12.746763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.799805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:12.801007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:12.802249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lazy-loading 'fault' on Instance uuid b10982b1-78ba-45a9-830f-6a54e6329bc5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:14:13.233195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8d1e6f3591a4c4ea97eadbd97954916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0638463dadea48a0b7650229ad028a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:13.251815 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a46e7a4d-bb43-4cae-ba20-66462810287c tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 200 len: 1305 microversion: 2.1 time: 0.719620 Jul 25 16:14:13.257853 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1033/2132] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:12 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 1305 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:13.274659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:13.275709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:13.291505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:13.297476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:13.299683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:13.309718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:13.785344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:13.798715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5265790f-0611-4b7a-b82d-2c093a6ee3ff tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1508 microversion: 2.1 time: 1.110101 Jul 25 16:14:13.800097 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1100/2133] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:12 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1508 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:13.808095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:13.809150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:13.818468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:13.819263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:13.820324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:13.829267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:14.647079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:14.666325 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4826fcae-cd7d-4c42-a87b-de9a58e58cf2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 1.406669 Jul 25 16:14:14.669338 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1034/2134] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:13 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:14.682964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:14.684058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:14.713699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:14.714159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:14.715000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:14.721349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:14.959634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:15.013651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e278931f-a0c0-4965-bf0c-c6857983a9aa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 1.210005 Jul 25 16:14:15.020406 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1101/2135] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:13 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:15.060522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:15.062338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:15.088519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:15.096769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:15.098494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:15.103368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:16.213412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:16.282870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa536415-1ddd-4e31-9789-1d3a25b286d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1322 microversion: 2.1 time: 1.601781 Jul 25 16:14:16.285697 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1035/2136] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:14 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1322 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:16.363792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:16.371690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] [instance: b10982b1-78ba-45a9-830f-6a54e6329bc5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:16.440145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:16.441245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:16.448179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:16.453755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:16.508171 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] HTTP exception thrown: Instance b10982b1-78ba-45a9-830f-6a54e6329bc5 could not be found. Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Request method failure captured: Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 HTTP/1.1 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r8S6f_rikKSHNdrMJdejAwSxNqupZ6XWaVREUY7HTyciuKkEjXkGkh4STWJIo4WUwApNQhWJp_ImKrEx5j5KoC3aLIoed3lR43tJOMxyZV9slVUseNGo0wQFS4Cplw8ZIh76erw-CWxM3K6Sn9F8m71NncEMOP1h27IE1guwKnH7oQ Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0638463dadea48a0b7650229ad028a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0638463dadea48a0b7650229ad028a90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0638463dadea48a0b7650229ad028a90"}]}] Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveMigrationTest-2009906717 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0638463dadea48a0b7650229ad028a90 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveMigrationTest-2009906717 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveMigrationTest-2009906717-project Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: d8d1e6f3591a4c4ea97eadbd97954916 Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveMigrationTest-2009906717-project Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b10982b1-78ba-45a9-830f-6a54e6329bc5 could not be found. Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b10982b1-78ba-45a9-830f-6a54e6329bc5'} Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10982b1-78ba-45a9-830f-6a54e6329bc5 could not be found. Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10982b1-78ba-45a9-830f-6a54e6329bc5 could not be found. Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:16.515725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10982b1-78ba-45a9-830f-6a54e6329bc5 could not be found. Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:16.519715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] Returning 404 to user: Instance b10982b1-78ba-45a9-830f-6a54e6329bc5 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:16.525886 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a606abf6-844f-4bfc-8bd8-0b7ef19b5cab tempest-LiveMigrationTest-2009906717 tempest-LiveMigrationTest-2009906717-project] 10.222.0.105 "GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5" status: 404 len: 111 microversion: 2.1 time: 0.215322 Jul 25 16:14:16.533138 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1036/2137] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:16 2022] GET /compute/v2.1/servers/b10982b1-78ba-45a9-830f-6a54e6329bc5 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:14:16.548847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:16.554373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:16.584652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:16.585485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:16.587303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:16.588153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:16.769162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:16.805790 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee593ae1-6743-4afb-8062-48b75838c599 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 200 len: 1508 microversion: 2.1 time: 1.782515 Jul 25 16:14:16.808845 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1102/2138] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:15 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 1508 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:16.840879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:16.847261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:16.888055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:16.896868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:16.911595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:16.912324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:18.908209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:18.920054 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f2b0ae4-a070-48e9-948f-85dcfd12e278 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1522 microversion: 2.1 time: 2.388692 Jul 25 16:14:18.920660 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1037/2139] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:16 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1522 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:18.949204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3237ecde-2e2e-49bf-9297-b745debaa82c req-92ab3aa8-8a6d-48db-94ad-8f7128533305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe35ce4d-d238-4af5-acf3-fc8cbda010d3", "tag": "5923fb76-d0dc-4e68-94e3-8cb451afd9b7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:18.982607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3237ecde-2e2e-49bf-9297-b745debaa82c req-92ab3aa8-8a6d-48db-94ad-8f7128533305 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:18.983663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3237ecde-2e2e-49bf-9297-b745debaa82c req-92ab3aa8-8a6d-48db-94ad-8f7128533305 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.021713 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3237ecde-2e2e-49bf-9297-b745debaa82c req-92ab3aa8-8a6d-48db-94ad-8f7128533305 service nova] Creating event network-changed:5923fb76-d0dc-4e68-94e3-8cb451afd9b7 for instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 on n-h2-846219-13 Jul 25 16:14:19.033810 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3237ecde-2e2e-49bf-9297-b745debaa82c req-92ab3aa8-8a6d-48db-94ad-8f7128533305 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091899 Jul 25 16:14:19.036361 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1038/2140] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:19.075663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:19.076703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:19.085437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:19.118719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.119289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.120112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.129570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.185413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:19.208429 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e927a374-ce86-4337-939b-a3115ea89ea5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 2.394325 Jul 25 16:14:19.213554 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1103/2141] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:16 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:19.232117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:19.232621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:19.252205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.252653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.253477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.253816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:14:19.254065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.327889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:14:19.521952 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2fdcf5d5-13ec-43ee-bbd1-53b6f0fc5501 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "DELETE /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 204 len: 0 microversion: 2.1 time: 0.306499 Jul 25 16:14:19.522982 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1104/2142] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:14:19 2022] DELETE /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:14:19.558596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:19.559932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:19.596648 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8aefff86-9ebd-4cc9-b4fd-29c8f61f0d8c tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 204 len: 0 microversion: 2.25 time: 0.557703 Jul 25 16:14:19.597458 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1039/2143] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:14:19 2022] DELETE /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:14:19.598833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.605667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.611801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:19.612504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.612828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:19.619672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.629779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.630264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.634494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:19.635588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:19.751868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:20.642177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:20.657205 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6a4d17dd-95da-4ce4-bc42-9d485548bd8a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1322 microversion: 2.1 time: 1.132358 Jul 25 16:14:20.658278 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1105/2144] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:19 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1322 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:20.890028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:20.922369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:20.927344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:20.932395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e50968a-9d8c-47c8-9acf-77519d6e64a0 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 200 len: 1734 microversion: 2.25 time: 1.328907 Jul 25 16:14:20.959236 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1040/2145] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:19 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 1734 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:14:20.981820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:20.984026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:21.001500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:21.005721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:21.011427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:21.019711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:21.190306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-845131065", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "cfec397e-5c56-457e-879b-fca60edceb31"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:21.362689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] validate_networks() for [('cfec397e-5c56-457e-879b-fca60edceb31', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:14:22.103914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:22.117773 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2dcac7f-01d6-4f31-9fc5-393cc5dd8176 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.156828 Jul 25 16:14:22.118373 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1041/2146] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:20 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:22.136148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1781932063", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "5158bc42-bdb3-4b68-8404-8ff835ac0788"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:22.377573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] validate_networks() for [('5158bc42-bdb3-4b68-8404-8ff835ac0788', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:14:25.629527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:14:25.631909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:14:25.632567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:14:25.633189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:14:25.634033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:14:25.666928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:25.669676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:25.671189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:25.674074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:25.730091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Getting quotas for project 63671a9868644882990d6f938fffc223. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:25.762498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Getting quotas for user a1adfb100c9b4f81a18e24dbde96d6c0 and project 63671a9868644882990d6f938fffc223. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:25.815928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Going to run 2 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:14:25.827011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:14:25.883937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6f0c7066-0117-4b28-af0c-455061cf0e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=6717f831-c4a9-4446-ad80-c006d25fdc06,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:14:26.028930 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-76a6e489-364e-4e0a-b01f-9be1dcf8bc69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.369386 Jul 25 16:14:26.031210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1106/2147] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:14:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 5372 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:14:26.049030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:26.052362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:26.070477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.071266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.074472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.075552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.493551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:14:26.494335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:14:26.498204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:14:26.498204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:14:26.498204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:14:26.529767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.531902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.535569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.536362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.576192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Getting quotas for project 39dd18d28d79468a8ebb393017af7979. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:26.603595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Getting quotas for user a4a4683dfce541c8acff65c7c09e5372 and project 39dd18d28d79468a8ebb393017af7979. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:26.641264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:14:26.651825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:14:26.737957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:26.740485 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6d920c6-c3c9-4437-b401-7e7b2617c42e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.615613 Jul 25 16:14:26.743011 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1042/2148] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:14:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 4619 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:14:26.754328 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12c37b5d-c7f8-4bbf-92d5-7a5951ca3657 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 0.721436 Jul 25 16:14:26.755097 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1107/2149] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:26 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:26.756590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4e7eb3f5-d220-493e-bb88-cbf6e51d3f21 req-1f793671-ab93-4c1c-9676-cb4fb832e313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b95ec35-12ff-46c5-aceb-8daf24ae63b7", "tag": "ce4676ac-b993-4041-85d8-5a309a5e5f56"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:26.776840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4e7eb3f5-d220-493e-bb88-cbf6e51d3f21 req-1f793671-ab93-4c1c-9676-cb4fb832e313 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.777556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4e7eb3f5-d220-493e-bb88-cbf6e51d3f21 req-1f793671-ab93-4c1c-9676-cb4fb832e313 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.794167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c687d268-0ceb-46a1-8964-810547aaea04 req-3fb46486-4fe9-46cb-a2c7-15e16e529086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b11802-77ce-40cc-92ae-1cbb91bf4bfe", "tag": "6e5da7e1-d468-424a-aeea-f74a89e72067"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:26.821263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c687d268-0ceb-46a1-8964-810547aaea04 req-3fb46486-4fe9-46cb-a2c7-15e16e529086 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.821689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c687d268-0ceb-46a1-8964-810547aaea04 req-3fb46486-4fe9-46cb-a2c7-15e16e529086 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.824068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4e7eb3f5-d220-493e-bb88-cbf6e51d3f21 req-1f793671-ab93-4c1c-9676-cb4fb832e313 service nova] Creating event network-changed:ce4676ac-b993-4041-85d8-5a309a5e5f56 for instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 on n-h2-846219-13 Jul 25 16:14:26.840601 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4e7eb3f5-d220-493e-bb88-cbf6e51d3f21 req-1f793671-ab93-4c1c-9676-cb4fb832e313 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092419 Jul 25 16:14:26.842652 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1043/2150] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:26.845751 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c687d268-0ceb-46a1-8964-810547aaea04 req-3fb46486-4fe9-46cb-a2c7-15e16e529086 service nova] Creating event network-changed:6e5da7e1-d468-424a-aeea-f74a89e72067 for instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe on n-h2-846219-13 Jul 25 16:14:26.850115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:26.851296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:26.867698 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c687d268-0ceb-46a1-8964-810547aaea04 req-3fb46486-4fe9-46cb-a2c7-15e16e529086 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098095 Jul 25 16:14:26.869930 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1108/2151] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:26.871638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.874415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.875540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.878281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.892126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:26.896553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: c89f1679-8eed-4efc-b90b-9de768bb23d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:26.931518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.935283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:26.938942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:26.939586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.018299 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] HTTP exception thrown: Instance c89f1679-8eed-4efc-b90b-9de768bb23d3 could not be found. Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Request method failure captured: Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 HTTP/1.1 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3r9daNs3zEt_obbpF2048Puk4mazR4nsIqtJ04zgimqeGmyrPuuvjeh5WY07ori7ZrpMAJyhYjJQQ7kzfyjAMr-H9ebAqUjTESfReWudZQMNcFoXccWcmW7cRPaYADj-Tl331I_nPTCVFHS1QNAc32DCe_4lMf30vlB1nxnY_zt2HzE Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c2d3ce22679e4ac284a29ee1c6302ab8"}]}] Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f3a2bf8f94f44b78a80c37bc8b370726 Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance c89f1679-8eed-4efc-b90b-9de768bb23d3 could not be found. Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'c89f1679-8eed-4efc-b90b-9de768bb23d3'} Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c89f1679-8eed-4efc-b90b-9de768bb23d3 could not be found. Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c89f1679-8eed-4efc-b90b-9de768bb23d3 could not be found. Jul 25 16:14:27.022475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c89f1679-8eed-4efc-b90b-9de768bb23d3 could not be found. Jul 25 16:14:27.027663 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:27.034002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Returning 404 to user: Instance c89f1679-8eed-4efc-b90b-9de768bb23d3 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:27.037428 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4d4a04a9-c05d-45fc-8fd3-c16fbe71a661 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3" status: 404 len: 111 microversion: 2.25 time: 0.161181 Jul 25 16:14:27.041705 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1109/2152] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:26 2022] GET /compute/v2.1/servers/c89f1679-8eed-4efc-b90b-9de768bb23d3 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:14:27.052657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:27.054895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:27.085522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.086773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.087946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.089387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.846163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:27.855065 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-325b2fed-697d-4919-be29-c7b062c3c27a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1322 microversion: 2.1 time: 1.010682 Jul 25 16:14:27.858388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:27.859695 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1044/2153] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:26 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1322 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:27.878034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-35aa2c20-12b1-461a-9807-986b6d16709f req-c29c809c-5d7c-4271-b1c6-609711005047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe35ce4d-d238-4af5-acf3-fc8cbda010d3", "name": "network-vif-plugged", "status": "completed", "tag": "5923fb76-d0dc-4e68-94e3-8cb451afd9b7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:27.881466 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1963ad4b-5cc4-4d73-b03a-58e299fa312b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.838253 Jul 25 16:14:27.882358 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1110/2154] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:27 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:27.888212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:27.893772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-35aa2c20-12b1-461a-9807-986b6d16709f req-c29c809c-5d7c-4271-b1c6-609711005047 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.902799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-35aa2c20-12b1-461a-9807-986b6d16709f req-c29c809c-5d7c-4271-b1c6-609711005047 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.906528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:27.909768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Searching by: {'deleted': False, 'project_id': '63671a9868644882990d6f938fffc223'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:14:27.920477 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-35aa2c20-12b1-461a-9807-986b6d16709f req-c29c809c-5d7c-4271-b1c6-609711005047 service nova] Creating event network-vif-plugged:5923fb76-d0dc-4e68-94e3-8cb451afd9b7 for instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 on n-h2-846219-13 Jul 25 16:14:27.927690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.929745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.933123 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-35aa2c20-12b1-461a-9807-986b6d16709f req-c29c809c-5d7c-4271-b1c6-609711005047 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071107 Jul 25 16:14:27.933829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.933970 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1045/2155] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:27.934752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.946050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:27.946789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:27.958995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.959923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.960765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:27.961441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:27.971694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:14:28.020652 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99f2e1d1-44f7-489c-a100-82d52f3420d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 679 microversion: 2.1 time: 0.135749 Jul 25 16:14:28.022023 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1111/2156] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:14:27 2022] GET /compute/v2.1/servers => generated 679 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:28.027525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25e88bc0-89f8-4e10-8a3d-bad046dacf88 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '.version_select at 0x7f9da494cf70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.055039 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25e88bc0-89f8-4e10-8a3d-bad046dacf88 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341799139" status: 204 len: 0 microversion: 2.25 time: 0.031399 Jul 25 16:14:28.057230 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1112/2157] 10.222.0.105 () {60 vars in 1264 bytes} [Mon Jul 25 16:14:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341799139 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:14:28.067520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.068507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:28.076658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.077499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.078534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.079150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.214941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:28.223421 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5107feb3-e768-4d0c-b322-4a305af740ca tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1218 microversion: 2.1 time: 0.284710 Jul 25 16:14:28.224024 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1046/2158] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:27 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:28.228911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.229608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:28.236053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.236507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.237303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.237892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.450335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:28.460265 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7801eaaa-4abf-4206-bbfb-e6cf902c11d1 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 0.401538 Jul 25 16:14:28.461798 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1113/2159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:28 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:28.466802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.467666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:28.474329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.475115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.476130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.476725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.497297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:28.505768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fbcc2434-0ce9-48f7-8ac6-2584ef664e30 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.280480 Jul 25 16:14:28.518270 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1047/2160] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:28 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:28.528905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c54962b8-6c04-4c7c-a86d-e9f1afcc2307 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:28.535227 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c54962b8-6c04-4c7c-a86d-e9f1afcc2307 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance c858a3ae-0268-410a-8c24-7651bff7887a has no mapping to a cell. Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c54962b8-6c04-4c7c-a86d-e9f1afcc2307 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/c858a3ae-0268-410a-8c24-7651bff7887a/action HTTP/1.1 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 15 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: {"os-stop": {}} Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance c858a3ae-0268-410a-8c24-7651bff7887a has no mapping to a cell. Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'c858a3ae-0268-410a-8c24-7651bff7887a', 'body': {'os-stop': {}}} Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance c858a3ae-0268-410a-8c24-7651bff7887a has no mapping to a cell. Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 25 16:14:28.550530 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c858a3ae-0268-410a-8c24-7651bff7887a has no mapping to a cell. Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c858a3ae-0268-410a-8c24-7651bff7887a has no mapping to a cell. Jul 25 16:14:28.554904 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:28.558049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c54962b8-6c04-4c7c-a86d-e9f1afcc2307 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance c858a3ae-0268-410a-8c24-7651bff7887a has no mapping to a cell. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:28.559338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c54962b8-6c04-4c7c-a86d-e9f1afcc2307 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/c858a3ae-0268-410a-8c24-7651bff7887a/action" status: 404 len: 117 microversion: 2.1 time: 0.035076 Jul 25 16:14:28.560989 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1048/2161] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:28 2022] POST /compute/v2.1/servers/c858a3ae-0268-410a-8c24-7651bff7887a/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:14:28.571929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.573203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:28.584127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.584818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.585847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.586512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.586932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:28.596575 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc53e3ea-7fd6-4874-b745-e506ceceb1dd tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1275 microversion: 2.1 time: 0.133448 Jul 25 16:14:28.597412 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1114/2162] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:28 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:28.791738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:28.800344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d997ece8-f434-44a8-a170-38aa382ea40a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.234711 Jul 25 16:14:28.801339 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1049/2163] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:28 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:28.874071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.894913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:28.897790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:28.898309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:28.929391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.929850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.932296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.933240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.935378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.936354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:28.956781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:28.963430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:29.080025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:30.208216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:30.219977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:30.220976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83e10acb-ed92-4023-b553-6c47ccfbca37 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1322 microversion: 2.1 time: 1.336550 Jul 25 16:14:30.221277 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1050/2164] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:28 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1322 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:30.230714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2000b416-6f3f-48e0-b693-c79405a55cf1 req-b0127699-d2ce-42d0-ae18-2a4b7a6d423d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89f1679-8eed-4efc-b90b-9de768bb23d3", "name": "network-vif-deleted", "tag": "b5dbd428-0252-4b8c-a31c-0a77d93fe561"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:30.236314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e7a6828-a996-46a3-9ef2-b06fd6830e8b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.412948 Jul 25 16:14:30.236314 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1115/2165] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:28 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:30.242994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2352f8a8-153e-46a7-92f0-05c050b16135 req-869028a9-56f9-43af-bebd-f4455bc2999f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}, {"server_uuid": "343ebf36-2002-442e-9d5c-dcd8aa5e2c8b", "name": "network-vif-deleted", "tag": "9b72738c-d065-4ab6-af98-e844f9ab5ace"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:30.261035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2000b416-6f3f-48e0-b693-c79405a55cf1 req-b0127699-d2ce-42d0-ae18-2a4b7a6d423d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.262190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2000b416-6f3f-48e0-b693-c79405a55cf1 req-b0127699-d2ce-42d0-ae18-2a4b7a6d423d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.272126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2352f8a8-153e-46a7-92f0-05c050b16135 req-869028a9-56f9-43af-bebd-f4455bc2999f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.272850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2352f8a8-153e-46a7-92f0-05c050b16135 req-869028a9-56f9-43af-bebd-f4455bc2999f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.283732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2000b416-6f3f-48e0-b693-c79405a55cf1 req-b0127699-d2ce-42d0-ae18-2a4b7a6d423d service nova] Creating event network-vif-deleted:b5dbd428-0252-4b8c-a31c-0a77d93fe561 for instance c89f1679-8eed-4efc-b90b-9de768bb23d3 on n-h1-846219-13 Jul 25 16:14:30.292573 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2000b416-6f3f-48e0-b693-c79405a55cf1 req-b0127699-d2ce-42d0-ae18-2a4b7a6d423d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067764 Jul 25 16:14:30.294378 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1051/2166] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:30.300488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2352f8a8-153e-46a7-92f0-05c050b16135 req-869028a9-56f9-43af-bebd-f4455bc2999f service nova] Creating event network-changed:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:14:30.302499 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2352f8a8-153e-46a7-92f0-05c050b16135 req-869028a9-56f9-43af-bebd-f4455bc2999f service nova] Creating event network-vif-deleted:9b72738c-d065-4ab6-af98-e844f9ab5ace for instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b on n-h1-846219-13 Jul 25 16:14:30.302952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:30.303831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:30.314484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.316669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.317823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.318984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.319565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2352f8a8-153e-46a7-92f0-05c050b16135 req-869028a9-56f9-43af-bebd-f4455bc2999f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084940 Jul 25 16:14:30.320949 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1116/2167] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:30.329166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:30.329954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:30.344024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.344860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.346384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.347185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.500924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:30.512807 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-644015c3-f22b-471e-b1fc-da4b04bbc79a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1280 microversion: 2.1 time: 0.216275 Jul 25 16:14:30.514869 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1052/2168] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:30 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:30.522431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:30.524799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:30.541116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.541917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.543417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:30.544486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:30.954734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:30.972411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-90091473-2d49-4698-86bf-b5cec2d288a3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1281 microversion: 2.1 time: 0.455894 Jul 25 16:14:30.977632 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1053/2169] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:30 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1281 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:30.983780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:30.984303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:31.020849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.020849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:31.025227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.026200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:31.375545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:31.386020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a8cfd260-7492-4dd0-ab93-6a5f88656989 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 1.062749 Jul 25 16:14:31.390184 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1117/2170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:30 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:31.398267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-21cdac78-baba-434c-83cf-9e6b1c6b05a0 req-92e903dc-c8da-498d-8917-4de0e342b8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b11802-77ce-40cc-92ae-1cbb91bf4bfe", "name": "network-vif-plugged", "status": "completed", "tag": "6e5da7e1-d468-424a-aeea-f74a89e72067"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:31.419191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-21cdac78-baba-434c-83cf-9e6b1c6b05a0 req-92e903dc-c8da-498d-8917-4de0e342b8b8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.419911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-21cdac78-baba-434c-83cf-9e6b1c6b05a0 req-92e903dc-c8da-498d-8917-4de0e342b8b8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:31.434100 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-21cdac78-baba-434c-83cf-9e6b1c6b05a0 req-92e903dc-c8da-498d-8917-4de0e342b8b8 service nova] Creating event network-vif-plugged:6e5da7e1-d468-424a-aeea-f74a89e72067 for instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe on n-h2-846219-13 Jul 25 16:14:31.440721 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-21cdac78-baba-434c-83cf-9e6b1c6b05a0 req-92e903dc-c8da-498d-8917-4de0e342b8b8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046288 Jul 25 16:14:31.442202 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1118/2171] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:31.450051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37ded151-a3ec-4ec3-931a-c8e3dfa9497a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:31.451059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-37ded151-a3ec-4ec3-931a-c8e3dfa9497a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:31.459259 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-37ded151-a3ec-4ec3-931a-c8e3dfa9497a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9 could not be found. Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37ded151-a3ec-4ec3-931a-c8e3dfa9497a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/6cd6ccfd-0b26-4618-86ec-3d7adc282fa9/action HTTP/1.1 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 15 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: {"suspend": {}} Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9 could not be found. Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '6cd6ccfd-0b26-4618-86ec-3d7adc282fa9', 'body': {'suspend': {}}} Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9 could not be found. Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9 could not be found. Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:31.461422 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:31.465301 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:31.465301 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:31.465301 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9 could not be found. Jul 25 16:14:31.465301 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:31.467813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37ded151-a3ec-4ec3-931a-c8e3dfa9497a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 6cd6ccfd-0b26-4618-86ec-3d7adc282fa9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:31.468922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37ded151-a3ec-4ec3-931a-c8e3dfa9497a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/6cd6ccfd-0b26-4618-86ec-3d7adc282fa9/action" status: 404 len: 111 microversion: 2.1 time: 0.025254 Jul 25 16:14:31.473406 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1119/2172] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:31 2022] POST /compute/v2.1/servers/6cd6ccfd-0b26-4618-86ec-3d7adc282fa9/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:14:31.479129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:31.479931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:31.487912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.488598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:31.489524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.490033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:31.627649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:14:31.815551 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-703343ce-609b-43fe-bd78-ed585acf58f8 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 204 len: 0 microversion: 2.25 time: 0.835064 Jul 25 16:14:31.817459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1054/2173] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:14:30 2022] DELETE /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:14:31.829384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:31.832947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:31.848599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.855410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:31.856331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:31.858341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:32.770690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:32.786987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b6118ff-fe81-43d7-a236-cb8904aad968 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1322 microversion: 2.1 time: 1.312040 Jul 25 16:14:32.795368 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1120/2174] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:31 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1322 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:32.816172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:32.817329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:32.824846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:32.825335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:32.826453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:32.826930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:33.078007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:33.094799 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67a1c5ac-4055-45be-9d5b-8c12ce5fbe61 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.275387 Jul 25 16:14:33.096288 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1055/2175] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:31 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:33.101807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:33.103010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:33.112343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:33.113592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:33.115987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:33.117072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:33.961018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:33.972042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:33.982972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:33.985810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7ba8950-f5eb-4195-8c27-bce7398632aa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1322 microversion: 2.1 time: 1.178715 Jul 25 16:14:33.986590 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1121/2176] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:32 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1322 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:33.989437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:33.995405 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3305e194-82a0-42fc-8f4b-6ae799db08ec tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1551 microversion: 2.25 time: 0.897803 Jul 25 16:14:34.009931 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1056/2177] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:33 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1551 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:14:34.015352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:34.030296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:34.035426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:34.050965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:34.058877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:34.065781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:34.076372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:34.077741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:34.080018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:34.081045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:34.081954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:34.082401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:35.794669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:35.806694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:35.826886 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38cb2406-51e1-4466-8cc0-6a2ac55cf79e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 1.815324 Jul 25 16:14:35.829587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1057/2178] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:34 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:35.851108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:35.857717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:35.876460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:35.878369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:35.879996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:35.880664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:35.918332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:35.968320 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2294f34-2e55-45e0-b407-61592afd55e3 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 1.980393 Jul 25 16:14:35.998056 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1122/2179] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:33 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:36.020082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:36.022316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:36.049142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:36.049594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:36.054498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:36.054927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:36.564700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:36.632774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:36.936458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:36.956508 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ad07183-21cd-4c4a-bc29-bf9ea145226f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1471 microversion: 2.1 time: 0.954718 Jul 25 16:14:36.961123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1123/2180] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:35 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1471 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:36.973582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ba2d20aa-aff2-4a30-bd1f-3140fed8b9fc req-fc18866c-19db-47b5-bf6b-aacfbb9e16e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b95ec35-12ff-46c5-aceb-8daf24ae63b7", "name": "network-vif-plugged", "status": "completed", "tag": "ce4676ac-b993-4041-85d8-5a309a5e5f56"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:36.996747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ba2d20aa-aff2-4a30-bd1f-3140fed8b9fc req-fc18866c-19db-47b5-bf6b-aacfbb9e16e1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:36.996948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ba2d20aa-aff2-4a30-bd1f-3140fed8b9fc req-fc18866c-19db-47b5-bf6b-aacfbb9e16e1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.013688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:37.020597 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ba2d20aa-aff2-4a30-bd1f-3140fed8b9fc req-fc18866c-19db-47b5-bf6b-aacfbb9e16e1 service nova] Creating event network-vif-plugged:ce4676ac-b993-4041-85d8-5a309a5e5f56 for instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 on n-h2-846219-13 Jul 25 16:14:37.027975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5e4c696-48c9-48c2-9072-9968f8d9ba8d tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.184040 Jul 25 16:14:37.028847 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1058/2181] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:35 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:37.030932 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ba2d20aa-aff2-4a30-bd1f-3140fed8b9fc req-fc18866c-19db-47b5-bf6b-aacfbb9e16e1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065365 Jul 25 16:14:37.043946 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1124/2182] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:37.048829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:37.049495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:37.050949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:37.053064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:37.068384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:37.070676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.071569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.072726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.073748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.075223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.075788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.076988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.077383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.163531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.163997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.164540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lazy-loading 'fault' on Instance uuid 7892f287-45bd-4633-8dfa-f97af06d18ef {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:14:37.632006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:37.642853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:37.646533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:37.648635 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de9d9d37-7c7b-44b5-b65e-00a0bc199505 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 200 len: 1355 microversion: 2.25 time: 0.602901 Jul 25 16:14:37.649848 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1125/2183] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:37 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 1355 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:14:37.658443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7d94d98b-aeee-4a8a-8294-f004ec72e2ed req-2cd62847-d998-44e6-95ea-db269e03e712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c93153b-4dba-4766-817d-2d48cbe83d73", "tag": "61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:37.698399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7d94d98b-aeee-4a8a-8294-f004ec72e2ed req-2cd62847-d998-44e6-95ea-db269e03e712 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.699735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7d94d98b-aeee-4a8a-8294-f004ec72e2ed req-2cd62847-d998-44e6-95ea-db269e03e712 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.722941 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7d94d98b-aeee-4a8a-8294-f004ec72e2ed req-2cd62847-d998-44e6-95ea-db269e03e712 service nova] Creating event network-changed:61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00 for instance 8c93153b-4dba-4766-817d-2d48cbe83d73 on n-h1-846219-13 Jul 25 16:14:37.734546 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7d94d98b-aeee-4a8a-8294-f004ec72e2ed req-2cd62847-d998-44e6-95ea-db269e03e712 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082302 Jul 25 16:14:37.736188 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1126/2184] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:37.746414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2b8f46d5-b491-4dfb-bba1-a2bc6146086f req-556d17df-72dd-4393-a017-d55198f5641f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892f287-45bd-4633-8dfa-f97af06d18ef", "name": "network-vif-deleted", "tag": "3e8b5a7f-edcb-4942-a38e-1daba14ba065"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:37.764974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2b8f46d5-b491-4dfb-bba1-a2bc6146086f req-556d17df-72dd-4393-a017-d55198f5641f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.766429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2b8f46d5-b491-4dfb-bba1-a2bc6146086f req-556d17df-72dd-4393-a017-d55198f5641f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.793667 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2b8f46d5-b491-4dfb-bba1-a2bc6146086f req-556d17df-72dd-4393-a017-d55198f5641f service nova] Creating event network-vif-deleted:3e8b5a7f-edcb-4942-a38e-1daba14ba065 for instance 7892f287-45bd-4633-8dfa-f97af06d18ef on n-h1-846219-13 Jul 25 16:14:37.802837 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2b8f46d5-b491-4dfb-bba1-a2bc6146086f req-556d17df-72dd-4393-a017-d55198f5641f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063904 Jul 25 16:14:37.804362 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1127/2185] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:37.814364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:37.815566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:37.829985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.832420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.834372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.835557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.862801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:37.895581 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd5b1e48-5678-4a3d-bc73-ddcaffa377b0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1322 microversion: 2.1 time: 0.850728 Jul 25 16:14:37.899226 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1059/2186] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:37 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:37.916373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:37.917064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:37.925144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.925566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.943652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:37.944507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:37.950678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:38.448080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:38.457217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:38.467922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8fd2ea84-3685-4606-aad4-7cd23050318a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1322 microversion: 2.1 time: 0.659518 Jul 25 16:14:38.468927 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1128/2187] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:37 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1322 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:38.489940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:38.498702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:38.504830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.505165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.506069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.506687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.640971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:38.656261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e14b19f2-d571-4a2d-a2b2-a2c24bcf4345 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 200 len: 1470 microversion: 2.1 time: 0.755483 Jul 25 16:14:38.656876 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1060/2188] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:37 2022] GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 1470 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:38.664236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:38.671147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:38.683104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.683698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.685259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.686191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.722712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lazy-loading 'flavor' on Instance uuid 014fd993-5b27-49d3-a044-1a252cc437a8 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:14:38.863596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:38.886600 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4a316170-ba62-433e-94f0-3a14b6ffaf1b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 202 len: 0 microversion: 2.1 time: 0.227903 Jul 25 16:14:38.886889 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dfb51dfd-37ba-4b15-b3a0-a219af64e087 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.416300 Jul 25 16:14:38.887792 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1129/2189] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:38 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:38.891944 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1061/2190] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:38 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:14:38.925147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:38.932381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:38.939220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: 7892f287-45bd-4633-8dfa-f97af06d18ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:38.949481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:38.952814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Searching by: {'reservation_id': 'r-0wvomh6x', 'deleted': False, 'project_id': 'b0327cf82312473da90dfaf13e95fcea'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:14:38.963462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.964440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.968763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.970027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.970610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.972893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:38.976109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:38.986331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.000811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] HTTP exception thrown: Instance 7892f287-45bd-4633-8dfa-f97af06d18ef could not be found. Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Request method failure captured: Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef HTTP/1.1 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9daNs3zEt_obbpF2048Puk4mazR4nsIqtJ04zgimqeGmyrPuuvjeh5WY07ori7ZrpMAJyhYjJQQ7kzfyjAMr-H9ebAqUjTESfReWudZQMNcFoXccWcmW7cRPaYADj-Tl331I_nPTCVFHS1QNAc32DCe_4lMf30vlB1nxnY_zt2HzE Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c2d3ce22679e4ac284a29ee1c6302ab8"}]}] Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f3a2bf8f94f44b78a80c37bc8b370726 Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 7892f287-45bd-4633-8dfa-f97af06d18ef could not be found. Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7892f287-45bd-4633-8dfa-f97af06d18ef'} Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7892f287-45bd-4633-8dfa-f97af06d18ef could not be found. Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7892f287-45bd-4633-8dfa-f97af06d18ef could not be found. Jul 25 16:14:39.003227 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7892f287-45bd-4633-8dfa-f97af06d18ef could not be found. Jul 25 16:14:39.007564 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:39.024178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Returning 404 to user: Instance 7892f287-45bd-4633-8dfa-f97af06d18ef could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:39.026854 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35ac918e-90ae-477a-a1a7-5a529986b635 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef" status: 404 len: 111 microversion: 2.25 time: 0.132908 Jul 25 16:14:39.029064 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1062/2191] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:38 2022] GET /compute/v2.1/servers/7892f287-45bd-4633-8dfa-f97af06d18ef => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:14:39.038837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:39.039722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:39.062059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.063628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.065738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.066447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.319709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:14:39.452828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:39.460983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.461459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.474666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:39.508688 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-01cf5f60-d676-49b3-bd7a-b5fb4806fb7f tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1517 microversion: 2.1 time: 0.464736 Jul 25 16:14:39.511285 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1063/2192] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:39 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1517 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:39.523249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:39.524262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:39.532609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.533326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.534334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.534929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.865396 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dbc91023-14d8-488e-b7f9-fdd62571a069 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/detail?reservation_id=r-0wvomh6x" status: 200 len: 2934 microversion: 2.1 time: 0.975612 Jul 25 16:14:39.881160 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1130/2193] 10.222.0.105 () {58 vars in 1202 bytes} [Mon Jul 25 16:14:38 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0wvomh6x => generated 2934 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:39.894813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:39.895834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:39.906245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.907053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.908584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.909333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.939303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:39.943883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:39.960197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:14:39.962181 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4571972-0a38-4bcc-ab20-050ea97f18ef tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1322 microversion: 2.1 time: 0.448702 Jul 25 16:14:39.963587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1064/2194] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:39 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:39.969496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-520ea40d-059d-4fd3-b381-1c753c89910e req-7d1dc600-4322-44a0-8cab-3476b30f0334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "name": "network-vif-plugged", "status": "completed", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:39.980796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-520ea40d-059d-4fd3-b381-1c753c89910e req-7d1dc600-4322-44a0-8cab-3476b30f0334 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:39.981620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-520ea40d-059d-4fd3-b381-1c753c89910e req-7d1dc600-4322-44a0-8cab-3476b30f0334 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:39.998997 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-520ea40d-059d-4fd3-b381-1c753c89910e req-7d1dc600-4322-44a0-8cab-3476b30f0334 service nova] Creating event network-vif-plugged:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:14:40.011775 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-520ea40d-059d-4fd3-b381-1c753c89910e req-7d1dc600-4322-44a0-8cab-3476b30f0334 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046642 Jul 25 16:14:40.013007 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1065/2195] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:40.019008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:40.022209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:40.031535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.035066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.036646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.037647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.126557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-630b1dce-c862-41b1-8d1a-1e3ca61cb354 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 204 len: 0 microversion: 2.25 time: 0.245638 Jul 25 16:14:40.127692 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1131/2196] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:14:39 2022] DELETE /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:14:40.134733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-25c42f6b-9811-4272-8f7e-91e334c74961 req-b38fc5a4-8206-4eb8-93a3-e5b83dd979a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6717f831-c4a9-4446-ad80-c006d25fdc06", "tag": "7a394690-f839-4843-9042-168f5d7f93fa"}, {"name": "network-changed", "server_uuid": "6f0c7066-0117-4b28-af0c-455061cf0e1c", "tag": "8cfb65c1-2848-4a74-811d-353426267917"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:40.155845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-25c42f6b-9811-4272-8f7e-91e334c74961 req-b38fc5a4-8206-4eb8-93a3-e5b83dd979a5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.156710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-25c42f6b-9811-4272-8f7e-91e334c74961 req-b38fc5a4-8206-4eb8-93a3-e5b83dd979a5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.173168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-25c42f6b-9811-4272-8f7e-91e334c74961 req-b38fc5a4-8206-4eb8-93a3-e5b83dd979a5 service nova] Creating event network-changed:7a394690-f839-4843-9042-168f5d7f93fa for instance 6717f831-c4a9-4446-ad80-c006d25fdc06 on n-h1-846219-13 Jul 25 16:14:40.173988 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-25c42f6b-9811-4272-8f7e-91e334c74961 req-b38fc5a4-8206-4eb8-93a3-e5b83dd979a5 service nova] Creating event network-changed:8cfb65c1-2848-4a74-811d-353426267917 for instance 6f0c7066-0117-4b28-af0c-455061cf0e1c on n-h2-846219-13 Jul 25 16:14:40.185188 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-25c42f6b-9811-4272-8f7e-91e334c74961 req-b38fc5a4-8206-4eb8-93a3-e5b83dd979a5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055019 Jul 25 16:14:40.187762 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1132/2197] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:40.196066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac3a6d28-8889-4df2-be0f-03f864fbf77a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:40.217266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.server_groups [None req-ac3a6d28-8889-4df2-be0f-03f864fbf77a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Querying cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) for 2 instances {{(pid=119599) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 16:14:40.218304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac3a6d28-8889-4df2-be0f-03f864fbf77a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.218827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac3a6d28-8889-4df2-be0f-03f864fbf77a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.266390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac3a6d28-8889-4df2-be0f-03f864fbf77a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups/aa5d2be4-9dee-4dde-a0a9-6268c6c98721" status: 200 len: 266 microversion: 2.1 time: 0.076690 Jul 25 16:14:40.267711 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1133/2198] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:14:40 2022] GET /compute/v2.1/os-server-groups/aa5d2be4-9dee-4dde-a0a9-6268c6c98721 => generated 266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:40.273421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:40.274299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:40.282241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.282993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.283787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.284031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.664434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:40.680642 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6ea85e46-ea83-4f4a-869f-d8a3fb69734d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1471 microversion: 2.1 time: 0.662404 Jul 25 16:14:40.683780 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1066/2199] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:40 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:40.710315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:40.714664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:40.730995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.733273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.736641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.737763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.919876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:40.945991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4eaa1ff2-3306-4b47-83a2-65750b449468 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.677063 Jul 25 16:14:40.953451 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1134/2200] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:40 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:40.959349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:40.959991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:40.974136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.975007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:40.975157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:40.975590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:41.442376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:41.456400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:41.458668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:41.462884 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee20709c-2343-478a-8bef-fb2c7040f94e tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1566 microversion: 2.25 time: 0.761872 Jul 25 16:14:41.477678 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1067/2201] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:40 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1566 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:14:41.979694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:41.980714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:41.997260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:41.997716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:41.998866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:41.999584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:42.003062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e886b8d-6f6a-4aa2-ac06-5895b260d689 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 200 len: 1624 microversion: 2.1 time: 1.048044 Jul 25 16:14:42.006285 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1135/2202] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:40 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 1624 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:42.022735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:42.023633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:42.033077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:42.041858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:42.043775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:42.044483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:42.855475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:42.874430 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0cba1f0d-07ad-43d1-a6cf-22f460663883 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1321 microversion: 2.1 time: 0.862843 Jul 25 16:14:42.875051 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1136/2203] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:42 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1321 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:42.894186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:42.894811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:42.911875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:42.917378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:42.918460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:42.919052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:42.982157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:42.996596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8b1ea75-9507-4944-9fd4-9a75977fd3d3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1500 microversion: 2.1 time: 1.514055 Jul 25 16:14:42.997719 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1068/2204] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:41 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1500 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:43.018138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:43.019440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:43.037131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.037567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.038366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.038800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.304241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:43.314873 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ed77086b-1fba-4882-bdd3-4bbffd048cc9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1322 microversion: 2.1 time: 0.424949 Jul 25 16:14:43.329920 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1137/2205] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:42 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:43.335989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:43.336849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:43.343505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:43.344470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.345068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.346372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.347105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.351967 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8a70a53-defd-4d84-82d7-eeb67f2b9e75 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.352897 Jul 25 16:14:43.365472 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1069/2206] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:42 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:43.378953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b4446850-7a91-433a-bd90-6d379aebc140 req-55fb2a72-4e19-4055-a3cb-360871f568ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58e405e-9682-4fb7-9741-c2ee3c5997f1", "name": "network-vif-deleted", "tag": "5702a729-23cf-443a-a57b-cf4ac17e7a81"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:43.393642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b4446850-7a91-433a-bd90-6d379aebc140 req-55fb2a72-4e19-4055-a3cb-360871f568ec service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.394244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b4446850-7a91-433a-bd90-6d379aebc140 req-55fb2a72-4e19-4055-a3cb-360871f568ec service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.410552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b4446850-7a91-433a-bd90-6d379aebc140 req-55fb2a72-4e19-4055-a3cb-360871f568ec service nova] Creating event network-vif-deleted:5702a729-23cf-443a-a57b-cf4ac17e7a81 for instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 on n-h2-846219-13 Jul 25 16:14:43.416549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b4446850-7a91-433a-bd90-6d379aebc140 req-55fb2a72-4e19-4055-a3cb-360871f568ec service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049434 Jul 25 16:14:43.417833 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1070/2207] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:43.425086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:43.426048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:43.434730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.435661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.436691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.437564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.478335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.479173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.479795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lazy-loading 'fault' on Instance uuid a58e405e-9682-4fb7-9741-c2ee3c5997f1 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:14:43.547163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:43.558460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:43.561052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3a2bf8f94f44b78a80c37bc8b370726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d3ce22679e4ac284a29ee1c6302ab8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:43.562364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e515c4fa-c245-46fd-b3e3-af83183feda7 tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 200 len: 1355 microversion: 2.25 time: 0.143192 Jul 25 16:14:43.571557 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1071/2208] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:43 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 1355 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:14:43.582133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:43.583057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:43.591243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.592180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.593277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.594267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.644257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lazy-loading 'flavor' on Instance uuid 014fd993-5b27-49d3-a044-1a252cc437a8 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:14:43.662975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'suspend' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state suspended Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 15 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: {"suspend": {}} Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'suspend' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state suspended Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'suspend': {}}} Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 25 16:14:43.665195 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state suspended Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state suspended Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:43.670103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'suspend' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state suspended {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:43.672977 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2d7b6fa6-384c-4407-b25f-41e61584ef3e tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 200 len: 1623 microversion: 2.1 time: 0.336220 Jul 25 16:14:43.672977 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1138/2209] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:43 2022] GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 1623 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:43.673512 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea16e81b-12a2-4cdc-a61d-6e39808db350 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 148 microversion: 2.1 time: 0.098396 Jul 25 16:14:43.673512 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1072/2210] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:43 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 148 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:14:43.682480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:43.683412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:43.695068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae7a242b-f9fd-40a1-be13-9f2eaa8a0051 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: .version_select at 0x7f9da4a85670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-15707768", "policies": ["anti-affinity"]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:43.699998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.700890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.702211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.703070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.723641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:43.750120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ae7a242b-f9fd-40a1-be13-9f2eaa8a0051 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:43.771861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ae7a242b-f9fd-40a1-be13-9f2eaa8a0051 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:43.843012 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fb6716af-b196-4064-83b4-f97e0f33ee51 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 202 len: 0 microversion: 2.1 time: 0.164869 Jul 25 16:14:43.853295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ae7a242b-f9fd-40a1-be13-9f2eaa8a0051 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:43.859081 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1139/2211] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:43 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:14:43.882715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ae7a242b-f9fd-40a1-be13-9f2eaa8a0051 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:43.884643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:43.890905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:43.908007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.908484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.909335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:43.909785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:43.937086 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae7a242b-f9fd-40a1-be13-9f2eaa8a0051 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.246920 Jul 25 16:14:43.938142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1073/2212] 10.222.0.105 () {60 vars in 1179 bytes} [Mon Jul 25 16:14:43 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:14:43.972584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-99a6302f-9fe8-4fc2-87ef-94257008a3c1 req-fc4675bf-9506-4e60-888b-53f4036d374f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c93153b-4dba-4766-817d-2d48cbe83d73", "name": "network-vif-plugged", "status": "completed", "tag": "61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:44.004626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-99a6302f-9fe8-4fc2-87ef-94257008a3c1 req-fc4675bf-9506-4e60-888b-53f4036d374f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.005339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-99a6302f-9fe8-4fc2-87ef-94257008a3c1 req-fc4675bf-9506-4e60-888b-53f4036d374f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.030519 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-99a6302f-9fe8-4fc2-87ef-94257008a3c1 req-fc4675bf-9506-4e60-888b-53f4036d374f service nova] Creating event network-vif-plugged:61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00 for instance 8c93153b-4dba-4766-817d-2d48cbe83d73 on n-h1-846219-13 Jul 25 16:14:44.048821 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-99a6302f-9fe8-4fc2-87ef-94257008a3c1 req-fc4675bf-9506-4e60-888b-53f4036d374f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091885 Jul 25 16:14:44.053031 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1074/2213] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:44.065265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:44.067327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:44.089194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.090833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.093017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.095391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.298673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:44.314190 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6bf43b42-1ff6-4455-896e-faa88ddb40b1 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1506 microversion: 2.1 time: 0.452778 Jul 25 16:14:44.315384 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1140/2214] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:43 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:44.344735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:44.350364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:44.370738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.371345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.372186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.372705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.467316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:44.491406 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d92de8d-ed8d-424f-8799-8ebd08fd8b4b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1471 microversion: 2.1 time: 0.435582 Jul 25 16:14:44.505999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1075/2215] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:44 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:44.520907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:44.521906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:44.532637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.533984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.536058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.537072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.812813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:44.826501 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c75c15e-1d42-482e-9c42-28f25a73c209 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1322 microversion: 2.1 time: 0.489249 Jul 25 16:14:44.836989 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1141/2216] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:44 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:44.840768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1268934989", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3cd8ff77-94b0-4d81-a5a8-f3eccbc896e2"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:44.933556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:44.947427 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe21ef08-27b8-4e29-ba4d-c98a427abbd8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.439711 Jul 25 16:14:44.961619 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1076/2217] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:44 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:44.961619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2031169028"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:44.961928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:14:44.969139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:44.981329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.981329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:44.981329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:44.981329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.318322 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc6f5b17-998a-4fd7-bdf5-52803f0979cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "POST /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca/action" status: 202 len: 0 microversion: 2.1 time: 0.364902 Jul 25 16:14:45.319677 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1077/2218] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:44 2022] POST /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:14:45.349552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:45.350613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] [instance: a58e405e-9682-4fb7-9741-c2ee3c5997f1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:45.362292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:45.362879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.364133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:45.365000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.387211 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] HTTP exception thrown: Instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 could not be found. Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Request method failure captured: Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 HTTP/1.1 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3r9daNs3zEt_obbpF2048Puk4mazR4nsIqtJ04zgimqeGmyrPuuvjeh5WY07ori7ZrpMAJyhYjJQQ7kzfyjAMr-H9ebAqUjTESfReWudZQMNcFoXccWcmW7cRPaYADj-Tl331I_nPTCVFHS1QNAc32DCe_4lMf30vlB1nxnY_zt2HzE Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/c2d3ce22679e4ac284a29ee1c6302ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_c2d3ce22679e4ac284a29ee1c6302ab8"}]}] Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: c2d3ce22679e4ac284a29ee1c6302ab8 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: f3a2bf8f94f44b78a80c37bc8b370726 Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1498569713-project Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 could not be found. Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'a58e405e-9682-4fb7-9741-c2ee3c5997f1'} Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 could not be found. Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 could not be found. Jul 25 16:14:45.402072 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 could not be found. Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] Returning 404 to user: Instance a58e405e-9682-4fb7-9741-c2ee3c5997f1 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0ce35534-a73a-48d8-8bba-1b074c9e1efa tempest-LiveAutoBlockMigrationV225Test-1498569713 tempest-LiveAutoBlockMigrationV225Test-1498569713-project] 10.222.0.105 "GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1" status: 404 len: 111 microversion: 2.25 time: 0.076095 Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1078/2219] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:14:45 2022] GET /compute/v2.1/servers/a58e405e-9682-4fb7-9741-c2ee3c5997f1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:14:45.432936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1faacf44-652a-4b60-99a7-bb530d6005cc tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4ac93a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:45.563177 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1faacf44-652a-4b60-99a7-bb530d6005cc tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.152603 Jul 25 16:14:45.570105 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1079/2220] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:45 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:45.582681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:45.584546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:45.631631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:14:45.632482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:14:45.633784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:14:45.634368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:14:45.635253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:14:45.644113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:45.645134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.646129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:45.647776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.664324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:45.665170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.666581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:45.667316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:45.712480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:45.731439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:45.760013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Going to run 2 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:14:45.765360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:14:45.884861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:45.899287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:45.979308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:45.984338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:45.993075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:45.999600 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9cb26c6b-45cd-49e7-a9a3-021cd7cab578 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1506 microversion: 2.1 time: 0.425172 Jul 25 16:14:46.001676 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1080/2221] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:45 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:46.007646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:46.008731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:46.017010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:46.018015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:46.019015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:46.019623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:46.064269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=309ec262-31d9-4fc7-9807-3b79e98e55a5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:14:46.228548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:46.238556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:46.242865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:46.337694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:14:46.352423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:14:46.368749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:46.390295 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ad5fe90-2148-4791-8e8e-58d43057d73b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1322 microversion: 2.1 time: 0.385417 Jul 25 16:14:46.392990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1081/2222] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:46 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:46.398160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:46.401562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:46.417278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:46.420296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:46.421740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:46.421740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:46.432147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-52a827d6-1c9d-4e92-b86b-c2adb771d577 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.597267 Jul 25 16:14:46.437318 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1142/2223] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:14:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 1603 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:14:46.443564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:46.452646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:46.456342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Searching by: {'deleted': False, 'project_id': 'b0327cf82312473da90dfaf13e95fcea'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:14:46.486252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:46.487420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:46.489374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:46.490552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:46.546921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:14:46.624864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:46.631393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aea86312-0f2e-4622-a22d-81cc696fdc12 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 1673 microversion: 2.1 time: 0.191871 Jul 25 16:14:46.632812 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1143/2224] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:14:46 2022] GET /compute/v2.1/servers => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:46.648269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac43efe4-b420-4578-b891-1993b213db21 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4a5b8b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:46.772749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac43efe4-b420-4578-b891-1993b213db21 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.135299 Jul 25 16:14:46.781824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1144/2225] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:46 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:46.792399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0db3e051-c5a1-48f4-8cc5-95f608dce8f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:46.793359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0db3e051-c5a1-48f4-8cc5-95f608dce8f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:46.858650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:46.885977 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e9d5fd2a-7352-4b02-b3f7-9039f3d77629 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.491504 Jul 25 16:14:46.886703 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1082/2226] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:46 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:47.016643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0db3e051-c5a1-48f4-8cc5-95f608dce8f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:47.023186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:47.023806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:47.046944 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0db3e051-c5a1-48f4-8cc5-95f608dce8f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1223 microversion: 2.1 time: 0.263989 Jul 25 16:14:47.066224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:47.067673 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1145/2227] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:46 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1223 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:47.071307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:47.083381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:47.086132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:47.420544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:47.428186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:47.444242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:47.445454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:47.446937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:47.450229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:47.541817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:47.551286 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7565dc40-06b1-45eb-ba7c-2947ef1ba841 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1506 microversion: 2.1 time: 0.532002 Jul 25 16:14:47.552416 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1083/2228] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:47 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:14:47.757792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:47.770654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a647ee52-f06d-4ec4-9fac-205a69efcf2b tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1512 microversion: 2.1 time: 0.355717 Jul 25 16:14:47.771901 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1146/2229] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:47 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:47.790975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92100a53-0da3-4cf3-bcea-fd74ea2b64b8 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93cffca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:47.812843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:47.813772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:47.835615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:47.838722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:47.840320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:47.843602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:47.920027 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92100a53-0da3-4cf3-bcea-fd74ea2b64b8 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.131173 Jul 25 16:14:47.925295 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1084/2230] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:47 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:47.958387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:47.960443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:48.006464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.009432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.013255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.018827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.094302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:48.537556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:48.580513 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd8466d7-c066-4bd8-9f25-5c76a5eb3451 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1512 microversion: 2.1 time: 0.771936 Jul 25 16:14:48.582771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1147/2231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:47 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1512 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:48.595533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:48.608866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:48.659898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.665800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.677291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.682854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.687307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:48.702512 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9a55adc8-1776-4c73-ab43-cebbaa4e2c69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.760966 Jul 25 16:14:48.714383 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1085/2232] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:47 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:48.737953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:48.757833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:48.791984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.792440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.803996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.804871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.836024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:48.848749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e3d4b09a-24dc-49ce-8df6-a3159666a538 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1219 microversion: 2.1 time: 0.264253 Jul 25 16:14:48.850118 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1148/2233] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:48 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1219 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:48.864539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:48.870057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:48.880845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.881945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:48.883026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:48.884989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:49.091063 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a29ad67b-ab88-46f8-9009-c17b56824128 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "PUT /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1084 microversion: 2.1 time: 0.234930 Jul 25 16:14:49.092852 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1149/2234] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:14:48 2022] PUT /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1084 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:49.111823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ed3e08d-90e6-4e4d-95f4-0e353950eeb9 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4938f70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:49.232544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:49.244351 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61210e02-db81-415a-85e4-2ffbda0e0947 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.527785 Jul 25 16:14:49.246768 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ed3e08d-90e6-4e4d-95f4-0e353950eeb9 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.142986 Jul 25 16:14:49.247760 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1086/2235] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:48 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:49.249390 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1150/2236] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:49 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:49.265619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:49.270677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:49.281674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:49.283186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:49.284502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:49.284787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:49.522498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:49.548005 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e63d8d4-c401-4cf9-9069-8ff908c20bf2 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1510 microversion: 2.1 time: 0.297288 Jul 25 16:14:49.583780 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1151/2237] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:49 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:49.599861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-84019e01-b8c2-48ff-bda1-16ab3eebaca7 req-1e37882d-7d1f-448f-9a86-37a16c76149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0c7066-0117-4b28-af0c-455061cf0e1c", "name": "network-vif-plugged", "status": "completed", "tag": "8cfb65c1-2848-4a74-811d-353426267917"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:49.613342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-84019e01-b8c2-48ff-bda1-16ab3eebaca7 req-1e37882d-7d1f-448f-9a86-37a16c76149f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:49.613823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-84019e01-b8c2-48ff-bda1-16ab3eebaca7 req-1e37882d-7d1f-448f-9a86-37a16c76149f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:49.618327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2a9c0ab4-f5ca-470a-a6fc-9cac8b760bce tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] Action: 'create', calling method: .version_select at 0x7f9d93d4be50>, body: {"security_group": {"name": "tempest-securitygroup-1916371292", "description": "tempest-description-1435629851"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:49.628556 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-84019e01-b8c2-48ff-bda1-16ab3eebaca7 req-1e37882d-7d1f-448f-9a86-37a16c76149f service nova] Creating event network-vif-plugged:8cfb65c1-2848-4a74-811d-353426267917 for instance 6f0c7066-0117-4b28-af0c-455061cf0e1c on n-h2-846219-13 Jul 25 16:14:49.634642 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-84019e01-b8c2-48ff-bda1-16ab3eebaca7 req-1e37882d-7d1f-448f-9a86-37a16c76149f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049175 Jul 25 16:14:49.637040 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1152/2238] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:49.644966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:49.647056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:49.656362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:49.657203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:49.659509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:49.660949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:50.314699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:50.334578 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d36ddc4-81de-4bfd-a5bf-ccd378fd26d9 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.695753 Jul 25 16:14:50.343405 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1153/2239] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:49 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:50.348427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:50.349064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:50.362564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:50.363017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:50.364673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:50.365161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:50.777882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:50.786620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac7eae9a-1b0e-4096-8d32-1126b200314a tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1510 microversion: 2.1 time: 0.441802 Jul 25 16:14:50.801649 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1154/2240] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:50 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:50.801649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:50.801649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:50.817843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:50.821262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:50.823304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:50.827897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:50.886394 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2a9c0ab4-f5ca-470a-a6fc-9cac8b760bce tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.637303 Jul 25 16:14:50.896068 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1087/2241] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:14:49 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:50.902495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:50.903910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:50.919828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:50.926906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:50.928277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:50.929160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.135695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:51.151416 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b1db879-e591-4e44-b311-20eb6a2011a9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1281 microversion: 2.1 time: 0.253916 Jul 25 16:14:51.155132 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1088/2242] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:50 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:51.164008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-848d7877-1b22-42e7-b899-a7b2e93ae436 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4a85ee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:51.179764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:51.194807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1529baaf-ef58-4108-b972-71a3eb33e2df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.402870 Jul 25 16:14:51.197317 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1155/2243] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:50 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:51.202788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e15df180-fbe7-48f1-bd2e-1b5d6192799a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:51.204019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e15df180-fbe7-48f1-bd2e-1b5d6192799a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 5823a865-e19f-4168-9105-da0027cc7c79] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:51.215791 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e15df180-fbe7-48f1-bd2e-1b5d6192799a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 5823a865-e19f-4168-9105-da0027cc7c79 could not be found. Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e15df180-fbe7-48f1-bd2e-1b5d6192799a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/5823a865-e19f-4168-9105-da0027cc7c79/action HTTP/1.1 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 15 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: {"unpause": {}} Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 5823a865-e19f-4168-9105-da0027cc7c79 could not be found. Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5823a865-e19f-4168-9105-da0027cc7c79', 'body': {'unpause': {}}} Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5823a865-e19f-4168-9105-da0027cc7c79 could not be found. Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5823a865-e19f-4168-9105-da0027cc7c79 could not be found. Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:51.218339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:51.223455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:51.223455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:51.223455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5823a865-e19f-4168-9105-da0027cc7c79 could not be found. Jul 25 16:14:51.223455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:14:51.249836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e15df180-fbe7-48f1-bd2e-1b5d6192799a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 5823a865-e19f-4168-9105-da0027cc7c79 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:51.251021 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e15df180-fbe7-48f1-bd2e-1b5d6192799a tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/5823a865-e19f-4168-9105-da0027cc7c79/action" status: 404 len: 111 microversion: 2.1 time: 0.052473 Jul 25 16:14:51.253880 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1156/2244] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:51 2022] POST /compute/v2.1/servers/5823a865-e19f-4168-9105-da0027cc7c79/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:14:51.255779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-848d7877-1b22-42e7-b899-a7b2e93ae436 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.096924 Jul 25 16:14:51.259543 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1089/2245] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:51 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:51.262629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:51.266114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:51.270779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-324439c2-9f00-41b4-8b43-e21f448e5c0f tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] Action: 'create', calling method: .version_select at 0x7f9d93f26b80>, body: {"security_group": {"name": "tempest-securitygroup-2077712665", "description": "tempest-description-2083087857"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:51.290689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.291950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.294570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.295344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.423380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:14:51.424748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:14:51.425503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:14:51.426149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:14:51.426954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:14:51.581995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:51.606625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.609443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.613355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.614452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.668427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4a1dc099-25f8-4d77-bfd5-cf0a962739d9 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "POST /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73/action" status: 202 len: 1116 microversion: 2.1 time: 0.413119 Jul 25 16:14:51.669674 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1157/2246] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:51 2022] POST /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73/action => generated 1116 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:14:51.675825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:51.676798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:51.679866 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-324439c2-9f00-41b4-8b43-e21f448e5c0f tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.418830 Jul 25 16:14:51.682142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1090/2247] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:14:51 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:51.687906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-637f1074-0957-4a96-8f29-e8d0f4806981 req-3e42dff9-128b-43b8-8d94-2fa9e71f4dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6717f831-c4a9-4446-ad80-c006d25fdc06", "name": "network-vif-plugged", "status": "completed", "tag": "7a394690-f839-4843-9042-168f5d7f93fa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:51.709957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.713582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-637f1074-0957-4a96-8f29-e8d0f4806981 req-3e42dff9-128b-43b8-8d94-2fa9e71f4dd0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.714161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.715048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.715490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.720545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-637f1074-0957-4a96-8f29-e8d0f4806981 req-3e42dff9-128b-43b8-8d94-2fa9e71f4dd0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.748784 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-637f1074-0957-4a96-8f29-e8d0f4806981 req-3e42dff9-128b-43b8-8d94-2fa9e71f4dd0 service nova] Creating event network-vif-plugged:7a394690-f839-4843-9042-168f5d7f93fa for instance 6717f831-c4a9-4446-ad80-c006d25fdc06 on n-h1-846219-13 Jul 25 16:14:51.762820 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-637f1074-0957-4a96-8f29-e8d0f4806981 req-3e42dff9-128b-43b8-8d94-2fa9e71f4dd0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077882 Jul 25 16:14:51.764934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1091/2248] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:51.776977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:51.777735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:51.792586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.793041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:51.795097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:51.795756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:52.234070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:52.280233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b93b190-2d9d-41b7-915c-457cbdbc7812 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.599528 Jul 25 16:14:52.283476 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1158/2249] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:51 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:52.721528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:52.765135 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-979549bb-1f31-4865-a5c5-597bf9a0fdd3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.988679 Jul 25 16:14:52.768955 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1092/2250] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:51 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:52.796658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:52.805427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:52.840161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:52.856630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:52.863150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:52.864247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:53.195965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ba43fd7-c5a2-414b-b546-2c7e8db38913 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] Action: 'create', calling method: .version_select at 0x7f9da49fea60>, body: {"security_group": {"name": "tempest-securitygroup-844058509", "description": "tempest-description-393258809"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:53.348207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:53.379585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4f212acb-a0e3-418a-980d-f93e1cfb6f5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1281 microversion: 2.1 time: 0.605207 Jul 25 16:14:53.422139 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1093/2251] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:52 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1281 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:53.441734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:53.442943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:53.475838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:53.476957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:53.478680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:53.479748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:53.917797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:53.920379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:53.942126 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d7165bee-6787-4a23-9eaf-f2c398717a65 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1323 microversion: 2.1 time: 0.506230 Jul 25 16:14:53.942126 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1094/2252] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:53 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1323 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:53.955458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7cfba90-e3f9-4944-bf0d-983063c0f5cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da49a2dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:54.044324 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7cfba90-e3f9-4944-bf0d-983063c0f5cb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.104037 Jul 25 16:14:54.054610 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1095/2253] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:53 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:54.060163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:54.061170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:54.072511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:54.081223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:54.082305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:54.083035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:54.310441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ba43fd7-c5a2-414b-b546-2c7e8db38913 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.025820 Jul 25 16:14:54.311822 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1159/2254] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:14:52 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:54.316964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:54.318084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:54.337903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:54.341287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:54.346324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:54.348635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:54.850196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:54.870681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:54.882168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c3b3d7c-54a3-4af1-91bd-412eb4c97084 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.568761 Jul 25 16:14:54.891506 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1160/2255] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:54 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:54.894997 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04926f0a-f534-4e92-a1ef-8f5cfd0a0319 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.825294 Jul 25 16:14:54.900356 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1096/2256] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:54 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:54.912004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:54.918851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:54.923089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cd5bf9d0-e46a-4317-9de9-1a68133d85a2 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] Action: 'create', calling method: .version_select at 0x7f9d93c198b0>, body: {"security_group": {"name": "tempest-securitygroup-1967721853", "description": "tempest-description-1605635812"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:54.959658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:54.961931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:54.964775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:54.970640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:55.382038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:55.403486 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ee3629f-2099-4dc2-a129-2e25ee83e236 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.501658 Jul 25 16:14:55.406147 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1097/2257] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:54 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:55.441130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:55.443258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:55.456814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:55.457730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:55.459279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:55.460332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:55.493294 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'unpause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 15 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: {"unpause": {}} Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'unpause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'unpause': {}}} Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state active. Cannot unpause while the instance is in this state. Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:14:55.495982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:14:55.499741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:14:55.499741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:14:55.499741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:14:55.499741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:14:55.499741 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:14:55.503929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'unpause' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:14:55.505388 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5471534d-b9f6-4293-b927-3a06a42ad4c3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 145 microversion: 2.1 time: 0.082610 Jul 25 16:14:55.506371 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1098/2258] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:14:55 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:14:55.511873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:55.513574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:55.522081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:55.523087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:55.525630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:55.526499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:56.120501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:56.168618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cd5bf9d0-e46a-4317-9de9-1a68133d85a2 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.275188 Jul 25 16:14:56.170745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1161/2259] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:14:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:56.177344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4ae021b-28fb-4769-9a0b-3beb5da00e1e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 200 len: 1512 microversion: 2.1 time: 0.646286 Jul 25 16:14:56.181233 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1099/2260] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:55 2022] GET /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 1512 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:56.199689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82fe6f71-4ecb-474f-9d06-f7db777f77fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93584550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:56.221882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:56.228216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:56.268067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:56.273736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:56.277917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:56.279448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:56.318308 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82fe6f71-4ecb-474f-9d06-f7db777f77fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.145408 Jul 25 16:14:56.321860 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1162/2261] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:56 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:56.333176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e508e3cb-a498-4d56-ae64-9734e7273b7e req-7663cd2b-9331-4d1b-9af3-049ac0536f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309ec262-31d9-4fc7-9807-3b79e98e55a5", "tag": "ec609041-989a-4ca4-b260-a498b8be8b29"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:56.362442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e508e3cb-a498-4d56-ae64-9734e7273b7e req-7663cd2b-9331-4d1b-9af3-049ac0536f16 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:56.366068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e508e3cb-a498-4d56-ae64-9734e7273b7e req-7663cd2b-9331-4d1b-9af3-049ac0536f16 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:56.382635 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e508e3cb-a498-4d56-ae64-9734e7273b7e req-7663cd2b-9331-4d1b-9af3-049ac0536f16 service nova] Creating event network-changed:ec609041-989a-4ca4-b260-a498b8be8b29 for instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 on n-h1-846219-13 Jul 25 16:14:56.390300 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e508e3cb-a498-4d56-ae64-9734e7273b7e req-7663cd2b-9331-4d1b-9af3-049ac0536f16 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066546 Jul 25 16:14:56.391487 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1163/2262] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:56.397896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:56.398901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:56.406466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:56.407203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:56.408535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:56.409151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:56.507570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:57.029761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=26 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:57.555211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:57.569321 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45eb0046-ddd4-4f6f-ba48-acfe1b1942f7 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.374623 Jul 25 16:14:57.569992 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1100/2263] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:56 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:57.594404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-01e98729-a222-4863-b1bc-494f614185a5 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] Calling method '.version_select at 0x7f9da4955670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:57.621903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:57.637692 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6e84748-4d00-4184-93e7-80b0cd425c11 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 1.244612 Jul 25 16:14:57.639786 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1164/2264] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:56 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:57.650863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:57.654791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6f0c7066-0117-4b28-af0c-455061cf0e1c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:57.681309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:57.682243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:57.683268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:57.683867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:58.034268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:58.038061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:58.049275 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f19f6d8-f480-48de-9ef1-3db54255d621 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/6f0c7066-0117-4b28-af0c-455061cf0e1c" status: 200 len: 1512 microversion: 2.1 time: 0.405868 Jul 25 16:14:58.053278 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1165/2265] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:57 2022] GET /compute/v2.1/servers/6f0c7066-0117-4b28-af0c-455061cf0e1c => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:58.061606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:58.064665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:58.083345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:58.087676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:58.088696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:58.093977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:58.487211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:58.501666 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc325ef9-2fe4-468a-91ca-f86caea31077 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.446932 Jul 25 16:14:58.502445 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1166/2266] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:58 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:58.523731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-08bc5f14-84b8-4f54-8766-6e14e60b8af7 req-0783f920-2a30-4ae9-887c-d9d954f398b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "name": "network-vif-plugged", "status": "completed", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:58.541647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-08bc5f14-84b8-4f54-8766-6e14e60b8af7 req-0783f920-2a30-4ae9-887c-d9d954f398b5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:58.547616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-08bc5f14-84b8-4f54-8766-6e14e60b8af7 req-0783f920-2a30-4ae9-887c-d9d954f398b5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:58.573596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-08bc5f14-84b8-4f54-8766-6e14e60b8af7 req-0783f920-2a30-4ae9-887c-d9d954f398b5 service nova] Creating event network-vif-plugged:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:14:58.584483 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-08bc5f14-84b8-4f54-8766-6e14e60b8af7 req-0783f920-2a30-4ae9-887c-d9d954f398b5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080048 Jul 25 16:14:58.585831 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1167/2267] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:58.601318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5323a70e-1ec5-45d6-ac8f-44de77ffc060 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92f885e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:58.735559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5323a70e-1ec5-45d6-ac8f-44de77ffc060 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.145354 Jul 25 16:14:58.737932 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1168/2268] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:14:58 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:58.744688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:58.748416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:58.758870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:58.760441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:58.761672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:58.762277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:59.156792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:14:59.191127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37d81597-94ff-482f-95ae-55ec1712c973 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.439527 Jul 25 16:14:59.199689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1169/2269] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:58 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:14:59.228354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:59.233217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6f0c7066-0117-4b28-af0c-455061cf0e1c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:59.255903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:59.256535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:59.257620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:59.265854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:59.354725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6f0c7066-0117-4b28-af0c-455061cf0e1c] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:14:59.583427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94da6ef5-74f5-4594-b9a8-4ff27d122e1c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6f0c7066-0117-4b28-af0c-455061cf0e1c" status: 204 len: 0 microversion: 2.1 time: 0.378108 Jul 25 16:14:59.585438 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1170/2270] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:14:59 2022] DELETE /compute/v2.1/servers/6f0c7066-0117-4b28-af0c-455061cf0e1c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:14:59.593919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-52518fd1-83d1-421d-a0d8-27d9df31193d req-0abc81d0-c93b-454a-895c-9bee27cf7afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3015bf-74b2-462a-bfac-23b80c32591f", "tag": "1e8e35c2-f1ab-440b-8a78-903ae7f5910a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:14:59.608969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-52518fd1-83d1-421d-a0d8-27d9df31193d req-0abc81d0-c93b-454a-895c-9bee27cf7afc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:59.610240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-52518fd1-83d1-421d-a0d8-27d9df31193d req-0abc81d0-c93b-454a-895c-9bee27cf7afc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:59.628488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-52518fd1-83d1-421d-a0d8-27d9df31193d req-0abc81d0-c93b-454a-895c-9bee27cf7afc service nova] Creating event network-changed:1e8e35c2-f1ab-440b-8a78-903ae7f5910a for instance fa3015bf-74b2-462a-bfac-23b80c32591f on n-h2-846219-13 Jul 25 16:14:59.634997 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-52518fd1-83d1-421d-a0d8-27d9df31193d req-0abc81d0-c93b-454a-895c-9bee27cf7afc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047547 Jul 25 16:14:59.636640 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1171/2271] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:14:59.646309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:14:59.648418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:14:59.658514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:59.659393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:14:59.661372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:14:59.662134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:00.099105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:00.125338 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d76563b-6151-445f-bb2d-4b2ac2a48c5e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.485627 Jul 25 16:15:00.132018 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1172/2272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:14:59 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:00.144249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1136608b-e33a-4e00-b66b-aaad0d452402 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:00.144836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1136608b-e33a-4e00-b66b-aaad0d452402 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: ee2a7f03-1640-42a1-9f04-a413e4182847] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:00.168407 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1136608b-e33a-4e00-b66b-aaad0d452402 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance ee2a7f03-1640-42a1-9f04-a413e4182847 could not be found. Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1136608b-e33a-4e00-b66b-aaad0d452402 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/ee2a7f03-1640-42a1-9f04-a413e4182847/action HTTP/1.1 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 18 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: {"unshelve": null} Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance ee2a7f03-1640-42a1-9f04-a413e4182847 could not be found. Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'ee2a7f03-1640-42a1-9f04-a413e4182847', 'body': {'unshelve': None}} Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2a7f03-1640-42a1-9f04-a413e4182847 could not be found. Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2a7f03-1640-42a1-9f04-a413e4182847 could not be found. Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:00.170871 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:00.174620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:00.174620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:00.174620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:00.174620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:00.174620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2a7f03-1640-42a1-9f04-a413e4182847 could not be found. Jul 25 16:15:00.174620 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:00.179517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1136608b-e33a-4e00-b66b-aaad0d452402 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance ee2a7f03-1640-42a1-9f04-a413e4182847 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:00.182908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1136608b-e33a-4e00-b66b-aaad0d452402 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/ee2a7f03-1640-42a1-9f04-a413e4182847/action" status: 404 len: 111 microversion: 2.1 time: 0.049661 Jul 25 16:15:00.184205 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1173/2273] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:15:00 2022] POST /compute/v2.1/servers/ee2a7f03-1640-42a1-9f04-a413e4182847/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:00.193064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:00.194788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:00.204276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:00.205160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:00.206309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:00.206981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:00.749269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:00.765322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c697b54-8940-422b-b8d7-1f1d1464c450 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.578375 Jul 25 16:15:00.766002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1174/2274] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:00 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:00.775427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:00.775903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:00.793349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:00.793894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:00.794582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:00.795024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:00.852131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 6717f831-c4a9-4446-ad80-c006d25fdc06] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:15:01.016921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5291e5ce-ad4c-41cd-9be4-0326d146148e tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06" status: 204 len: 0 microversion: 2.1 time: 0.249477 Jul 25 16:15:01.020572 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1175/2275] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:15:00 2022] DELETE /compute/v2.1/servers/6717f831-c4a9-4446-ad80-c006d25fdc06 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:15:01.048843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b608c5e7-837e-4d07-83c7-ab07ac2d78cc tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4a1f5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:01.206989 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b608c5e7-837e-4d07-83c7-ab07ac2d78cc tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.169401 Jul 25 16:15:01.208014 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1176/2276] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:01 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:01.228785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:01.232370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:01.263762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:01.266447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:01.268859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:01.272400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:01.801688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:01.832439 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8cdf81af-52e4-4396-9d57-5e4a4109d28b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.613985 Jul 25 16:15:01.838866 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1177/2277] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:01 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:01.860816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:01.870014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:01.891416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:01.899526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:01.907610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:01.908741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:02.761028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:02.798088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18464ea7-ad9a-4b98-a9c1-c7a616f75534 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.955229 Jul 25 16:15:02.804209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1178/2278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:01 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:02.844100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2002998428", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "cfec397e-5c56-457e-879b-fca60edceb31"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:03.003401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] validate_networks() for [('cfec397e-5c56-457e-879b-fca60edceb31', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:03.431182 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-01e98729-a222-4863-b1bc-494f614185a5 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] 10.222.0.105 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9749 microversion: 2.1 time: 5.852592 Jul 25 16:15:03.432013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1101/2279] 10.222.0.105 () {58 vars in 1196 bytes} [Mon Jul 25 16:14:57 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9749 bytes in 5861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:03.456033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:03.459034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:03.477573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:03.480344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:03.482664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:03.484163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:04.173340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:04.185853 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-90c9ce91-4244-4b5c-b5b5-44f1d9ed54d5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.738316 Jul 25 16:15:04.210070 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1102/2280] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:03 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:04.220624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:04.222303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:04.232271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:04.233253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:04.234356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:04.235089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:04.638756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:04.639250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:04.639928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:04.640437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:04.640949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:04.657394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:04.659583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:04.664530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:04.667587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:04.678007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:04.689182 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-af6d047f-7686-4b90-8951-5fe6345e75f3 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.477135 Jul 25 16:15:04.689852 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1103/2281] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:04 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:04.716771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4fb863fb-8eb8-441f-b348-3a3e867a99ff tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da013b9d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:04.730814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Getting quotas for project 63671a9868644882990d6f938fffc223. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:04.749169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Getting quotas for user a1adfb100c9b4f81a18e24dbde96d6c0 and project 63671a9868644882990d6f938fffc223. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:04.758774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:04.800736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Going to run 2 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:15:04.810510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:04.862584 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4fb863fb-8eb8-441f-b348-3a3e867a99ff tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.147279 Jul 25 16:15:04.864525 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1104/2282] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:04 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:04.870660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8097f0b-bb8b-4a38-a883-ae1a6712a2c4 tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] Calling method '.version_select at 0x7f9da00329d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:04.951032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:05.181513 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4aeb11ac-41a0-4819-b498-7270b63dddfa tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.362577 Jul 25 16:15:05.182216 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1179/2283] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 2377 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:15:05.200221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:05.204863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:05.222084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:05.240824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:05.246879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:05.253243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:05.920584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:05.941211 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d9725fb-7c5e-4600-b310-1532c3bc09bb tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.756625 Jul 25 16:15:05.966391 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1180/2284] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:05 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:05.980883 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8097f0b-bb8b-4a38-a883-ae1a6712a2c4 tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 1.114855 Jul 25 16:15:05.982471 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1105/2285] 10.222.0.105 () {58 vars in 1196 bytes} [Mon Jul 25 16:15:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:05.997022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:06.000030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:06.000647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:06.007091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:06.010259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Searching by: {'deleted': False, 'project_id': '63671a9868644882990d6f938fffc223'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:15:06.058807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.059755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.060911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.069003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.071004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.076604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.082659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.090039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.196652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:15:06.219236 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Cannot 'unshelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action HTTP/1.1 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 18 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: {"unshelve": null} Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'unshelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'unshelve': None}} Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 in vm_state active. Cannot unshelve while the instance is in this state. Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:15:06.225554 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active Jul 25 16:15:06.230410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:06.234733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 409 to user: Cannot 'unshelve' instance 014fd993-5b27-49d3-a044-1a252cc437a8 while it is in vm_state active {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:06.239144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41db358d-9e9c-4f22-aec2-60f5ba42bfa2 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action" status: 409 len: 146 microversion: 2.1 time: 0.269650 Jul 25 16:15:06.241433 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1181/2286] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:15:05 2022] POST /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8/action => generated 146 bytes in 274 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:15:06.266168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:06.267534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:06.291589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.292951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.298050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.300070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.310552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2aee12c-219a-4854-ba53-36f826eb247a tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 1343 microversion: 2.1 time: 0.326547 Jul 25 16:15:06.316676 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1106/2287] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:15:05 2022] GET /compute/v2.1/servers => generated 1343 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:06.330403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-96e4d42c-20ad-4c92-813d-bbda01732050 req-11a1b682-a9f9-4516-8322-b96f95bb1a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6717f831-c4a9-4446-ad80-c006d25fdc06", "name": "network-vif-deleted", "tag": "7a394690-f839-4843-9042-168f5d7f93fa"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:06.371494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-96e4d42c-20ad-4c92-813d-bbda01732050 req-11a1b682-a9f9-4516-8322-b96f95bb1a21 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.371876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-96e4d42c-20ad-4c92-813d-bbda01732050 req-11a1b682-a9f9-4516-8322-b96f95bb1a21 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.431240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-96e4d42c-20ad-4c92-813d-bbda01732050 req-11a1b682-a9f9-4516-8322-b96f95bb1a21 service nova] Creating event network-vif-deleted:7a394690-f839-4843-9042-168f5d7f93fa for instance 6717f831-c4a9-4446-ad80-c006d25fdc06 on n-h1-846219-13 Jul 25 16:15:06.446070 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-96e4d42c-20ad-4c92-813d-bbda01732050 req-11a1b682-a9f9-4516-8322-b96f95bb1a21 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126290 Jul 25 16:15:06.452870 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1107/2288] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:06.482116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-96c55b5c-2e65-4cf6-9bd0-142026e90714 req-f7035d20-7035-4d7d-b888-f9047eef2fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0c7066-0117-4b28-af0c-455061cf0e1c", "name": "network-vif-deleted", "tag": "8cfb65c1-2848-4a74-811d-353426267917"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:06.527517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-96c55b5c-2e65-4cf6-9bd0-142026e90714 req-f7035d20-7035-4d7d-b888-f9047eef2fc0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.529573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-96c55b5c-2e65-4cf6-9bd0-142026e90714 req-f7035d20-7035-4d7d-b888-f9047eef2fc0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.564426 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-96c55b5c-2e65-4cf6-9bd0-142026e90714 req-f7035d20-7035-4d7d-b888-f9047eef2fc0 service nova] Creating event network-vif-deleted:8cfb65c1-2848-4a74-811d-353426267917 for instance 6f0c7066-0117-4b28-af0c-455061cf0e1c on n-h2-846219-13 Jul 25 16:15:06.585805 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-96c55b5c-2e65-4cf6-9bd0-142026e90714 req-f7035d20-7035-4d7d-b888-f9047eef2fc0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126723 Jul 25 16:15:06.589251 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1108/2289] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:06.627814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-935181da-c7de-4a7f-892e-df443af9b6cd tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4ac9c10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:06.772647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-935181da-c7de-4a7f-892e-df443af9b6cd tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.176623 Jul 25 16:15:06.775025 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1109/2290] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:06 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:06.775243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:06.788909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec5b64a0-ae61-4d61-9fdd-bfd7e40b0a35 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] Calling method '.version_select at 0x7f9da0031430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:06.794159 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-019a5c78-b880-44e1-9085-e3a8e961379a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.547192 Jul 25 16:15:06.798065 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1182/2291] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:06 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:06.822403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:06.823619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:06.851317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.852030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:06.854089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:06.855568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:07.492264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:07.504565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e265ed3-92e3-41fd-ab50-aadd44d166bf tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.697745 Jul 25 16:15:07.507822 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1183/2292] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:06 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:07.520328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6018316-8025-46e2-a699-974becb1c7d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:07.522637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6018316-8025-46e2-a699-974becb1c7d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:07.548627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec5b64a0-ae61-4d61-9fdd-bfd7e40b0a35 tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/71cdc911-15ea-4484-a75c-6e915728147e" status: 202 len: 0 microversion: 2.1 time: 0.771042 Jul 25 16:15:07.550591 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1110/2293] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:15:06 2022] DELETE /compute/v2.1/os-security-groups/71cdc911-15ea-4484-a75c-6e915728147e => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:15:07.557638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:07.558819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:07.578844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:07.581884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:07.584695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:07.587412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:07.724538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6018316-8025-46e2-a699-974becb1c7d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:07.758631 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6018316-8025-46e2-a699-974becb1c7d8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1222 microversion: 2.1 time: 0.248982 Jul 25 16:15:07.767421 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1184/2294] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:07 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:07.794427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ae1457fc-793a-4d75-9f2b-28a2e8e8375f req-e4714f7e-408f-4252-a950-cfa384ef4050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309ec262-31d9-4fc7-9807-3b79e98e55a5", "name": "network-vif-plugged", "status": "completed", "tag": "ec609041-989a-4ca4-b260-a498b8be8b29"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:07.865756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ae1457fc-793a-4d75-9f2b-28a2e8e8375f req-e4714f7e-408f-4252-a950-cfa384ef4050 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:07.866959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ae1457fc-793a-4d75-9f2b-28a2e8e8375f req-e4714f7e-408f-4252-a950-cfa384ef4050 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:07.909897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ae1457fc-793a-4d75-9f2b-28a2e8e8375f req-e4714f7e-408f-4252-a950-cfa384ef4050 service nova] Creating event network-vif-plugged:ec609041-989a-4ca4-b260-a498b8be8b29 for instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 on n-h1-846219-13 Jul 25 16:15:07.936252 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ae1457fc-793a-4d75-9f2b-28a2e8e8375f req-e4714f7e-408f-4252-a950-cfa384ef4050 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166562 Jul 25 16:15:07.942911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1185/2295] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:07.960228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:07.961902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:07.978982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:07.980121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:07.981825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:07.983036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:08.003584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:08.095086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:08.114125 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3f0c082-80b0-4829-8e2a-5abca3003a1d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.557801 Jul 25 16:15:08.115234 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1111/2296] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:07 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:08.137544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db89c2e7-efbf-493d-a232-ea558f94e0fd tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] Calling method '.version_select at 0x7f9da051f280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:08.480796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:08.508308 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51b3d349-29b8-4bd6-ba15-1e840f10f456 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.559995 Jul 25 16:15:08.517819 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1186/2297] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:07 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:08.523145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe7601ee-7ce4-4af2-a1fa-4dbd9fb89d32 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93845280>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:08.645589 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe7601ee-7ce4-4af2-a1fa-4dbd9fb89d32 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.126243 Jul 25 16:15:08.656267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1187/2298] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:08 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:08.672892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:08.674824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:08.693369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:08.694426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:08.695501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:08.696160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:08.900367 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db89c2e7-efbf-493d-a232-ea558f94e0fd tempest-SecurityGroupsTestAdminJSON-1071673329 tempest-SecurityGroupsTestAdminJSON-1071673329-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/b694dcc4-15b2-4509-9637-93f86c6ba55b" status: 202 len: 0 microversion: 2.1 time: 0.780245 Jul 25 16:15:08.901884 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1112/2299] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:15:08 2022] DELETE /compute/v2.1/os-security-groups/b694dcc4-15b2-4509-9637-93f86c6ba55b => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:15:08.924468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48aff612-dc83-4aaa-ab27-7f21b5af5de8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-138738899_updated"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:08.935937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48aff612-dc83-4aaa-ab27-7f21b5af5de8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 518a5472-050a-44a7-83f3-2bf639b47f3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:08.960952 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-48aff612-dc83-4aaa-ab27-7f21b5af5de8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 518a5472-050a-44a7-83f3-2bf639b47f3e could not be found. Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48aff612-dc83-4aaa-ab27-7f21b5af5de8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/servers/518a5472-050a-44a7-83f3-2bf639b47f3e HTTP/1.1 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 80 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-138738899_updated"}} Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 518a5472-050a-44a7-83f3-2bf639b47f3e could not be found. Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '518a5472-050a-44a7-83f3-2bf639b47f3e', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-138738899_updated'}}} Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518a5472-050a-44a7-83f3-2bf639b47f3e could not be found. Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 16:15:08.966434 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518a5472-050a-44a7-83f3-2bf639b47f3e could not be found. Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518a5472-050a-44a7-83f3-2bf639b47f3e could not be found. Jul 25 16:15:08.970674 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:08.975645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48aff612-dc83-4aaa-ab27-7f21b5af5de8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 518a5472-050a-44a7-83f3-2bf639b47f3e could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:08.978744 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48aff612-dc83-4aaa-ab27-7f21b5af5de8 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "PUT /compute/v2.1/servers/518a5472-050a-44a7-83f3-2bf639b47f3e" status: 404 len: 111 microversion: 2.1 time: 0.074323 Jul 25 16:15:08.982591 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1113/2300] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:15:08 2022] PUT /compute/v2.1/servers/518a5472-050a-44a7-83f3-2bf639b47f3e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:08.991261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:08.996750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:09.003987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:09.004980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:09.005967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:09.006733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:09.156116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:09.166761 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75cd5b1f-c160-4d7b-9cd2-ac5661cd0055 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1274 microversion: 2.1 time: 0.182746 Jul 25 16:15:09.168442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1114/2301] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:08 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:09.182386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0ba5df8d-1d7b-4697-865b-a723cbbed4c8 tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] Calling method '.version_select at 0x7f9da49a2700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:09.254560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:09.269443 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d5440bb9-016d-4b8b-ac47-e537fe91977d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.611567 Jul 25 16:15:09.273237 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1188/2302] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:08 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:09.292520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:09.294823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:09.311845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:09.317806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:09.332434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:09.333445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:09.683353 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0ba5df8d-1d7b-4697-865b-a723cbbed4c8 tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/49a78d68-4712-426a-b13f-2dea82999fb1" status: 202 len: 0 microversion: 2.1 time: 0.506738 Jul 25 16:15:09.684236 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1115/2303] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:15:09 2022] DELETE /compute/v2.1/os-security-groups/49a78d68-4712-426a-b13f-2dea82999fb1 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:15:09.691584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:09.692730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:09.707226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:09.717907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:09.719122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:09.720121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:09.725317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:09.757385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:09.774388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24c42935-bd18-4f40-9ae8-9f710e1f1888 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.499711 Jul 25 16:15:09.775075 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1189/2304] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:09 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:09.801448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ddbf1f9-cd73-4c74-a11f-45805b35cc91 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938df550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:09.892607 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ddbf1f9-cd73-4c74-a11f-45805b35cc91 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.103842 Jul 25 16:15:09.897471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1190/2305] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:09 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:09.910896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fddf105-0b91-4dd7-9d28-a847ca47c662 tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] Calling method '.version_select at 0x7f9da4a1f310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:10.271665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:10.299672 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bea9f6e2-7c16-4e95-a9c5-786cb94b5943 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.612233 Jul 25 16:15:10.316962 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1116/2306] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:09 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:10.339407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:10.340662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:10.352543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:10.354109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:10.356664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:10.358700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.215178 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fddf105-0b91-4dd7-9d28-a847ca47c662 tempest-SecurityGroupsTestAdminJSON-1269979772 tempest-SecurityGroupsTestAdminJSON-1269979772-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/f5eba533-1562-4eed-b9e9-292d683bff49" status: 202 len: 0 microversion: 2.1 time: 1.315536 Jul 25 16:15:11.217921 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1191/2307] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:15:09 2022] DELETE /compute/v2.1/os-security-groups/f5eba533-1562-4eed-b9e9-292d683bff49 => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:15:11.246205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-219daf5f-453e-4b36-a721-9ced3dd934e2 req-47c196d1-dd24-4fec-890a-214ddec08cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3015bf-74b2-462a-bfac-23b80c32591f", "name": "network-vif-plugged", "status": "completed", "tag": "1e8e35c2-f1ab-440b-8a78-903ae7f5910a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:11.282118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:11.304543 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03d93fe3-06e4-47c5-82a3-3ca1103f37ee tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.975159 Jul 25 16:15:11.305686 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1117/2308] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:10 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:11.320298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:11.324035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:11.347876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.348139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-219daf5f-453e-4b36-a721-9ced3dd934e2 req-47c196d1-dd24-4fec-890a-214ddec08cf3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.349386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.351010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-219daf5f-453e-4b36-a721-9ced3dd934e2 req-47c196d1-dd24-4fec-890a-214ddec08cf3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.352018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.354110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.435649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-219daf5f-453e-4b36-a721-9ced3dd934e2 req-47c196d1-dd24-4fec-890a-214ddec08cf3 service nova] Creating event network-vif-plugged:1e8e35c2-f1ab-440b-8a78-903ae7f5910a for instance fa3015bf-74b2-462a-bfac-23b80c32591f on n-h2-846219-13 Jul 25 16:15:11.479431 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-219daf5f-453e-4b36-a721-9ced3dd934e2 req-47c196d1-dd24-4fec-890a-214ddec08cf3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250340 Jul 25 16:15:11.480682 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1192/2309] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:11.518007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:11.520354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:11.550200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.552379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.558520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.560053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.758315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:11.770249 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8e04b66-7ca1-4bf9-92e9-eeafdb06876c tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1280 microversion: 2.1 time: 0.461124 Jul 25 16:15:11.771490 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1118/2310] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:11 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:11.777480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24a958a2-a682-44a1-ac6e-15b73aac980a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93c22550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:11.890824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24a958a2-a682-44a1-ac6e-15b73aac980a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.117604 Jul 25 16:15:11.891871 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1119/2311] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:11 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:11.914211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:11.928025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:11.950041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.953444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:11.956059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:11.965324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:12.045868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:12.060734 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e31b469-8c87-4786-b2de-11c266a7beb4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 0.568040 Jul 25 16:15:12.064987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1193/2312] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:11 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:12.070433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13cc0147-dcbd-45d6-b4f9-f2dbc9c5eb55 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13cc0147-dcbd-45d6-b4f9-f2dbc9c5eb55 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 HTTP/1.1 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 280 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.086547 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 16:15:12.089797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:12.095435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13cc0147-dcbd-45d6-b4f9-f2dbc9c5eb55 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:12.096662 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13cc0147-dcbd-45d6-b4f9-f2dbc9c5eb55 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "PUT /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 400 len: 619 microversion: 2.1 time: 0.030317 Jul 25 16:15:12.099706 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1194/2313] 10.222.0.105 () {60 vars in 1262 bytes} [Mon Jul 25 16:15:12 2022] PUT /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:15:12.112709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:12.113584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:12.127666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:12.130635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:12.143080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:12.147803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:12.483280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:12.497012 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d43f551a-54fe-4b3f-8902-c4702e636c73 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.600816 Jul 25 16:15:12.498395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1120/2314] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:11 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:12.581680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:12.597063 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff845b8e-fe12-414e-90d4-119433d1f610 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.487820 Jul 25 16:15:12.613164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1195/2315] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:12 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:15:12.646265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:12.655326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:12.678075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:12.679201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:12.682288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:12.683208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:12.796851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:12.798031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:12.882464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:12.885740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:12.893536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:12.898311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:13.248778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:13.262678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4e7014e3-724d-4889-9f32-afbd585d2e85 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1280 microversion: 2.1 time: 0.471930 Jul 25 16:15:13.281835 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1196/2316] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:12 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1280 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:13.288272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-094a5bb5-2c02-4b17-9c82-c428b789e1c7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93879d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:13.379386 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-094a5bb5-2c02-4b17-9c82-c428b789e1c7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.095882 Jul 25 16:15:13.393867 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1197/2317] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:13 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:13.414619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:13.418818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:13.441832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:13.451953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:13.454666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:13.458671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:13.539298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:13.563681 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-728b2d7a-8cc4-429b-97eb-3383aa6d7d43 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 0.926541 Jul 25 16:15:13.574326 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1121/2318] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:12 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:13.598499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:13.603595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:13.616476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:13.619719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:13.622336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:13.624502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:14.691728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:15.436714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:15.485791 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1e0529ee-bc3d-4765-ba75-2f99cba2d6e0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 1.896439 Jul 25 16:15:15.496518 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1122/2319] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:13 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:15.550287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2c2dfb0-05a2-4681-8fd9-df67d4464674 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2c2dfb0-05a2-4681-8fd9-df67d4464674 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 HTTP/1.1 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 24 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": ""}} Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8', 'body': {'server': {'name': ''}}} Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi '' Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:15:15.581597 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:15:15.586353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:15.591889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2c2dfb0-05a2-4681-8fd9-df67d4464674 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:15.618168 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2c2dfb0-05a2-4681-8fd9-df67d4464674 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "PUT /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 400 len: 108 microversion: 2.1 time: 0.095995 Jul 25 16:15:15.627596 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1123/2320] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:15:15 2022] PUT /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 108 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:15:15.682974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:15.694031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:15.697131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:15.755483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:15.786349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:15.787494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:15.788540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:15.789372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:15.816056 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d98560c-ac99-4db3-a647-b7962ed405f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1323 microversion: 2.1 time: 2.419607 Jul 25 16:15:15.817055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1198/2321] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:13 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1323 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:15.860795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38a63331-4319-4886-92bd-b61cb9306ead tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938dfe50>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:16.060816 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38a63331-4319-4886-92bd-b61cb9306ead tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1458 microversion: 2.1 time: 0.231948 Jul 25 16:15:16.085770 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1199/2322] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:15 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1458 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:16.095477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:16.103895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9cf0e154-36d9-4d93-8844-c34984b95278 req-e1260339-26d8-4d16-ab0f-c0604eb8f176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4", "tag": "dde690ba-0845-4eb2-a660-da54966a90b7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:16.202332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9cf0e154-36d9-4d93-8844-c34984b95278 req-e1260339-26d8-4d16-ab0f-c0604eb8f176 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:16.204174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9cf0e154-36d9-4d93-8844-c34984b95278 req-e1260339-26d8-4d16-ab0f-c0604eb8f176 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:16.327139 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9cf0e154-36d9-4d93-8844-c34984b95278 req-e1260339-26d8-4d16-ab0f-c0604eb8f176 service nova] Creating event network-changed:dde690ba-0845-4eb2-a660-da54966a90b7 for instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 on n-h1-846219-13 Jul 25 16:15:16.349370 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9cf0e154-36d9-4d93-8844-c34984b95278 req-e1260339-26d8-4d16-ab0f-c0604eb8f176 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261337 Jul 25 16:15:16.353563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1200/2323] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:16.374084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:16.375041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:16.404694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:16.405165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:16.406274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:16.406906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:16.649978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:16.670168 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6803c026-c4bf-40ad-8af7-6b3f19b65fb2 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 1.031175 Jul 25 16:15:16.676280 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1124/2324] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:15 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:17.290980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72a1025c-bfb1-4b16-b780-65ddffee65d0 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Calling method '.version_select at 0x7f9d93fdd700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:17.527388 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72a1025c-bfb1-4b16-b780-65ddffee65d0 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 371 microversion: 2.1 time: 0.848684 Jul 25 16:15:17.528908 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1125/2325] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:15:16 2022] GET /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 371 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:17.543446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:17.544404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:17.553191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:17.553937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:17.554882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:17.555464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:17.680355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:17.699262 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bfcf6df3-61b4-4a85-b284-96d07eb68ca0 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1509 microversion: 2.1 time: 1.343295 Jul 25 16:15:17.701784 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1201/2326] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:16 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1509 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:17.717279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:17.717904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:17.731268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:17.732060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:17.733617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:17.737247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:17.738397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:18.298357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:18.339018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:18.339288 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22cd3456-9c6a-4288-910f-7c7f8ca358fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.806374 Jul 25 16:15:18.341740 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1126/2327] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:17 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:18.355105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5356fcb2-02c1-472a-a205-145000e3af9a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4942550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:18.365708 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a9e90ddb-b856-4e74-9c5f-ac8886986b7b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1473 microversion: 2.1 time: 0.661202 Jul 25 16:15:18.390114 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1202/2328] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:17 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1473 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:18.401530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0cca66fb-2550-43af-9b08-f9ae8ac0b414 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Action: 'update', calling method: .version_select at 0x7f9da49385e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:18.476296 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5356fcb2-02c1-472a-a205-145000e3af9a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1467 microversion: 2.1 time: 0.133347 Jul 25 16:15:18.489084 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1127/2329] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:18 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1467 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:18.503769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:18.507047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:18.524007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:18.529362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:18.537802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:18.539253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.132734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:19.152358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9636e1a-002d-454f-b9b3-af4b26d4766d tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.661659 Jul 25 16:15:19.159270 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1128/2330] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:18 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:19.232721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:19.236386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:19.260983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.263540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.271032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.274429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.670577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cca66fb-2550-43af-9b08-f9ae8ac0b414 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.675611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cca66fb-2550-43af-9b08-f9ae8ac0b414 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.676919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cca66fb-2550-43af-9b08-f9ae8ac0b414 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.678642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cca66fb-2550-43af-9b08-f9ae8ac0b414 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.703300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:19.717172 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40944570-7aaf-47cb-81bd-5336dfea1bc1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 200 len: 1473 microversion: 2.1 time: 0.555442 Jul 25 16:15:19.718283 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1129/2331] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:19 2022] GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 1473 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:19.724032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bacb7fd3-09da-43eb-a696-3a02181c23ab tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da0031dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:19.809853 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0cca66fb-2550-43af-9b08-f9ae8ac0b414 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 328 microversion: 2.1 time: 1.413898 Jul 25 16:15:19.811782 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1203/2332] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:18 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 328 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:19.818536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b3d11d57-202e-4199-b5e9-e5a52c7e48b7 req-4371c61b-739c-4712-8ebc-43bb4a724499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccef1233-dc50-4e36-b33b-5fe3947d2d40", "tag": "424981b1-8d26-410d-b453-7a973fd17c3a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:19.838048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b3d11d57-202e-4199-b5e9-e5a52c7e48b7 req-4371c61b-739c-4712-8ebc-43bb4a724499 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.838952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b3d11d57-202e-4199-b5e9-e5a52c7e48b7 req-4371c61b-739c-4712-8ebc-43bb4a724499 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.873185 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bacb7fd3-09da-43eb-a696-3a02181c23ab tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 200 len: 1467 microversion: 2.1 time: 0.153354 Jul 25 16:15:19.891862 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b3d11d57-202e-4199-b5e9-e5a52c7e48b7 req-4371c61b-739c-4712-8ebc-43bb4a724499 service nova] Creating event network-changed:424981b1-8d26-410d-b453-7a973fd17c3a for instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 on n-h1-846219-13 Jul 25 16:15:19.900217 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1130/2333] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:19 2022] GET /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 1467 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:19.909823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:19.917577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:19.932422 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b3d11d57-202e-4199-b5e9-e5a52c7e48b7 req-4371c61b-739c-4712-8ebc-43bb4a724499 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118222 Jul 25 16:15:19.935776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.937804 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1204/2334] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:19.941255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.942701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:19.943252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:19.962152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:19.987835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:19.992861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Searching by: {'reservation_id': 'r-vl7y5k31', 'deleted': False, 'project_id': 'b0327cf82312473da90dfaf13e95fcea'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:15:20.025503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:20.026870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:20.028804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:20.037566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:20.231034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:15:20.505833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:20.525975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:20.545923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2219cc98-1df3-4952-9217-2315468b7d77 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1521 microversion: 2.1 time: 0.642038 Jul 25 16:15:20.550690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1131/2335] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:19 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1521 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:20.560669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:20.562146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:20.572082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:20.572865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:20.592145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:20.592948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:20.594618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:20.597751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:21.394754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:21.424383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a43807b1-2fd3-4c9a-9e41-fffdf3253cd5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1471 microversion: 2.1 time: 0.871684 Jul 25 16:15:21.425919 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1132/2336] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:20 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1471 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:21.461692 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11e5b7bc-c770-4a57-b5ce-f06732569607 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/detail?reservation_id=r-vl7y5k31" status: 200 len: 2939 microversion: 2.1 time: 1.521308 Jul 25 16:15:21.463010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1205/2337] 10.222.0.105 () {58 vars in 1202 bytes} [Mon Jul 25 16:15:19 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vl7y5k31 => generated 2939 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:21.471355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:21.472615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:21.505831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:21.508661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:21.515490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:21.518145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:22.103255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1427255713", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:22.156481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:22.186466 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0bba1fb2-46a2-46fd-9ef1-3f7d6c8fbfd4 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.744948 Jul 25 16:15:22.187725 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1133/2338] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:21 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:22.222491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:22.325965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-483022871", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:22.490579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:23.623645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:23.624449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:23.625251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:23.626182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:23.627962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:23.654869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.655191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.656406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.657764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.705538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Getting quotas for project 027b63fd942b4af28161915158a37c46. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:23.718952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Getting quotas for user 8fbe6a04011445b1a1a3fd99cf019f72 and project 027b63fd942b4af28161915158a37c46. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:23.759281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:23.760148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:23.761544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:23.762437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:23.763321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:23.785991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.utils [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] cores quota exceeded for 027b63fd942b4af28161915158a37c46, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119599) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 16:15:23.786901 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Request method failure captured: Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 145 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sGR7jIFpy5p2J6x7SDjyQFj-CTxDBb5PoyYd1O3risoPWCtvVdBVgxOuEMKA9WtEXrIpoCNV1PN2r9lCo-n0QLEq1Yu-wilNi4BwQp--JdgRlethxg0m4G-THSZyUoWYIkL8_uEMKXsdhWiA1pkXffqlptFa4Y0Tkeut6ZHB_qewvs Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/027b63fd942b4af28161915158a37c46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_027b63fd942b4af28161915158a37c46"}]}] Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 8fbe6a04011445b1a1a3fd99cf019f72 Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1427255713", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1427255713', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452'}}} Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:15:23.798128 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 16:15:23.805869 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:23.815452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:23.815656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.815792 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3bd53b19-54ad-4f4c-afd8-77e6ac3ebdd8 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.346168 Jul 25 16:15:23.815792 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1206/2339] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:21 2022] POST /compute/v2.1/servers => generated 111 bytes in 2348 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:23.815945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.818128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.821743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.822913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c23c5b16-cccd-44b2-9fad-1af8714366c6 req-41d376c7-1213-460d-9871-27c3c14b233c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "name": "network-vif-unplugged", "status": "completed", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:23.838484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c23c5b16-cccd-44b2-9fad-1af8714366c6 req-41d376c7-1213-460d-9871-27c3c14b233c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.840213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c23c5b16-cccd-44b2-9fad-1af8714366c6 req-41d376c7-1213-460d-9871-27c3c14b233c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.855057 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c23c5b16-cccd-44b2-9fad-1af8714366c6 req-41d376c7-1213-460d-9871-27c3c14b233c service nova] Creating event network-vif-unplugged:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:15:23.865412 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c23c5b16-cccd-44b2-9fad-1af8714366c6 req-41d376c7-1213-460d-9871-27c3c14b233c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047649 Jul 25 16:15:23.866363 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1207/2340] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:23.876838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-269435008"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:23.883235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:23.892816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.894398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.896054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:23.897232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:23.915952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Getting quotas for project 959f5a2108434bf58ee07e6126258124. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:23.926519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Getting quotas for user c27015dd9c294b0fb05d8c555fe57362 and project 959f5a2108434bf58ee07e6126258124. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:23.947624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:15:23.951268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:24.037338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc47eb89-5ed1-425d-9c57-4f43c2e649a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.847998 Jul 25 16:15:24.038699 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1134/2341] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:15:24.068218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cce08356-5e79-4a1c-baca-5387b717f3da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:24.106366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.server_groups [None req-cce08356-5e79-4a1c-baca-5387b717f3da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Querying cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) for 2 instances {{(pid=119598) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 16:15:24.107444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cce08356-5e79-4a1c-baca-5387b717f3da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:24.108821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cce08356-5e79-4a1c-baca-5387b717f3da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:24.171600 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cce08356-5e79-4a1c-baca-5387b717f3da tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups/3cd8ff77-94b0-4d81-a5a8-f3eccbc896e2" status: 200 len: 269 microversion: 2.1 time: 0.131318 Jul 25 16:15:24.173370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1135/2342] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:15:24 2022] GET /compute/v2.1/os-server-groups/3cd8ff77-94b0-4d81-a5a8-f3eccbc896e2 => generated 269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:24.185242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:24.188470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:24.204095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:24.204556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:24.207267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:24.207744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:24.574889 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-46d510db-837d-4db6-87b3-438a96ade0ea tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "POST /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7/action" status: 202 len: 0 microversion: 2.1 time: 0.701185 Jul 25 16:15:24.576033 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1208/2343] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:15:23 2022] POST /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:15:24.585337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:24.590476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:24.608636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:24.614042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:24.615446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:24.617775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:24.867867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:24.896367 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2c00699-0d50-41c1-97cf-9fab82eb3a4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1527 microversion: 2.1 time: 0.721169 Jul 25 16:15:24.926307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1136/2344] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:24 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1527 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:24.957142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c112cc4e-db0e-4893-9b7a-78ea7657f00f tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Action: 'update', calling method: .version_select at 0x7f9da04d5940>, body: {"quota_set": {"cores": 20}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:25.174196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:25.184054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-28d1cb6c-5db9-4308-abd6-11b492f2e030 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.606147 Jul 25 16:15:25.187110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1209/2345] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:24 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:25.211421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1479195301", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:25.323898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:25.407037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c112cc4e-db0e-4893-9b7a-78ea7657f00f tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:25.415417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c112cc4e-db0e-4893-9b7a-78ea7657f00f tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:25.417800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c112cc4e-db0e-4893-9b7a-78ea7657f00f tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:25.419206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c112cc4e-db0e-4893-9b7a-78ea7657f00f tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:25.694814 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c112cc4e-db0e-4893-9b7a-78ea7657f00f tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 329 microversion: 2.1 time: 0.765872 Jul 25 16:15:25.697368 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1137/2346] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:24 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 329 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:25.716566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:25.724136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:25.742886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:25.745524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:25.749072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:25.751116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.033372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:26.034088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:26.034916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:26.035365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:26.035783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:26.103716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.106216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.109277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.111238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.113262 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d2f7506-d74d-4b71-a97c-dce2fbe07b89 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1626 microversion: 2.1 time: 0.413269 Jul 25 16:15:26.116221 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1138/2347] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:25 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1626 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:26.127635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0802b30b-57fa-4297-bd4f-881824a88290 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4a853a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:26.192860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Getting quotas for project 959f5a2108434bf58ee07e6126258124. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:26.231340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Getting quotas for user c27015dd9c294b0fb05d8c555fe57362 and project 959f5a2108434bf58ee07e6126258124. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:26.237715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0802b30b-57fa-4297-bd4f-881824a88290 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.118520 Jul 25 16:15:26.247443 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1139/2348] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:26 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:26.252714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c167307-2140-40e6-a361-24149582d8d5 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Calling method '.version_select at 0x7f9d93e4cca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:26.280273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:15:26.323196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:26.434660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:26.474424 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c167307-2140-40e6-a361-24149582d8d5 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 371 microversion: 2.1 time: 0.224860 Jul 25 16:15:26.477276 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1140/2349] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:15:26 2022] GET /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:26.506102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c30c64fb-2747-4ce3-8c9a-2890476758d5 req-a3f81587-42ca-48ea-a7a7-e6ec74526d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4", "name": "network-vif-plugged", "status": "completed", "tag": "dde690ba-0845-4eb2-a660-da54966a90b7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:26.545273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c30c64fb-2747-4ce3-8c9a-2890476758d5 req-a3f81587-42ca-48ea-a7a7-e6ec74526d5d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.551111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c30c64fb-2747-4ce3-8c9a-2890476758d5 req-a3f81587-42ca-48ea-a7a7-e6ec74526d5d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.554539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1f3d2fa-a5c1-4e8b-adc3-5bd104d1ce3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.364759 Jul 25 16:15:26.574491 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1210/2350] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:25 2022] POST /compute/v2.1/servers => generated 382 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:15:26.587384 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c30c64fb-2747-4ce3-8c9a-2890476758d5 req-a3f81587-42ca-48ea-a7a7-e6ec74526d5d service nova] Creating event network-vif-plugged:dde690ba-0845-4eb2-a660-da54966a90b7 for instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 on n-h1-846219-13 Jul 25 16:15:26.596377 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c30c64fb-2747-4ce3-8c9a-2890476758d5 req-a3f81587-42ca-48ea-a7a7-e6ec74526d5d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116841 Jul 25 16:15:26.602110 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1141/2351] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:26.609393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:26.610617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:26.613788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:26.633372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.634135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.637929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:26.638506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.639241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.648514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:26.670183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.671013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.676698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:26.678010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:26.725563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:27.033030 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-295aba25-ce92-4ff1-b6aa-728bf0169ec2 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 200 len: 1626 microversion: 2.1 time: 0.426304 Jul 25 16:15:27.035162 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1142/2352] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:26 2022] GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 1626 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:27.089976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:27.094648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:27.126186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:27.127221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:27.137625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:27.140696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:27.647404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:27.680018 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4d686bf4-dec4-4401-99b8-ea4e135904bc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1527 microversion: 2.1 time: 1.102419 Jul 25 16:15:27.695240 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1211/2353] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:26 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1527 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:27.711727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9278f425-eade-4d0e-930f-7af6b9061994 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Action: 'update', calling method: .version_select at 0x7f9d938790d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:27.919670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9278f425-eade-4d0e-930f-7af6b9061994 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:27.921754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9278f425-eade-4d0e-930f-7af6b9061994 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:27.922895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9278f425-eade-4d0e-930f-7af6b9061994 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:27.925837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9278f425-eade-4d0e-930f-7af6b9061994 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:27.933168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:27.952068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6791f8ea-627a-4c4f-96fd-9b3359ba11b1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.911058 Jul 25 16:15:27.954704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1143/2354] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:27 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:27.969951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:27.971757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:27.989611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:27.991649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:27.994320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:27.994986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:28.065602 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9278f425-eade-4d0e-930f-7af6b9061994 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 328 microversion: 2.1 time: 0.368479 Jul 25 16:15:28.084029 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1212/2355] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:27 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:28.084029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f9b747f8-5028-4906-ac07-26361163c878 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93536160>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:28.181313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:28.196012 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2c75d70e-2713-444a-980f-1178d758aefb tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1214 microversion: 2.1 time: 0.236599 Jul 25 16:15:28.196816 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1144/2356] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:27 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:28.223376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1084590483", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "9fd58fea-6110-43b7-9f72-c20592d5f0d4"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:28.232142 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f9b747f8-5028-4906-ac07-26361163c878 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.160090 Jul 25 16:15:28.236115 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1213/2357] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:28 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:28.255099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1720322801", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:28.362608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:28.367621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:29.043751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:29.045644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:29.046580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:29.048525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:29.049324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:29.094434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.095433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.100208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.101966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.196249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Getting quotas for project 027b63fd942b4af28161915158a37c46. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:29.213309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Getting quotas for user 8fbe6a04011445b1a1a3fd99cf019f72 and project 027b63fd942b4af28161915158a37c46. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:29.245415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.utils [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] instances quota exceeded for 027b63fd942b4af28161915158a37c46, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119599) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 16:15:29.258585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Request method failure captured: Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 145 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sGR7jIFpy5p2J6x7SDjyQFj-CTxDBb5PoyYd1O3risoPWCtvVdBVgxOuEMKA9WtEXrIpoCNV1PN2r9lCo-n0QLEq1Yu-wilNi4BwQp--JdgRlethxg0m4G-THSZyUoWYIkL8_uEMKXsdhWiA1pkXffqlptFa4Y0Tkeut6ZHB_qewvs Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/027b63fd942b4af28161915158a37c46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_027b63fd942b4af28161915158a37c46"}]}] Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 8fbe6a04011445b1a1a3fd99cf019f72 Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1720322801", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1720322801', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452'}}} Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:15:29.268110 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 16:15:29.278475 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:29.287449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:29.289957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6178371-ce85-479b-b27f-355ccdb6632d tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.052014 Jul 25 16:15:29.291906 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1214/2358] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:28 2022] POST /compute/v2.1/servers => generated 119 bytes in 1055 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:29.303208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:29.304560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:29.343961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.346413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.349073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.350055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.704101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:29.705712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:29.706646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:29.707615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:29.708140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:29.725495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.726316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.727627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.728741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.761371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:29.771356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:29.794341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:15:29.799336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:29.876301 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-655acc6c-95be-4f3c-8e04-9ec276d60ae0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.658606 Jul 25 16:15:29.883380 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1145/2359] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:15:29.888533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a9ee8098-a11a-42b5-b1f3-130789bdc6ff req-8f18005c-801e-4999-aac4-2578f6bb40f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b95ec35-12ff-46c5-aceb-8daf24ae63b7", "name": "network-vif-plugged", "status": "completed", "tag": "ce4676ac-b993-4041-85d8-5a309a5e5f56"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:29.901804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a9ee8098-a11a-42b5-b1f3-130789bdc6ff req-8f18005c-801e-4999-aac4-2578f6bb40f0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.902233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a9ee8098-a11a-42b5-b1f3-130789bdc6ff req-8f18005c-801e-4999-aac4-2578f6bb40f0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.919181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:29.927927 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a9ee8098-a11a-42b5-b1f3-130789bdc6ff req-8f18005c-801e-4999-aac4-2578f6bb40f0 service nova] Creating event network-vif-plugged:ce4676ac-b993-4041-85d8-5a309a5e5f56 for instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 on n-h2-846219-13 Jul 25 16:15:29.941311 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a9ee8098-a11a-42b5-b1f3-130789bdc6ff req-8f18005c-801e-4999-aac4-2578f6bb40f0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062888 Jul 25 16:15:29.943445 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1146/2360] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:29.946424 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-55f6cb91-1a9e-4c37-b841-ea97adce55cc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1527 microversion: 2.1 time: 0.652393 Jul 25 16:15:29.950090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:29.950998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:29.952396 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1215/2361] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:29 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1527 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:29.957679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:29.958301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:29.971330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.972427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.975748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.978320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.995167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.995658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:29.996848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:29.997432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:30.220453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:30.245845 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c964a894-7e15-4e64-b1fe-2f2a6aed2b78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1276 microversion: 2.1 time: 0.291790 Jul 25 16:15:30.256466 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1216/2362] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:29 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:30.276474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bd4b195-275c-4199-b638-faead0579624 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938795e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:30.395715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7bd4b195-275c-4199-b638-faead0579624 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.136744 Jul 25 16:15:30.398413 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1217/2363] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:30 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:30.414006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-437355b4-0f3e-400f-9bb8-7c88a7261bfd tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Action: 'update', calling method: .version_select at 0x7f9d9352d3a0>, body: {"quota_set": {"instances": 10}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:30.555448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:30.568392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e43ce294-9147-41ad-94d9-ee76549a0ac8 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.619536 Jul 25 16:15:30.581168 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1147/2364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:29 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:30.581168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:30.581168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:30.595336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:30.596373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:30.597908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:30.600639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:30.645569 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 HTTP/1.1 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b7615cee-3cb3-4712-b6c0-2b4d54eba252'} Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:15:30.650189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.655191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:30.656285 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce90a439-00e3-4c6a-a593-5e5fc965ad82 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 404 len: 111 microversion: 2.1 time: 0.085506 Jul 25 16:15:30.661775 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1148/2365] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:15:30 2022] DELETE /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:30.674748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e4e9d3b-0986-4faa-8967-3f966c7c7c34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:30.675186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6e4e9d3b-0986-4faa-8967-3f966c7c7c34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:30.855482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6e4e9d3b-0986-4faa-8967-3f966c7c7c34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:30.865020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6e4e9d3b-0986-4faa-8967-3f966c7c7c34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1221 microversion: 2.1 time: 0.203924 Jul 25 16:15:30.869693 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1149/2366] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:30 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:30.900269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:30.903897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: b7615cee-3cb3-4712-b6c0-2b4d54eba252] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:30.920800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:30.936881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:30.939305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:30.942664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:30.965232 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 HTTP/1.1 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b7615cee-3cb3-4712-b6c0-2b4d54eba252'} Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:30.967767 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. Jul 25 16:15:30.971857 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:30.975641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance b7615cee-3cb3-4712-b6c0-2b4d54eba252 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:30.976769 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56946634-60f6-4914-8577-fda89c60602c tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252" status: 404 len: 111 microversion: 2.1 time: 0.105339 Jul 25 16:15:30.978589 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1150/2367] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:30 2022] GET /compute/v2.1/servers/b7615cee-3cb3-4712-b6c0-2b4d54eba252 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:30.988268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:30.995107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:31.018733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.021411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.028186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.029319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.088142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-437355b4-0f3e-400f-9bb8-7c88a7261bfd tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.091254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-437355b4-0f3e-400f-9bb8-7c88a7261bfd tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.093960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-437355b4-0f3e-400f-9bb8-7c88a7261bfd tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.094718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-437355b4-0f3e-400f-9bb8-7c88a7261bfd tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.287915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-437355b4-0f3e-400f-9bb8-7c88a7261bfd tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 329 microversion: 2.1 time: 0.887499 Jul 25 16:15:31.311037 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1218/2368] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:30 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 329 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:31.317531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:31.319698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:31.335755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.336207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.337148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.337470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.403571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:15:31.611466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:31.636542 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b6347bd-f203-4ec9-9144-5e61a92ed855 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1527 microversion: 2.1 time: 0.656199 Jul 25 16:15:31.650233 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1151/2369] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:30 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1527 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:31.673547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:31.674954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:31.690857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:31.719725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.724623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.728932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:31.738709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:31.790050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-32b6ad16-2751-423a-8549-7d37a5a08b68 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "DELETE /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 204 len: 0 microversion: 2.1 time: 0.476382 Jul 25 16:15:31.793245 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1219/2370] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:15:31 2022] DELETE /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:15:31.800137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e37f96a-174c-4083-937a-94a72a29aa5a tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Calling method '.version_select at 0x7f9da4b178b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:32.079419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:32.109987 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56e56428-20fb-4b83-8783-418a3e335e30 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1276 microversion: 2.1 time: 0.456372 Jul 25 16:15:32.124781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1152/2371] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:31 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1276 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:32.142921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-049fb241-7344-49fd-b465-0876ad285591 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93fdd940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:32.263117 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-049fb241-7344-49fd-b465-0876ad285591 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.136179 Jul 25 16:15:32.266598 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1153/2372] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:32 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:32.280996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:32.286198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:32.312173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:32.318159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:32.322711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:32.324047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:32.781367 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e37f96a-174c-4083-937a-94a72a29aa5a tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 371 microversion: 2.1 time: 0.983963 Jul 25 16:15:32.782281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1220/2373] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 16:15:31 2022] GET /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 371 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:32.791130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:32.792272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:32.811055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:32.812015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:32.814457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:32.820060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:32.941085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:32.954368 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cd73672a-4f55-49e5-8a38-e7fb5c37d572 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.685554 Jul 25 16:15:32.985555 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1154/2374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:32 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:33.003337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:33.010321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:33.031542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.032362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:33.033451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.034189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:33.229146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:33.256114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f2ee2f43-0507-4106-8131-fc191b901804 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1217 microversion: 2.1 time: 0.265594 Jul 25 16:15:33.257653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1155/2375] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:32 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:33.291524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2fc147fb-4a87-4490-bf56-b270b832c70a req-4bb1048c-388b-478b-a020-0284b7c7abfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c93153b-4dba-4766-817d-2d48cbe83d73", "name": "network-vif-plugged", "status": "completed", "tag": "61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:33.379649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2fc147fb-4a87-4490-bf56-b270b832c70a req-4bb1048c-388b-478b-a020-0284b7c7abfe service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.380858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2fc147fb-4a87-4490-bf56-b270b832c70a req-4bb1048c-388b-478b-a020-0284b7c7abfe service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:33.429761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:33.451485 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d0dfdb4d-b8fa-4146-b729-3929e5a7ea3b tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1515 microversion: 2.1 time: 0.666366 Jul 25 16:15:33.465191 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1221/2376] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:32 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1515 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:33.465506 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2fc147fb-4a87-4490-bf56-b270b832c70a req-4bb1048c-388b-478b-a020-0284b7c7abfe service nova] Creating event network-vif-plugged:61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00 for instance 8c93153b-4dba-4766-817d-2d48cbe83d73 on n-h1-846219-13 Jul 25 16:15:33.481438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:33.481438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:33.485077 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2fc147fb-4a87-4490-bf56-b270b832c70a req-4bb1048c-388b-478b-a020-0284b7c7abfe service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222491 Jul 25 16:15:33.486867 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1156/2377] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:33.499680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.500772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:33.502784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.503822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:33.510438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09d5182c-516c-4218-82c3-c638e8e810fb tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Action: 'update', calling method: .version_select at 0x7f9da02b4280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:33.915823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09d5182c-516c-4218-82c3-c638e8e810fb tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.927289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09d5182c-516c-4218-82c3-c638e8e810fb tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:33.943906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09d5182c-516c-4218-82c3-c638e8e810fb tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:33.947934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09d5182c-516c-4218-82c3-c638e8e810fb tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.002758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:34.014725 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-835ebcb6-7100-4ba7-b71f-7602bae2ba00 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1527 microversion: 2.1 time: 0.559608 Jul 25 16:15:34.030274 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1222/2378] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:33 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1527 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:34.036322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:34.037255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:34.049401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:34.050984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.052076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:34.052698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.147371 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09d5182c-516c-4218-82c3-c638e8e810fb tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 325 microversion: 2.1 time: 0.653066 Jul 25 16:15:34.148421 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1157/2379] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:33 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 325 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:34.155871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9bfbebc2-f481-4c01-a1d7-4a932b91ebf5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da02a2700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:34.403049 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9bfbebc2-f481-4c01-a1d7-4a932b91ebf5 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.252816 Jul 25 16:15:34.415112 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1158/2380] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:34 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:34.434408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:34.454765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:34.488655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:34.490241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.491953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:34.492944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.784179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:34.808469 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ed315782-833c-4eb3-aa15-4f544c106827 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 0.776194 Jul 25 16:15:34.809271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1223/2381] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:34 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:34.830319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:34.831193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:34.844325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:34.846867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.850292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:34.854166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:34.872949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:34.912740 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8b17ee2-a7a8-4d1a-98bf-74bd49a446eb tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.491060 Jul 25 16:15:34.942194 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1159/2382] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:34 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:34.968125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:34.971281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:35.005909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:35.007167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:35.008915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:35.010061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:35.522261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:35.543461 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ad5899f-7adb-4599-a098-67587f425789 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1217 microversion: 2.1 time: 0.732921 Jul 25 16:15:35.544073 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1224/2383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:34 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1217 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:35.560092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-953161958", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:35.687116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:35.759617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa99685f6e9645beb76617f1d0fdbae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd36be87b9d404ea0126c2046f31845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:35.781380 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57e48f98-73f5-4e85-b38d-d89417761fcd tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 200 len: 1515 microversion: 2.1 time: 0.833215 Jul 25 16:15:35.788198 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1160/2384] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:34 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 1515 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:35.812541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:35.815001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:35.840739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:35.846565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:35.860057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:35.860563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:37.332258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:37.437644 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e6323815-0cf1-42d3-bb51-335de5136daa tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1527 microversion: 2.1 time: 1.645992 Jul 25 16:15:37.463931 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1161/2385] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:35 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1527 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:37.512069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-15cf8b12-18e9-4ab4-a2d5-1a4e1468271d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93d214c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:37.581665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:37.582241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:37.582565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:37.583059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:37.583631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:37.625205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:37.638303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:37.639842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:37.640569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:37.661479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-15cf8b12-18e9-4ab4-a2d5-1a4e1468271d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.187046 Jul 25 16:15:37.665557 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1162/2386] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:37 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:37.702370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-72a76b71-6900-424f-9d6c-084d08f1bc8e req-06d48640-0746-4f30-acd7-1b70263e291a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccef1233-dc50-4e36-b33b-5fe3947d2d40", "name": "network-vif-plugged", "status": "completed", "tag": "424981b1-8d26-410d-b453-7a973fd17c3a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:37.787273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-72a76b71-6900-424f-9d6c-084d08f1bc8e req-06d48640-0746-4f30-acd7-1b70263e291a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:37.787836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-72a76b71-6900-424f-9d6c-084d08f1bc8e req-06d48640-0746-4f30-acd7-1b70263e291a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:37.793311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Getting quotas for project 027b63fd942b4af28161915158a37c46. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:37.832601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Getting quotas for user 8fbe6a04011445b1a1a3fd99cf019f72 and project 027b63fd942b4af28161915158a37c46. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:37.866692 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-72a76b71-6900-424f-9d6c-084d08f1bc8e req-06d48640-0746-4f30-acd7-1b70263e291a service nova] Creating event network-vif-plugged:424981b1-8d26-410d-b453-7a973fd17c3a for instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 on n-h1-846219-13 Jul 25 16:15:37.906713 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-72a76b71-6900-424f-9d6c-084d08f1bc8e req-06d48640-0746-4f30-acd7-1b70263e291a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228582 Jul 25 16:15:37.909571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1163/2387] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:37.930930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.utils [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] ram quota exceeded for 027b63fd942b4af28161915158a37c46, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119599) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 16:15:37.931897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 16:15:37.942350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:37.943716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Request method failure captured: Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 144 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sGR7jIFpy5p2J6x7SDjyQFj-CTxDBb5PoyYd1O3risoPWCtvVdBVgxOuEMKA9WtEXrIpoCNV1PN2r9lCo-n0QLEq1Yu-wilNi4BwQp--JdgRlethxg0m4G-THSZyUoWYIkL8_uEMKXsdhWiA1pkXffqlptFa4Y0Tkeut6ZHB_qewvs Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/027b63fd942b4af28161915158a37c46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_027b63fd942b4af28161915158a37c46"}]}] Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 8fbe6a04011445b1a1a3fd99cf019f72 Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-953161958", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-953161958', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452'}}} Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 16:15:37.954972 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:15:37.964106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:37.972522 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-61c72d8c-b803-4187-99bd-8179674ca8f0 tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.423537 Jul 25 16:15:37.977914 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1225/2388] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:35 2022] POST /compute/v2.1/servers => generated 110 bytes in 2433 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:38.016849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:38.020028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:38.021258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:38.022690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:38.023608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:38.028794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:38.088412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:38.089238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:38.113132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:38.115819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.281059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:39.294955 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dbd8cdf7-9937-4253-bff9-bb7329259a69 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 1.314293 Jul 25 16:15:39.296071 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1226/2389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:37 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:39.314930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:39.316353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:39.320348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:39.337895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6be58528-9ae8-4177-89df-829b5ece2bf5 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 1.420440 Jul 25 16:15:39.338103 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1164/2390] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:37 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:39.346756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.347492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.348450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.349292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.353173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:39.353982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] [instance: 014fd993-5b27-49d3-a044-1a252cc437a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:39.362627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.363470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.365641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.366527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.393495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] HTTP exception thrown: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 could not be found. Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Request method failure captured: Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 HTTP/1.1 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sBClgoTkgR8wt5y3YbGiHft1JyHL7qrm9w2mWrdIVk20eIOuZwc3eV5eoTdFLgMeZ-S4VkUfMqNRpGvqbXtysHxnDZl0qLYGPCs8r_1WZg-9o-6WuydTuhjHesepEOBUYrp6oxEMIAmiIhbj89TssWLrTqHDTG1THt52zeBeyNgUso Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7bd36be87b9d404ea0126c2046f31845"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7bd36be87b9d404ea0126c2046f31845"}]}] Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7bd36be87b9d404ea0126c2046f31845 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1595239835 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: fa99685f6e9645beb76617f1d0fdbae3 Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1595239835-project Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 could not be found. Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '014fd993-5b27-49d3-a044-1a252cc437a8'} Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 could not be found. Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 could not be found. Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:39.395422 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 could not be found. Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] Returning 404 to user: Instance 014fd993-5b27-49d3-a044-1a252cc437a8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-638342d5-7cdb-45a8-8bfb-341058efa997 tempest-ServersNegativeTestJSON-1595239835 tempest-ServersNegativeTestJSON-1595239835-project] 10.222.0.105 "GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8" status: 404 len: 111 microversion: 2.1 time: 0.051949 Jul 25 16:15:39.406262 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1165/2391] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:39 2022] GET /compute/v2.1/servers/014fd993-5b27-49d3-a044-1a252cc437a8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:39.412132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-51f1c8aa-6e2c-477e-9f03-60dbd4538566 req-452a8f2d-4576-4308-8622-a5e6f96d4e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:39.420916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-51f1c8aa-6e2c-477e-9f03-60dbd4538566 req-452a8f2d-4576-4308-8622-a5e6f96d4e60 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.421359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-51f1c8aa-6e2c-477e-9f03-60dbd4538566 req-452a8f2d-4576-4308-8622-a5e6f96d4e60 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.461030 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-51f1c8aa-6e2c-477e-9f03-60dbd4538566 req-452a8f2d-4576-4308-8622-a5e6f96d4e60 service nova] Creating event network-changed:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:15:39.475742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-51f1c8aa-6e2c-477e-9f03-60dbd4538566 req-452a8f2d-4576-4308-8622-a5e6f96d4e60 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070532 Jul 25 16:15:39.478750 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1166/2392] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:39.496520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8df6f36-0983-4533-a2e8-d7ebe5ed0233 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Action: 'update', calling method: .version_select at 0x7f9d93c22700>, body: {"quota_set": {"ram": 51200}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:39.547250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:39.560423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99fed108-0281-41cf-8980-cfb9c87895d9 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1279 microversion: 2.1 time: 0.262845 Jul 25 16:15:39.573683 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1227/2393] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:39 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:39.579788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:39.590553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:39.606841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.608100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:39.608996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:39.609713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.182662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8df6f36-0983-4533-a2e8-d7ebe5ed0233 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.186663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8df6f36-0983-4533-a2e8-d7ebe5ed0233 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.189459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8df6f36-0983-4533-a2e8-d7ebe5ed0233 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.191800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8df6f36-0983-4533-a2e8-d7ebe5ed0233 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.433419 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f8df6f36-0983-4533-a2e8-d7ebe5ed0233 tempest-QuotasAdminNegativeTest-1045377469 tempest-QuotasAdminNegativeTest-1045377469-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 200 len: 329 microversion: 2.1 time: 0.948655 Jul 25 16:15:40.455419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1167/2394] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:39 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 329 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:40.468222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16d73229-a7d3-4cfc-a2ff-6d58d9bc5360 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da041ae50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:40.478039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:40.498544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d0700f74-921a-4584-9110-5c5b3c0067cf tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1512 microversion: 2.1 time: 0.931864 Jul 25 16:15:40.508883 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1228/2395] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:39 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1512 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:40.517323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f9955890-5d7f-475c-975d-7ab753161841 req-433aab12-2d02-4bf5-9ba7-261049b6ebbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "name": "network-vif-unplugged", "status": "completed", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:40.543311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f9955890-5d7f-475c-975d-7ab753161841 req-433aab12-2d02-4bf5-9ba7-261049b6ebbf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.550191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f9955890-5d7f-475c-975d-7ab753161841 req-433aab12-2d02-4bf5-9ba7-261049b6ebbf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.569767 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16d73229-a7d3-4cfc-a2ff-6d58d9bc5360 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.111889 Jul 25 16:15:40.571439 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1168/2396] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:40 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:40.572153 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f9955890-5d7f-475c-975d-7ab753161841 req-433aab12-2d02-4bf5-9ba7-261049b6ebbf service nova] Creating event network-vif-unplugged:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:15:40.585219 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f9955890-5d7f-475c-975d-7ab753161841 req-433aab12-2d02-4bf5-9ba7-261049b6ebbf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073747 Jul 25 16:15:40.587586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9fc4f00d-a0c4-4ee7-9a36-ac9daa32e5f4 req-83538d1b-fa32-4b9a-845c-a66894b2b9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db0aa9e-0897-4142-b8c1-03b4f979f863", "tag": "2c61b534-2639-48ec-833f-eb2807c3a5a5"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:40.588986 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1229/2397] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:40.613863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:40.621735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:40.635808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.636636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.637681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.637989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9fc4f00d-a0c4-4ee7-9a36-ac9daa32e5f4 req-83538d1b-fa32-4b9a-845c-a66894b2b9e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.638645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.642959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9fc4f00d-a0c4-4ee7-9a36-ac9daa32e5f4 req-83538d1b-fa32-4b9a-845c-a66894b2b9e3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.673492 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9fc4f00d-a0c4-4ee7-9a36-ac9daa32e5f4 req-83538d1b-fa32-4b9a-845c-a66894b2b9e3 service nova] Creating event network-changed:2c61b534-2639-48ec-833f-eb2807c3a5a5 for instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 on n-h2-846219-13 Jul 25 16:15:40.688616 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9fc4f00d-a0c4-4ee7-9a36-ac9daa32e5f4 req-83538d1b-fa32-4b9a-845c-a66894b2b9e3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113982 Jul 25 16:15:40.689630 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1169/2398] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:40.709051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:40.710220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:40.720933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.722294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:40.723798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:40.724628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:41.254747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:41.298527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e7a4494-adae-499c-9ead-55e3080c777a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 0.607223 Jul 25 16:15:41.299860 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1170/2399] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:40 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:41.310838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d437f7d-585e-4271-8468-b9b7ec6db21b tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Action: 'update', calling method: .version_select at 0x7f9da041a9d0>, body: {"quota_set": {"ram": 0}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:41.340074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6d437f7d-585e-4271-8468-b9b7ec6db21b tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '8fbe6a04011445b1a1a3fd99cf019f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b63fd942b4af28161915158a37c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d437f7d-585e-4271-8468-b9b7ec6db21b tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Request method failure captured: Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 HTTP/1.1 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 25 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sGR7jIFpy5p2J6x7SDjyQFj-CTxDBb5PoyYd1O3risoPWCtvVdBVgxOuEMKA9WtEXrIpoCNV1PN2r9lCo-n0QLEq1Yu-wilNi4BwQp--JdgRlethxg0m4G-THSZyUoWYIkL8_uEMKXsdhWiA1pkXffqlptFa4Y0Tkeut6ZHB_qewvs Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/027b63fd942b4af28161915158a37c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/027b63fd942b4af28161915158a37c46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_027b63fd942b4af28161915158a37c46"}]}] Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 027b63fd942b4af28161915158a37c46 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-220297125 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 8fbe6a04011445b1a1a3fd99cf019f72 Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-QuotasAdminNegativeTest-220297125-project Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: {"quota_set": {"ram": 0}} Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '027b63fd942b4af28161915158a37c46', 'body': {'quota_set': {'ram': 0}}} Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 16:15:41.351509 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 16:15:41.358856 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:15:41.365773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d437f7d-585e-4271-8468-b9b7ec6db21b tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:15:41.367739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d437f7d-585e-4271-8468-b9b7ec6db21b tempest-QuotasAdminNegativeTest-220297125 tempest-QuotasAdminNegativeTest-220297125-project] 10.222.0.105 "PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46" status: 403 len: 116 microversion: 2.1 time: 0.066219 Jul 25 16:15:41.368999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1171/2400] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:15:41 2022] PUT /compute/v2.1/os-quota-sets/027b63fd942b4af28161915158a37c46 => generated 116 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:15:41.387845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:41.389948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:41.408769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:41.416354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:41.418166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:41.418874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:41.484616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:41.550433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:41.600922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06ec8c39-56c3-4a58-b632-07366c5fe5df tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1322 microversion: 2.1 time: 0.994492 Jul 25 16:15:41.617672 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1230/2401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:40 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1322 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:41.646742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:41.647726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:41.663698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:41.664014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:41.666135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:41.670798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:43.913604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:43.943395 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-400c3918-0f06-4af5-8dc6-f2849d5bad06 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 2.323594 Jul 25 16:15:43.957231 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1231/2402] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:41 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:43.980266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5ef9dc22-cbd3-41f5-80fb-750b8e942a01 req-4c95047d-6944-413a-bee5-eeb352664dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014fd993-5b27-49d3-a044-1a252cc437a8", "name": "network-vif-deleted", "tag": "2f821718-5754-40f4-8ae7-609c27092b2b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:44.002784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5ef9dc22-cbd3-41f5-80fb-750b8e942a01 req-4c95047d-6944-413a-bee5-eeb352664dcd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:44.003646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5ef9dc22-cbd3-41f5-80fb-750b8e942a01 req-4c95047d-6944-413a-bee5-eeb352664dcd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:44.022890 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5ef9dc22-cbd3-41f5-80fb-750b8e942a01 req-4c95047d-6944-413a-bee5-eeb352664dcd service nova] Creating event network-vif-deleted:2f821718-5754-40f4-8ae7-609c27092b2b for instance 014fd993-5b27-49d3-a044-1a252cc437a8 on n-h2-846219-13 Jul 25 16:15:44.033268 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5ef9dc22-cbd3-41f5-80fb-750b8e942a01 req-4c95047d-6944-413a-bee5-eeb352664dcd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085662 Jul 25 16:15:44.043062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1232/2403] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:44.054668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-23d0dcdd-9969-462f-a808-0bbd4de6afe9 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d936bd940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:44.074778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:44.097847 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-228b734a-8714-4470-9577-ce529e718cf1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 200 len: 1512 microversion: 2.1 time: 2.719205 Jul 25 16:15:44.098221 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1172/2404] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:41 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 1512 bytes in 2722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:44.142103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:44.143220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:44.181718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:44.182402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:44.183822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:44.184485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:44.205415 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-23d0dcdd-9969-462f-a808-0bbd4de6afe9 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.159738 Jul 25 16:15:44.217945 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1233/2405] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:44 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:44.224682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:44.226465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:44.255843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:44.256664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:44.258143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:44.258894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:44.357746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:45.171849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:45.199660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00c824f9-3a4c-40f4-9d41-1157e57c616b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 200 len: 1511 microversion: 2.1 time: 0.979813 Jul 25 16:15:45.201216 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1234/2406] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:44 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 1511 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:45.220247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:45.230044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:45.239131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:45.243876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:45.244793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:45.247566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:45.248375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:45.252534 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6fa048f5-86d8-4856-b994-fb4b81b18136 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 1.137621 Jul 25 16:15:45.257612 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1173/2407] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:44 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:45.278103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:45.280065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:45.300896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:45.304404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:45.307191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:45.313170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:45.321770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:15:45.584148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:45.635840 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fa19ee5f-945f-4f2e-8170-92dfdd2cecc7 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 204 len: 0 microversion: 2.1 time: 0.431491 Jul 25 16:15:45.640616 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1235/2408] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:15:45 2022] DELETE /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:15:45.718472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:45.728377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:45.748401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:45.750390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:45.752631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:45.753893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:46.004347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:46.019662 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f1d0066-973f-4b0a-9545-75320265e295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 0.760269 Jul 25 16:15:46.049604 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1174/2409] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:45 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:46.064445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34c8a08b-7636-4748-92e5-e6ac8f891ce7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4955dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:46.212458 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34c8a08b-7636-4748-92e5-e6ac8f891ce7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.160722 Jul 25 16:15:46.217077 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1175/2410] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:46 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:46.251380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1588236816", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "5158bc42-bdb3-4b68-8404-8ff835ac0788"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:46.508848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] validate_networks() for [('5158bc42-bdb3-4b68-8404-8ff835ac0788', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:46.743313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:46.769744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-acc3bb0e-6f60-4622-b5f9-94e46633db27 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4" status: 200 len: 1510 microversion: 2.1 time: 1.125122 Jul 25 16:15:46.773085 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1236/2411] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:45 2022] GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 => generated 1510 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:46.794047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:46.795943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:46.811652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:46.813592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:46.815258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:46.816388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:47.711416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=16 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:47.877964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=52 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:48.522184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:48.535828 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bb6f4b4b-42db-4c0d-898d-565e71171b00 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 1.760552 Jul 25 16:15:48.539089 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1237/2412] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:46 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:48.557313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-27755798-6d4d-4000-ac1d-48f8aedab28d req-a6f12a69-7801-42a4-9fea-86602273a541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "name": "network-vif-plugged", "status": "completed", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:48.582092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-27755798-6d4d-4000-ac1d-48f8aedab28d req-a6f12a69-7801-42a4-9fea-86602273a541 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:48.583470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-27755798-6d4d-4000-ac1d-48f8aedab28d req-a6f12a69-7801-42a4-9fea-86602273a541 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:48.619192 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-27755798-6d4d-4000-ac1d-48f8aedab28d req-a6f12a69-7801-42a4-9fea-86602273a541 service nova] Creating event network-vif-plugged:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:15:48.630830 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-27755798-6d4d-4000-ac1d-48f8aedab28d req-a6f12a69-7801-42a4-9fea-86602273a541 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089984 Jul 25 16:15:48.635201 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1238/2413] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:48.655752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:48.658220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:48.680257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:48.682258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:48.687852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:48.689247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:48.771315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:15:49.036844 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fbf4e22c-e979-42e0-a6b3-0702fc8f9697 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4" status: 204 len: 0 microversion: 2.1 time: 0.398605 Jul 25 16:15:49.042521 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1239/2414] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:15:48 2022] DELETE /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:15:49.062307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:49.069474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:49.093910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:49.096296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:49.098697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:49.101462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:49.780510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:49.795808 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24bb1c85-cb3f-4529-88d3-0cb8a9de769c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 0.751190 Jul 25 16:15:49.798519 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1240/2415] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:49 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:49.817057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-01a40098-f034-4201-9286-f79c5198080f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93500a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:49.926561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-01a40098-f034-4201-9286-f79c5198080f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.126435 Jul 25 16:15:49.927651 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1241/2416] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:49 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:49.943778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:49.957945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:49.986394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:49.986687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:49.987648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:49.993361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:50.089418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:15:50.249858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:50.273014 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13eb7a20-4e53-40b7-9b24-04a45aa7f362 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 204 len: 0 microversion: 2.1 time: 0.341771 Jul 25 16:15:50.274089 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1242/2417] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:15:49 2022] DELETE /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:15:50.332703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-cd749f59-3749-48ed-8796-f4f629722764 req-e75630f7-643d-4d2d-98e4-e90992a30ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d282c9ca-9b5f-4406-afc3-6d647d0b508e", "tag": "21c59e6e-eb38-4eb8-b010-d4ece0f797c1"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:50.357765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cd749f59-3749-48ed-8796-f4f629722764 req-e75630f7-643d-4d2d-98e4-e90992a30ce8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:50.360183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cd749f59-3749-48ed-8796-f4f629722764 req-e75630f7-643d-4d2d-98e4-e90992a30ce8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:50.387799 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-cd749f59-3749-48ed-8796-f4f629722764 req-e75630f7-643d-4d2d-98e4-e90992a30ce8 service nova] Creating event network-changed:21c59e6e-eb38-4eb8-b010-d4ece0f797c1 for instance d282c9ca-9b5f-4406-afc3-6d647d0b508e on n-h2-846219-13 Jul 25 16:15:50.403660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=42 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:50.420261 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-cd749f59-3749-48ed-8796-f4f629722764 req-e75630f7-643d-4d2d-98e4-e90992a30ce8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119031 Jul 25 16:15:50.426811 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1243/2418] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:50.443460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:50.444289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:50.466420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:50.467952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:50.468698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:50.469166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:50.669377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:50.670226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:50.670844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:50.671264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:50.671926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:50.719989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:50.721352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:50.726886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:50.728348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:50.793082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Getting quotas for project 39dd18d28d79468a8ebb393017af7979. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:50.835311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Getting quotas for user a4a4683dfce541c8acff65c7c09e5372 and project 39dd18d28d79468a8ebb393017af7979. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:50.892339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:15:50.900328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:51.078899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-432f752b-0ba9-4c2a-9c99-248fb4c07293 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.859759 Jul 25 16:15:51.081835 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1176/2419] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 4864 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:15:51.091977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:51.092608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:51.120825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:51.121488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:51.123128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:51.123694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:51.964845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:51.990821 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3e908fe-541f-4bcb-95f9-ca6e61160318 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 1.562482 Jul 25 16:15:51.992172 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1244/2420] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:50 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:52.006801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:52.008018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:52.029960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:52.036410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:52.037996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:52.038821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:52.136388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:52.171696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba92e407-36f1-404b-95df-34fc852e5de1 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4" status: 200 len: 1516 microversion: 2.1 time: 1.087506 Jul 25 16:15:52.172433 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1177/2421] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:51 2022] GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 => generated 1516 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:52.218379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0591e1ff-f1b7-4f5a-929e-40c0377b5b03 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da046e700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:52.424429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0591e1ff-f1b7-4f5a-929e-40c0377b5b03 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.235236 Jul 25 16:15:52.442407 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1178/2422] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:52 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:52.473656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:52.474970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:52.525178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:52.525916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:52.534503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:52.535246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:52.711001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:52.723672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:52.726636 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-276b4e09-4461-4d0d-bc2a-d67dd16b28c3 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1226 microversion: 2.1 time: 0.278385 Jul 25 16:15:52.728806 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1179/2423] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:52 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:52.733983 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9998f3e7-fbd0-4281-9861-6dcd669b2833 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 0.740378 Jul 25 16:15:52.739319 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1245/2424] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:51 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:52.746811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fa4f6da9-7fd9-4c9f-8523-015d1157576e req-2f6a284d-2445-4df7-bfd8-aa85add506b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db0aa9e-0897-4142-b8c1-03b4f979f863", "name": "network-vif-plugged", "status": "completed", "tag": "2c61b534-2639-48ec-833f-eb2807c3a5a5"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:52.757672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0df686d7-50a4-47d6-af2e-51ac0aa6fa5b req-3977ce56-bd19-4d40-b66f-e5f0582c7247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c93153b-4dba-4766-817d-2d48cbe83d73", "name": "network-vif-deleted", "tag": "61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:52.766090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fa4f6da9-7fd9-4c9f-8523-015d1157576e req-2f6a284d-2445-4df7-bfd8-aa85add506b5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:52.766913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fa4f6da9-7fd9-4c9f-8523-015d1157576e req-2f6a284d-2445-4df7-bfd8-aa85add506b5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:52.798387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fa4f6da9-7fd9-4c9f-8523-015d1157576e req-2f6a284d-2445-4df7-bfd8-aa85add506b5 service nova] Creating event network-vif-plugged:2c61b534-2639-48ec-833f-eb2807c3a5a5 for instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 on n-h2-846219-13 Jul 25 16:15:52.805631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0df686d7-50a4-47d6-af2e-51ac0aa6fa5b req-3977ce56-bd19-4d40-b66f-e5f0582c7247 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:52.806327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0df686d7-50a4-47d6-af2e-51ac0aa6fa5b req-3977ce56-bd19-4d40-b66f-e5f0582c7247 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:52.808295 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fa4f6da9-7fd9-4c9f-8523-015d1157576e req-2f6a284d-2445-4df7-bfd8-aa85add506b5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067310 Jul 25 16:15:52.820811 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1246/2425] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:52.845852 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0df686d7-50a4-47d6-af2e-51ac0aa6fa5b req-3977ce56-bd19-4d40-b66f-e5f0582c7247 service nova] Creating event network-vif-deleted:61f7d7b0-5374-4f8e-b8e9-66ebf7f81e00 for instance 8c93153b-4dba-4766-817d-2d48cbe83d73 on n-h1-846219-13 Jul 25 16:15:52.862904 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0df686d7-50a4-47d6-af2e-51ac0aa6fa5b req-3977ce56-bd19-4d40-b66f-e5f0582c7247 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129303 Jul 25 16:15:52.864031 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1180/2426] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:53.042730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:53.044501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:53.066935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:53.070754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:53.078229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:53.079291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:53.210344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:53.211494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:53.253483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:53.262965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:53.270707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:53.271478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:53.516105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:53.526788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-286bfa34-da8f-4654-9d87-04a88957ead9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 0.499290 Jul 25 16:15:53.531453 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1247/2427] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:53 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:53.547592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b7cf812-459c-4880-a955-6c4ea4e2e02d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d935edaf0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:53.796757 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b7cf812-459c-4880-a955-6c4ea4e2e02d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.247119 Jul 25 16:15:53.806330 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1248/2428] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:53 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:53.832141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:53.848454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:53.937642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:53.938148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:53.949684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:53.950351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:54.171256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:54.233087 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bbfaa8b-5584-4d6c-94e3-d1f90d3479ce tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4" status: 200 len: 1516 microversion: 2.1 time: 1.020254 Jul 25 16:15:54.249684 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1181/2429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:53 2022] GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 => generated 1516 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:15:54.274386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:54.285045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:54.338333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:54.340054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:54.343854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:54.344560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:54.873191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:54.885755 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3470735e-10d2-4183-8d86-f8e0a464fc86 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 1.077767 Jul 25 16:15:54.892288 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1249/2430] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:53 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:54.905045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:54.906183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:54.926419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:54.927228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:54.931259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:54.932231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:54.943660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:54.970215 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68a4aa31-e930-4fcf-be6c-1f81f6005939 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1274 microversion: 2.1 time: 0.716555 Jul 25 16:15:54.983929 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1182/2431] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:54 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1274 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:55.005650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:56.048777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-767610962", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:56.288888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:15:57.768395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:57.781723 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9034f125-baf4-430c-9768-4579813650d8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1318 microversion: 2.1 time: 2.887370 Jul 25 16:15:57.796945 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1250/2432] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:54 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1318 bytes in 2903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:57.806065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e23a48e2-3f5d-41bf-a7dd-46d72e55c345 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93853ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:57.928300 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e23a48e2-3f5d-41bf-a7dd-46d72e55c345 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1457 microversion: 2.1 time: 0.127425 Jul 25 16:15:57.944344 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1251/2433] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:15:57 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1457 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:57.950139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:57.957030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:57.979520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:57.982702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:57.987839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:57.989995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:58.418507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1adfb100c9b4f81a18e24dbde96d6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63671a9868644882990d6f938fffc223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:15:58.451933 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e511295f-0675-428d-8622-5445f78acca7 tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4" status: 200 len: 1474 microversion: 2.1 time: 0.504597 Jul 25 16:15:58.467064 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1252/2434] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:57 2022] GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 => generated 1474 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:58.496488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:58.497757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:58.515278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:58.516251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:58.520366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:58.521407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:59.291954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:15:59.292774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:15:59.293471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:15:59.294000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:15:59.294810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:15:59.345374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:59.345770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:59.348293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:59.349702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:59.405553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Getting quotas for project 96f9b49b1d7945b88422b645ed7c986d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:15:59.418493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Getting quotas for user a3012be588e343b789032f05ba7f4539 and project 96f9b49b1d7945b88422b645ed7c986d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:15:59.443755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:15:59.446624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:15:59.462501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:59.530153 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b078c70-cb1b-4f04-b834-b7b2713d5a22 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.542766 Jul 25 16:15:59.539576 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1183/2435] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:15:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 4554 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:15:59.564258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:59.564576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:15:59.578041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:59.578816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:15:59.580548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:15:59.581565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.089923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:00.118180 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60d26fde-c6d5-413e-930c-0fc7b5a34b6c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1280 microversion: 2.1 time: 0.572813 Jul 25 16:16:00.122071 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1184/2436] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:59 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1280 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:00.147875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e1d92bb7-182a-47d7-a565-e4e41c2e836b req-a2008809-a496-4bbf-88ec-7333d1ad68e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccef1233-dc50-4e36-b33b-5fe3947d2d40", "name": "network-vif-deleted", "tag": "424981b1-8d26-410d-b453-7a973fd17c3a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:00.181201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e1d92bb7-182a-47d7-a565-e4e41c2e836b req-a2008809-a496-4bbf-88ec-7333d1ad68e5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.184119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e1d92bb7-182a-47d7-a565-e4e41c2e836b req-a2008809-a496-4bbf-88ec-7333d1ad68e5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.201140 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e1d92bb7-182a-47d7-a565-e4e41c2e836b req-a2008809-a496-4bbf-88ec-7333d1ad68e5 service nova] Creating event network-vif-deleted:424981b1-8d26-410d-b453-7a973fd17c3a for instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 on n-h1-846219-13 Jul 25 16:16:00.211271 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e1d92bb7-182a-47d7-a565-e4e41c2e836b req-a2008809-a496-4bbf-88ec-7333d1ad68e5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085459 Jul 25 16:16:00.219044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1185/2437] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:00.225120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3b889941-d059-4a55-87bd-61793df28e48 req-da37cb07-b7a5-4ce0-a544-e01d76571b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4", "name": "network-vif-unplugged", "status": "completed", "tag": "dde690ba-0845-4eb2-a660-da54966a90b7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:00.246083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3b889941-d059-4a55-87bd-61793df28e48 req-da37cb07-b7a5-4ce0-a544-e01d76571b52 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.246787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3b889941-d059-4a55-87bd-61793df28e48 req-da37cb07-b7a5-4ce0-a544-e01d76571b52 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.260779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3b889941-d059-4a55-87bd-61793df28e48 req-da37cb07-b7a5-4ce0-a544-e01d76571b52 service nova] Creating event network-vif-unplugged:dde690ba-0845-4eb2-a660-da54966a90b7 for instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 on n-h1-846219-13 Jul 25 16:16:00.266517 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3b889941-d059-4a55-87bd-61793df28e48 req-da37cb07-b7a5-4ce0-a544-e01d76571b52 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045957 Jul 25 16:16:00.267534 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1186/2438] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:00.276285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-89fd5721-31af-4356-9231-de140df93640 req-61d8bb32-3e8b-486b-849b-505a202432e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4", "name": "network-vif-deleted", "tag": "dde690ba-0845-4eb2-a660-da54966a90b7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:00.293525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-89fd5721-31af-4356-9231-de140df93640 req-61d8bb32-3e8b-486b-849b-505a202432e8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.294662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-89fd5721-31af-4356-9231-de140df93640 req-61d8bb32-3e8b-486b-849b-505a202432e8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.320670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:00.326891 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-89fd5721-31af-4356-9231-de140df93640 req-61d8bb32-3e8b-486b-849b-505a202432e8 service nova] Creating event network-vif-deleted:dde690ba-0845-4eb2-a660-da54966a90b7 for instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 on n-h1-846219-13 Jul 25 16:16:00.335386 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-89fd5721-31af-4356-9231-de140df93640 req-61d8bb32-3e8b-486b-849b-505a202432e8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065922 Jul 25 16:16:00.336538 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1187/2439] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:00.343503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:00.344744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:00.354026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.354964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.356597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.357621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.359744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26468655-3459-4658-a3dd-5de8b507ac19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 1.877438 Jul 25 16:16:00.362873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1253/2440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:15:58 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:00.370909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-458962a4-02a6-4ee4-957a-818e7070381d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d935364c0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:00.504410 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-458962a4-02a6-4ee4-957a-818e7070381d tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1466 microversion: 2.1 time: 0.137859 Jul 25 16:16:00.505938 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1254/2441] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:00 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1466 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:00.517441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:00.519164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:00.533206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.534015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.535236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.536244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.573780 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] HTTP exception thrown: Instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 could not be found. Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Request method failure captured: Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 HTTP/1.1 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sFbSu8MOysRCqTr9oqTC_XEAm8elUIL1yelqXhPheu9FZ01K9I6K_zks8xVLF5Ny6WnrsRpewrPcTy13h_CRXBIEhfUSqkgUQZ_qcEUUMsBMSuYRutdDyewwzvSSL-2KZumvNRh73TINXRs8CWndbKSJ-MiReN_vHkYExE_sBIU0so Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 63671a9868644882990d6f938fffc223 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MultipleCreateTestJSON-1020625304 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/63671a9868644882990d6f938fffc223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/63671a9868644882990d6f938fffc223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/63671a9868644882990d6f938fffc223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_63671a9868644882990d6f938fffc223"}]}] Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MultipleCreateTestJSON-1020625304 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 63671a9868644882990d6f938fffc223 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1020625304 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MultipleCreateTestJSON-1020625304-project Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a1adfb100c9b4f81a18e24dbde96d6c0 Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MultipleCreateTestJSON-1020625304-project Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 could not be found. Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4'} Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 could not be found. Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 could not be found. Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:00.577472 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 could not be found. Jul 25 16:16:00.582893 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:00.585495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Returning 404 to user: Instance 8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:00.586890 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92843947-f6ac-4aeb-8dfe-387f584a29ec tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4" status: 404 len: 111 microversion: 2.1 time: 0.079195 Jul 25 16:16:00.591707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1255/2442] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:00 2022] GET /compute/v2.1/servers/8b205b3a-ed0a-4bf1-9419-0cfab7d0a8e4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:00.600194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-32df71dc-ac74-40f3-80ee-bc7c83b2e128 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:00.601561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-32df71dc-ac74-40f3-80ee-bc7c83b2e128 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:00.776308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-32df71dc-ac74-40f3-80ee-bc7c83b2e128 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:00.792317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-32df71dc-ac74-40f3-80ee-bc7c83b2e128 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1217 microversion: 2.1 time: 0.197810 Jul 25 16:16:00.809412 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1256/2443] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:00 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:00.820367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f79ed360-84fe-44f3-9ec8-cb3dc099301f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938e7430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:00.941076 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f79ed360-84fe-44f3-9ec8-cb3dc099301f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 200 len: 1466 microversion: 2.1 time: 0.134924 Jul 25 16:16:00.942811 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1257/2444] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:00 2022] GET /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 1466 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:00.959183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:00.961213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] [instance: ccef1233-dc50-4e36-b33b-5fe3947d2d40] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:00.972841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.974609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:00.976712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:00.989805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.028899 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] HTTP exception thrown: Instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 could not be found. Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Request method failure captured: Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 HTTP/1.1 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sFbSu8MOysRCqTr9oqTC_XEAm8elUIL1yelqXhPheu9FZ01K9I6K_zks8xVLF5Ny6WnrsRpewrPcTy13h_CRXBIEhfUSqkgUQZ_qcEUUMsBMSuYRutdDyewwzvSSL-2KZumvNRh73TINXRs8CWndbKSJ-MiReN_vHkYExE_sBIU0so Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 63671a9868644882990d6f938fffc223 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MultipleCreateTestJSON-1020625304 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/63671a9868644882990d6f938fffc223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/63671a9868644882990d6f938fffc223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/63671a9868644882990d6f938fffc223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_63671a9868644882990d6f938fffc223"}]}] Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MultipleCreateTestJSON-1020625304 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 63671a9868644882990d6f938fffc223 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1020625304 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MultipleCreateTestJSON-1020625304-project Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a1adfb100c9b4f81a18e24dbde96d6c0 Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MultipleCreateTestJSON-1020625304-project Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 could not be found. Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'ccef1233-dc50-4e36-b33b-5fe3947d2d40'} Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 could not be found. Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 could not be found. Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:01.032623 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 could not be found. Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] Returning 404 to user: Instance ccef1233-dc50-4e36-b33b-5fe3947d2d40 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:01.041063 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53445271-9848-48bc-b0eb-9f34f664890b tempest-MultipleCreateTestJSON-1020625304 tempest-MultipleCreateTestJSON-1020625304-project] 10.222.0.105 "GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40" status: 404 len: 111 microversion: 2.1 time: 0.091802 Jul 25 16:16:01.043086 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1258/2445] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:00 2022] GET /compute/v2.1/servers/ccef1233-dc50-4e36-b33b-5fe3947d2d40 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:01.072164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:01.072896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:01.089674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.092643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.093251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:01.093522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.096058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.102964 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-62d06aba-cdbe-4c64-b14f-7f95b36fbede tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1468 microversion: 2.1 time: 0.764612 Jul 25 16:16:01.139029 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1188/2446] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:00 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1468 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:01.151500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:01.154362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:01.166072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.169987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.171200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.173846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.547200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:01.567920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-632c4d62-562d-4345-97af-4767d8a9da8a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1466 microversion: 2.1 time: 0.425903 Jul 25 16:16:01.572091 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1189/2447] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:01 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1466 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:01.585651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:01.587922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:01.609073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.612569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.614734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.615213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.916614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:01.931011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1bbcd7cb-0545-4151-95dd-1369502f15fb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1471 microversion: 2.1 time: 0.885307 Jul 25 16:16:01.931778 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1259/2448] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:01 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1471 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:01.937078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:01.948871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:01.956600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.966678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:01.967786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:01.969158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:02.943765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:02.960369 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc198714-5c16-4dfd-96e0-e8a36f6042fe tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 1.386655 Jul 25 16:16:02.962015 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1190/2449] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:01 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:02.980659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:02.986709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:02.998351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:02.999530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:03.002058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:03.003477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:03.096225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:03.106201 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c2f89af-b7e0-49b4-b3ca-7fcefc10136d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 1.173000 Jul 25 16:16:03.107484 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1260/2450] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:01 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:03.114005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-146534972", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ed5f296c-0785-4c9a-a14c-56f011027564"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:03.198194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:16:03.668031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:03.703634 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10feffbf-7dc2-4a09-b260-67f85da790da tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1275 microversion: 2.1 time: 0.735318 Jul 25 16:16:03.709600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1191/2451] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:02 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1275 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:03.719069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-463229460"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:03.738134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:03.754301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:03.754907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:03.757145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:03.761546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.260987 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d305ac0d-1a99-4a40-868e-fd405646ed69 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "POST /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca/action" status: 202 len: 0 microversion: 2.1 time: 0.549382 Jul 25 16:16:04.269824 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1192/2452] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:16:03 2022] POST /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:16:04.277185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ee1ed519-c5be-4f69-bc27-c07c54e5ec16 req-94ee8d81-6840-42bc-9f8f-04b1b1d495d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d282c9ca-9b5f-4406-afc3-6d647d0b508e", "name": "network-vif-plugged", "status": "completed", "tag": "21c59e6e-eb38-4eb8-b010-d4ece0f797c1"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:04.293209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ee1ed519-c5be-4f69-bc27-c07c54e5ec16 req-94ee8d81-6840-42bc-9f8f-04b1b1d495d6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.293848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ee1ed519-c5be-4f69-bc27-c07c54e5ec16 req-94ee8d81-6840-42bc-9f8f-04b1b1d495d6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.313088 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ee1ed519-c5be-4f69-bc27-c07c54e5ec16 req-94ee8d81-6840-42bc-9f8f-04b1b1d495d6 service nova] Creating event network-vif-plugged:21c59e6e-eb38-4eb8-b010-d4ece0f797c1 for instance d282c9ca-9b5f-4406-afc3-6d647d0b508e on n-h2-846219-13 Jul 25 16:16:04.321565 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ee1ed519-c5be-4f69-bc27-c07c54e5ec16 req-94ee8d81-6840-42bc-9f8f-04b1b1d495d6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049435 Jul 25 16:16:04.322499 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1193/2453] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:04.334260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:04.335472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:04.360004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.360457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.362212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.364256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.408042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:04.491149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:16:04.492254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:16:04.493246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:16:04.495443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:16:04.496488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:16:04.567969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.571814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.574988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.578065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.625631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Getting quotas for project 959f5a2108434bf58ee07e6126258124. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:16:04.642089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Getting quotas for user c27015dd9c294b0fb05d8c555fe57362 and project 959f5a2108434bf58ee07e6126258124. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:16:04.676185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:16:04.681237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:16:04.798447 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1bbffa5-3304-4e1e-8ee9-404de86ac5a2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.688394 Jul 25 16:16:04.799969 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1261/2454] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:16:04.818938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:04.822526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:04.849213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.849704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:04.851462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:04.851462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:05.589873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:05.604929 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f501567-cca3-491e-a33b-19697a743f7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 0.801837 Jul 25 16:16:05.605675 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1262/2455] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:04 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:05.625117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4ddde3b-1f31-4eab-ade5-0f3320212414 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d935003a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:05.647077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:05.660328 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-85ab2997-0701-4b1e-86a4-105fe08e1b51 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 1.330001 Jul 25 16:16:05.687606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1194/2456] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:04 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:05.700952 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4ddde3b-1f31-4eab-ade5-0f3320212414 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.081834 Jul 25 16:16:05.701606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:05.702808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:05.704079 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1263/2457] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:05 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:05.717326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:05.717871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:05.718918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:05.719543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:05.730070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:05.733033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:05.750111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:05.751151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:05.752296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:05.753033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:05.985449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:05.998291 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eaddc8c5-a9b8-4ccf-b785-488a8bc2e5a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1221 microversion: 2.1 time: 0.292870 Jul 25 16:16:05.998904 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1264/2458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:05 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1221 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:06.093331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:06.123176 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f488008-4f42-4686-8e64-9776ef737462 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1275 microversion: 2.1 time: 0.433869 Jul 25 16:16:06.124599 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1195/2459] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:05 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1275 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:06.286351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0a91f8e2-421f-4b64-87fd-dc37429e71e9 req-61bb545e-258c-466f-bb58-5933d826a045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9dfd9-3964-40b4-9af3-0cc6662d7e91", "tag": "d49981f8-6f55-409c-a678-75a8ebac4060"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:06.319564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0a91f8e2-421f-4b64-87fd-dc37429e71e9 req-61bb545e-258c-466f-bb58-5933d826a045 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:06.320298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0a91f8e2-421f-4b64-87fd-dc37429e71e9 req-61bb545e-258c-466f-bb58-5933d826a045 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:06.334820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0a91f8e2-421f-4b64-87fd-dc37429e71e9 req-61bb545e-258c-466f-bb58-5933d826a045 service nova] Creating event network-changed:d49981f8-6f55-409c-a678-75a8ebac4060 for instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 on n-h1-846219-13 Jul 25 16:16:06.346921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-02c6906e-c83c-46c1-ae5d-0f1b12b886f8 req-6b2aee27-d117-4643-9dd8-337d20f7eb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b95ec35-12ff-46c5-aceb-8daf24ae63b7", "name": "network-vif-unplugged", "status": "completed", "tag": "ce4676ac-b993-4041-85d8-5a309a5e5f56"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:06.362164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0a91f8e2-421f-4b64-87fd-dc37429e71e9 req-61bb545e-258c-466f-bb58-5933d826a045 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081853 Jul 25 16:16:06.374412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-02c6906e-c83c-46c1-ae5d-0f1b12b886f8 req-6b2aee27-d117-4643-9dd8-337d20f7eb16 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:06.375820 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1265/2460] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:16:06.376529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-02c6906e-c83c-46c1-ae5d-0f1b12b886f8 req-6b2aee27-d117-4643-9dd8-337d20f7eb16 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:06.406522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-02c6906e-c83c-46c1-ae5d-0f1b12b886f8 req-6b2aee27-d117-4643-9dd8-337d20f7eb16 service nova] Creating event network-vif-unplugged:ce4676ac-b993-4041-85d8-5a309a5e5f56 for instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 on n-h2-846219-13 Jul 25 16:16:06.417364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-02c6906e-c83c-46c1-ae5d-0f1b12b886f8 req-6b2aee27-d117-4643-9dd8-337d20f7eb16 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072232 Jul 25 16:16:06.433449 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1196/2461] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:06.628349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:06.629457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:06.649476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:06.650175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:06.651152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:06.651598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:06.718001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:06.721564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:06.749489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:06.750113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:06.759972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:06.760559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:08.352292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:08.382094 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6bf17dfb-fa87-4cc1-902d-1c4e8e7efe1b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1321 microversion: 2.1 time: 1.759523 Jul 25 16:16:08.401132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1266/2462] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:06 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1321 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:08.401962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:08.421439 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ddb8df5-08d0-43d9-8331-0fa75b5c85fc tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 1.722200 Jul 25 16:16:08.421798 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1197/2463] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:06 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:08.423406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db3e2aaf-9b37-49ce-87d3-5ff7bb143218 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938f0dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:08.440984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:08.443172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:08.451021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:08.452160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:08.453245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:08.453877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:08.511410 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db3e2aaf-9b37-49ce-87d3-5ff7bb143218 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.122372 Jul 25 16:16:08.517707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1267/2464] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:08 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:08.532895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:08.536550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:08.555307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:08.555952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:08.557154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:08.557679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:08.735857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:08.768496 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07f5574e-bfcc-41be-8619-393afc6bd8f6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1275 microversion: 2.1 time: 0.344801 Jul 25 16:16:08.774953 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1198/2465] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:08 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1275 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:09.424260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:09.431477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:09.447458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:09.449808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=12 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:09.454778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:09.455761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:09.457637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:09.458305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:09.465938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:09.503346 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d810863e-fd47-4396-b568-99efe183e51a tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.983087 Jul 25 16:16:09.520727 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1268/2466] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:08 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:09.530753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:09.531769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:09.543115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:09.544211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:09.545963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:09.546594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:10.392439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:10.414279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b6bbe0f-2499-44f1-b372-efa2871b936e tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 0.891480 Jul 25 16:16:10.415426 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1269/2467] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:09 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:10.421240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-511331ab-a9ee-4ebe-bf26-50e800dd38cf tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93845430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:10.590507 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-511331ab-a9ee-4ebe-bf26-50e800dd38cf tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.173518 Jul 25 16:16:10.604842 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1270/2468] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:10 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:10.616953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:10.617695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:10.636068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:10.636906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:10.638071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:10.639813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:10.983444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:11.042607 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77fdcbc2-1866-4d8b-938a-3e7e417b9b60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1470 microversion: 2.1 time: 1.624686 Jul 25 16:16:11.053522 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1199/2469] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:09 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1470 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:16:11.069337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a4183f73-73a4-4ac5-ad2d-68742050a1f2 req-4c46163d-be6e-4391-af65-577df6ea9db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "name": "network-vif-plugged", "status": "completed", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:11.102066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a4183f73-73a4-4ac5-ad2d-68742050a1f2 req-4c46163d-be6e-4391-af65-577df6ea9db8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.104544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a4183f73-73a4-4ac5-ad2d-68742050a1f2 req-4c46163d-be6e-4391-af65-577df6ea9db8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:11.126377 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a4183f73-73a4-4ac5-ad2d-68742050a1f2 req-4c46163d-be6e-4391-af65-577df6ea9db8 service nova] Creating event network-vif-plugged:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:16:11.136596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a4183f73-73a4-4ac5-ad2d-68742050a1f2 req-4c46163d-be6e-4391-af65-577df6ea9db8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080276 Jul 25 16:16:11.139189 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1200/2470] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:11.155895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:11.157762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:11.190940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.193047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:11.195131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.196374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:11.492523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:11.507467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-100f0420-eb4b-4999-a515-f1245e182033 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.897856 Jul 25 16:16:11.514176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1271/2471] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:10 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:11.524321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:11.533903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:11.560441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.561602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:11.562914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.563570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:11.875985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:11.890938 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb281bca-d859-4b07-b42d-0d3d477cffde tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.749625 Jul 25 16:16:11.895079 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1201/2472] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:11 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:11.901551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:11.908952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:11.931779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.935419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:11.937771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:11.940644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:12.471101 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff83c06e-283b-4606-ac65-f61047b9f542 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1623 microversion: 2.1 time: 0.955209 Jul 25 16:16:12.487132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1272/2473] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:11 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1623 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:12.537173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d2016fd-de75-400e-bd70-681c6aa59e70 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4b31790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:12.611041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:12.624378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dedb12f3-b4c4-4fd5-adfa-c54db7a461df tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 0.727729 Jul 25 16:16:12.625053 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1202/2474] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:11 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:12.638987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:12.648619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:12.659545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:12.662311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:12.663798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:12.670220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:12.787330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d2016fd-de75-400e-bd70-681c6aa59e70 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.288395 Jul 25 16:16:12.787943 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1273/2475] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:12 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:12.814158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fda0cb6b-cdf3-40ab-acc9-809043530eab req-12e93e7d-0b1f-49d8-9a74-d0223cd085db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff738b41-10e1-4002-bc15-02f562e1e707", "tag": "a2aef440-40c1-46b9-9ebc-d1dc9c07bdc8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:12.859536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fda0cb6b-cdf3-40ab-acc9-809043530eab req-12e93e7d-0b1f-49d8-9a74-d0223cd085db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:12.861778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fda0cb6b-cdf3-40ab-acc9-809043530eab req-12e93e7d-0b1f-49d8-9a74-d0223cd085db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:12.905996 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fda0cb6b-cdf3-40ab-acc9-809043530eab req-12e93e7d-0b1f-49d8-9a74-d0223cd085db service nova] Creating event network-changed:a2aef440-40c1-46b9-9ebc-d1dc9c07bdc8 for instance ff738b41-10e1-4002-bc15-02f562e1e707 on n-h1-846219-13 Jul 25 16:16:12.928038 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fda0cb6b-cdf3-40ab-acc9-809043530eab req-12e93e7d-0b1f-49d8-9a74-d0223cd085db service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135294 Jul 25 16:16:12.932477 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1274/2476] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:12.945058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-594855780", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["9fd58fea-6110-43b7-9f72-c20592d5f0d4"]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:13.115535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:16:13.660347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:13.687035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d2e9701-057c-4ecc-9b9a-d8dff5e2cea3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 1.057370 Jul 25 16:16:13.688058 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1203/2477] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:12 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:13.717316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:13.718196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:13.743612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:13.744248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:13.745269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:13.745830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:14.019140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:16:14.020620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:16:14.021903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:16:14.022943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:16:14.023768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:16:14.086088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:14.089999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:14.091228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:14.093585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:14.148042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:16:14.166729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:14.168202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:16:14.205523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:16:14.210684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:16:14.414953 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-776677ab-7c31-4236-8fa6-eb63f0478849 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.470695 Jul 25 16:16:14.429376 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1275/2478] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:16:14.443831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-25dc8f44-d9e7-4764-b956-45c5f52a495f req-9fb8979a-8af5-45db-aef6-0cf7da167e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecec2b7a-7092-4301-a224-bde0f2657e3e", "tag": "b1cb52a6-a3c5-4829-9b09-61e7a843a66f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:14.495268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-25dc8f44-d9e7-4764-b956-45c5f52a495f req-9fb8979a-8af5-45db-aef6-0cf7da167e74 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:14.497695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-25dc8f44-d9e7-4764-b956-45c5f52a495f req-9fb8979a-8af5-45db-aef6-0cf7da167e74 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:14.540216 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-25dc8f44-d9e7-4764-b956-45c5f52a495f req-9fb8979a-8af5-45db-aef6-0cf7da167e74 service nova] Creating event network-changed:b1cb52a6-a3c5-4829-9b09-61e7a843a66f for instance ecec2b7a-7092-4301-a224-bde0f2657e3e on n-h1-846219-13 Jul 25 16:16:14.551219 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-25dc8f44-d9e7-4764-b956-45c5f52a495f req-9fb8979a-8af5-45db-aef6-0cf7da167e74 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119032 Jul 25 16:16:14.553442 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1276/2479] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:14.566455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:14.568214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:14.581941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:14.583819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:14.585682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:14.590758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:14.974265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:15.001797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87df8af7-7f9a-444a-ba59-cc365c78b142 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 1.289070 Jul 25 16:16:15.006750 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1204/2480] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:13 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:15.025042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f357214f-ec8d-4ff2-a3c6-e74390e73cf9 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93a40f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:15.256159 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f357214f-ec8d-4ff2-a3c6-e74390e73cf9 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.247886 Jul 25 16:16:15.257135 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1205/2481] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:15 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:15.271889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-93bd484a-14a6-49b0-b7e1-f6c05652fd8e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:15.272553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-93bd484a-14a6-49b0-b7e1-f6c05652fd8e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:15.580093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:15.618987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b531a64b-9022-4cbc-b0d5-6f931500d050 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 1.063180 Jul 25 16:16:15.620619 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1277/2482] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:14 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:15.634701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:15.637848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:15.648227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-93bd484a-14a6-49b0-b7e1-f6c05652fd8e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:15.691975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-93bd484a-14a6-49b0-b7e1-f6c05652fd8e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1220 microversion: 2.1 time: 0.424562 Jul 25 16:16:15.692875 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1206/2483] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:15 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1220 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:15.695620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:15.696902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:15.698447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:15.702315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:16.060324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:16.071704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:16.140978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:16.168181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:16.183044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:16.184059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:16.318020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:16.340604 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ce32ce9-8c1e-4d5f-8e78-dfd8703c3f6a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.718070 Jul 25 16:16:16.354105 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1278/2484] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:15 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:16.364253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e55fcd0-3515-45cf-b826-728d2db6a839 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ed0e50>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:16.540468 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e55fcd0-3515-45cf-b826-728d2db6a839 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.183007 Jul 25 16:16:16.548749 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1279/2485] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:16 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:16.741507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:16.769161 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ab6c25aa-4926-44c7-a4a3-b94e143e99ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.728426 Jul 25 16:16:16.787255 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1207/2486] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:16 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:16:16.804433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:16.807429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:16.825757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:16.827643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:16.830781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:16.832157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:17.285884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:17.298469 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea8dd481-a76f-4ff0-b316-e09d5dff7505 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 0.508978 Jul 25 16:16:17.304148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1208/2487] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:16 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:17.313603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:17.322194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:17.340317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:17.341251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:17.343079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:17.345561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:17.595833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:17.612842 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24486075-c9e2-4636-8cfd-3fd50df41911 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1280 microversion: 2.1 time: 0.307254 Jul 25 16:16:17.615692 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1209/2488] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:17 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1280 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:17.653006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:17.658704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:17.690571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac8606f8-a948-428e-8e3b-f68dc016cb8a tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-476675726", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:17.695388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:17.695882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:17.696845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:17.697444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:17.718400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ac8606f8-a948-428e-8e3b-f68dc016cb8a tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] HTTP exception thrown: min_count must be <= max_count Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac8606f8-a948-428e-8e3b-f68dc016cb8a tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Request method failure captured: Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 183 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sHPdTiLX3PNAyFjyUW3uA4PX5HkMTc1n77v1BbrmiGJ2qjt4mus3a7BKWi8CrvpMmvu29V3Yip28q_lFARqXQLxBedSlnniDZ1zkoMtmLgoS1Jcz6Yk95s6tcUsXRmMo042pgzXJLcjrlZjFFWONrBXZju4JS3R4Z4oKraLaVVQ54w Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8289428710b434c9ebd66484a256add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8289428710b434c9ebd66484a256add"}]}] Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 59efa94d8731468aaa8b71924f6ac239 Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-476675726", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: exception: min_count must be <= max_count Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-476675726', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 25 16:16:17.732223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:17.739066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac8606f8-a948-428e-8e3b-f68dc016cb8a tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Returning 400 to user: min_count must be <= max_count {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:17.740020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac8606f8-a948-428e-8e3b-f68dc016cb8a tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 1.184664 Jul 25 16:16:17.745137 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1280/2489] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:16 2022] POST /compute/v2.1/servers => generated 74 bytes in 1194 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:17.758446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90fb7417-cf86-430f-bda7-a0ba018442d3 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da49388b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:17.886536 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90fb7417-cf86-430f-bda7-a0ba018442d3 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.140522 Jul 25 16:16:17.887298 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1281/2490] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:17 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:17.922167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:17.922821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:17.934516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:17.935091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:17.935922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:17.936464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:18.031579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:18.351126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:18.370292 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cfbdecbf-428f-4a06-87f9-a6d92052c59b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.752717 Jul 25 16:16:18.376578 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1210/2491] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:17 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:18.383196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89327740-439f-47a7-91ad-a4c551c40e2b tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1585842500", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "max_count": 0}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89327740-439f-47a7-91ad-a4c551c40e2b tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Request method failure captured: Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 168 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sHPdTiLX3PNAyFjyUW3uA4PX5HkMTc1n77v1BbrmiGJ2qjt4mus3a7BKWi8CrvpMmvu29V3Yip28q_lFARqXQLxBedSlnniDZ1zkoMtmLgoS1Jcz6Yk95s6tcUsXRmMo042pgzXJLcjrlZjFFWONrBXZju4JS3R4Z4oKraLaVVQ54w Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8289428710b434c9ebd66484a256add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8289428710b434c9ebd66484a256add"}]}] Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 59efa94d8731468aaa8b71924f6ac239 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1585842500", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "max_count": 0}} Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1585842500', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'max_count': 0}}} Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 0 Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:16:18.407898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 16:16:18.413235 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:18.418694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89327740-439f-47a7-91ad-a4c551c40e2b tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:18.421464 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89327740-439f-47a7-91ad-a4c551c40e2b tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.042260 Jul 25 16:16:18.422801 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1211/2492] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:18 2022] POST /compute/v2.1/servers => generated 130 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:16:18.437998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:18.439142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:18.481484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:18.491593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:18.501007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:18.502125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:18.631624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:18.652570 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7680396-7797-4ced-bb01-4256e7d32a2e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.754519 Jul 25 16:16:18.662078 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1282/2493] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:17 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:18.694337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:18.700543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:18.718245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:18.719440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:18.722071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:18.723216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:18.876645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:18.938637 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6516124-b6e5-4d68-8ee5-736fa0887c03 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1278 microversion: 2.1 time: 0.274372 Jul 25 16:16:18.961429 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1283/2494] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:18 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:18.997654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dba12e4b-e26a-4a6c-a068-4f655864ee54 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1692247299", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "max_count": 2.5}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dba12e4b-e26a-4a6c-a068-4f655864ee54 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Request method failure captured: Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 170 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sHPdTiLX3PNAyFjyUW3uA4PX5HkMTc1n77v1BbrmiGJ2qjt4mus3a7BKWi8CrvpMmvu29V3Yip28q_lFARqXQLxBedSlnniDZ1zkoMtmLgoS1Jcz6Yk95s6tcUsXRmMo042pgzXJLcjrlZjFFWONrBXZju4JS3R4Z4oKraLaVVQ54w Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8289428710b434c9ebd66484a256add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8289428710b434c9ebd66484a256add"}]}] Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 59efa94d8731468aaa8b71924f6ac239 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1692247299", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "max_count": 2.5}} Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1692247299', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'max_count': 2.5}}} Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:16:19.027367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 16:16:19.033207 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.036732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dba12e4b-e26a-4a6c-a068-4f655864ee54 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:19.038628 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dba12e4b-e26a-4a6c-a068-4f655864ee54 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.074817 Jul 25 16:16:19.040033 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1284/2495] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:16:19.049617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e3b53db-c10c-4f8e-9a75-117d43dcaa01 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ed0ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:19.136836 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e3b53db-c10c-4f8e-9a75-117d43dcaa01 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.093293 Jul 25 16:16:19.147426 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1285/2496] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:19 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:19.390034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:19.427407 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-76d35fcf-a07e-4583-af07-f7d21449ba7c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 1.001142 Jul 25 16:16:19.460642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:19.461071 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1212/2497] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:18 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:19.480085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:19.559419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60389343-fc15-4403-9172-d245d1b00d5d tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891690896", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 0}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:19.581243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:19.583435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60389343-fc15-4403-9172-d245d1b00d5d tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Request method failure captured: Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 168 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sHPdTiLX3PNAyFjyUW3uA4PX5HkMTc1n77v1BbrmiGJ2qjt4mus3a7BKWi8CrvpMmvu29V3Yip28q_lFARqXQLxBedSlnniDZ1zkoMtmLgoS1Jcz6Yk95s6tcUsXRmMo042pgzXJLcjrlZjFFWONrBXZju4JS3R4Z4oKraLaVVQ54w Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8289428710b434c9ebd66484a256add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8289428710b434c9ebd66484a256add"}]}] Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 59efa94d8731468aaa8b71924f6ac239 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891690896", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 0}} Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1891690896', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'min_count': 0}}} Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 0 Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:16:19.589476 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 16:16:19.599145 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:19.605580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:19.605580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:19.606110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60389343-fc15-4403-9172-d245d1b00d5d tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:19.610960 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60389343-fc15-4403-9172-d245d1b00d5d tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.064013 Jul 25 16:16:19.619653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1213/2498] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:16:19.694321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:19.696040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:19.718175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:19.719756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:19.726157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:19.727602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:19.991379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:20.052298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-47ec81d3-86a3-4b71-868a-ed44da0accb7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.634570 Jul 25 16:16:20.057045 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1286/2499] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:19 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:20.134310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d1c40d70-cab1-4310-b1af-a22edbe4f335 req-627ec727-fbca-4052-b44b-792763accf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9dfd9-3964-40b4-9af3-0cc6662d7e91", "name": "network-vif-plugged", "status": "completed", "tag": "d49981f8-6f55-409c-a678-75a8ebac4060"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:20.170315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d1c40d70-cab1-4310-b1af-a22edbe4f335 req-627ec727-fbca-4052-b44b-792763accf67 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:20.174602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d1c40d70-cab1-4310-b1af-a22edbe4f335 req-627ec727-fbca-4052-b44b-792763accf67 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:20.242357 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d1c40d70-cab1-4310-b1af-a22edbe4f335 req-627ec727-fbca-4052-b44b-792763accf67 service nova] Creating event network-vif-plugged:d49981f8-6f55-409c-a678-75a8ebac4060 for instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 on n-h1-846219-13 Jul 25 16:16:20.269621 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d1c40d70-cab1-4310-b1af-a22edbe4f335 req-627ec727-fbca-4052-b44b-792763accf67 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205009 Jul 25 16:16:20.271422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1287/2500] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:20.285927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:20.285927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:20.301596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:20.302792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:20.308590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:20.310443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:20.703610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:20.730815 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-130854ab-5238-44d7-a5fc-a65c5779d3ff tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 1.048083 Jul 25 16:16:20.735631 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1214/2501] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:19 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:20.749851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45e39a55-3eec-43a8-bf83-a2e8b9690d7a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da49a2550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:20.915397 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45e39a55-3eec-43a8-bf83-a2e8b9690d7a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.169006 Jul 25 16:16:20.925993 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1215/2502] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:20 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:20.978924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f50c8d8b-0fd1-416c-994e-5b1fc0dd7056 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1688499427", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 2.5}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f50c8d8b-0fd1-416c-994e-5b1fc0dd7056 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Request method failure captured: Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 170 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sHPdTiLX3PNAyFjyUW3uA4PX5HkMTc1n77v1BbrmiGJ2qjt4mus3a7BKWi8CrvpMmvu29V3Yip28q_lFARqXQLxBedSlnniDZ1zkoMtmLgoS1Jcz6Yk95s6tcUsXRmMo042pgzXJLcjrlZjFFWONrBXZju4JS3R4Z4oKraLaVVQ54w Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8289428710b434c9ebd66484a256add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8289428710b434c9ebd66484a256add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8289428710b434c9ebd66484a256add"}]}] Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8289428710b434c9ebd66484a256add Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1110625813 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 59efa94d8731468aaa8b71924f6ac239 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1110625813-project Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1688499427", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 2.5}} Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1688499427', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'min_count': 2.5}}} Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:16:21.006698 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:21.019887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f50c8d8b-0fd1-416c-994e-5b1fc0dd7056 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:21.027630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f50c8d8b-0fd1-416c-994e-5b1fc0dd7056 tempest-MultipleCreateNegativeTestJSON-1110625813 tempest-MultipleCreateNegativeTestJSON-1110625813-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.091719 Jul 25 16:16:21.028738 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1216/2503] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:16:21.081433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:21.082085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:21.126002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:21.126696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:21.146585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:21.147086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:21.206055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:21.223500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8a36d86-49f6-4647-92d5-13c8e4a09d7e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 0.949797 Jul 25 16:16:21.230785 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1288/2504] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:20 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:21.255564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:21.257671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:21.271411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:21.272828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:21.274944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:21.275950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:22.007909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:22.072281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6532b10b-ef5d-4c65-aff1-9477f629f16c tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 1.039492 Jul 25 16:16:22.074057 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1217/2505] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:21 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:22.085516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:22.087234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:22.100704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:22.101985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:22.103681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:22.104671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:22.114463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:22.203913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:22.215629 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-590c3aaa-244b-4118-b430-0ad55ea43528 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.983055 Jul 25 16:16:22.223673 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1289/2506] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:21 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:22.228928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-642cb8f8-9ba4-44db-88d4-23e31d7f0fec tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938f0550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:22.393442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-642cb8f8-9ba4-44db-88d4-23e31d7f0fec tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.166321 Jul 25 16:16:22.396633 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1290/2507] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:22 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:22.418120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:22.419457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:22.439346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:22.440023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:22.448350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:22.449157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:23.344853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:23.389292 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84806e02-fe87-4847-b430-70a25eed37fd tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 1.313029 Jul 25 16:16:23.426189 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1218/2508] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:22 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:23.432931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:23.440364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:23.454776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:23.457420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:23.464100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:23.464875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:23.632287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:23.659374 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8bdfc1cd-cfbe-44cf-9d41-f14740b06782 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 1.258739 Jul 25 16:16:23.665152 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1291/2509] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:22 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:23.685233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:23.687030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:23.703126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:23.706623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:23.709345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:23.710048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:24.105859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:24.184626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:25.655345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:25.842602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:25.869751 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78521d90-9661-4ceb-9a8b-44c35c4f5e9b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 2.200750 Jul 25 16:16:25.877772 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1292/2510] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:23 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:25.891913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb01a547-979c-434c-95d3-8d439a22377a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d9352df70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:25.999372 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb01a547-979c-434c-95d3-8d439a22377a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.120043 Jul 25 16:16:26.001845 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1293/2511] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:25 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:26.016642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:26.017768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:26.027770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:26.028719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:26.030235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:26.031117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:26.210527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:26.241350 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea2be382-62c8-47b5-a921-eb976d1ea859 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1322 microversion: 2.1 time: 2.809455 Jul 25 16:16:26.242604 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1219/2512] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:23 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1322 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:26.264098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:26.269683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:26.302717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:26.303919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:26.318761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:26.322179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:26.872373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:26.917700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bb3520a8-c588-49c5-ac54-6d6f14844113 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.905844 Jul 25 16:16:26.928888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1294/2513] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:26 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:26.962550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:26.987893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:27.048199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.051469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.062110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.064256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.357134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:27.397051 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-229a83cd-d4d0-4acc-a7da-7a4b8f15be60 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 1.147417 Jul 25 16:16:27.407763 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1220/2514] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:26 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:27.419010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10c91c1a-0e36-4256-bb28-f3da35464eff tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da4955430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:27.569715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10c91c1a-0e36-4256-bb28-f3da35464eff tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.149754 Jul 25 16:16:27.580566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1221/2515] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:27 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:27.616458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-15cf8572-70fc-4230-8079-fa7618cdd48d req-c9cbb546-0682-427c-9440-b87f83299217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eba1e5-1df5-4f24-a596-317f046e74d0", "tag": "07e71465-7c41-4b5c-946c-016311f84262"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:27.653066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-15cf8572-70fc-4230-8079-fa7618cdd48d req-c9cbb546-0682-427c-9440-b87f83299217 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.654450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-15cf8572-70fc-4230-8079-fa7618cdd48d req-c9cbb546-0682-427c-9440-b87f83299217 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.682223 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-15cf8572-70fc-4230-8079-fa7618cdd48d req-c9cbb546-0682-427c-9440-b87f83299217 service nova] Creating event network-changed:07e71465-7c41-4b5c-946c-016311f84262 for instance 17eba1e5-1df5-4f24-a596-317f046e74d0 on n-h2-846219-13 Jul 25 16:16:27.694445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-15cf8572-70fc-4230-8079-fa7618cdd48d req-c9cbb546-0682-427c-9440-b87f83299217 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103701 Jul 25 16:16:27.699018 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1222/2516] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:27.715131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:27.717724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:27.719844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:27.732940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb5c9476-c584-4586-9ecf-803e7c999cc2 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.797551 Jul 25 16:16:27.733933 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1295/2517] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:26 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:27.735010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.736273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.740522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.742524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.757224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2cba166f-b4fa-40d3-b6c8-3170b16c4ccd req-1a0f80f8-d716-4d1f-90de-f0cd4a4dd654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecec2b7a-7092-4301-a224-bde0f2657e3e", "name": "network-vif-plugged", "status": "completed", "tag": "b1cb52a6-a3c5-4829-9b09-61e7a843a66f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:27.800619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2cba166f-b4fa-40d3-b6c8-3170b16c4ccd req-1a0f80f8-d716-4d1f-90de-f0cd4a4dd654 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.809673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2cba166f-b4fa-40d3-b6c8-3170b16c4ccd req-1a0f80f8-d716-4d1f-90de-f0cd4a4dd654 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.874428 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2cba166f-b4fa-40d3-b6c8-3170b16c4ccd req-1a0f80f8-d716-4d1f-90de-f0cd4a4dd654 service nova] Creating event network-vif-plugged:b1cb52a6-a3c5-4829-9b09-61e7a843a66f for instance ecec2b7a-7092-4301-a224-bde0f2657e3e on n-h1-846219-13 Jul 25 16:16:27.902370 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2cba166f-b4fa-40d3-b6c8-3170b16c4ccd req-1a0f80f8-d716-4d1f-90de-f0cd4a4dd654 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161320 Jul 25 16:16:27.905267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1296/2518] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:27.968262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:27.970836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:27.992277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.993327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:27.995226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:27.997693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:28.734992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:28.805261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de6c14fc-7bd1-444b-8fbd-b2a4a1566515 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1512 microversion: 2.1 time: 1.089880 Jul 25 16:16:28.821043 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1223/2519] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:27 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1512 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:28.853750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:28.860471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:28.887223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:28.909508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:28.911537 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0f965a19-ea52-4bca-9de6-589c430615ec tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.949120 Jul 25 16:16:28.912478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1297/2520] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:27 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:28.918030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53856046-ddde-457e-a896-73e9b427ff76 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938e3ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:28.931081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:28.963449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:28.964313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:29.073792 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53856046-ddde-457e-a896-73e9b427ff76 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.158073 Jul 25 16:16:29.078925 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1298/2521] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:28 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:29.086234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:29.086914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:29.123891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:29.124348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:29.125217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:29.125685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:29.833047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:29.860091 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c1dab4ba-6f7c-4153-b43c-58bb9a3760a2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 1.029011 Jul 25 16:16:29.862524 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1224/2522] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:28 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:29.881585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:29.891707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:29.915587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=73 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:29.921382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:29.921956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:29.927140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:29.927140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:29.945441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:29.961551 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75c653ca-21b0-4a49-a187-b8c8893806a7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 0.881243 Jul 25 16:16:29.967756 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1299/2523] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:29 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:29.976649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:29.989821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:30.013253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:30.021300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:30.023655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:30.024426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:30.403748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:30.422879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-603b192b-2030-45fd-90ba-54b992351017 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1512 microversion: 2.1 time: 0.554267 Jul 25 16:16:30.427371 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1225/2524] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:29 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:30.451824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25db79db-ef90-4c39-8b18-cd4eaa7b99a0 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da49a2dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:30.534727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:30.569599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-09771cc7-0b74-4c92-804d-99a9ee44d964 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1317 microversion: 2.1 time: 0.598061 Jul 25 16:16:30.584117 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25db79db-ef90-4c39-8b18-cd4eaa7b99a0 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.154997 Jul 25 16:16:30.589754 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1300/2525] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:29 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:30.596152 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1226/2526] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:30 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:30.616122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:30.627787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:30.663875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:30.666095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:30.678954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:30.679799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:30.892493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:30.893419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:30.915943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:30.932177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:30.933377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:30.933839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:31.002049 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a67a082f-eb57-4e33-b879-b01e7f916cbd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "PUT /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1084 microversion: 2.1 time: 0.407073 Jul 25 16:16:31.004644 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1301/2527] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:16:30 2022] PUT /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1084 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:31.027796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:31.046007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:31.090523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:31.094024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:31.097983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:31.101551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:31.943153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:31.960137 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9e70723-4217-4530-85cd-686ad97dd82a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 1.072098 Jul 25 16:16:31.978281 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1227/2528] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:30 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:16:31.992666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:31.993511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:31.997694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:32.011188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:32.016225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:32.017493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:32.018218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:32.031121 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e2a7555-66f6-495a-9ee5-e4935d8f4f4c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 1.019364 Jul 25 16:16:32.033451 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1302/2529] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:31 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:32.081427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b8587f18-92dd-4efb-9b54-8b38e3a60390 req-54554911-430b-46fc-828f-ae69856e8ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff738b41-10e1-4002-bc15-02f562e1e707", "name": "network-vif-plugged", "status": "completed", "tag": "a2aef440-40c1-46b9-9ebc-d1dc9c07bdc8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:32.135595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b8587f18-92dd-4efb-9b54-8b38e3a60390 req-54554911-430b-46fc-828f-ae69856e8ce1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:32.137469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b8587f18-92dd-4efb-9b54-8b38e3a60390 req-54554911-430b-46fc-828f-ae69856e8ce1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:32.178405 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b8587f18-92dd-4efb-9b54-8b38e3a60390 req-54554911-430b-46fc-828f-ae69856e8ce1 service nova] Creating event network-vif-plugged:a2aef440-40c1-46b9-9ebc-d1dc9c07bdc8 for instance ff738b41-10e1-4002-bc15-02f562e1e707 on n-h1-846219-13 Jul 25 16:16:32.194309 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b8587f18-92dd-4efb-9b54-8b38e3a60390 req-54554911-430b-46fc-828f-ae69856e8ce1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134062 Jul 25 16:16:32.196760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1303/2530] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:32.220596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:32.226047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:32.282307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:32.283915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:32.299970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:32.313155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:34.085138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:34.112020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7eac0311-de71-441c-8b18-fe5472f7e129 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1466 microversion: 2.1 time: 1.905948 Jul 25 16:16:34.137777 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1304/2531] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:32 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1466 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:34.152955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8628b3a-a3a5-4ab8-a838-d9dc5fd17b87 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93853ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:34.325682 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8628b3a-a3a5-4ab8-a838-d9dc5fd17b87 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.186128 Jul 25 16:16:34.326519 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1305/2532] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:34 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:34.352358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:34.353406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:34.380914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:34.381525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:34.382471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:34.387490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:34.509064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:34.693822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:34.709129 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3073fb26-792a-4ae3-8381-a66dc32747d6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1510 microversion: 2.1 time: 2.726978 Jul 25 16:16:34.731052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1228/2533] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:31 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1510 bytes in 2752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:34.741392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:34.748695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:34.773493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:34.778874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:34.781287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:34.784081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:35.915895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:35.939025 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7c88ad5a-679a-4fe8-81f8-761d42863f61 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 1.604427 Jul 25 16:16:35.966375 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1306/2534] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:34 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:36.012454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:36.061479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-44610f2f-4477-4ad1-b1d8-8f9b0893ae33 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1317 microversion: 2.1 time: 1.328354 Jul 25 16:16:36.076655 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1229/2535] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:34 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1317 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:36.100583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:36.112143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:36.148161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:36.149871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:36.154862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:36.163700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:36.481764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65bb426e-1b4a-48b2-8875-34df9e84cbb7 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Calling method '.version_select at 0x7f9da4aead30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:36.505227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65bb426e-1b4a-48b2-8875-34df9e84cbb7 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:36.506153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65bb426e-1b4a-48b2-8875-34df9e84cbb7 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:36.548479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65bb426e-1b4a-48b2-8875-34df9e84cbb7 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:36.552839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65bb426e-1b4a-48b2-8875-34df9e84cbb7 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:36.602992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65bb426e-1b4a-48b2-8875-34df9e84cbb7 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] 10.222.0.105 "GET /compute/v2.1/os-simple-tenant-usage/96f9b49b1d7945b88422b645ed7c986d?start=2022-07-24T16%3A16%3A34.134047&end=2022-07-26T16%3A16%3A34.134047" status: 200 len: 694 microversion: 2.1 time: 0.634095 Jul 25 16:16:36.606296 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1307/2536] 10.222.0.105 () {58 vars in 1417 bytes} [Mon Jul 25 16:16:35 2022] GET /compute/v2.1/os-simple-tenant-usage/96f9b49b1d7945b88422b645ed7c986d?start=2022-07-24T16%3A16%3A34.134047&end=2022-07-26T16%3A16%3A34.134047 => generated 694 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:36.625568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04eb8100-7789-4586-9ad3-912c37393f62 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938e7790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:36.814476 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04eb8100-7789-4586-9ad3-912c37393f62 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.206467 Jul 25 16:16:36.818463 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1308/2537] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:36 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:36.852449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bf1cf76d-68de-4f56-99b9-978e17ed2f0e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '.version_select at 0x7f9da49feee0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:36.903374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:36.921297 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-818cc9f4-c9bb-4361-8bd1-4c0d4f23b83f tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1510 microversion: 2.1 time: 0.840961 Jul 25 16:16:36.922266 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1230/2538] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:36 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1510 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:36.939027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf1cf76d-68de-4f56-99b9-978e17ed2f0e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:36.943121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf1cf76d-68de-4f56-99b9-978e17ed2f0e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:36.966786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:36.985867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:36.994894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf1cf76d-68de-4f56-99b9-978e17ed2f0e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.000832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf1cf76d-68de-4f56-99b9-978e17ed2f0e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.041680 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bf1cf76d-68de-4f56-99b9-978e17ed2f0e tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/os-simple-tenant-usage/96f9b49b1d7945b88422b645ed7c986d?start=2022-07-24T16%3A16%3A34.134047&end=2022-07-26T16%3A16%3A34.134047" status: 200 len: 690 microversion: 2.1 time: 0.213425 Jul 25 16:16:37.053516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1309/2539] 10.222.0.105 () {58 vars in 1417 bytes} [Mon Jul 25 16:16:36 2022] GET /compute/v2.1/os-simple-tenant-usage/96f9b49b1d7945b88422b645ed7c986d?start=2022-07-24T16%3A16%3A34.134047&end=2022-07-26T16%3A16%3A34.134047 => generated 690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:37.060025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:37.061547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:37.068097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.068870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.070318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.088535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.089220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.089470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.091706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.093363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.460453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:37.467742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c33be98f-028e-4988-9cdf-0c422869039d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "PUT /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1086 microversion: 2.1 time: 0.513108 Jul 25 16:16:37.473329 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1231/2540] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:16:36 2022] PUT /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1086 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:37.473648 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8f8a1b0-dbf2-4cf0-970b-8965755009f3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 0.428992 Jul 25 16:16:37.474340 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1310/2541] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:37 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:37.489714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:37.492852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:37.495020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c85058e8-7d01-47f6-8280-d5d656f54b42 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Calling method '.version_select at 0x7f9d93a8ac10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:37.522711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.523187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.529170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.531028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.591009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c85058e8-7d01-47f6-8280-d5d656f54b42 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.592206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c85058e8-7d01-47f6-8280-d5d656f54b42 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.684847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c85058e8-7d01-47f6-8280-d5d656f54b42 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.687111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c85058e8-7d01-47f6-8280-d5d656f54b42 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.835768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:37.846078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37713c49-678d-4d51-9917-b23b6cd1e61b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1466 microversion: 2.1 time: 0.370516 Jul 25 16:16:37.857131 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1311/2542] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:37 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1466 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:37.866375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:37.899239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:37.909166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.910871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:37.912078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:37.923747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:38.210557 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c85058e8-7d01-47f6-8280-d5d656f54b42 tempest-TenantUsagesTestJSON-1876369446 tempest-TenantUsagesTestJSON-1876369446-project-admin] 10.222.0.105 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T16%3A16%3A34.134047&end=2022-07-26T16%3A16%3A34.134047&detailed=1" status: 200 len: 30866 microversion: 2.1 time: 0.730564 Jul 25 16:16:38.215497 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1232/2543] 10.222.0.105 () {58 vars in 1340 bytes} [Mon Jul 25 16:16:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T16%3A16%3A34.134047&end=2022-07-26T16%3A16%3A34.134047&detailed=1 => generated 30866 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:38.235406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5fc25f5b-323d-4b2c-86a2-a1c9b7cadd82 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d9399b430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:38.318670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5fc25f5b-323d-4b2c-86a2-a1c9b7cadd82 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.099535 Jul 25 16:16:38.327408 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1233/2544] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:38 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:38.743677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:38.770298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2521a36b-911b-4884-b6e8-199f3a6f6c25 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1512 microversion: 2.1 time: 0.919885 Jul 25 16:16:38.775760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1312/2545] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:37 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1512 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:38.798927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:38.800780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:38.827021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:38.836352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:38.839372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:38.840091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:38.916180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:16:39.054184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:39.074363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'deleted': False, 'project_id': '9472271d24f6483b978d2685b2d50d03'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:39.100609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.103220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.106605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.112373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.120666 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca47c2d6-a314-4015-9534-e89f98634692 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 204 len: 0 microversion: 2.1 time: 0.341896 Jul 25 16:16:39.122909 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1313/2546] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:16:38 2022] DELETE /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:39.137154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:39.138783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:39.152834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.153647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.154649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.155338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.535759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:39.550223 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82349329-9d3c-40dd-87b4-fb298ca2be90 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 0.423372 Jul 25 16:16:39.550981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1314/2547] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:39 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:39.566941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-562ed389-cd84-4fc0-b6ca-9cbf17cc1418 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.246258 Jul 25 16:16:39.567876 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1234/2548] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:16:38 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:16:39.568447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:39.573043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:39.575224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9e8fe813-0c12-4c7f-a797-0b4c30d1b216 req-52df7584-ff28-43a9-8a16-83505c8af91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eba1e5-1df5-4f24-a596-317f046e74d0", "name": "network-vif-plugged", "status": "completed", "tag": "07e71465-7c41-4b5c-946c-016311f84262"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:39.587608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9e8fe813-0c12-4c7f-a797-0b4c30d1b216 req-52df7584-ff28-43a9-8a16-83505c8af91c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.588044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9e8fe813-0c12-4c7f-a797-0b4c30d1b216 req-52df7584-ff28-43a9-8a16-83505c8af91c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.602363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.602840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.603679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.604124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.604798 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9e8fe813-0c12-4c7f-a797-0b4c30d1b216 req-52df7584-ff28-43a9-8a16-83505c8af91c service nova] Creating event network-vif-plugged:07e71465-7c41-4b5c-946c-016311f84262 for instance 17eba1e5-1df5-4f24-a596-317f046e74d0 on n-h2-846219-13 Jul 25 16:16:39.614670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9e8fe813-0c12-4c7f-a797-0b4c30d1b216 req-52df7584-ff28-43a9-8a16-83505c8af91c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045260 Jul 25 16:16:39.621843 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1235/2549] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:39.640903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:39.642255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:39.666097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.666544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:39.667800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:39.674412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:40.695320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:40.707278 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab96f28a-b9a0-4ab3-8bca-1ee94118512d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1512 microversion: 2.1 time: 1.151064 Jul 25 16:16:40.726554 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1315/2550] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:39 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1512 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:40.736754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fbe0100-c155-4d17-8230-d22f38912940 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92f328b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:40.814980 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fbe0100-c155-4d17-8230-d22f38912940 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.086355 Jul 25 16:16:40.830505 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1316/2551] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:40 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:40.837503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:40.846320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'deleted': False} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:40.864262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:40.865619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:40.868288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:40.869598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:40.995176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:41.006174 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b923cef-c9e6-4e58-bad5-86acdffde490 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1472 microversion: 2.1 time: 1.384033 Jul 25 16:16:41.022486 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1236/2552] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:39 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1472 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:41.032978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:41.034026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:41.040849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:41.043536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:41.045412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:41.046689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:41.122230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:16:41.416164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:41.416810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:42.072121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:42.091480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd2bb6fe-b391-477e-9d5d-5c62ff81b7db tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1320 microversion: 2.1 time: 1.067231 Jul 25 16:16:42.098686 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1237/2553] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:41 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1320 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:42.124249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:42.128682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:42.147958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:42.149839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:42.151785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:42.153629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:42.248251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:16:42.346988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:42.501795 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a1cd6dad-99bb-4b7a-b098-8a2e3e69c556 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "DELETE /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 204 len: 0 microversion: 2.1 time: 0.399666 Jul 25 16:16:42.506919 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1238/2554] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:16:42 2022] DELETE /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:42.526248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2999dcff-552f-4ea0-b0b7-0c020e799a3e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da02a1430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:42.643947 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2999dcff-552f-4ea0-b0b7-0c020e799a3e tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1457 microversion: 2.1 time: 0.133364 Jul 25 16:16:42.651556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1239/2555] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:42 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1457 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:42.668860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:42.669674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:42.691571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:42.696782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:42.706461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:42.710072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.354029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:43.366462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-54403214-60cc-49b6-a375-d45ceb5c4599 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1472 microversion: 2.1 time: 0.714633 Jul 25 16:16:43.368253 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1240/2556] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:42 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1472 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:43.374779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:43.376307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:43.385638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:43.387484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.388936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:43.389649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.440516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:16:43.521658 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Instance is already in deleting state, ignoring this request Jul 25 16:16:43.523204 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d04c91b7-627a-40bf-a94a-a56bea0c6a99 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "DELETE /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 204 len: 0 microversion: 2.1 time: 0.153462 Jul 25 16:16:43.529193 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1241/2557] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:16:43 2022] DELETE /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:43.534299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:43.534925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:43.541319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:43.542116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.543189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:43.543821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.864215 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f7e7ee9-9f71-46f9-b9d2-fcde7cb868f6 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22500 microversion: 2.1 time: 3.031997 Jul 25 16:16:43.877371 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1317/2558] 10.222.0.105 () {58 vars in 1176 bytes} [Mon Jul 25 16:16:40 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22500 bytes in 3034 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:43.877371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:43.877371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:43.878488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:43.879707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.886601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:43.888079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:43.985890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:44.003638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34d0b3c4-5a90-4945-b8ec-acbeb1b893cc tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1470 microversion: 2.1 time: 0.473276 Jul 25 16:16:44.004346 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1242/2559] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:43 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1470 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:44.016118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-54ef3609-4b62-4d6b-9878-c1817349ee37 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d939be040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:44.104242 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-54ef3609-4b62-4d6b-9878-c1817349ee37 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1466 microversion: 2.1 time: 0.098399 Jul 25 16:16:44.105513 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1243/2560] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:44 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:44.387840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:44.404854 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7016f49-64b5-48cd-a873-831d0f7a98fd tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1518 microversion: 2.1 time: 0.537853 Jul 25 16:16:44.406010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1318/2561] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:43 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1518 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:44.421765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b06df053-9215-4332-bf49-e14197a1099f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'create', calling method: .version_select at 0x7f9d93952670>, body: {"keypair": {"name": "tempest-keypair-1164140981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuhWC7pRUzptpJpP1iXaAKFOVqul5ViRAerO3mIqaiYrs7Vvw/SXsyWypA8dGDMu/SqB06DqbXlgcGNMfuBSAlgmIODF98GbS/dYuN9Ric1Zv9Nt2wZ9LY8oJTJKo5Low=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:44.461397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:44.462792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b06df053-9215-4332-bf49-e14197a1099f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:16:44.483028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b06df053-9215-4332-bf49-e14197a1099f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for user ed4735185f84421f92bc1404d62f26e3 and project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:16:44.490107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'deleted': False, 'project_id': '9472271d24f6483b978d2685b2d50d03'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:44.493217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:44.505888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:44.510267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:44.513418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:44.514753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:44.530143 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b06df053-9215-4332-bf49-e14197a1099f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [eedb447a-e383-4eb0-aa6d-41c096dddc49] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:16:44.664256 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c83ae1a6-36b1-4bd3-9e80-00dd36ff7c9a tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/detail?tenant_id=959f5a2108434bf58ee07e6126258124" status: 200 len: 15 microversion: 2.1 time: 0.238721 Jul 25 16:16:44.667243 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1319/2562] 10.222.0.105 () {58 vars in 1236 bytes} [Mon Jul 25 16:16:44 2022] GET /compute/v2.1/servers/detail?tenant_id=959f5a2108434bf58ee07e6126258124 => generated 15 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:16:44.714357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:44.716120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:44.746685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:44.747643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:44.748970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:44.749590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.137638 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b5e4af60-d84e-4103-9b15-dba575f3a711 tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1623 microversion: 2.1 time: 0.465994 Jul 25 16:16:45.138316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1320/2563] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:44 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1623 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:45.144045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-865270f8-35de-45c6-a6ff-514950a3885b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938df670>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:45.202848 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-865270f8-35de-45c6-a6ff-514950a3885b tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 200 len: 1466 microversion: 2.1 time: 0.063181 Jul 25 16:16:45.210105 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1321/2564] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:45 2022] GET /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 1466 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:45.222591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:45.223550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:45.234671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.236146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.237982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.238829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.302232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.303237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.303843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lazy-loading 'fault' on Instance uuid ecec2b7a-7092-4301-a224-bde0f2657e3e {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:16:45.378397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3012be588e343b789032f05ba7f4539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9b49b1d7945b88422b645ed7c986d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:45.390078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53d70a1e-0ee8-4b5d-8c4f-6abc30a1bf20 tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 200 len: 1307 microversion: 2.1 time: 0.178086 Jul 25 16:16:45.391686 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1322/2565] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:45 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:45.397681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:45.404487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'tenant_id': '959f5a2108434bf58ee07e6126258124', 'deleted': False} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:45.428574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.429898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.431025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.431847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.473939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:16:45.532392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.533333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.542249 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [None req-b06df053-9215-4332-bf49-e14197a1099f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [eedb447a-e383-4eb0-aa6d-41c096dddc49] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 55198. Jul 25 16:16:45.563783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b06df053-9215-4332-bf49-e14197a1099f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.457075 Jul 25 16:16:45.564434 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1244/2566] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:16:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:45.574825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c633d0a6-a59a-453f-a4e8-52ded19afe36 req-643bd099-1af2-43c9-8421-894adb79350a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecec2b7a-7092-4301-a224-bde0f2657e3e", "name": "network-vif-deleted", "tag": "b1cb52a6-a3c5-4829-9b09-61e7a843a66f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:45.605252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c633d0a6-a59a-453f-a4e8-52ded19afe36 req-643bd099-1af2-43c9-8421-894adb79350a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.605252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c633d0a6-a59a-453f-a4e8-52ded19afe36 req-643bd099-1af2-43c9-8421-894adb79350a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.624889 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c633d0a6-a59a-453f-a4e8-52ded19afe36 req-643bd099-1af2-43c9-8421-894adb79350a service nova] Creating event network-vif-deleted:b1cb52a6-a3c5-4829-9b09-61e7a843a66f for instance ecec2b7a-7092-4301-a224-bde0f2657e3e on n-h1-846219-13 Jul 25 16:16:45.647934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c633d0a6-a59a-453f-a4e8-52ded19afe36 req-643bd099-1af2-43c9-8421-894adb79350a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081972 Jul 25 16:16:45.648966 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1245/2567] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:45.656281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:45.657052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:45.690822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.692963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.695919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:45.697378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:45.886145 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-464f19a8-fb24-4832-bd88-b08d9dc3cb54 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=959f5a2108434bf58ee07e6126258124" status: 200 len: 4842 microversion: 2.1 time: 0.492491 Jul 25 16:16:45.887111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1323/2568] 10.222.0.105 () {58 vars in 1262 bytes} [Mon Jul 25 16:16:45 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=959f5a2108434bf58ee07e6126258124 => generated 4842 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:45.895366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1505382161", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9fd58fea-6110-43b7-9f72-c20592d5f0d4"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:46.015637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:16:46.473203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:46.484354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9b8eac2-03db-4ab5-a6d1-a3cb32f0055c tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1471 microversion: 2.1 time: 0.833761 Jul 25 16:16:46.497693 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1246/2569] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:45 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1471 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:46.506757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.507389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:46.527195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:46.527748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:46.528788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:46.529266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:46.770878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a4683dfce541c8acff65c7c09e5372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dd18d28d79468a8ebb393017af7979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:46.788148 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fcfd03ef-199c-47e9-822d-7d1c9c9a9ea0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 200 len: 1476 microversion: 2.1 time: 0.288707 Jul 25 16:16:46.789320 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1247/2570] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:46.808066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.816797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'tenant_id': '9472271d24f6483b978d2685b2d50d03', 'deleted': False} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:46.823790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:46.824606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:46.825967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:46.827097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:46.887681 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9e4dcaa6-cfb9-4f79-8cec-db0b22de77a1 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9472271d24f6483b978d2685b2d50d03" status: 200 len: 15 microversion: 2.1 time: 0.096072 Jul 25 16:16:46.888886 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1248/2571] 10.222.0.105 () {58 vars in 1262 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9472271d24f6483b978d2685b2d50d03 => generated 15 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:16:46.902812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.903615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] [instance: ecec2b7a-7092-4301-a224-bde0f2657e3e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:46.912440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:46.913033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:46.916152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:46.916707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:46.979149 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] HTTP exception thrown: Instance ecec2b7a-7092-4301-a224-bde0f2657e3e could not be found. Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Request method failure captured: Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e HTTP/1.1 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sG37JdnWMP3JLmCjUDqeRKjiM00wl5FgZ6_-67KnxhTm85IuEBA8pbP5QgXf2179HVgiiDM1fXW8hHrUKBlZR1WU_3_ilgTqIoe8rkjKcMGADAoEcQYU3ULho_6yHJi7pQVeHkeUnJO7aICC8RPoy-zMuqkPDFCMRLQ9PJcYnu8lXw Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 96f9b49b1d7945b88422b645ed7c986d Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TenantUsagesTestJSON-438296723 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/96f9b49b1d7945b88422b645ed7c986d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/96f9b49b1d7945b88422b645ed7c986d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/96f9b49b1d7945b88422b645ed7c986d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_96f9b49b1d7945b88422b645ed7c986d"}]}] Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TenantUsagesTestJSON-438296723 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 96f9b49b1d7945b88422b645ed7c986d Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TenantUsagesTestJSON-438296723 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TenantUsagesTestJSON-438296723-project Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a3012be588e343b789032f05ba7f4539 Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TenantUsagesTestJSON-438296723-project Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance ecec2b7a-7092-4301-a224-bde0f2657e3e could not be found. Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'ecec2b7a-7092-4301-a224-bde0f2657e3e'} Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecec2b7a-7092-4301-a224-bde0f2657e3e could not be found. Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecec2b7a-7092-4301-a224-bde0f2657e3e could not be found. Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:46.981744 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecec2b7a-7092-4301-a224-bde0f2657e3e could not be found. Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] Returning 404 to user: Instance ecec2b7a-7092-4301-a224-bde0f2657e3e could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99b8f207-380f-45ca-91a2-5c3bfead221b tempest-TenantUsagesTestJSON-438296723 tempest-TenantUsagesTestJSON-438296723-project] 10.222.0.105 "GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e" status: 404 len: 111 microversion: 2.1 time: 0.088783 Jul 25 16:16:46.991437 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1249/2572] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/servers/ecec2b7a-7092-4301-a224-bde0f2657e3e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:47.001837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6c666b4-cb5f-467e-90ab-128517767f75 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93d21a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:47.219575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:16:47.220410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:16:47.220573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:16:47.221054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:16:47.226302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:16:47.271768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6c666b4-cb5f-467e-90ab-128517767f75 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?changes-since=2022-07-25T16%3A13%3A52Z" status: 200 len: 1914 microversion: 2.1 time: 0.278723 Jul 25 16:16:47.275910 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1250/2573] 10.222.0.105 () {58 vars in 1204 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/images?changes-since=2022-07-25T16%3A13%3A52Z => generated 1914 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:47.278675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:47.279190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:47.296346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:47.298333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-48b7bec2-dd3b-4b11-8a6f-e92057022cda req-e8dea1ee-2ba1-4b42-89d2-eecd150e40d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9dfd9-3964-40b4-9af3-0cc6662d7e91", "name": "network-vif-deleted", "tag": "d49981f8-6f55-409c-a678-75a8ebac4060"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:47.299516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:47.338346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-48b7bec2-dd3b-4b11-8a6f-e92057022cda req-e8dea1ee-2ba1-4b42-89d2-eecd150e40d1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:47.339959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-48b7bec2-dd3b-4b11-8a6f-e92057022cda req-e8dea1ee-2ba1-4b42-89d2-eecd150e40d1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:47.369823 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-48b7bec2-dd3b-4b11-8a6f-e92057022cda req-e8dea1ee-2ba1-4b42-89d2-eecd150e40d1 service nova] Creating event network-vif-deleted:d49981f8-6f55-409c-a678-75a8ebac4060 for instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 on n-h1-846219-13 Jul 25 16:16:47.393629 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-48b7bec2-dd3b-4b11-8a6f-e92057022cda req-e8dea1ee-2ba1-4b42-89d2-eecd150e40d1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114048 Jul 25 16:16:47.397509 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1251/2574] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:47.413028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4d36f4d6-a104-4107-ab13-c8ef43252f58 req-a787f7ae-ca1b-44a7-b7a8-123df6556c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "name": "network-vif-unplugged", "status": "completed", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:47.429897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:16:47.439173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4d36f4d6-a104-4107-ab13-c8ef43252f58 req-a787f7ae-ca1b-44a7-b7a8-123df6556c79 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:47.441132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4d36f4d6-a104-4107-ab13-c8ef43252f58 req-a787f7ae-ca1b-44a7-b7a8-123df6556c79 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:47.452889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Getting quotas for user ca8774372f9e4f178645ff20c4fe2693 and project b0327cf82312473da90dfaf13e95fcea. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:16:47.469370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4d36f4d6-a104-4107-ab13-c8ef43252f58 req-a787f7ae-ca1b-44a7-b7a8-123df6556c79 service nova] Creating event network-vif-unplugged:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:16:47.482775 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4d36f4d6-a104-4107-ab13-c8ef43252f58 req-a787f7ae-ca1b-44a7-b7a8-123df6556c79 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082027 Jul 25 16:16:47.487430 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1252/2575] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:47.490820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:16:47.507960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:16:47.512427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9212f47a-48b8-4e79-a7f2-e5f09d050de4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:47.538769 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9212f47a-48b8-4e79-a7f2-e5f09d050de4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.047850 Jul 25 16:16:47.546139 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1253/2576] 10.222.0.105 () {58 vars in 1194 bytes} [Mon Jul 25 16:16:47 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:16:47.562835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-045b9b09-d0ba-4b83-a0de-55aad35de7eb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d939524c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:47.658479 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b91b2a03-ecef-402f-bec0-2dc65f115e18 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.767899 Jul 25 16:16:47.659686 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1324/2577] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:16:47.699086 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-045b9b09-d0ba-4b83-a0de-55aad35de7eb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1700414100" status: 200 len: 488 microversion: 2.1 time: 0.148273 Jul 25 16:16:47.704793 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1254/2578] 10.222.0.105 () {58 vars in 1236 bytes} [Mon Jul 25 16:16:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1700414100 => generated 488 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:47.705353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:47.720363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5c4dfc7-984b-4a26-aae0-2715cbfbf5d2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:47.721633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:47.731237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5c4dfc7-984b-4a26-aae0-2715cbfbf5d2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:47.750127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:47.753220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:47.757258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:47.758619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:47.852060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:47.990311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5c4dfc7-984b-4a26-aae0-2715cbfbf5d2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:48.003357 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5c4dfc7-984b-4a26-aae0-2715cbfbf5d2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1221 microversion: 2.1 time: 0.295576 Jul 25 16:16:48.004154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1255/2579] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:47 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1221 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:48.024507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51247d17-0b1f-41f8-abe5-c38eb5b137a3 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93900af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.058824 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef65a82f-9a37-4357-8aff-7574f413deef tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 0 microversion: 2.1 time: 0.395623 Jul 25 16:16:48.071480 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1325/2580] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:16:47 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:16:48.130270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.132600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: cca9dfd9-3964-40b4-9af3-0cc6662d7e91] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:48.142579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.143234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.145306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.146211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.212432 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] HTTP exception thrown: Instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 could not be found. Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Request method failure captured: Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 HTTP/1.1 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEAMxNNZ1EWkZED7jSD4FOorXqQy0oLE6w8Y5w6oiiTsgwB4-7s88R_tbZqg1GHeVAIZ39dPar8Etke0EN59Mp6FSSKZTu7Cnr7xiI78jVqMFJyOStoxlqkFWU5z8uiea8dRfMpECy-v6zp4BUTTpFqgpvd2W6OQh3HaSiAfNeA_Bs Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_39dd18d28d79468a8ebb393017af7979"}]}] Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a4a4683dfce541c8acff65c7c09e5372 Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 could not be found. Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'cca9dfd9-3964-40b4-9af3-0cc6662d7e91'} Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 could not be found. Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 could not be found. Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.219803 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 could not be found. Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Returning 404 to user: Instance cca9dfd9-3964-40b4-9af3-0cc6662d7e91 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:48.234246 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8949b9c5-4d9d-4157-adc5-07aa8a8c56e1 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91" status: 404 len: 111 microversion: 2.1 time: 0.154488 Jul 25 16:16:48.237556 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1326/2581] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/servers/cca9dfd9-3964-40b4-9af3-0cc6662d7e91 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:48.260063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.282425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:48.289747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '959f5a2108434bf58ee07e6126258124'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:48.304589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.306553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.308252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.309564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.345696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51247d17-0b1f-41f8-abe5-c38eb5b137a3 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?server=a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 963 microversion: 2.1 time: 0.333488 Jul 25 16:16:48.346225 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1256/2582] 10.222.0.105 () {58 vars in 1214 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/images?server=a5152839-3340-429d-b949-0ca6709e78ca => generated 963 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:48.380500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.381051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:48.427134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.440021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.443027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.444075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.500208 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] HTTP exception thrown: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Request method failure captured: Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 HTTP/1.1 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEAMxNNZ1EWkZED7jSD4FOorXqQy0oLE6w8Y5w6oiiTsgwB4-7s88R_tbZqg1GHeVAIZ39dPar8Etke0EN59Mp6FSSKZTu7Cnr7xiI78jVqMFJyOStoxlqkFWU5z8uiea8dRfMpECy-v6zp4BUTTpFqgpvd2W6OQh3HaSiAfNeA_Bs Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_39dd18d28d79468a8ebb393017af7979"}]}] Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a4a4683dfce541c8acff65c7c09e5372 Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '8c93153b-4dba-4766-817d-2d48cbe83d73'} Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:48.503873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.508622 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.512031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Returning 404 to user: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:48.514305 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12e839ac-87d0-457d-b116-acdcde307ef6 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 404 len: 111 microversion: 2.1 time: 0.151087 Jul 25 16:16:48.515704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1257/2583] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:16:48 2022] DELETE /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:48.524698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6417e8d5-8565-411a-81d1-17ebbf51ed56 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93a0c1f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.598010 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6417e8d5-8565-411a-81d1-17ebbf51ed56 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fv2.1%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 487 microversion: 2.1 time: 0.079548 Jul 25 16:16:48.598757 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1258/2584] 10.222.0.105 () {58 vars in 1324 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fv2.1%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 487 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:48.620199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:16:48.624048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.628035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 8c93153b-4dba-4766-817d-2d48cbe83d73] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:48.644349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.645426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.647249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.649085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.684616 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] HTTP exception thrown: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Request method failure captured: Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 HTTP/1.1 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEAMxNNZ1EWkZED7jSD4FOorXqQy0oLE6w8Y5w6oiiTsgwB4-7s88R_tbZqg1GHeVAIZ39dPar8Etke0EN59Mp6FSSKZTu7Cnr7xiI78jVqMFJyOStoxlqkFWU5z8uiea8dRfMpECy-v6zp4BUTTpFqgpvd2W6OQh3HaSiAfNeA_Bs Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_39dd18d28d79468a8ebb393017af7979"}]}] Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a4a4683dfce541c8acff65c7c09e5372 Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '8c93153b-4dba-4766-817d-2d48cbe83d73'} Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.687331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. Jul 25 16:16:48.691987 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.697653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Returning 404 to user: Instance 8c93153b-4dba-4766-817d-2d48cbe83d73 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:48.699987 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ee4b0c5-a0c2-410b-bccd-779085aa49f0 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73" status: 404 len: 111 microversion: 2.1 time: 0.085666 Jul 25 16:16:48.701529 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1259/2585] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/servers/8c93153b-4dba-4766-817d-2d48cbe83d73 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:48.715691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c044716-ab00-457d-8afe-3c563f29a695 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d939009d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.812326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c044716-ab00-457d-8afe-3c563f29a695 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 487 microversion: 2.1 time: 0.106393 Jul 25 16:16:48.813627 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1260/2586] 10.222.0.105 () {58 vars in 1310 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 487 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:48.839122 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8a695455-9ca7-4fae-85cf-9fe6279e202e tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers?status=error" status: 200 len: 340 microversion: 2.1 time: 0.597384 Jul 25 16:16:48.842599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.843515 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1327/2587] 10.222.0.105 () {58 vars in 1155 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/servers?status=error => generated 340 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:48.850217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:48.863215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cd927031-d928-48cc-a868-dec8bcca5525 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ea2940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.874220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.874722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.875635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.876086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.897037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] HTTP exception thrown: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Request method failure captured: Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b HTTP/1.1 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEAMxNNZ1EWkZED7jSD4FOorXqQy0oLE6w8Y5w6oiiTsgwB4-7s88R_tbZqg1GHeVAIZ39dPar8Etke0EN59Mp6FSSKZTu7Cnr7xiI78jVqMFJyOStoxlqkFWU5z8uiea8dRfMpECy-v6zp4BUTTpFqgpvd2W6OQh3HaSiAfNeA_Bs Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_39dd18d28d79468a8ebb393017af7979"}]}] Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a4a4683dfce541c8acff65c7c09e5372 Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '343ebf36-2002-442e-9d5c-dcd8aa5e2c8b'} Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:48.899082 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.905617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Returning 404 to user: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:48.907298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f1a4331a-fdbd-4388-9f89-c2a32cdb0270 tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "DELETE /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 404 len: 111 microversion: 2.1 time: 0.076258 Jul 25 16:16:48.910385 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1261/2588] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:16:48 2022] DELETE /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:48.920645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:48.923088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:48.939751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.940535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:48.941821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:48.945643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.136191 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aeb10254-0bbf-488c-bf7f-07dc1073ee5f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 0 microversion: 2.1 time: 0.223974 Jul 25 16:16:49.137412 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1262/2589] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:16:48 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:16:49.159126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:49.160175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] [instance: 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:49.162344 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cd927031-d928-48cc-a868-dec8bcca5525 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3302 microversion: 2.1 time: 0.317003 Jul 25 16:16:49.174542 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1328/2590] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3302 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:49.187096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:49.188069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:49.196147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:49.197048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.198547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:49.199337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.200112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:49.200768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.201625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:49.202293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.279643 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] HTTP exception thrown: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Request method failure captured: Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b HTTP/1.1 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEAMxNNZ1EWkZED7jSD4FOorXqQy0oLE6w8Y5w6oiiTsgwB4-7s88R_tbZqg1GHeVAIZ39dPar8Etke0EN59Mp6FSSKZTu7Cnr7xiI78jVqMFJyOStoxlqkFWU5z8uiea8dRfMpECy-v6zp4BUTTpFqgpvd2W6OQh3HaSiAfNeA_Bs Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/39dd18d28d79468a8ebb393017af7979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_39dd18d28d79468a8ebb393017af7979"}]}] Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 39dd18d28d79468a8ebb393017af7979 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-658459345 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a4a4683dfce541c8acff65c7c09e5372 Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerDiskConfigTestJSON-658459345-project Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '343ebf36-2002-442e-9d5c-dcd8aa5e2c8b'} Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:49.283780 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:16:49.287668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] Returning 404 to user: Instance 343ebf36-2002-442e-9d5c-dcd8aa5e2c8b could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:49.289229 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b437fec8-c9dc-4b95-8f5c-f87b7c651f4d tempest-ServerDiskConfigTestJSON-658459345 tempest-ServerDiskConfigTestJSON-658459345-project] 10.222.0.105 "GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b" status: 404 len: 111 microversion: 2.1 time: 0.150376 Jul 25 16:16:49.290934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1263/2591] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:49 2022] GET /compute/v2.1/servers/343ebf36-2002-442e-9d5c-dcd8aa5e2c8b => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:16:49.301219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:49.306708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:49.320408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:49.320904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.321743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:49.325380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:49.671228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:49.701891 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5dcf9a50-4291-4c19-a44e-68455f74eeb8 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1217 microversion: 2.1 time: 0.525367 Jul 25 16:16:49.705457 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1329/2592] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:49 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1217 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:49.716270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-791debfb-b01a-4d33-bc8e-ea5c2bf3d2d0 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92fe8dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:49.972152 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-791debfb-b01a-4d33-bc8e-ea5c2bf3d2d0 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1438 microversion: 2.1 time: 0.261738 Jul 25 16:16:49.973810 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1330/2593] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:16:49 2022] GET /compute/v2.1/images?type=snapshot => generated 1438 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:50.003303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d00e6ccf-4d4e-4f25-a2d4-33ed39bf4c13 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ffe8b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.010051 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c4f2ea7b-93c8-4382-807d-ab3fec442d60 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1619 microversion: 2.1 time: 0.717433 Jul 25 16:16:50.011267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1264/2594] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:49 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1619 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:50.073808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.076543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:50.122656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:50.124289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:50.131840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:50.132995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:50.168407 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d00e6ccf-4d4e-4f25-a2d4-33ed39bf4c13 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images?limit=1" status: 200 len: 625 microversion: 2.1 time: 0.183045 Jul 25 16:16:50.186179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1331/2595] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:16:49 2022] GET /compute/v2.1/images?limit=1 => generated 625 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:16:50.216039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-885bb8a2-b2ee-4ecf-bc06-061ddf676070 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92fe85e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.556805 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-885bb8a2-b2ee-4ecf-bc06-061ddf676070 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?changes-since=2022-07-25T16%3A13%3A44Z" status: 200 len: 6352 microversion: 2.1 time: 0.357583 Jul 25 16:16:50.557635 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1332/2596] 10.222.0.105 () {58 vars in 1225 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-25T16%3A13%3A44Z => generated 6352 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:50.589083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-319b9fb7-46ac-4dce-8d0c-e4240cc183ff tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ffe550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.739275 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-319b9fb7-46ac-4dce-8d0c-e4240cc183ff tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1700414100" status: 200 len: 668 microversion: 2.1 time: 0.158494 Jul 25 16:16:50.746771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1333/2597] 10.222.0.105 () {58 vars in 1257 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1700414100 => generated 668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:50.778521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.781763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:50.820323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:50.833184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:50.837204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:50.838557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:51.093875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:51.098253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-165b591d-0054-431d-8760-044e76409ad4 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1619 microversion: 2.1 time: 1.054366 Jul 25 16:16:51.113613 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1265/2598] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1619 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.120968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10ad5bda-71d2-485e-b7f2-c6c09ea104cf tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93a76a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.122385 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d384f487-395d-4b1c-8c08-efe79d862295 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1279 microversion: 2.1 time: 0.363185 Jul 25 16:16:51.147406 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1334/2599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.166242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.175380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'host': 'n-h1-846219-13', 'deleted': False} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:51.196954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:51.201559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:51.203052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:51.204159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:51.253675 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10ad5bda-71d2-485e-b7f2-c6c09ea104cf tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fv2.1%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1469 microversion: 2.1 time: 0.138411 Jul 25 16:16:51.254275 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1266/2600] 10.222.0.105 () {58 vars in 1345 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fv2.1%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1469 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.282285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5524c0c-6543-4ee3-8126-ec022dceb985 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93961550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.383006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5524c0c-6543-4ee3-8126-ec022dceb985 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1469 microversion: 2.1 time: 0.105827 Jul 25 16:16:51.396284 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1267/2601] 10.222.0.105 () {58 vars in 1331 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.105%2Fcompute%2Fservers%2F4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1469 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.403366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1589674829", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6caa10b5-bb0b-47f3-bbd9-62b23141517a"}], "security_groups": [{"name": "tempest-securitygroup--561386028"}], "key_name": "tempest-keypair-1164140981", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:51.425824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:16:51.584118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8ae8986-72e3-4cf6-9354-269e6b070748 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers?host=n-h1-846219-13&all_tenants=1" status: 200 len: 1661 microversion: 2.1 time: 0.432831 Jul 25 16:16:51.584950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1335/2602] 10.222.0.105 () {58 vars in 1197 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/servers?host=n-h1-846219-13&all_tenants=1 => generated 1661 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.596252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-670f1d26-99e4-4055-a22b-ce2468bde0c7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938791f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.766620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-670f1d26-99e4-4055-a22b-ce2468bde0c7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7130 microversion: 2.1 time: 0.180087 Jul 25 16:16:51.768120 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1336/2603] 10.222.0.105 () {58 vars in 1175 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7130 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.777314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.791576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:16:51.803717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:51.804683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:51.806324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:51.807025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:51.857441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3956c6b-bcf7-41c0-9423-d033c91d811f tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.086744 Jul 25 16:16:51.867813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1337/2604] 10.222.0.105 () {58 vars in 1201 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:16:51.878159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eaedc0f5-03da-4004-a9bc-8cd56dcdc96f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9da49a5310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.986913 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eaedc0f5-03da-4004-a9bc-8cd56dcdc96f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4384 microversion: 2.1 time: 0.116070 Jul 25 16:16:51.988254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1338/2605] 10.222.0.105 () {58 vars in 1175 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4384 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:51.996302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:52.001152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:52.015173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.016017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.017068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.017992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.126708 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e09899bc-2916-4368-a3d3-5ca9ac967a0b tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 0 microversion: 2.1 time: 0.136212 Jul 25 16:16:52.128114 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1339/2606] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:16:51 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:16:52.133752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9604d04f-511c-4dc7-9cee-ceb50825deb3 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ab23a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:52.160660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] validate_networks() for [('6caa10b5-bb0b-47f3-bbd9-62b23141517a', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:16:52.196904 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9604d04f-511c-4dc7-9cee-ceb50825deb3 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/984a5010-f259-40b9-952b-c497908cc5d8" status: 200 len: 787 microversion: 2.1 time: 0.067462 Jul 25 16:16:52.199243 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1340/2607] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:16:52 2022] GET /compute/v2.1/images/984a5010-f259-40b9-952b-c497908cc5d8 => generated 787 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:52.205787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:52.210187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:52.225715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.226175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.226981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.227416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.329244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:16:52.329932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:16:52.330549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:16:52.331107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:16:52.331668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:16:52.455253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:52.476739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.478061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.480182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.483043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.570523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-056d9e08-4836-48c3-a8ed-3d82705ba9c9 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 1070 microversion: 2.1 time: 0.369691 Jul 25 16:16:52.576493 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1341/2608] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:16:52 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 1070 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:16:52.595202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:52.595663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:52.621288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.624713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.628523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:52.629184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:52.869337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:52.881272 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3803dfca-a9f9-428f-bd19-8729452f0c29 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1279 microversion: 2.1 time: 0.303436 Jul 25 16:16:52.882022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1342/2609] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:52 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1279 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:52.893382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-47b0b0d5-c563-47d8-9710-1a25fc05cb68 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92ffeaf0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:52.964931 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-47b0b0d5-c563-47d8-9710-1a25fc05cb68 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1614 microversion: 2.1 time: 0.081078 Jul 25 16:16:52.968264 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1343/2610] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:16:52 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:52.974136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:52.974945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:53.001415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:53.002417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:53.004344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:53.004867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:53.960646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:53.970593 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3de5f298-6658-4133-b4a5-7e851db03cc1 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1474 microversion: 2.1 time: 1.000972 Jul 25 16:16:53.992987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1344/2611] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:52 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1474 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:53.998793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-008ec3d8-65b5-4ac4-a1c2-2718c6dc273a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938df9d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:54.330557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:16:54.333262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:16:54.334776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:16:54.335747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:16:54.339775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:16:54.410417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:54.412307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:54.419176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:54.420872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:54.520145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:16:54.534087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for user ed4735185f84421f92bc1404d62f26e3 and project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:16:54.587553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:16:54.593450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:16:54.700817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:54.771758 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d37d0adf-d11b-48ce-bdc8-2cba902051aa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 3.373687 Jul 25 16:16:54.776710 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1268/2612] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:16:51 2022] POST /compute/v2.1/servers => generated 410 bytes in 3379 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:16:54.809012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:54.810752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:54.842474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:54.845898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:54.847479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:54.852880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:55.394352 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-008ec3d8-65b5-4ac4-a1c2-2718c6dc273a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358" status: 204 len: 0 microversion: 2.1 time: 1.399156 Jul 25 16:16:55.399666 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1345/2613] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:53 2022] DELETE /compute/v2.1/images/210c235b-4273-43d5-9c62-3f1f2d8aa358 => generated 0 bytes in 1401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:55.400667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a0ca1d44-6d61-4573-8fe7-51a11c6b39b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:55.401819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0ca1d44-6d61-4573-8fe7-51a11c6b39b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:55.726179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a0ca1d44-6d61-4573-8fe7-51a11c6b39b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:55.756807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a0ca1d44-6d61-4573-8fe7-51a11c6b39b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1243 microversion: 2.1 time: 0.359100 Jul 25 16:16:55.758723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1346/2614] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:55 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1243 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:55.775371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:55.778313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:55.819866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:55.845085 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb5530e9-c97c-4992-aafe-1cde7c5ae99e tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 1.061510 Jul 25 16:16:55.848132 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1269/2615] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:54 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:55.858623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:55.859508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:55.860674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:55.863180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:55.870539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3150712b-230e-4874-b846-8b1f63d49a08 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93961af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:56.726565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:56.752473 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a13190d6-1fa2-4395-afae-6bf4a4fccecd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1474 microversion: 2.1 time: 0.984171 Jul 25 16:16:56.755676 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1347/2616] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:55 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1474 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:56.796621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:56.804008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:56.866443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:56.868222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:56.872094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:56.872567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:57.063224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:57.066958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:57.077386 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4bad9367-a3ce-4bc6-8b19-7504eb4a860b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1295 microversion: 2.1 time: 0.296278 Jul 25 16:16:57.078284 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1348/2617] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:56 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1295 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:57.091393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:57.092828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:57.113248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:57.114007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:57.115578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:57.117615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:57.581359 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3150712b-230e-4874-b846-8b1f63d49a08 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45" status: 204 len: 0 microversion: 2.1 time: 1.728727 Jul 25 16:16:57.582830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1270/2618] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:55 2022] DELETE /compute/v2.1/images/bccdf975-f891-4988-aad1-63b386b57d45 => generated 0 bytes in 1734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:57.595498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-399f9329-5094-4166-ad26-021e0981c7d0 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d938fe9d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:57.766474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:57.782540 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-670f5836-725d-472b-9930-ed9ade273975 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 0.701972 Jul 25 16:16:57.783228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1349/2619] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:57 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:57.827412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:57.831629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:57.853767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:57.854503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:57.855498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:57.856154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.295426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:58.307534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-45c0daa0-e8c9-4ade-b3c7-5d32674c6203 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1474 microversion: 2.1 time: 0.520441 Jul 25 16:16:58.322558 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1350/2620] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:57 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1474 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:58.337010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:58.338348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:58.346434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.347135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.349805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.350473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.414806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-399f9329-5094-4166-ad26-021e0981c7d0 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c" status: 204 len: 0 microversion: 2.1 time: 0.827576 Jul 25 16:16:58.415404 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1271/2621] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:57 2022] DELETE /compute/v2.1/images/98dc91c3-5302-4934-a580-12ce77c4da1c => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:58.420534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-54a93cd2-d63f-4a29-a929-1fd80a3286d5 req-77a4f20a-abe5-40cb-b6d7-245086fec6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e", "tag": "b03c4ef1-97dd-45b2-8c81-003870173810"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:58.433019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-54a93cd2-d63f-4a29-a929-1fd80a3286d5 req-77a4f20a-abe5-40cb-b6d7-245086fec6ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.434635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-54a93cd2-d63f-4a29-a929-1fd80a3286d5 req-77a4f20a-abe5-40cb-b6d7-245086fec6ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.452052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-54a93cd2-d63f-4a29-a929-1fd80a3286d5 req-77a4f20a-abe5-40cb-b6d7-245086fec6ef service nova] Creating event network-changed:b03c4ef1-97dd-45b2-8c81-003870173810 for instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e on n-h1-846219-13 Jul 25 16:16:58.464693 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-54a93cd2-d63f-4a29-a929-1fd80a3286d5 req-77a4f20a-abe5-40cb-b6d7-245086fec6ef service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047480 Jul 25 16:16:58.466020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:58.466556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1272/2622] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:58.476130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:58.477122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:58.485499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.486287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.487511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.488594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.489819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9855289e-9200-4765-8924-bfef52e13edd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1301 microversion: 2.1 time: 0.163382 Jul 25 16:16:58.492065 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1351/2623] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:58 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:58.522148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:58.538679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:16:58.665195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bebb253-7f90-4a94-a91d-f4eaeaef00bb tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 204 len: 0 microversion: 2.1 time: 0.196365 Jul 25 16:16:58.666607 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1273/2624] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:16:58 2022] DELETE /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:16:58.679552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:58.680527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:58.703037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.707002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.708796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.709926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.814537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:58.820730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:58.848823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.854766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:58.863469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:58.869332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:59.499750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:59.513803 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f8f709b-df9d-42c8-ad13-78da6eec6573 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1477 microversion: 2.1 time: 0.842630 Jul 25 16:16:59.514696 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1352/2625] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:58 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1477 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:59.520404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:59.521826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:59.529210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:59.529872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:59.530872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:59.531486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:59.742233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:59.755309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d7910815-5c0b-43e4-86f3-6593eb4a809c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 0.950620 Jul 25 16:16:59.756213 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1274/2626] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:58 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:59.763510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:59.764780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:16:59.782638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:59.783428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:59.789052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:16:59.789713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:16:59.865703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:59.888157 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dd23d4c6-5968-4301-907b-60943fa5f345 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1474 microversion: 2.1 time: 0.371595 Jul 25 16:16:59.888295 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1353/2627] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:59 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:59.922184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:16:59.932534 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ccd5f06-9113-4edf-9f63-f2bf47eb949b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1301 microversion: 2.1 time: 0.174603 Jul 25 16:16:59.933447 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1275/2628] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:16:59 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:00.546265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:00.548991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:00.581411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:00.583632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:00.585268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:00.585907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:00.785193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:00.788283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:00.820854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:00.823988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:00.826843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:00.827669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:01.190518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:01.200052 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75f735e3-87ac-422d-83d4-881056c58235 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1477 microversion: 2.1 time: 0.659589 Jul 25 16:17:01.204322 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1354/2629] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:00 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:01.216593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:01.217520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:01.232896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:01.234822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:01.235861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:01.237692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:01.316471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:01.327620 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52b6aade-e9fe-43ff-9400-c08c25c6bb19 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 0.548546 Jul 25 16:17:01.328540 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1276/2630] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:00 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:01.345085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:01.346012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:01.356959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:01.357737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:01.358692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:01.359325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:01.835968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:01.958280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:01.968309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:01.987702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2748386-38c9-4921-8351-b12ec5072d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.651635 Jul 25 16:17:02.008888 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-471c2359-5abf-4b8d-be07-180926e69040 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1474 microversion: 2.1 time: 0.802911 Jul 25 16:17:02.011496 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1355/2631] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:01 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1474 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:02.017609 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1277/2632] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:01 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:02.235956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:02.237436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:02.256045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:02.256881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:02.258047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:02.261797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:02.362599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:02.367357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:02.384607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:02.385065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:02.389132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:02.390490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:02.695100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:02.703230 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-414b5306-2251-481b-b286-44faeee18bd7 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 200 len: 1435 microversion: 2.1 time: 0.476242 Jul 25 16:17:02.721940 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1356/2633] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:02 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 1435 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:02.731050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2fa578c3-b7af-44a9-8802-d029ff3b5e52 req-752ed7eb-e664-4ef0-b122-52441b5e51cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b95ec35-12ff-46c5-aceb-8daf24ae63b7", "name": "network-vif-deleted", "tag": "ce4676ac-b993-4041-85d8-5a309a5e5f56"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:02.762414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2fa578c3-b7af-44a9-8802-d029ff3b5e52 req-752ed7eb-e664-4ef0-b122-52441b5e51cd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:02.765512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2fa578c3-b7af-44a9-8802-d029ff3b5e52 req-752ed7eb-e664-4ef0-b122-52441b5e51cd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:02.780291 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2fa578c3-b7af-44a9-8802-d029ff3b5e52 req-752ed7eb-e664-4ef0-b122-52441b5e51cd service nova] Creating event network-vif-deleted:ce4676ac-b993-4041-85d8-5a309a5e5f56 for instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 on n-h2-846219-13 Jul 25 16:17:02.791470 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2fa578c3-b7af-44a9-8802-d029ff3b5e52 req-752ed7eb-e664-4ef0-b122-52441b5e51cd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067936 Jul 25 16:17:02.792972 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1357/2634] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:03.016101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:03.016870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:03.068966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.069516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.085766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.093569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.470578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:03.492748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ba408d1-5efa-473d-9478-f8dc07f723ea tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 1.147216 Jul 25 16:17:03.505749 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1278/2635] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:02 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:03.514865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:03.517255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:03.530619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.531727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.534095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.535761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.763741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:03.775805 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db2db9b4-3060-4d07-8347-708e2dffaf3f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.766456 Jul 25 16:17:03.791583 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1358/2636] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:03 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:03.807128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:03.808452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: 4b95ec35-12ff-46c5-aceb-8daf24ae63b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:03.823584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.824329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.828518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.829463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.875044 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] HTTP exception thrown: Instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 could not be found. Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Request method failure captured: Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 HTTP/1.1 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sE3Iz9UQbxVIdAuZlDCBWf1XiRyvvlrz66OxuN2LOsTFKBwSJGJadzlexbzmofCPR6x3Ihn99rj1y9nprJVeoRsSP3f2-s1CgVrY4PmV3CEUJYj-a_h3IKd9dcAewYDGLs-6aWYDfhIz3jeqkmmFOwk4wdAcAaapkTJXqilkYkcdu0 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8c2edaf68e0742afbe3ce9fb84ad3bcd Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListImageFiltersTestJSON-335992724 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}] Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListImageFiltersTestJSON-335992724 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8c2edaf68e0742afbe3ce9fb84ad3bcd Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-335992724 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListImageFiltersTestJSON-335992724-project Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c1f25f3683f9450eb919f69ccbe24db7 Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListImageFiltersTestJSON-335992724-project Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 could not be found. Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4b95ec35-12ff-46c5-aceb-8daf24ae63b7'} Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 could not be found. Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 could not be found. Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:03.877236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 could not be found. Jul 25 16:17:03.882441 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:03.884680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Returning 404 to user: Instance 4b95ec35-12ff-46c5-aceb-8daf24ae63b7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:03.885916 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-552d1012-310f-42f8-83b2-9bec40e8109a tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7" status: 404 len: 111 microversion: 2.1 time: 0.092859 Jul 25 16:17:03.886731 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1359/2637] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:03 2022] GET /compute/v2.1/servers/4b95ec35-12ff-46c5-aceb-8daf24ae63b7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:03.897778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:03.902219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:03.920364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.924620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.926817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:03.927953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:03.962254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:04.146081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:04.154813 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6c31670-e66f-48c9-863f-cf4c66045076 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 204 len: 0 microversion: 2.1 time: 0.257301 Jul 25 16:17:04.157391 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1360/2638] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:03 2022] DELETE /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:04.174558 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cd7c2fdc-7175-42a4-869c-1a64f0807a29 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1474 microversion: 2.1 time: 0.660430 Jul 25 16:17:04.177876 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1279/2639] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:03 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1474 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:04.189914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:04.191003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:04.199369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:04.200107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:04.201467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:04.202159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:04.500744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:04.509134 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91141323-8bc7-47a1-9c34-07fcd263f1fa tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1477 microversion: 2.1 time: 0.345090 Jul 25 16:17:04.510446 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1361/2640] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:04 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1477 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:04.528180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:04.532486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:04.546137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:04.552880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:04.553937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:04.555733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:04.556443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:04.573284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=12 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:04.818257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:04.819504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:04.847230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:04.851004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:04.854046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:04.856256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:05.635610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:05.651044 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ecbb9813-eb99-4c3f-a244-eefbf5a856e4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 1.134216 Jul 25 16:17:05.651657 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1280/2641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:04 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:05.665981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:05.667102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:05.672047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:05.674835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:05.675510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:05.676882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:05.677569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:05.682797 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7428310-18bf-4323-a28a-1155c64e82e8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.870864 Jul 25 16:17:05.686597 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1362/2642] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:04 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:05.695680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1b5b18f8-f85b-4cbd-94bc-4152ce296837 req-7e7b14d6-e788-49e6-8f0b-ea679df4453d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:05.721073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1b5b18f8-f85b-4cbd-94bc-4152ce296837 req-7e7b14d6-e788-49e6-8f0b-ea679df4453d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:05.721634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1b5b18f8-f85b-4cbd-94bc-4152ce296837 req-7e7b14d6-e788-49e6-8f0b-ea679df4453d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:05.744673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:05.749017 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1b5b18f8-f85b-4cbd-94bc-4152ce296837 req-7e7b14d6-e788-49e6-8f0b-ea679df4453d service nova] Creating event network-changed:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:17:05.757576 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1b5b18f8-f85b-4cbd-94bc-4152ce296837 req-7e7b14d6-e788-49e6-8f0b-ea679df4453d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069469 Jul 25 16:17:05.758376 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1363/2643] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:05.764368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:05.765142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:05.767256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:05.776908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:05.777805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:05.779600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:05.780355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:06.171789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:06.187161 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d15709f0-e3a7-4a7e-8f41-136139e3de42 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 0.533880 Jul 25 16:17:06.188501 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1281/2644] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:05 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:06.288373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:06.304736 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-678ac03d-dc0c-44ff-bc48-8e92a0804131 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1477 microversion: 2.1 time: 0.545102 Jul 25 16:17:06.305585 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1364/2645] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:05 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1477 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:06.674988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:06.681693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:06.710413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:06.712758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:06.719601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:06.722759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:06.726825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:06.728014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:06.730239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:06.733314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:06.734453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:06.736297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:07.394473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:07.411454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c16193f-762a-4934-a7d9-24af25e46b5b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 0.742472 Jul 25 16:17:07.414499 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1282/2646] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:06 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:07.425744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:07.427200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:07.451064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:07.451911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:07.455430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:07.458734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:07.599840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:07.618718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:07.624583 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-63ea22db-18a5-4cae-a8bf-0e19a9401820 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.919230 Jul 25 16:17:07.625611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1365/2647] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:06 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:07.647973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:07.649287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:07.666559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:07.667598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:07.669915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:07.670933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:08.586876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:08.604562 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a21bde01-69fe-4faf-8ef7-764c840701ac tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 1.184575 Jul 25 16:17:08.605304 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1283/2648] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:07 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:08.617004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-483e5d49-20d6-4140-992b-edc74c00e949 req-6ed63b84-2418-4d04-b5f2-5be63742db90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e", "name": "network-vif-plugged", "status": "completed", "tag": "b03c4ef1-97dd-45b2-8c81-003870173810"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:08.651649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-483e5d49-20d6-4140-992b-edc74c00e949 req-6ed63b84-2418-4d04-b5f2-5be63742db90 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:08.652119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-483e5d49-20d6-4140-992b-edc74c00e949 req-6ed63b84-2418-4d04-b5f2-5be63742db90 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:08.674456 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-483e5d49-20d6-4140-992b-edc74c00e949 req-6ed63b84-2418-4d04-b5f2-5be63742db90 service nova] Creating event network-vif-plugged:b03c4ef1-97dd-45b2-8c81-003870173810 for instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e on n-h1-846219-13 Jul 25 16:17:08.681390 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-483e5d49-20d6-4140-992b-edc74c00e949 req-6ed63b84-2418-4d04-b5f2-5be63742db90 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069952 Jul 25 16:17:08.682429 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1284/2649] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:08.689626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:08.690450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:08.699498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:08.700285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:08.701580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:08.702403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:08.723858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f25f3683f9450eb919f69ccbe24db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2edaf68e0742afbe3ce9fb84ad3bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:08.774169 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f18b9dbf-066b-4633-9767-f0c858b69c83 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 200 len: 1477 microversion: 2.1 time: 1.122693 Jul 25 16:17:08.781853 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1366/2650] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:07 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 1477 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:08.793545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:08.798393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:08.816510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:08.817541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:08.819400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:08.820266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:10.262741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:10.284633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9432865-b11f-426b-9fb2-34f21818b9f0 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 1.596846 Jul 25 16:17:10.289194 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1285/2651] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:08 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:10.312931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b58b5c5b-c0a4-401f-8d75-5e18e29c2da8 req-eed57bb0-bb87-465b-85f3-ea8496f7d52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5152839-3340-429d-b949-0ca6709e78ca", "name": "network-vif-deleted", "tag": "a11cab23-2b3c-45cf-9efc-5bf4291ba857"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:10.338000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:10.345243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b58b5c5b-c0a4-401f-8d75-5e18e29c2da8 req-eed57bb0-bb87-465b-85f3-ea8496f7d52c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:10.346225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b58b5c5b-c0a4-401f-8d75-5e18e29c2da8 req-eed57bb0-bb87-465b-85f3-ea8496f7d52c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:10.363271 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9002dc4-96a2-4bfc-9248-25b807a240f8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 1.573250 Jul 25 16:17:10.364780 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1367/2652] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:08 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:10.388034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:10.393759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:10.397956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b58b5c5b-c0a4-401f-8d75-5e18e29c2da8 req-eed57bb0-bb87-465b-85f3-ea8496f7d52c service nova] Creating event network-vif-deleted:a11cab23-2b3c-45cf-9efc-5bf4291ba857 for instance a5152839-3340-429d-b949-0ca6709e78ca on n-h2-846219-13 Jul 25 16:17:10.408515 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b58b5c5b-c0a4-401f-8d75-5e18e29c2da8 req-eed57bb0-bb87-465b-85f3-ea8496f7d52c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114917 Jul 25 16:17:10.411355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:10.412063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:10.413587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1286/2653] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:10.413956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:10.415054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:10.431378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:10.451426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] [instance: a5152839-3340-429d-b949-0ca6709e78ca] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:10.484950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:10.486610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:10.490691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:10.491238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:10.539141 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] HTTP exception thrown: Instance a5152839-3340-429d-b949-0ca6709e78ca could not be found. Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Request method failure captured: Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca HTTP/1.1 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sE3Iz9UQbxVIdAuZlDCBWf1XiRyvvlrz66OxuN2LOsTFKBwSJGJadzlexbzmofCPR6x3Ihn99rj1y9nprJVeoRsSP3f2-s1CgVrY4PmV3CEUJYj-a_h3IKd9dcAewYDGLs-6aWYDfhIz3jeqkmmFOwk4wdAcAaapkTJXqilkYkcdu0 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 8c2edaf68e0742afbe3ce9fb84ad3bcd Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ListImageFiltersTestJSON-335992724 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8c2edaf68e0742afbe3ce9fb84ad3bcd"}]}] Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ListImageFiltersTestJSON-335992724 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 8c2edaf68e0742afbe3ce9fb84ad3bcd Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-335992724 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ListImageFiltersTestJSON-335992724-project Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c1f25f3683f9450eb919f69ccbe24db7 Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ListImageFiltersTestJSON-335992724-project Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance a5152839-3340-429d-b949-0ca6709e78ca could not be found. Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'a5152839-3340-429d-b949-0ca6709e78ca'} Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5152839-3340-429d-b949-0ca6709e78ca could not be found. Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5152839-3340-429d-b949-0ca6709e78ca could not be found. Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:10.542903 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5152839-3340-429d-b949-0ca6709e78ca could not be found. Jul 25 16:17:10.547799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:10.552908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Returning 404 to user: Instance a5152839-3340-429d-b949-0ca6709e78ca could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:10.555494 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2dc40352-7a7a-4e72-bf7e-ecd38d32b8ed tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca" status: 404 len: 111 microversion: 2.1 time: 0.131922 Jul 25 16:17:10.556480 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1287/2654] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:10 2022] GET /compute/v2.1/servers/a5152839-3340-429d-b949-0ca6709e78ca => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:10.574294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5ae5f71-c19a-408f-bada-12e41c65b4ef tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d93a76a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:11.083550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:11.105029 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d753a922-eb31-4a91-92f4-e1dc1b39f587 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 0.738675 Jul 25 16:17:11.121156 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1368/2655] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:10 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:11.131701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e128818c-2e1d-468e-aded-56b6b0fa6428 req-0d52b430-332a-4bc9-8f89-5b8485e23f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "name": "network-vif-unplugged", "status": "completed", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:11.146409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e128818c-2e1d-468e-aded-56b6b0fa6428 req-0d52b430-332a-4bc9-8f89-5b8485e23f42 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:11.147024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e128818c-2e1d-468e-aded-56b6b0fa6428 req-0d52b430-332a-4bc9-8f89-5b8485e23f42 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:11.170398 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e128818c-2e1d-468e-aded-56b6b0fa6428 req-0d52b430-332a-4bc9-8f89-5b8485e23f42 service nova] Creating event network-vif-unplugged:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:17:11.202664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e128818c-2e1d-468e-aded-56b6b0fa6428 req-0d52b430-332a-4bc9-8f89-5b8485e23f42 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076940 Jul 25 16:17:11.210744 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1369/2656] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:11.318419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:11.319613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:11.333406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:11.334337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:11.335330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:11.337617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:11.873181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:11.891167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b187714-52c3-4e05-a360-4c1ea66c474f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 0.577363 Jul 25 16:17:11.892580 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1370/2657] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:11 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:11.902674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:11.903712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:11.915329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:11.917036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:11.918590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:11.919148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:12.129717 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5ae5f71-c19a-408f-bada-12e41c65b4ef tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/images/17235ecd-bd5b-471d-8912-1ed46e929479" status: 204 len: 0 microversion: 2.1 time: 1.564982 Jul 25 16:17:12.131989 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1288/2658] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:10 2022] DELETE /compute/v2.1/images/17235ecd-bd5b-471d-8912-1ed46e929479 => generated 0 bytes in 1571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:12.141762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-193d170c-8497-4c2f-96bd-3221eebd2005 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d9383c040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:12.216278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:12.260984 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69bd852c-47d0-4a85-8aaa-6577638f2596 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.346774 Jul 25 16:17:12.264738 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1371/2659] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:11 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:12.306894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:12.313476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:12.330360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:12.350946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:12.354144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:12.356669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:12.618875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:12.631096 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df8538b1-0358-4c60-99e7-d0819105dd37 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 0.364186 Jul 25 16:17:12.649131 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1372/2660] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:12 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:12.745924 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-193d170c-8497-4c2f-96bd-3221eebd2005 tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/images/96a4e743-9b83-4369-aad6-c6521d749f09" status: 204 len: 0 microversion: 2.1 time: 0.608101 Jul 25 16:17:12.762943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1289/2661] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:12 2022] DELETE /compute/v2.1/images/96a4e743-9b83-4369-aad6-c6521d749f09 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:12.765065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6fb39f1-8788-47aa-8d55-a6af0855399f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] Calling method '.version_select at 0x7f9d92a50ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:12.929441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:12.933769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:12.977727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:12.981827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:12.985724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:12.987580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:13.418681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:13.464857 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4360b054-2f9e-4bca-b01c-e727a369a899 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1321 microversion: 2.1 time: 0.544889 Jul 25 16:17:13.465790 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1290/2662] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:12 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:13.492443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:13.516925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:13.547631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:13.547919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:13.549464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:13.550230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:13.627738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6fb39f1-8788-47aa-8d55-a6af0855399f tempest-ListImageFiltersTestJSON-335992724 tempest-ListImageFiltersTestJSON-335992724-project] 10.222.0.105 "DELETE /compute/v2.1/images/d0905a71-0e84-4db1-a8b4-d9ad5762e8da" status: 204 len: 0 microversion: 2.1 time: 0.873367 Jul 25 16:17:13.629401 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1373/2663] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:12 2022] DELETE /compute/v2.1/images/d0905a71-0e84-4db1-a8b4-d9ad5762e8da => generated 0 bytes in 876 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:13.663949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:13.665212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:13.676723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:13.677908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:13.679680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:13.681052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:14.052141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:14.065824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef390f03-5cb4-4173-a735-86c1ad3b402a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.598563 Jul 25 16:17:14.072052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1291/2664] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:13 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:14.230464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:14.244306 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0e6df98-16f5-472c-b6af-06a510396c2c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 0.587409 Jul 25 16:17:14.246865 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1374/2665] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:13 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:14.497575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:14.500014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:14.522573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:14.528616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:14.532188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:14.540207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:14.630578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:15.049981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-564b9990-7ce8-438d-a5ad-7ff524d733e2 req-30817f47-10b0-4150-91e1-499a182f652a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "name": "network-vif-plugged", "status": "completed", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:15.080431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-564b9990-7ce8-438d-a5ad-7ff524d733e2 req-30817f47-10b0-4150-91e1-499a182f652a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:15.086101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-564b9990-7ce8-438d-a5ad-7ff524d733e2 req-30817f47-10b0-4150-91e1-499a182f652a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:15.129470 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-564b9990-7ce8-438d-a5ad-7ff524d733e2 req-30817f47-10b0-4150-91e1-499a182f652a service nova] Creating event network-vif-plugged:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:17:15.136381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:15.144948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-564b9990-7ce8-438d-a5ad-7ff524d733e2 req-30817f47-10b0-4150-91e1-499a182f652a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099053 Jul 25 16:17:15.148472 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1375/2666] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:15.163908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:15.166635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:15.179101 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1cdd2fc7-cb0d-4bf8-abf5-63d59b89ae7d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1470 microversion: 2.1 time: 0.685576 Jul 25 16:17:15.188182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:15.191719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:15.194718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:15.196157 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1292/2667] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:14 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:15.197030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:15.224912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:15.234857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:15.247162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:15.247622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:15.248513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:15.248953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:16.069162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:16.095597 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00803402-2ed5-4d03-a4a3-a1118f3b9acb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.944581 Jul 25 16:17:16.113463 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c561c207-2096-49e4-a481-1d1e5e5f3dbb tempest-ServersOnMultiNodesTest-55620968 tempest-ServersOnMultiNodesTest-55620968-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1623 microversion: 2.1 time: 0.894634 Jul 25 16:17:16.113463 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1293/2668] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:15 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1623 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:16.116739 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1376/2669] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:15 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:16.132916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:16.134090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:16.155599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:16.159597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:16.168500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:16.169940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:16.171746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:16.178724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:16.190506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:16.191703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:16.194546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:16.195759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:16.296541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:16.482407 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-701d377e-8217-4e24-b227-6cf671733161 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 204 len: 0 microversion: 2.1 time: 0.332778 Jul 25 16:17:16.486960 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1377/2670] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:16 2022] DELETE /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:16.518320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:16.521081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:16.550053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:16.551012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:16.558797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:16.560370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:17.367737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:17.392079 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d627b465-754d-4cd2-b7e5-c0f130a90eb8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 1.278442 Jul 25 16:17:17.392690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1294/2671] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:16 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:17.401842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:17.413061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:17.428673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:17.443247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:17.444376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:17.444817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:17.446530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:17.465451 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7508f889-44cc-48e6-94cb-bf1803e68435 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1476 microversion: 2.1 time: 0.969399 Jul 25 16:17:17.469936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1378/2672] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:16 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1476 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:18.343881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:18.356628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-267059005", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "ca324e91-84a7-45bd-ac01-1dc3db3c7586"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:18.385313 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7dab6b86-8c3b-4d23-9675-0760daed6121 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.985252 Jul 25 16:17:18.402746 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1295/2673] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:17 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:18.417060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:18.418502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:18.468453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:18.472604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:18.477593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:18.481242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] validate_networks() for [('ca324e91-84a7-45bd-ac01-1dc3db3c7586', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:17:18.482090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.439990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:19.448824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4470b562-cd9e-4767-9987-e581491a78db tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1480 microversion: 2.1 time: 1.036482 Jul 25 16:17:19.452203 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1296/2674] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:18 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1480 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:19.457341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:19.457968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:19.476092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:19.476732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.478082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:19.478813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.846546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:19.858899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55c97277-0658-4ef7-9350-9fa016728960 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1476 microversion: 2.1 time: 0.405433 Jul 25 16:17:19.860440 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1297/2675] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:19 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:19.869806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:19.870988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:19.885755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:19.886073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:17:19.886629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:17:19.886963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:17:19.887604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:17:19.888456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:17:19.888795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.890895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:19.891745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.904011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:19.904461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.905818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:19.906551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:19.935942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Getting quotas for project 31c1131868ba4d308aff6536e5c4a8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:17:19.945059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Getting quotas for user 6d3542a7652a43698af59ef2b5d792d9 and project 31c1131868ba4d308aff6536e5c4a8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:17:19.972300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Going to run 3 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:17:19.976868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:17:20.045451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=0a673cff-0a94-4f74-9d71-4d58a6ef306f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:17:20.135075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:20.140005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=d29c02ac-5630-45b5-aa72-87c62deefd77,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:17:20.145007 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c55d14ea-1a47-4db5-bd07-cb52f0e259b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.281589 Jul 25 16:17:20.155812 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1298/2676] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:19 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:20.263423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cad33080-38e4-4bed-a17e-aa7670c33980 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.062061 Jul 25 16:17:20.270940 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1379/2677] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:17:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:17:20.283266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:20.305180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:20.307389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:17:20.357075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:20.358010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:20.359187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:20.359871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:20.431154 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a2cee63-f645-40cc-a1ca-3c9fb6eb32d9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 1021 microversion: 2.1 time: 0.158179 Jul 25 16:17:20.432212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1380/2678] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:17:20 2022] GET /compute/v2.1/servers => generated 1021 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:20.482961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7ca765f0-99b3-4d8e-a965-dd672b10c1aa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:20.484112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ca765f0-99b3-4d8e-a965-dd672b10c1aa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:20.570521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-658b02c5-ff11-40ac-ab4b-370a7174d467 tempest-ListImageFiltersNegativeTestJSON-866646707 tempest-ListImageFiltersNegativeTestJSON-866646707-project] Calling method '.version_select at 0x7f9d937d6040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:20.632921 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-658b02c5-ff11-40ac-ab4b-370a7174d467 tempest-ListImageFiltersNegativeTestJSON-866646707 tempest-ListImageFiltersNegativeTestJSON-866646707-project] HTTP exception thrown: Image not found. Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-658b02c5-ff11-40ac-ab4b-370a7174d467 tempest-ListImageFiltersNegativeTestJSON-866646707 tempest-ListImageFiltersNegativeTestJSON-866646707-project] Request method failure captured: Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/images/a6aa97ab-51ae-4291-a769-d13fe688766d HTTP/1.1 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sIPSH5jCZqeLlROO7M_ZnrUDMhLWEkn29Y3jUw-NJgPyWz7xtu0mxg-F0tY20LI01XGn2qpY0Bm0dEdxs3vDqYzl3Ueex_aWFtu8cWPrFE2b7aVAYfxKKbbrl4sPxwwJp5-JW8A2YHHrq_akUCnos6tTTV2mL5WXCtatezKl-7xL1w Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0846e1724f2c421d913f640f36bc63d6 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-866646707 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0846e1724f2c421d913f640f36bc63d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0846e1724f2c421d913f640f36bc63d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0846e1724f2c421d913f640f36bc63d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0846e1724f2c421d913f640f36bc63d6"}]}] Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-866646707 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0846e1724f2c421d913f640f36bc63d6 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-866646707 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ListImageFiltersNegativeTestJSON-866646707-project Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 94d97c5bd92747e7a399b770fead1f38 Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-866646707-project Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'a6aa97ab-51ae-4291-a769-d13fe688766d'} Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a6aa97ab-51ae-4291-a769-d13fe688766d Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:17:20.635429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6aa97ab-51ae-4291-a769-d13fe688766d could not be found. Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:17:20.640370 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:20.646495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-658b02c5-ff11-40ac-ab4b-370a7174d467 tempest-ListImageFiltersNegativeTestJSON-866646707 tempest-ListImageFiltersNegativeTestJSON-866646707-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:20.647266 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-658b02c5-ff11-40ac-ab4b-370a7174d467 tempest-ListImageFiltersNegativeTestJSON-866646707 tempest-ListImageFiltersNegativeTestJSON-866646707-project] 10.222.0.105 "GET /compute/v2.1/images/a6aa97ab-51ae-4291-a769-d13fe688766d" status: 404 len: 62 microversion: 2.1 time: 0.489496 Jul 25 16:17:20.648038 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1299/2679] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:17:20 2022] GET /compute/v2.1/images/a6aa97ab-51ae-4291-a769-d13fe688766d => generated 62 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:17:20.663979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:20.665593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:20.680126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:20.680820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:20.681821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:20.682879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:20.726587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7ca765f0-99b3-4d8e-a965-dd672b10c1aa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:20.788992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7ca765f0-99b3-4d8e-a965-dd672b10c1aa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1226 microversion: 2.1 time: 0.337269 Jul 25 16:17:20.789877 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1381/2680] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:20 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1226 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:20.882450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:20.883080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:20.892206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:20.892962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:20.893553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:20.901213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:21.162325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:21.188265 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed7d03c9-50ce-4ea4-a2e2-fb3f10697edd tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1466 microversion: 2.1 time: 0.531434 Jul 25 16:17:21.189847 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1300/2681] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:20 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1466 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:21.204838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:21.212660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:21.215377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:21.235494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:21.236533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:21.238842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:21.239915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:21.243478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b48c547d-a8f5-415a-9646-db90a2e78a52 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1434 microversion: 2.1 time: 0.364588 Jul 25 16:17:21.253878 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1382/2682] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:20 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1434 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:21.282945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:21.292505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:21.327843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:21.334564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:21.338540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:21.343004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:21.709232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:21.761610 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9802acf7-5a1f-42dd-940d-571b631df886 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.568327 Jul 25 16:17:21.761903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:21.767883 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1301/2683] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:21 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:21.793939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-896da3c4-965a-4a7e-b178-86de0fc7c456 req-1e30de70-a3ff-4f3e-a45f-32c458ac80b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e", "name": "network-vif-deleted", "tag": "b03c4ef1-97dd-45b2-8c81-003870173810"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:21.796492 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7cc222a2-881f-442f-9666-7c85fc27b7a4 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1466 microversion: 2.1 time: 0.535748 Jul 25 16:17:21.797212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1383/2684] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:21 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1466 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:21.817661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35982b6a-69dd-4c15-901b-e94431ee0e94 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:21.819516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-35982b6a-69dd-4c15-901b-e94431ee0e94 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:21.878856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-896da3c4-965a-4a7e-b178-86de0fc7c456 req-1e30de70-a3ff-4f3e-a45f-32c458ac80b0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:21.882132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-896da3c4-965a-4a7e-b178-86de0fc7c456 req-1e30de70-a3ff-4f3e-a45f-32c458ac80b0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:21.949651 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-896da3c4-965a-4a7e-b178-86de0fc7c456 req-1e30de70-a3ff-4f3e-a45f-32c458ac80b0 service nova] Creating event network-vif-deleted:b03c4ef1-97dd-45b2-8c81-003870173810 for instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e on n-h1-846219-13 Jul 25 16:17:21.976734 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-896da3c4-965a-4a7e-b178-86de0fc7c456 req-1e30de70-a3ff-4f3e-a45f-32c458ac80b0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202167 Jul 25 16:17:21.979456 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1302/2685] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:22.004083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:22.008103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35982b6a-69dd-4c15-901b-e94431ee0e94 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:22.017671 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35982b6a-69dd-4c15-901b-e94431ee0e94 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1226 microversion: 2.1 time: 0.207525 Jul 25 16:17:22.021929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1384/2686] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:21 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1226 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:22.037678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:22.070973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.071655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.072618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.073261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.268777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:22.269623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:22.278872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.284191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.285265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.286679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.353891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:17:22.357127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:17:22.358767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:17:22.359983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:17:22.361299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:17:22.369425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.370182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.370977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lazy-loading 'fault' on Instance uuid c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:17:22.561079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:22.598776 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ce976d2-ab31-482b-9818-cf9a7e61178d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 200 len: 1311 microversion: 2.1 time: 0.330287 Jul 25 16:17:22.603398 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1385/2687] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:22 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 1311 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:22.642902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:22.658114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.661654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.663964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.665185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.748425 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f49d5041-a466-4b32-8ad7-283cc8e21146 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 1070 microversion: 2.1 time: 0.764392 Jul 25 16:17:22.764450 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1303/2688] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:17:21 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 1070 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:17:22.774620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:22.774620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:22.798563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.799297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.800524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.809762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.813802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:22.814447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:22.825840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.830584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:22.837500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:22.838449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:22.838905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.201577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:23.236475 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-df624f20-bff4-43b2-99fc-9718119bfc6d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.443765 Jul 25 16:17:23.265493 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1304/2689] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:22 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:23.281297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:23.287331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:23.309215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.309983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.311065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.313872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.345003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:23.375492 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fcb59e8-3ee4-4f10-9df6-5d913ce2f379 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.607398 Jul 25 16:17:23.378181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1386/2690] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:22 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:23.583241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:23.607923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ede810e-cfaf-444e-b790-63e9af57e9fa tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1230 microversion: 2.1 time: 0.339802 Jul 25 16:17:23.613301 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1305/2691] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:23 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1230 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:23.632318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:23.633331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:23.641386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.642110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.643851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.644615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.662586 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e could not be found. Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e HTTP/1.1 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e could not be found. Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e'} Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e could not be found. Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e could not be found. Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:23.664352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e could not be found. Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:23.669180 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-daa9830f-2166-4140-8ce1-1316b14c7275 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e" status: 404 len: 111 microversion: 2.1 time: 0.037720 Jul 25 16:17:23.675274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:23.675785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:23.679081 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1387/2692] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:23 2022] GET /compute/v2.1/servers/c5006ca4-8ec4-4bb2-b30e-d4a1bbb7084e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:23.683364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.684852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.685828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.686279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.719136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:23.854387 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04306f77-b708-4eab-9708-7c3d66a372d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 204 len: 0 microversion: 2.1 time: 0.180585 Jul 25 16:17:23.860654 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1306/2693] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:23 2022] DELETE /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:17:23.878397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:23.884537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:23.896470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.897601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:23.898818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:23.899798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:24.226764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:24.244634 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b5be47b3-ef8f-437a-a43e-dd124a1c7bc3 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1476 microversion: 2.1 time: 0.377418 Jul 25 16:17:24.245964 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1388/2694] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:23 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:24.274936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:24.276434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:24.297537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:24.298389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:24.299918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:24.301788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:24.310578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:24.403778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:24.406212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:24.434209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:24.434667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:24.435448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:24.435975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:24.974270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:25.001022 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d5f88a86-ef83-4496-b178-73deb3649e5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.728749 Jul 25 16:17:25.003415 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1307/2695] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:24 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:25.012079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:25.047574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:25.051314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:25.070881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:25.072941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:25.074145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:25.075254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:25.094496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:25.111242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3903ff01-94b0-4638-8902-d586b3a0ca03 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.711372 Jul 25 16:17:25.113000 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1389/2696] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:24 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:25.120621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-99660806-32e9-4b89-a8e0-ce2846d0d004 req-bd15a251-4ac0-4a90-94b9-b1aa398719e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-plugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:25.157051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-99660806-32e9-4b89-a8e0-ce2846d0d004 req-bd15a251-4ac0-4a90-94b9-b1aa398719e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:25.158530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-99660806-32e9-4b89-a8e0-ce2846d0d004 req-bd15a251-4ac0-4a90-94b9-b1aa398719e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:25.179783 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-99660806-32e9-4b89-a8e0-ce2846d0d004 req-bd15a251-4ac0-4a90-94b9-b1aa398719e0 service nova] Creating event network-vif-plugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:17:25.189549 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-99660806-32e9-4b89-a8e0-ce2846d0d004 req-bd15a251-4ac0-4a90-94b9-b1aa398719e0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075020 Jul 25 16:17:25.191639 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1390/2697] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:25.223994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:25.257567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-96e4a26f-3626-47e5-8912-6f54d72d1244 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1278 microversion: 2.1 time: 0.252162 Jul 25 16:17:25.258199 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1308/2698] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:25 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:25.278385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:25.281738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:25.312903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:25.317464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:25.318488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:25.320606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:26.049581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:26.052116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:26.081731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:26.090734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:26.096314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:26.097282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:26.850102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:26.893762 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7a532df2-fd35-42d4-aca0-792c394b97a5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1476 microversion: 2.1 time: 1.614424 Jul 25 16:17:26.904987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1391/2699] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:25 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1476 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:26.916154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:26.918729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:26.932781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:26.934095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:26.935919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:26.937177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:27.276567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:27.307181 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1ea0afb-50dd-4e2d-9e1c-2bab3ff7e467 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 1.286076 Jul 25 16:17:27.307803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1309/2700] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:26 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:27.325557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:27.326358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:27.334903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:27.335746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:27.336762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:27.337450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:27.579531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:27.606184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94199ce5-af08-4f37-b3c0-db1d759eb571 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1284 microversion: 2.1 time: 0.297168 Jul 25 16:17:27.613193 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1310/2701] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:27 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:27.636053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:27.650054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30639db5-4849-4c91-9239-dd7f10060019 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.742916 Jul 25 16:17:27.657900 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1392/2702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:26 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:27.922922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:27.924099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:27.954920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:27.955339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:27.956317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:27.956777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.334106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:28.334842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:28.343220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.344639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.346328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.346985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.514132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:28.559917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b98ad6f4-03fc-40a0-b0ee-80e66b6d7443 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 200 len: 1476 microversion: 2.1 time: 0.643503 Jul 25 16:17:28.593739 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1311/2703] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:27 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:28.625508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2c928409-c2e5-41a3-98c2-4d39b2e641b2 req-40c59b52-5d92-4acd-8262-b1ff85ddf2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eba1e5-1df5-4f24-a596-317f046e74d0", "name": "network-vif-deleted", "tag": "07e71465-7c41-4b5c-946c-016311f84262"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:28.674762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2c928409-c2e5-41a3-98c2-4d39b2e641b2 req-40c59b52-5d92-4acd-8262-b1ff85ddf2e5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.678191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2c928409-c2e5-41a3-98c2-4d39b2e641b2 req-40c59b52-5d92-4acd-8262-b1ff85ddf2e5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.746232 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2c928409-c2e5-41a3-98c2-4d39b2e641b2 req-40c59b52-5d92-4acd-8262-b1ff85ddf2e5 service nova] Creating event network-vif-deleted:07e71465-7c41-4b5c-946c-016311f84262 for instance 17eba1e5-1df5-4f24-a596-317f046e74d0 on n-h2-846219-13 Jul 25 16:17:28.776803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:28.778010 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2c928409-c2e5-41a3-98c2-4d39b2e641b2 req-40c59b52-5d92-4acd-8262-b1ff85ddf2e5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181935 Jul 25 16:17:28.781292 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1312/2704] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:28.811988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:28.813788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:28.819505 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b29e9460-9041-4658-8c88-8736ffbf5a7c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1368 microversion: 2.1 time: 0.489138 Jul 25 16:17:28.848431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.849696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.854038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.857870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.881645 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1393/2705] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:28 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1368 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:28.890139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:28.891719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:28.908149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.909232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:28.911083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:28.912295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.071109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:29.084269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67f1a302-93d4-4c73-957b-6c1f43755457 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1284 microversion: 2.1 time: 0.297417 Jul 25 16:17:29.085571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1313/2706] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:28 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:29.382766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:29.404031 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-32d771dc-4d53-46e9-a5f1-6d8b9cb67e9a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.519814 Jul 25 16:17:29.405503 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1394/2707] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:28 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:29.608740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:29.614250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 17eba1e5-1df5-4f24-a596-317f046e74d0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:29.640291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:29.641265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.642484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:29.643254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.674239 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance 17eba1e5-1df5-4f24-a596-317f046e74d0 could not be found. Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 HTTP/1.1 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 17eba1e5-1df5-4f24-a596-317f046e74d0 could not be found. Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '17eba1e5-1df5-4f24-a596-317f046e74d0'} Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eba1e5-1df5-4f24-a596-317f046e74d0 could not be found. Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eba1e5-1df5-4f24-a596-317f046e74d0 could not be found. Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:29.678491 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eba1e5-1df5-4f24-a596-317f046e74d0 could not be found. Jul 25 16:17:29.683163 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:17:29.686256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance 17eba1e5-1df5-4f24-a596-317f046e74d0 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:29.688901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52584dbd-3f21-4c9e-8458-eb4d35985d8d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0" status: 404 len: 111 microversion: 2.1 time: 0.090776 Jul 25 16:17:29.690903 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1314/2708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:29 2022] GET /compute/v2.1/servers/17eba1e5-1df5-4f24-a596-317f046e74d0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:29.702215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:29.703575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:29.721710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:29.722441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.723615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:29.724313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.773552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:29.861689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:29.862660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:29.884674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:29.885524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.891446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:29.893074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:29.964815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:29.987992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67414558-85f2-4381-8ccb-535784dc43e1 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 204 len: 0 microversion: 2.1 time: 0.286100 Jul 25 16:17:29.991936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1395/2709] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:29 2022] DELETE /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:30.017361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:30.018928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:30.044197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.049839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.053748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.054453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.343846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:30.384454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a95a473-3447-43ca-919b-b35a1d19e796 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1555 microversion: 2.1 time: 0.526791 Jul 25 16:17:30.386832 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1315/2710] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:29 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1555 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:30.394679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:30.403447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:30.411754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:30.424501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.425868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.427115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.429019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.505739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:30.542484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8173fdf-8af8-48bb-9747-d8f68decb14f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1476 microversion: 2.1 time: 0.528913 Jul 25 16:17:30.548104 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1396/2711] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:29 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:30.577056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:30.579105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:30.587993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.588824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.589963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.591130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.763472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:30.779782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4befec8-ae34-4451-a28e-d7ae503134f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1284 microversion: 2.1 time: 0.391004 Jul 25 16:17:30.787613 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1316/2712] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:30 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1284 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:30.813560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:30.830586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:30.848981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.857153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:30.859095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:30.860101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:31.205846 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6f497e4-4f7a-4082-b69e-3f1915a5b90b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.641327 Jul 25 16:17:31.208103 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1397/2713] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:17:30 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/os-interface => generated 284 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:31.580794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:31.583054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:31.600254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:31.600816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:31.602779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:31.605083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:32.013485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:33.026403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:33.042518 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cccdd058-a75f-459e-a7eb-a253d27d968c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 2.233012 Jul 25 16:17:33.063692 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1317/2714] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:30 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:33.070832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:33.072873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:33.082741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:33.084360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:33.086751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:33.087483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:33.587674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:33.611029 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9320b4bc-c3cc-4816-aca3-49616df90840 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1284 microversion: 2.1 time: 0.545111 Jul 25 16:17:33.612276 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1318/2715] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:33 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1284 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:33.712866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:33.746564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2865ac72-0244-4024-9791-8b1d85f72cf5 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1476 microversion: 2.1 time: 2.171076 Jul 25 16:17:33.770443 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1398/2716] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:31 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1476 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:34.081749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:34.082605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:34.105751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:34.106727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:34.108198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:34.109027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:34.643066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:34.643690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:34.656015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:34.663154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:34.666368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:34.671420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:36.618837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:36.630115 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22d2324c-f1cb-4ac8-9549-6cc9f0c5e2f0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 2.559877 Jul 25 16:17:36.635674 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1319/2717] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:34 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:36.653949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:36.656017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:36.673902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:36.678293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:36.680200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:36.680743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:37.124725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:37.146288 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b26b6735-de3c-4d22-a44e-0d9956ddee95 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 200 len: 1434 microversion: 2.1 time: 0.506805 Jul 25 16:17:37.147032 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1320/2718] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:36 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 1434 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:37.165680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d58e6d73-f934-4248-aa9c-090f61d08e67 req-f84e7b32-78bd-437a-9126-88db994c3bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d282c9ca-9b5f-4406-afc3-6d647d0b508e", "name": "network-vif-deleted", "tag": "21c59e6e-eb38-4eb8-b010-d4ece0f797c1"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:37.212267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d58e6d73-f934-4248-aa9c-090f61d08e67 req-f84e7b32-78bd-437a-9126-88db994c3bd4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:37.213214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d58e6d73-f934-4248-aa9c-090f61d08e67 req-f84e7b32-78bd-437a-9126-88db994c3bd4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:37.256002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d58e6d73-f934-4248-aa9c-090f61d08e67 req-f84e7b32-78bd-437a-9126-88db994c3bd4 service nova] Creating event network-vif-deleted:21c59e6e-eb38-4eb8-b010-d4ece0f797c1 for instance d282c9ca-9b5f-4406-afc3-6d647d0b508e on n-h2-846219-13 Jul 25 16:17:37.271016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d58e6d73-f934-4248-aa9c-090f61d08e67 req-f84e7b32-78bd-437a-9126-88db994c3bd4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112070 Jul 25 16:17:37.276594 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1321/2719] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:17:37.414625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:37.423347 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-288ddcf8-0d54-4a81-a034-a96dbaab59ff tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 2.784920 Jul 25 16:17:37.446704 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1399/2720] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:34 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:37.664944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:37.667043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:37.701657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:37.702519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:37.705575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:37.706355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.151542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b48c87c2-525c-4ecf-a6ed-07eac0ace433 req-b8519d2a-8152-4e1c-a1ed-8dea5bf45072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29c02ac-5630-45b5-aa72-87c62deefd77", "tag": "c2fc2466-d0a4-4c9e-a582-57fc00dc9f63"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:38.189269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b48c87c2-525c-4ecf-a6ed-07eac0ace433 req-b8519d2a-8152-4e1c-a1ed-8dea5bf45072 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.198013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b48c87c2-525c-4ecf-a6ed-07eac0ace433 req-b8519d2a-8152-4e1c-a1ed-8dea5bf45072 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.237191 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b48c87c2-525c-4ecf-a6ed-07eac0ace433 req-b8519d2a-8152-4e1c-a1ed-8dea5bf45072 service nova] Creating event network-changed:c2fc2466-d0a4-4c9e-a582-57fc00dc9f63 for instance d29c02ac-5630-45b5-aa72-87c62deefd77 on n-h1-846219-13 Jul 25 16:17:38.249497 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b48c87c2-525c-4ecf-a6ed-07eac0ace433 req-b8519d2a-8152-4e1c-a1ed-8dea5bf45072 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099025 Jul 25 16:17:38.251363 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1400/2721] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:17:38.270231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:38.275170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: d282c9ca-9b5f-4406-afc3-6d647d0b508e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:38.295358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.295860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.299442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.302126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.348218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance d282c9ca-9b5f-4406-afc3-6d647d0b508e could not be found. Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e HTTP/1.1 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d282c9ca-9b5f-4406-afc3-6d647d0b508e could not be found. Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd282c9ca-9b5f-4406-afc3-6d647d0b508e'} Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d282c9ca-9b5f-4406-afc3-6d647d0b508e could not be found. Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d282c9ca-9b5f-4406-afc3-6d647d0b508e could not be found. Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:38.353675 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d282c9ca-9b5f-4406-afc3-6d647d0b508e could not be found. Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance d282c9ca-9b5f-4406-afc3-6d647d0b508e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:38.358820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4d9fe97-71f9-4c58-83b3-69f43980997b tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e" status: 404 len: 111 microversion: 2.1 time: 0.103471 Jul 25 16:17:38.359483 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1401/2722] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:38 2022] GET /compute/v2.1/servers/d282c9ca-9b5f-4406-afc3-6d647d0b508e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:38.375046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:38.376047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:38.388822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.389589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.391276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.392009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.496440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:38.654965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:38.756465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:38.771031 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-036ab819-e15d-4783-94a2-f4ba97478f54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 1.113097 Jul 25 16:17:38.776455 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1322/2723] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:37 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:38.787302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:38.791402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:38.809121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.814209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.815743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.816485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.818870 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f11a005a-79f1-4062-9662-ee39358c7a7f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 204 len: 0 microversion: 2.1 time: 0.449492 Jul 25 16:17:38.823164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1402/2724] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:38 2022] DELETE /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:17:38.847962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:38.849449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:38.877264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.878724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.880316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:38.881712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:38.939021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:39.079600 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b504b7e2-f3d3-4340-82b0-2ad169bf6165 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 204 len: 0 microversion: 2.1 time: 0.246046 Jul 25 16:17:39.081609 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1403/2725] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:38 2022] DELETE /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:39.117665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:39.120118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:39.135632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:39.136124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:39.137261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:39.137828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:40.500110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:40.509688 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c75bf2b3-9f8b-431b-9f3a-23ca7d88a12e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 1.731544 Jul 25 16:17:40.510701 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1323/2726] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:38 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:40.531241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:40.532321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:40.540509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:40.541427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:40.543976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:40.544814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:40.568632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:40.592240 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-269be533-9071-4379-abd9-f3f70e63561f tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 200 len: 1479 microversion: 2.1 time: 1.501062 Jul 25 16:17:40.599645 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1404/2727] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:39 2022] GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 1479 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:40.610405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0f7cfdc3-6639-4f64-bf08-ac65163ea3d7 req-fe8440ae-f8a9-4497-aa54-80584b4d5b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:40.654413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0f7cfdc3-6639-4f64-bf08-ac65163ea3d7 req-fe8440ae-f8a9-4497-aa54-80584b4d5b2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:40.655396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0f7cfdc3-6639-4f64-bf08-ac65163ea3d7 req-fe8440ae-f8a9-4497-aa54-80584b4d5b2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:40.681965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0f7cfdc3-6639-4f64-bf08-ac65163ea3d7 req-fe8440ae-f8a9-4497-aa54-80584b4d5b2d service nova] Creating event network-changed:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:17:40.693715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0f7cfdc3-6639-4f64-bf08-ac65163ea3d7 req-fe8440ae-f8a9-4497-aa54-80584b4d5b2d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091326 Jul 25 16:17:40.695096 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1405/2728] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:41.969965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a5b4e044-d6a8-46be-a798-3bb614034f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Action: 'create', calling method: .version_select at 0x7f9d92a10820>, body: {"keypair": {"name": "tempest-keypair-654953733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbfQJ6y7efskFhZrnNMIP5jgKzB0N5Z/nlD5SLnZHmOj7ktwFdfgxN7er8OnjhS4SqHUC/+gtPvGoRhDhlaxgrIVaUE++wSBHa+FGJncKsJy0dLNb/D9CBzvjEE119k0Q=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:42.049732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a5b4e044-d6a8-46be-a798-3bb614034f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Getting quotas for project 5fbadf69c41746339f1711ec9cea2ac9. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:17:42.095399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a5b4e044-d6a8-46be-a798-3bb614034f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Getting quotas for user 83bf735d88e34c6caa3514f80a4e1560 and project 5fbadf69c41746339f1711ec9cea2ac9. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:17:42.162752 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5b4e044-d6a8-46be-a798-3bb614034f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [c4dfd66c-9d87-4c77-92e5-ba0b2d024fa9] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:17:43.136947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:43.170085 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67716f11-8d0f-485e-b380-b2876f37b63a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 2.643888 Jul 25 16:17:43.175722 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5b4e044-d6a8-46be-a798-3bb614034f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [c4dfd66c-9d87-4c77-92e5-ba0b2d024fa9] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 56442. Jul 25 16:17:43.202148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1324/2729] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:40 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:43.224176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:43.229055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:43.230132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a5b4e044-d6a8-46be-a798-3bb614034f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.842470 Jul 25 16:17:43.238669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1406/2730] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:17:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:43.267621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:43.268567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:43.270772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:43.271585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:43.275284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:43.294601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:43.356316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:43.368230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:43.394702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:43.399829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:45.529588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:45.536997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:45.547148 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e924a4b-4ddd-4995-9aa0-518b60413dcf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 2.342664 Jul 25 16:17:45.548579 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1325/2731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:43 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:45.565051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-56dcd9f2-ae91-4cb9-9e12-e22fb45c4eb1 req-65077387-ba71-4143-9e5f-5362906e4359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aee42a0-abee-4e87-b7b1-856cd504173e", "tag": "347e5825-ff44-471c-8fb7-0f01116a1e4a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:45.632964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-56dcd9f2-ae91-4cb9-9e12-e22fb45c4eb1 req-65077387-ba71-4143-9e5f-5362906e4359 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:45.678125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-56dcd9f2-ae91-4cb9-9e12-e22fb45c4eb1 req-65077387-ba71-4143-9e5f-5362906e4359 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:45.726449 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-56dcd9f2-ae91-4cb9-9e12-e22fb45c4eb1 req-65077387-ba71-4143-9e5f-5362906e4359 service nova] Creating event network-changed:347e5825-ff44-471c-8fb7-0f01116a1e4a for instance 9aee42a0-abee-4e87-b7b1-856cd504173e on n-h2-846219-13 Jul 25 16:17:45.744544 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-56dcd9f2-ae91-4cb9-9e12-e22fb45c4eb1 req-65077387-ba71-4143-9e5f-5362906e4359 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193577 Jul 25 16:17:45.745246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1326/2732] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:45.757846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:45.758968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:45.774427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:45.774883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:45.775700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:45.776125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:46.667745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:46.696208 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6d63492-6ef6-48d3-b889-9aacbc482340 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 200 len: 1479 microversion: 2.1 time: 3.448864 Jul 25 16:17:46.697597 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1407/2733] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:43 2022] GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 1479 bytes in 3452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:46.728069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1892924d-115f-4687-bae7-efa8b6b9c932 req-5f0adcb4-cbb5-43b2-878f-3831b85610a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309ec262-31d9-4fc7-9807-3b79e98e55a5", "name": "network-vif-unplugged", "status": "completed", "tag": "ec609041-989a-4ca4-b260-a498b8be8b29"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:46.759050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1892924d-115f-4687-bae7-efa8b6b9c932 req-5f0adcb4-cbb5-43b2-878f-3831b85610a8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:46.773864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1892924d-115f-4687-bae7-efa8b6b9c932 req-5f0adcb4-cbb5-43b2-878f-3831b85610a8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:46.833800 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1892924d-115f-4687-bae7-efa8b6b9c932 req-5f0adcb4-cbb5-43b2-878f-3831b85610a8 service nova] Creating event network-vif-unplugged:ec609041-989a-4ca4-b260-a498b8be8b29 for instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 on n-h1-846219-13 Jul 25 16:17:46.852820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1892924d-115f-4687-bae7-efa8b6b9c932 req-5f0adcb4-cbb5-43b2-878f-3831b85610a8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151762 Jul 25 16:17:46.854283 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1408/2734] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:46.873491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:46.876112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:46.901758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:46.902963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:46.908334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:46.909385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:47.627416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:47.648988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9afe48d-1905-436d-bf07-bcd07cb7c783 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 1.900435 Jul 25 16:17:47.650239 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1327/2735] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:45 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:47.697568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f9f9b84f-7d0b-492c-b185-eefea0d21488 req-2691cdd0-b51c-4631-acae-f0114f1ae04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a673cff-0a94-4f74-9d71-4d58a6ef306f", "tag": "ebf5810e-ef1c-4131-8b07-a46ed6c4b7f7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:47.739475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f9f9b84f-7d0b-492c-b185-eefea0d21488 req-2691cdd0-b51c-4631-acae-f0114f1ae04a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:47.739972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f9f9b84f-7d0b-492c-b185-eefea0d21488 req-2691cdd0-b51c-4631-acae-f0114f1ae04a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:47.799309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f9f9b84f-7d0b-492c-b185-eefea0d21488 req-2691cdd0-b51c-4631-acae-f0114f1ae04a service nova] Creating event network-changed:ebf5810e-ef1c-4131-8b07-a46ed6c4b7f7 for instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f on n-h2-846219-13 Jul 25 16:17:47.815514 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f9f9b84f-7d0b-492c-b185-eefea0d21488 req-2691cdd0-b51c-4631-acae-f0114f1ae04a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134171 Jul 25 16:17:47.816176 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1328/2736] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:47.841138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:47.842899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:47.871003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:47.874016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:47.875706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:47.879264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:48.339822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:48.355160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-66c96a59-043b-44ee-b605-528ef9c1d05a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 200 len: 1437 microversion: 2.1 time: 0.533775 Jul 25 16:17:48.357268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1329/2737] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:47 2022] GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 1437 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:48.693367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:48.694543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:48.711995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:48.712529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:48.725803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:48.726681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:48.990013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:49.025848 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e9b80de-872f-46d7-b725-fee86cd06c50 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 2.169298 Jul 25 16:17:49.042332 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1409/2738] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:46 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:49.065442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4a201aa8-ab68-4bd7-821e-46168e39ec6d req-e75ef5c9-b0bb-4a04-b1e6-5b83384fc635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3015bf-74b2-462a-bfac-23b80c32591f", "name": "network-vif-unplugged", "status": "completed", "tag": "1e8e35c2-f1ab-440b-8a78-903ae7f5910a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:49.089429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4a201aa8-ab68-4bd7-821e-46168e39ec6d req-e75ef5c9-b0bb-4a04-b1e6-5b83384fc635 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:49.090663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4a201aa8-ab68-4bd7-821e-46168e39ec6d req-e75ef5c9-b0bb-4a04-b1e6-5b83384fc635 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:49.113880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4a201aa8-ab68-4bd7-821e-46168e39ec6d req-e75ef5c9-b0bb-4a04-b1e6-5b83384fc635 service nova] Creating event network-vif-unplugged:1e8e35c2-f1ab-440b-8a78-903ae7f5910a for instance fa3015bf-74b2-462a-bfac-23b80c32591f on n-h2-846219-13 Jul 25 16:17:49.121163 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4a201aa8-ab68-4bd7-821e-46168e39ec6d req-e75ef5c9-b0bb-4a04-b1e6-5b83384fc635 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076545 Jul 25 16:17:49.127735 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1410/2739] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:49.275118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:49.306990 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f2afa50-85e2-4457-a785-10d6c9ff0471 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.611971 Jul 25 16:17:49.321749 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1330/2740] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:48 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:49.399086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:49.400744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 309ec262-31d9-4fc7-9807-3b79e98e55a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:49.419779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:49.421873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:49.430166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:49.431457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:49.472457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 could not be found. Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 HTTP/1.1 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 could not be found. Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '309ec262-31d9-4fc7-9807-3b79e98e55a5'} Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 could not be found. Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 could not be found. Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:49.481805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 could not be found. Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-844e74fb-69b7-403e-8976-dfb46626149d tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5" status: 404 len: 111 microversion: 2.1 time: 0.090612 Jul 25 16:17:49.489596 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1411/2741] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:49 2022] GET /compute/v2.1/servers/309ec262-31d9-4fc7-9807-3b79e98e55a5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:49.497877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:49.498661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:49.513556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:49.521628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:49.534630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:49.540663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:49.854161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:49.871493 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7a3aea40-3e29-4e2b-a10a-40f635f507ca tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1437 microversion: 2.1 time: 0.379508 Jul 25 16:17:49.872760 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1331/2742] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:49 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1437 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:49.916671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-33cac3f2-e7fc-44d1-9861-7b0bece67a7d req-096eb51b-668c-4c99-8a57-f21159c6ed6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309ec262-31d9-4fc7-9807-3b79e98e55a5", "name": "network-vif-deleted", "tag": "ec609041-989a-4ca4-b260-a498b8be8b29"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:49.948526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-33cac3f2-e7fc-44d1-9861-7b0bece67a7d req-096eb51b-668c-4c99-8a57-f21159c6ed6f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:49.949241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-33cac3f2-e7fc-44d1-9861-7b0bece67a7d req-096eb51b-668c-4c99-8a57-f21159c6ed6f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:49.972892 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-33cac3f2-e7fc-44d1-9861-7b0bece67a7d req-096eb51b-668c-4c99-8a57-f21159c6ed6f service nova] Creating event network-vif-deleted:ec609041-989a-4ca4-b260-a498b8be8b29 for instance 309ec262-31d9-4fc7-9807-3b79e98e55a5 on n-h1-846219-13 Jul 25 16:17:49.978387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-33cac3f2-e7fc-44d1-9861-7b0bece67a7d req-096eb51b-668c-4c99-8a57-f21159c6ed6f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068458 Jul 25 16:17:49.978387 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1412/2743] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:50.084686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:50.087810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:50.104873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:50.110159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:50.113144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:50.115324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:50.352528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:50.366810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:50.399496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:50.408341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:50.413743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:50.415061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:51.253139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:51.259692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:51.303902 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80573d3d-ef0e-4fdd-91be-1fc5905e2a69 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 1.225946 Jul 25 16:17:51.306442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-928e5b76-35a4-4928-99f0-76e6c4513fed tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.962318 Jul 25 16:17:51.307070 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1332/2744] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:50 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:51.311929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1413/2745] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:50 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:51.322730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:51.324131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:51.341583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:51.342733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:51.344907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:51.345887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:51.433722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:51.434640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:51.435441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lazy-loading 'fault' on Instance uuid fa3015bf-74b2-462a-bfac-23b80c32591f {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:17:52.035660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b9986730-a34b-491d-8af2-ad4e9f67fe38 req-0607a1af-a19b-4125-9c63-20cc42d3ef94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3015bf-74b2-462a-bfac-23b80c32591f", "name": "network-vif-deleted", "tag": "1e8e35c2-f1ab-440b-8a78-903ae7f5910a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:52.044950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:52.060745 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89763a2b-cec9-43d7-8c8a-d5c1a86cb1a6 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 200 len: 1313 microversion: 2.1 time: 0.750711 Jul 25 16:17:52.079129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1333/2746] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:51 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 1313 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:52.090567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b9986730-a34b-491d-8af2-ad4e9f67fe38 req-0607a1af-a19b-4125-9c63-20cc42d3ef94 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:52.093575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b9986730-a34b-491d-8af2-ad4e9f67fe38 req-0607a1af-a19b-4125-9c63-20cc42d3ef94 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:52.152112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:52.164786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b9986730-a34b-491d-8af2-ad4e9f67fe38 req-0607a1af-a19b-4125-9c63-20cc42d3ef94 service nova] Creating event network-vif-deleted:1e8e35c2-f1ab-440b-8a78-903ae7f5910a for instance fa3015bf-74b2-462a-bfac-23b80c32591f on n-h2-846219-13 Jul 25 16:17:52.185671 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b9986730-a34b-491d-8af2-ad4e9f67fe38 req-0607a1af-a19b-4125-9c63-20cc42d3ef94 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156367 Jul 25 16:17:52.186563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1641508173", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2ce4d82d-6868-453d-9a90-220914af0e74"}], "security_groups": [{"name": "tempest-securitygroup--188245214"}], "key_name": "tempest-keypair-654953733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:52.191838 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1414/2747] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:52.336883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:52.337854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:52.369142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:52.370288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:52.371912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:52.372913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:52.741164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] validate_networks() for [('2ce4d82d-6868-453d-9a90-220914af0e74', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:17:53.179577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:53.204492 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-27e07a28-9542-4109-8bc2-dad54d8b9902 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 0.876745 Jul 25 16:17:53.214806 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1415/2748] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:52 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:17:53.235183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:53.241075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:53.263870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:53.270810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:53.273730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:53.274874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:53.994473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:54.055554 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2f09e59a-1b8d-4313-aac0-cc487a59dfe3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 0.836873 Jul 25 16:17:54.078158 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1416/2749] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:53 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:54.104070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-33c1351f-22ab-4f5d-b4b6-47398790e8ce req-4eaa764b-402e-441a-b88d-f239026e5a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aee42a0-abee-4e87-b7b1-856cd504173e", "name": "network-vif-plugged", "status": "completed", "tag": "347e5825-ff44-471c-8fb7-0f01116a1e4a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:54.161281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-33c1351f-22ab-4f5d-b4b6-47398790e8ce req-4eaa764b-402e-441a-b88d-f239026e5a2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:54.162355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-33c1351f-22ab-4f5d-b4b6-47398790e8ce req-4eaa764b-402e-441a-b88d-f239026e5a2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:54.196649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-33c1351f-22ab-4f5d-b4b6-47398790e8ce req-4eaa764b-402e-441a-b88d-f239026e5a2d service nova] Creating event network-vif-plugged:347e5825-ff44-471c-8fb7-0f01116a1e4a for instance 9aee42a0-abee-4e87-b7b1-856cd504173e on n-h2-846219-13 Jul 25 16:17:54.219877 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-33c1351f-22ab-4f5d-b4b6-47398790e8ce req-4eaa764b-402e-441a-b88d-f239026e5a2d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134968 Jul 25 16:17:54.222577 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1417/2750] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:54.237746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:54.250654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fa3015bf-74b2-462a-bfac-23b80c32591f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:54.301637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:54.303065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:54.310930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:54.312464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:54.386903 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance fa3015bf-74b2-462a-bfac-23b80c32591f could not be found. Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f HTTP/1.1 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fa3015bf-74b2-462a-bfac-23b80c32591f could not be found. Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fa3015bf-74b2-462a-bfac-23b80c32591f'} Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3015bf-74b2-462a-bfac-23b80c32591f could not be found. Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3015bf-74b2-462a-bfac-23b80c32591f could not be found. Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:17:54.396503 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3015bf-74b2-462a-bfac-23b80c32591f could not be found. Jul 25 16:17:54.400897 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:17:54.413239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance fa3015bf-74b2-462a-bfac-23b80c32591f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:17:54.420334 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02ea5f55-4a63-46fa-80ee-1db8af8817af tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f" status: 404 len: 111 microversion: 2.1 time: 0.192593 Jul 25 16:17:54.423560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1418/2751] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:54 2022] GET /compute/v2.1/servers/fa3015bf-74b2-462a-bfac-23b80c32591f => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:17:54.450687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:54.452592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:54.468294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:54.469664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:54.471187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:54.472392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:55.053473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:17:55.054185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:17:55.054897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:17:55.055510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:17:55.056118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:17:55.095267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:55.099015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:55.103389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:55.105544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:55.155139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=60 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:55.184610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Getting quotas for project 5fbadf69c41746339f1711ec9cea2ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:17:55.201693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Getting quotas for user 83bf735d88e34c6caa3514f80a4e1560 and project 5fbadf69c41746339f1711ec9cea2ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:17:55.252944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:17:55.256784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:17:55.378915 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d6ed7e39-9cae-4382-95ff-7616fb1c7a22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.201689 Jul 25 16:17:55.401849 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1334/2752] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:17:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 3226 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:17:55.418076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3095ae03-77d3-4020-8d33-60c76ab9097a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:55.544840 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3095ae03-77d3-4020-8d33-60c76ab9097a tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/3cd8ff77-94b0-4d81-a5a8-f3eccbc896e2" status: 204 len: 0 microversion: 2.1 time: 0.137128 Jul 25 16:17:55.551357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:55.554156 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1335/2753] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:17:55 2022] DELETE /compute/v2.1/os-server-groups/3cd8ff77-94b0-4d81-a5a8-f3eccbc896e2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:55.572314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e67edd36-ba66-45bf-8b73-6c43dd2dadb0 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1326 microversion: 2.1 time: 1.137165 Jul 25 16:17:55.580139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:55.582502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:55.583722 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1419/2754] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:54 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1326 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:55.598065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-886f40e3-8328-483a-8c7f-280996441a48 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:55.606303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-886f40e3-8328-483a-8c7f-280996441a48 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:55.642904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:55.643375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:55.645384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:55.645868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:55.824420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-886f40e3-8328-483a-8c7f-280996441a48 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:55.842856 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-886f40e3-8328-483a-8c7f-280996441a48 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1245 microversion: 2.1 time: 0.251326 Jul 25 16:17:55.848536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1420/2755] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:55 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1245 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:55.866084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:55.869501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:55.901869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:55.905822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:55.910786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:55.913675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:56.065489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:56.508884 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f237669c-9dc2-47e0-884f-2d71ed47ee14 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 204 len: 0 microversion: 2.1 time: 0.656118 Jul 25 16:17:56.509939 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1421/2756] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:55 2022] DELETE /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:56.537341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d9fa151f-45ed-4dba-97ce-46e430d1edd2 req-37727f57-8af6-4b09-a942-65817abcf726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29c02ac-5630-45b5-aa72-87c62deefd77", "name": "network-vif-plugged", "status": "completed", "tag": "c2fc2466-d0a4-4c9e-a582-57fc00dc9f63"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:56.613394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d9fa151f-45ed-4dba-97ce-46e430d1edd2 req-37727f57-8af6-4b09-a942-65817abcf726 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:56.618123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d9fa151f-45ed-4dba-97ce-46e430d1edd2 req-37727f57-8af6-4b09-a942-65817abcf726 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:56.732445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d9fa151f-45ed-4dba-97ce-46e430d1edd2 req-37727f57-8af6-4b09-a942-65817abcf726 service nova] Creating event network-vif-plugged:c2fc2466-d0a4-4c9e-a582-57fc00dc9f63 for instance d29c02ac-5630-45b5-aa72-87c62deefd77 on n-h1-846219-13 Jul 25 16:17:56.770580 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d9fa151f-45ed-4dba-97ce-46e430d1edd2 req-37727f57-8af6-4b09-a942-65817abcf726 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252110 Jul 25 16:17:56.779697 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1422/2757] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:17:56.832553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:56.833609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:56.882303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:56.890943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:56.901367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:56.906132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:57.136797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:17:57.198364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:57.534449 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4dae7ba8-cf08-4429-9ce1-d50a886f2cf2 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 204 len: 0 microversion: 2.1 time: 0.743740 Jul 25 16:17:57.537477 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1423/2758] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:17:56 2022] DELETE /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 0 bytes in 756 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:17:57.563360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:57.565556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:57.589803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:57.593670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:57.596016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:57.597653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:57.599330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:57.649794 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-66abbc78-8039-4adc-a173-06c63c3c1b2a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1475 microversion: 2.1 time: 2.084700 Jul 25 16:17:57.673132 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1336/2759] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:55 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1475 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:57.689782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:57.694729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:57.712689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:57.714925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:57.716038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:57.718242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.235493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:58.261142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92525abf-c9d4-4c7f-ba90-0f351377e698 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1241 microversion: 2.1 time: 0.582092 Jul 25 16:17:58.264475 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1337/2760] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:57 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1241 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:58.278858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:58.280397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:58.298332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.299885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.301341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.304768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.309217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:58.331400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c983a203-2f11-41d8-9802-1a85b606eb00 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 200 len: 1519 microversion: 2.1 time: 0.784779 Jul 25 16:17:58.333485 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1424/2761] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:57 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 1519 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:58.382573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:58.383751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:58.396962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.397949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.399472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.400289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.570917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:58.581656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b20908a9-5258-4e98-b20a-fbe6c7836e40 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 200 len: 1476 microversion: 2.1 time: 0.315077 Jul 25 16:17:58.597160 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1338/2762] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:58 2022] GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:58.689144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:58.690200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:58.703580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:58.708005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.708551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.709758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.710271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.728753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b8dc377-133d-4095-8e30-806c684a9d1d tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1326 microversion: 2.1 time: 0.353179 Jul 25 16:17:58.738884 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1425/2763] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:58 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1326 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:58.849142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d8c0521a-7cb4-4d7f-b54b-cf137ab4352e req-0481fd84-f37c-4650-b8b6-14f52f76d5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a673cff-0a94-4f74-9d71-4d58a6ef306f", "name": "network-vif-plugged", "status": "completed", "tag": "ebf5810e-ef1c-4131-8b07-a46ed6c4b7f7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:17:58.892083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d8c0521a-7cb4-4d7f-b54b-cf137ab4352e req-0481fd84-f37c-4650-b8b6-14f52f76d5b3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:58.896229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d8c0521a-7cb4-4d7f-b54b-cf137ab4352e req-0481fd84-f37c-4650-b8b6-14f52f76d5b3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:58.957127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d8c0521a-7cb4-4d7f-b54b-cf137ab4352e req-0481fd84-f37c-4650-b8b6-14f52f76d5b3 service nova] Creating event network-vif-plugged:ebf5810e-ef1c-4131-8b07-a46ed6c4b7f7 for instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f on n-h2-846219-13 Jul 25 16:17:58.969921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d8c0521a-7cb4-4d7f-b54b-cf137ab4352e req-0481fd84-f37c-4650-b8b6-14f52f76d5b3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131973 Jul 25 16:17:58.971800 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1426/2764] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:17:59.041321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:59.055309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-85f9c2f5-3742-432e-9197-de76bd804a3b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.370538 Jul 25 16:17:59.077689 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1339/2765] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:58 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:59.306812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:59.310245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:59.315186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:59.350534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:59.351314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:59.352817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:59.353623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:59.626977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:59.627604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:59.639830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:59.640267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:59.648273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:59.649039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:59.761196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:17:59.787341 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41d088fc-be7e-4960-b800-59ef54d45582 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1297 microversion: 2.1 time: 0.488423 Jul 25 16:17:59.788548 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1427/2766] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:59 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1297 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:17:59.794282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:59.795318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:17:59.802426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:59.803589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:17:59.809141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:17:59.809962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:01.204707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:01.218787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:01.228090 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2e60147-6cbb-4138-8523-eb0c8ed2f8d3 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1326 microversion: 2.1 time: 1.437856 Jul 25 16:18:01.234869 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1428/2767] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:59 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1326 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:01.246981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:01.248047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:01.258124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-051a84e0-c8fe-4b0e-9455-4451c4973fd7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 200 len: 1476 microversion: 2.1 time: 1.635034 Jul 25 16:18:01.261884 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1340/2768] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:17:59 2022] GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 1476 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:01.281675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:01.282258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:01.283055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:01.303798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:01.664555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d43ee8bc-baf9-4e96-b23f-50cc7a6a99de tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d93952550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-377765115", "description": "tempest-description-4919567"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:02.044643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:02.072654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30c5b84a-54f5-4b66-a82d-28f63735e0f3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.834630 Jul 25 16:18:02.075286 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1429/2769] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:01 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:02.099124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:02.102049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:02.124821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:02.134030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:02.135968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:02.138154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:02.687133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:02.750955 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36242efb-95c6-456c-bbe1-be8f1fa56209 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1305 microversion: 2.1 time: 0.669336 Jul 25 16:18:02.757641 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1430/2770] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:02 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1305 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:02.786319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-08e23c13-e02b-4f2e-a233-27d9898c33a2 req-c974d9d8-9b03-4e39-a24b-486c7787b19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b11802-77ce-40cc-92ae-1cbb91bf4bfe", "name": "network-vif-deleted", "tag": "6e5da7e1-d468-424a-aeea-f74a89e72067"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:02.812452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-08e23c13-e02b-4f2e-a233-27d9898c33a2 req-c974d9d8-9b03-4e39-a24b-486c7787b19e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:02.816858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-08e23c13-e02b-4f2e-a233-27d9898c33a2 req-c974d9d8-9b03-4e39-a24b-486c7787b19e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:02.837819 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d43ee8bc-baf9-4e96-b23f-50cc7a6a99de tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 252 microversion: 2.1 time: 1.571183 Jul 25 16:18:02.849224 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1341/2771] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:18:01 2022] POST /compute/v2.1/os-security-groups => generated 252 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:02.849224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:02.851726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:02.861380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-08e23c13-e02b-4f2e-a233-27d9898c33a2 req-c974d9d8-9b03-4e39-a24b-486c7787b19e service nova] Creating event network-vif-deleted:6e5da7e1-d468-424a-aeea-f74a89e72067 for instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe on n-h2-846219-13 Jul 25 16:18:02.874210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:02.876635 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-08e23c13-e02b-4f2e-a233-27d9898c33a2 req-c974d9d8-9b03-4e39-a24b-486c7787b19e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114977 Jul 25 16:18:02.878942 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1431/2772] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:02.879576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:02.884378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:02.885506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:02.967384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:02.975758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:03.001494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:03.002474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:03.006601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:03.007116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:03.352735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:03.370362 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cbb7c814-9670-45c9-ae11-feaef6940e34 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 200 len: 1434 microversion: 2.1 time: 0.432403 Jul 25 16:18:03.382146 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1432/2773] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:02 2022] GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 1434 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:03.392504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9c1f4b74-8b4f-4799-9dbf-9c8a7ea8a526 req-8ba07c95-2e4d-42ab-914f-54797be018b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "name": "network-vif-unplugged", "status": "completed", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:03.418649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9c1f4b74-8b4f-4799-9dbf-9c8a7ea8a526 req-8ba07c95-2e4d-42ab-914f-54797be018b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:03.421424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9c1f4b74-8b4f-4799-9dbf-9c8a7ea8a526 req-8ba07c95-2e4d-42ab-914f-54797be018b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:03.462141 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9c1f4b74-8b4f-4799-9dbf-9c8a7ea8a526 req-8ba07c95-2e4d-42ab-914f-54797be018b4 service nova] Creating event network-vif-unplugged:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:18:03.474008 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9c1f4b74-8b4f-4799-9dbf-9c8a7ea8a526 req-8ba07c95-2e4d-42ab-914f-54797be018b4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090407 Jul 25 16:18:03.475260 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1433/2774] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:03.481247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-687edda4-fc05-4c53-82a8-ecdb4870b4c1 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d929894c0>, body: {"security_group_rule": {"parent_group_id": "cd6c95b0-d768-44e1-b229-7b01c3ae0e3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:03.621378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:03.669470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1155b7dd-32ce-49f3-ba73-88ac3b13c559 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1520 microversion: 2.1 time: 0.800802 Jul 25 16:18:03.670973 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1342/2775] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:02 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1520 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:03.676277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e62f70c3-7618-4c99-8cac-522a9964c822 req-e24106b0-7e17-4166-8892-29fda04b9a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe35ce4d-d238-4af5-acf3-fc8cbda010d3", "name": "network-vif-deleted", "tag": "5923fb76-d0dc-4e68-94e3-8cb451afd9b7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:03.708073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e62f70c3-7618-4c99-8cac-522a9964c822 req-e24106b0-7e17-4166-8892-29fda04b9a9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:03.710322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e62f70c3-7618-4c99-8cac-522a9964c822 req-e24106b0-7e17-4166-8892-29fda04b9a9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:03.734705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e62f70c3-7618-4c99-8cac-522a9964c822 req-e24106b0-7e17-4166-8892-29fda04b9a9b service nova] Creating event network-vif-deleted:5923fb76-d0dc-4e68-94e3-8cb451afd9b7 for instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 on n-h2-846219-13 Jul 25 16:18:03.749531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e62f70c3-7618-4c99-8cac-522a9964c822 req-e24106b0-7e17-4166-8892-29fda04b9a9b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076696 Jul 25 16:18:03.751695 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1343/2776] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:03.758767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:03.759840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:03.769333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:03.770089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:03.771770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:03.772394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.143416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:04.162694 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2fcbd0e5-2daf-45b5-9684-33dec68bcb46 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.409199 Jul 25 16:18:04.164013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1344/2777] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:03 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:04.180732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:04.181733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:04.189557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.190510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.191553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.192180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.626279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-687edda4-fc05-4c53-82a8-ecdb4870b4c1 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.148140 Jul 25 16:18:04.628508 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1434/2778] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:04.663515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:04.665442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:04.667430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:04.680518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.681088 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7df306e4-e997-4bee-83f9-09626b4bd40e tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 200 len: 1519 microversion: 2.1 time: 0.511415 Jul 25 16:18:04.681903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.682172 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1345/2779] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:04 2022] GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:04.684615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.685496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.696711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:04.700502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: fe35ce4d-d238-4af5-acf3-fc8cbda010d3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:04.726721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.727640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.730917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.732028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.773006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 could not be found. Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 HTTP/1.1 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 could not be found. Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fe35ce4d-d238-4af5-acf3-fc8cbda010d3'} Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 could not be found. Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 could not be found. Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:04.777688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 could not be found. Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance fe35ce4d-d238-4af5-acf3-fc8cbda010d3 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa8e8909-9ee2-4f1a-980d-d00ddf352ce4 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3" status: 404 len: 111 microversion: 2.1 time: 0.097229 Jul 25 16:18:04.787873 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1346/2780] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:04 2022] GET /compute/v2.1/servers/fe35ce4d-d238-4af5-acf3-fc8cbda010d3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:04.794987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49aba308-b227-4b98-82d3-581a66886c54 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d939ccf70>, body: {"security_group_rule": {"parent_group_id": "cd6c95b0-d768-44e1-b229-7b01c3ae0e3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:04.963947 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-49aba308-b227-4b98-82d3-581a66886c54 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: This rule already exists in group cd6c95b0-d768-44e1-b229-7b01c3ae0e3e Jul 25 16:18:04.965376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49aba308-b227-4b98-82d3-581a66886c54 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 138 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: {"security_group_rule": {"parent_group_id": "cd6c95b0-d768-44e1-b229-7b01c3ae0e3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: exception: This rule already exists in group cd6c95b0-d768-44e1-b229-7b01c3ae0e3e Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cd6c95b0-d768-44e1-b229-7b01c3ae0e3e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group cd6c95b0-d768-44e1-b229-7b01c3ae0e3e Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group cd6c95b0-d768-44e1-b229-7b01c3ae0e3e Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:04.966170 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group cd6c95b0-d768-44e1-b229-7b01c3ae0e3e Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49aba308-b227-4b98-82d3-581a66886c54 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 400 to user: This rule already exists in group cd6c95b0-d768-44e1-b229-7b01c3ae0e3e {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49aba308-b227-4b98-82d3-581a66886c54 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.183640 Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1347/2781] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:04 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:04.976829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:04.997216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:04.997673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:04.998588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.004172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.005947 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48bdd0bf-e95c-44c3-94cd-3e9be42f36a6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1303 microversion: 2.1 time: 0.375238 Jul 25 16:18:05.006642 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1435/2782] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:04 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1303 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:05.036243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:05.049732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:05.051118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 69b11802-77ce-40cc-92ae-1cbb91bf4bfe] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:05.066664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:05.072335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.073496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.075157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.076137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.104011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe could not be found. Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe HTTP/1.1 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe could not be found. Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '69b11802-77ce-40cc-92ae-1cbb91bf4bfe'} Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe could not be found. Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe could not be found. Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:05.107467 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe could not be found. Jul 25 16:18:05.116053 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:05.118659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance 69b11802-77ce-40cc-92ae-1cbb91bf4bfe could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:05.120573 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b2f338f-1957-43d5-91fc-fdc4758986d7 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe" status: 404 len: 111 microversion: 2.1 time: 0.112545 Jul 25 16:18:05.122279 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1436/2783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:05 2022] GET /compute/v2.1/servers/69b11802-77ce-40cc-92ae-1cbb91bf4bfe => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:05.130956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-286a3072-51e0-434e-a1ec-f8e5f277a8ec tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9d929a6c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:05.158957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:05.258315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:05.266187 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a7116978-f0bb-4a5f-8eb3-ba5351844837 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "DELETE /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 204 len: 0 microversion: 2.1 time: 0.295755 Jul 25 16:18:05.267762 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1348/2784] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:04 2022] DELETE /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:05.280311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b654f91b-6111-4b50-b0ec-c502792a1932 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:05.321245 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b654f91b-6111-4b50-b0ec-c502792a1932 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/aa5d2be4-9dee-4dde-a0a9-6268c6c98721" status: 204 len: 0 microversion: 2.1 time: 0.051158 Jul 25 16:18:05.325565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1349/2785] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:18:05 2022] DELETE /compute/v2.1/os-server-groups/aa5d2be4-9dee-4dde-a0a9-6268c6c98721 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:05.332178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:05.333461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:05.348248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.348899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.350327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.350960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.585366 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-286a3072-51e0-434e-a1ec-f8e5f277a8ec tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-group-rules/1857504d-7839-44b9-abd1-514dc7fd2bde" status: 202 len: 0 microversion: 2.1 time: 0.461083 Jul 25 16:18:05.590906 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1437/2786] 10.222.0.105 () {58 vars in 1292 bytes} [Mon Jul 25 16:18:05 2022] DELETE /compute/v2.1/os-security-group-rules/1857504d-7839-44b9-abd1-514dc7fd2bde => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:05.603700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:05.604682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:05.615675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.616454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.620551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.621395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.761591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:05.777197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d04c716-9a3b-479e-bba4-f84e5925756a tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.450205 Jul 25 16:18:05.777792 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1350/2787] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:05 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:05.788092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:05.792100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:05.816424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.829474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.831235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:05.832043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:05.908974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:05.975047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:06.129896 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee48f335-fb40-49c1-b9fd-bde31dfd5196 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "DELETE /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 204 len: 0 microversion: 2.1 time: 0.345919 Jul 25 16:18:06.131115 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1351/2788] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:05 2022] DELETE /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:06.141947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7183a0f-454e-41b1-b7e5-ad11ae386db8 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d939ddc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-586379420", "description": "tempest-description-1139396955"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:06.584025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:06.632057 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92ae10ce-21b5-48e3-ac44-50829acfbc6b tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 200 len: 1525 microversion: 2.1 time: 1.039243 Jul 25 16:18:06.633521 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1438/2789] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:05 2022] GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 1525 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:06.653737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:06.655399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:06.679607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:06.680573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:06.681914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:06.682716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:07.334751 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7183a0f-454e-41b1-b7e5-ad11ae386db8 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.201437 Jul 25 16:18:07.344506 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1352/2790] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:18:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:07.349923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:07.351030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:07.368940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:07.376190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:07.377675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:07.378345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:07.499563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:07.509627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c2b6442-becd-49c8-84ab-8efe0cf9d32e tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.874031 Jul 25 16:18:07.532884 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1439/2791] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:06 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:07.550408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:07.552056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:07.567477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:07.568443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:07.569660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:07.570350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:08.051283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:08.088506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:08.162425 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-330a1b9b-8575-4afd-8022-363bbf3c8a78 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.627488 Jul 25 16:18:08.163047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1440/2792] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:07 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:08.176833 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5baa911a-0822-4eef-9205-3e1dbd928678 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1475 microversion: 2.1 time: 0.824629 Jul 25 16:18:08.184887 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1353/2793] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:07 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1475 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:08.241391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-561eff0e-1f4c-4714-a674-8aee27f486bb tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d92e70670>, body: {"security_group_rule": {"parent_group_id": "3aea486c-f151-45a1-913b-74465fbd6fc9", "ip_protocol": "tcp", "from_port": 597036802, "to_port": 22}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:08.253820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:08.263754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:08.296608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:08.305423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:08.312678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:08.319920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:08.910654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-561eff0e-1f4c-4714-a674-8aee27f486bb tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Invalid port range 597036802:22. Former value cannot be greater than the later Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-561eff0e-1f4c-4714-a674-8aee27f486bb tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 145 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: {"security_group_rule": {"parent_group_id": "3aea486c-f151-45a1-913b-74465fbd6fc9", "ip_protocol": "tcp", "from_port": 597036802, "to_port": 22}} Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid port range 597036802:22. Former value cannot be greater than the later Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3aea486c-f151-45a1-913b-74465fbd6fc9', 'ip_protocol': 'tcp', 'from_port': 597036802, 'to_port': 22}}} Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 597036802:22. Former value cannot be greater than the later Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 597036802:22. Former value cannot be greater than the later Jul 25 16:18:08.912361 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 597036802:22. Former value cannot be greater than the later Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-561eff0e-1f4c-4714-a674-8aee27f486bb tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 400 to user: Invalid port range 597036802:22. Former value cannot be greater than the later {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:08.917126 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-561eff0e-1f4c-4714-a674-8aee27f486bb tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.731589 Jul 25 16:18:08.921543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1441/2794] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:08 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 743 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:18:08.940900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:08.946449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:08.969523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:08.970536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:08.973791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:08.974880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:09.889236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:09.914208 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cc9bddae-c089-4600-b485-0dbc67bf990c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 200 len: 1525 microversion: 2.1 time: 1.726990 Jul 25 16:18:09.914850 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1354/2795] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:08 2022] GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 1525 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:10.157955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:10.166725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4145e39e-d759-4baa-a053-9135a30f84d8 req-d8f64eab-a7d1-470b-9081-c678d7f9bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf904be-f686-4f48-8a1f-dd55644b1973", "tag": "cdc27e7d-6c64-4d22-8cf8-468485ab9596"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:10.176052 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b88f13f-48b1-43e7-a980-fbbe689e1c92 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 1.252715 Jul 25 16:18:10.179220 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1442/2796] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:08 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:10.187956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-901ef088-44fb-407e-a7ee-c5a258ee8224 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d93d3f790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-463895651", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:10.195390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4145e39e-d759-4baa-a053-9135a30f84d8 req-d8f64eab-a7d1-470b-9081-c678d7f9bb45 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:10.195929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4145e39e-d759-4baa-a053-9135a30f84d8 req-d8f64eab-a7d1-470b-9081-c678d7f9bb45 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:10.207094 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-901ef088-44fb-407e-a7ee-c5a258ee8224 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Security group id should be uuid Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-901ef088-44fb-407e-a7ee-c5a258ee8224 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 130 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-463895651", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group id should be uuid Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-463895651', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:10.208940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:10.212983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 25 16:18:10.212983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:10.216772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-901ef088-44fb-407e-a7ee-c5a258ee8224 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 400 to user: Security group id should be uuid {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:10.218599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-901ef088-44fb-407e-a7ee-c5a258ee8224 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.037671 Jul 25 16:18:10.219422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1443/2797] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:10 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:10.228890 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4145e39e-d759-4baa-a053-9135a30f84d8 req-d8f64eab-a7d1-470b-9081-c678d7f9bb45 service nova] Creating event network-changed:cdc27e7d-6c64-4d22-8cf8-468485ab9596 for instance 3cf904be-f686-4f48-8a1f-dd55644b1973 on n-h1-846219-13 Jul 25 16:18:10.234471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:10.243945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:10.244977 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4145e39e-d759-4baa-a053-9135a30f84d8 req-d8f64eab-a7d1-470b-9081-c678d7f9bb45 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315078 Jul 25 16:18:10.249225 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1355/2798] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:10.259697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:10.260417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:10.263468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:10.264280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:10.265431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:10.266163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:10.284844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:10.286715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:10.287538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:10.287979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:10.577761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8774372f9e4f178645ff20c4fe2693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0327cf82312473da90dfaf13e95fcea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:10.593567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c09f001-442b-49af-bbdf-c404ef5b3e9c tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 200 len: 1433 microversion: 2.1 time: 0.341118 Jul 25 16:18:10.609669 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1356/2799] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:10 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 1433 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:10.622448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac9fc555-b54f-431a-922f-5bf28beb4053 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d93a51c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-924630270", "description": "tempest-description-1165040722"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:10.970288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:10.984442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb2a1909-a95e-4cbc-9976-b77637b99c84 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.756792 Jul 25 16:18:10.984973 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1444/2800] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:10 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:10.991281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:11.000452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:11.017133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.017881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.018938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.019559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.069817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:11.116029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.116522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.116988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lazy-loading 'fault' on Instance uuid 0a673cff-0a94-4f74-9d71-4d58a6ef306f {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:18:11.265877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:11.277534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-385c0e28-947a-4226-971b-fbd194b2758f tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 200 len: 1316 microversion: 2.1 time: 0.289943 Jul 25 16:18:11.278964 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1445/2801] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:10 2022] GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:11.290659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:11.291673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:11.300758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.301661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.304262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.304945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.583826 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac9fc555-b54f-431a-922f-5bf28beb4053 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.972259 Jul 25 16:18:11.585015 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1357/2802] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:18:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:11.608600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-358f7b64-dddd-469f-8703-efed1f3443e4 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d93f02040>, body: {"security_group_rule": {"parent_group_id": "462a1208-e8e0-4e3c-a123-b5c1d83041f1", "ip_protocol": "tempest-999-2034416124", "from_port": 22, "to_port": 22}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:11.842763 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-358f7b64-dddd-469f-8703-efed1f3443e4 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Invalid IP protocol tempest-999-2034416124. Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-358f7b64-dddd-469f-8703-efed1f3443e4 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 157 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: {"security_group_rule": {"parent_group_id": "462a1208-e8e0-4e3c-a123-b5c1d83041f1", "ip_protocol": "tempest-999-2034416124", "from_port": 22, "to_port": 22}} Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid IP protocol tempest-999-2034416124. Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'security_group_rule': {'parent_group_id': '462a1208-e8e0-4e3c-a123-b5c1d83041f1', 'ip_protocol': 'tempest-999-2034416124', 'from_port': 22, 'to_port': 22}}} Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2034416124. Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2034416124. Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.845360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2034416124. Jul 25 16:18:11.849306 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.851663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-358f7b64-dddd-469f-8703-efed1f3443e4 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 400 to user: Invalid IP protocol tempest-999-2034416124. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:11.852757 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-358f7b64-dddd-469f-8703-efed1f3443e4 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.256061 Jul 25 16:18:11.853514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1358/2803] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:11 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:11.864518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:11.864982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:11.865974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] [instance: 9fd58fea-6110-43b7-9f72-c20592d5f0d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:11.875922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0a4c9ef-f824-409a-980d-50ebc8e4e6f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.595423 Jul 25 16:18:11.877081 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1446/2804] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:11 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:11.878184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.879827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.880807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:11.881428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:11.882772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f956e13-fd91-4848-9904-3cd0828e6e80 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d92e70550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1608711818", "description": "tempest-description-1954887815"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:11.910956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] HTTP exception thrown: Instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 could not be found. Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Request method failure captured: Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 HTTP/1.1 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sEjlQr725srPfOJFhsYyy4QaA8MUQoKwsbXMUOK2aEvltxycIVZyM_O6Tl0GzpjA9dd4oC0cuemZvIv3JCoaWaOJ_TsHaJE2ej91-tIr1pqwvaf2p43XULqqUYWtGWdOWLc66-4d7Pd6hyUBf6VAeutGgg-W0BgDO9R4Ek4rEfDWHU Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b0327cf82312473da90dfaf13e95fcea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b0327cf82312473da90dfaf13e95fcea"}]}] Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: b0327cf82312473da90dfaf13e95fcea Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1996124551 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ca8774372f9e4f178645ff20c4fe2693 Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersOnMultiNodesTest-1996124551-project Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 could not be found. Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '9fd58fea-6110-43b7-9f72-c20592d5f0d4'} Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 could not be found. Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 could not be found. Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:11.912534 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 could not be found. Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] Returning 404 to user: Instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:11.917745 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ad30c2a2-42c5-49f0-9984-7e1e5fc04a81 tempest-ServersOnMultiNodesTest-1996124551 tempest-ServersOnMultiNodesTest-1996124551-project] 10.222.0.105 "GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4" status: 404 len: 111 microversion: 2.1 time: 0.060261 Jul 25 16:18:11.926283 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1359/2805] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:11 2022] GET /compute/v2.1/servers/9fd58fea-6110-43b7-9f72-c20592d5f0d4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:12.023743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:12.024265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:12.041941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.043376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.045185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.046074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.175978 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f956e13-fd91-4848-9904-3cd0828e6e80 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.296952 Jul 25 16:18:12.177128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1447/2806] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:18:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:12.203106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ecc77d7-b5be-4eee-873d-126be1e01913 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d9357b430>, body: {"security_group_rule": {"parent_group_id": "01c99d82-0093-4ad8-8ef2-7540ae4d17dc", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:12.395525 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-5ecc77d7-b5be-4eee-873d-126be1e01913 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ecc77d7-b5be-4eee-873d-126be1e01913 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 138 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: {"security_group_rule": {"parent_group_id": "01c99d82-0093-4ad8-8ef2-7540ae4d17dc", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'security_group_rule': {'parent_group_id': '01c99d82-0093-4ad8-8ef2-7540ae4d17dc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 16:18:12.398909 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.403749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ecc77d7-b5be-4eee-873d-126be1e01913 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:12.407884 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ecc77d7-b5be-4eee-873d-126be1e01913 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.211066 Jul 25 16:18:12.412874 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1448/2807] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:12 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:18:12.442416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-628d4de1-20c5-43bf-acea-d6c235279dd3 req-65319b55-a684-43ca-aa0e-ec12101cef47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "name": "network-vif-plugged", "status": "completed", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:12.478704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-628d4de1-20c5-43bf-acea-d6c235279dd3 req-65319b55-a684-43ca-aa0e-ec12101cef47 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.479378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-628d4de1-20c5-43bf-acea-d6c235279dd3 req-65319b55-a684-43ca-aa0e-ec12101cef47 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.514180 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-628d4de1-20c5-43bf-acea-d6c235279dd3 req-65319b55-a684-43ca-aa0e-ec12101cef47 service nova] Creating event network-vif-plugged:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:18:12.546014 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-628d4de1-20c5-43bf-acea-d6c235279dd3 req-65319b55-a684-43ca-aa0e-ec12101cef47 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124283 Jul 25 16:18:12.550197 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1449/2808] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:12.571051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:12.576215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:12.585880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:12.605016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1203eb5-5392-4919-9c28-8d69d8088f93 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.586606 Jul 25 16:18:12.610687 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1360/2809] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:12 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:18:12.623114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.624006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.629025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.630952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cc8dabfa-fde5-470a-a937-1239b8a30f76 req-25b4c3de-8b5c-41a7-9ade-4d1150e2c0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a673cff-0a94-4f74-9d71-4d58a6ef306f", "name": "network-vif-deleted", "tag": "ebf5810e-ef1c-4131-8b07-a46ed6c4b7f7"}, {"server_uuid": "9fd58fea-6110-43b7-9f72-c20592d5f0d4", "name": "network-vif-deleted", "tag": "c461cbf9-148a-4ce9-95bc-865540b15329"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:12.631898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.664529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cc8dabfa-fde5-470a-a937-1239b8a30f76 req-25b4c3de-8b5c-41a7-9ade-4d1150e2c0c5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.665434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cc8dabfa-fde5-470a-a937-1239b8a30f76 req-25b4c3de-8b5c-41a7-9ade-4d1150e2c0c5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.678726 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] HTTP exception thrown: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f HTTP/1.1 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0a673cff-0a94-4f74-9d71-4d58a6ef306f'} Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.681136 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:12.685345 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:12.695542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 404 to user: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:12.696915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4e0b54a-7f01-4341-bf58-bee16045cefb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 404 len: 111 microversion: 2.1 time: 0.141159 Jul 25 16:18:12.703397 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1450/2810] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:12 2022] GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:12.716422 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cc8dabfa-fde5-470a-a937-1239b8a30f76 req-25b4c3de-8b5c-41a7-9ade-4d1150e2c0c5 service nova] Creating event network-vif-deleted:ebf5810e-ef1c-4131-8b07-a46ed6c4b7f7 for instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f on n-h2-846219-13 Jul 25 16:18:12.717136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-05425a5b-deb1-4878-b7d7-79786d30c3e7 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d938f0280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-339258187", "description": "tempest-description-2008604809"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:12.717916 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cc8dabfa-fde5-470a-a937-1239b8a30f76 req-25b4c3de-8b5c-41a7-9ade-4d1150e2c0c5 service nova] Creating event network-vif-deleted:c461cbf9-148a-4ce9-95bc-865540b15329 for instance 9fd58fea-6110-43b7-9f72-c20592d5f0d4 on n-h1-846219-13 Jul 25 16:18:12.737133 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cc8dabfa-fde5-470a-a937-1239b8a30f76 req-25b4c3de-8b5c-41a7-9ade-4d1150e2c0c5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.123801 Jul 25 16:18:12.738523 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1361/2811] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:12.744934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:12.750455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:12.752308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:12.773874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.774810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:12.776014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:12.788815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.025683 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61482b5f-266a-4b5d-8e0c-6c111b7c6863 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.284132 Jul 25 16:18:13.026937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1362/2812] 10.222.0.105 () {58 vars in 1235 bytes} [Mon Jul 25 16:18:12 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:18:13.034111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:13.035819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:13.068933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:13.069500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.070273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:13.071859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.418744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-05425a5b-deb1-4878-b7d7-79786d30c3e7 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.713660 Jul 25 16:18:13.419705 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1451/2813] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:18:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:13.434395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ec27e1e4-efb5-4372-9e63-949c2a86e40c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ec27e1e4-efb5-4372-9e63-949c2a86e40c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 16:18:13.438876 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ec27e1e4-efb5-4372-9e63-949c2a86e40c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ec27e1e4-efb5-4372-9e63-949c2a86e40c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023246 Jul 25 16:18:13.448244 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1452/2814] 10.222.0.105 () {58 vars in 1187 bytes} [Mon Jul 25 16:18:13 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:18:13.455494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00df9b44-5e9c-4f91-9a02-aa79876f4107 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d92a10280>, body: {"security_group_rule": {"parent_group_id": "c87862cb-e955-4a5a-9412-ba3a9bac9e3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1155074393}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:13.516823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:13.556992 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e44c139-7790-4e93-aa5c-ace52b17d51d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.527539 Jul 25 16:18:13.559243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1363/2815] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:13 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:13.576787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:13.587857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:13.588722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:13.600743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:13.602791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.605688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:13.606616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.649162 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-00df9b44-5e9c-4f91-9a02-aa79876f4107 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Invalid port range 22:1155074393. Valid TCP ports should be between 1-65535 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00df9b44-5e9c-4f91-9a02-aa79876f4107 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 146 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: {"security_group_rule": {"parent_group_id": "c87862cb-e955-4a5a-9412-ba3a9bac9e3c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1155074393}} Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid port range 22:1155074393. Valid TCP ports should be between 1-65535 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c87862cb-e955-4a5a-9412-ba3a9bac9e3c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1155074393}}} Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1155074393. Valid TCP ports should be between 1-65535 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1155074393. Valid TCP ports should be between 1-65535 Jul 25 16:18:13.652004 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1155074393. Valid TCP ports should be between 1-65535 Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00df9b44-5e9c-4f91-9a02-aa79876f4107 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 400 to user: Invalid port range 22:1155074393. Valid TCP ports should be between 1-65535 {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00df9b44-5e9c-4f91-9a02-aa79876f4107 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.205703 Jul 25 16:18:13.658062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1453/2816] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:13 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:18:13.664144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:13.664776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:13.685866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:18:13.688487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:13.688991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.689950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:13.690405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:13.772862 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b52d039-0a79-467b-82bb-8631ff6b1dab tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 685 microversion: 2.1 time: 0.207130 Jul 25 16:18:13.788373 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1364/2817] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:18:13 2022] GET /compute/v2.1/servers => generated 685 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:13.803039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Action: 'create', calling method: .version_select at 0x7f9d93a40670>, body: {"security_group_rule": {"parent_group_id": "e1dd2132-95ba-4b2d-a8f3-d62ac688e608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:13.989045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:18:13.990822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Neutron security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:18:13.992092 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:13.992092 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 138 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: {"security_group_rule": {"parent_group_id": "e1dd2132-95ba-4b2d-a8f3-d62ac688e608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e1dd2132-95ba-4b2d-a8f3-d62ac688e608', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:18:13.997953 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 404 to user: Security group e1dd2132-95ba-4b2d-a8f3-d62ac688e608 does not exist Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-e6afe8b8-6523-41df-bdaf-3256cb2120fa'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b65d78ef-7ae8-47c3-8358-f174e1c770af tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.213039 Jul 25 16:18:14.018200 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1365/2818] 10.222.0.105 () {60 vars in 1200 bytes} [Mon Jul 25 16:18:13 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:14.038918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.048193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:14.048193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.servers [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Removing options 'limit' from query {{(pid=119598) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 16:18:14.048847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:14.062521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:14.066992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:14.068110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:14.076226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:14.189727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:18:14.335360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:14.338480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09b1defd-f19e-44fa-b2b1-4a6eef9d9f47 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?limit=102" status: 200 len: 685 microversion: 2.1 time: 0.314062 Jul 25 16:18:14.339715 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1366/2819] 10.222.0.105 () {58 vars in 1149 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/servers?limit=102 => generated 685 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:14.355649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8b3c90b-880f-4623-8334-69d5d42e9288 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.697943 Jul 25 16:18:14.357849 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1454/2820] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:13 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:14.372182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9d939cc8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.403374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f31fbda-3222-4d96-8504-1554af9130f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f31fbda-3222-4d96-8504-1554af9130f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '-1' Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 16:18:14.417217 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 16:18:14.429624 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.438689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f31fbda-3222-4d96-8504-1554af9130f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:14.443667 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f31fbda-3222-4d96-8504-1554af9130f7 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.062826 Jul 25 16:18:14.446418 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1455/2821] 10.222.0.105 () {58 vars in 1147 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:18:14.476907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41fcbf0a-3c5d-4007-9e4c-adddc9a35398 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41fcbf0a-3c5d-4007-9e4c-adddc9a35398 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: action_args: {} Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'testing' Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 16:18:14.495731 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 16:18:14.504958 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Neutron security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 not found {{(pid=119598) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] HTTP exception thrown: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Request method failure captured: Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-security-group-rules/7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 HTTP/1.1 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sI4sHQdYONet27heFWgJQhiGFQHAFOzQfyz8f8zu08Cgw8Fpz5T2FXSGySgwT_hUcNL-fvKxx5i00sSVJPmz31i5l9azx6JByzwSdymuc9Nrh78MVdTbTvf9le1xtyqsn5nq0-ZDgZCmwYZ8bCqKPpxxUBSPzwxOg5GqVJt_vDKE9E Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2406fdbfdd8d480e849fd9f4344a0489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2406fdbfdd8d480e849fd9f4344a0489"}]}] Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 2406fdbfdd8d480e849fd9f4344a0489 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4df0c52680f24fa8a377d4accbd2c809 Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-356169383-project Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7dee1a1a-ef61-4e58-9c33-6dc9e5b36728'} Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:14.510495 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] Jul 25 16:18:14.518654 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:14.533478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41fcbf0a-3c5d-4007-9e4c-adddc9a35398 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:14.534226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Returning 404 to user: Security group rule 7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 does not exist Jul 25 16:18:14.534226 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-2562e6fe-59fe-40a0-965e-a249b7485831'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:14.534519 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41fcbf0a-3c5d-4007-9e4c-adddc9a35398 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.055987 Jul 25 16:18:14.534687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43c3dc98-c52f-4fd6-a2e3-1d1bc6bd6afa tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-group-rules/7dee1a1a-ef61-4e58-9c33-6dc9e5b36728" status: 404 len: 199 microversion: 2.1 time: 0.151198 Jul 25 16:18:14.534871 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1456/2822] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:18:14.535036 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1367/2823] 10.222.0.105 () {58 vars in 1292 bytes} [Mon Jul 25 16:18:14 2022] DELETE /compute/v2.1/os-security-group-rules/7dee1a1a-ef61-4e58-9c33-6dc9e5b36728 => generated 199 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:14.539034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-873a9f7d-c11f-4da5-8031-b7f4cd885981 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.559261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ce41e1a-51ce-43be-bf84-4ab3f2761932 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9d93a46af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.560409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-873a9f7d-c11f-4da5-8031-b7f4cd885981 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:14.561327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-873a9f7d-c11f-4da5-8031-b7f4cd885981 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:14.584502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.servers [None req-873a9f7d-c11f-4da5-8031-b7f4cd885981 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Flavor 'non_existing_flavor' could not be found {{(pid=119599) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 25 16:18:14.585625 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-873a9f7d-c11f-4da5-8031-b7f4cd885981 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061759 Jul 25 16:18:14.593849 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1457/2824] 10.222.0.105 () {58 vars in 1183 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:18:14.599506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.600130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:14.619995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:14.621135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:14.622251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:14.625131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.131525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:15.146997 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57a48617-bc45-4451-8d06-f2ba4841be45 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.551174 Jul 25 16:18:15.149358 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1458/2825] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:15.160650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:15.169180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:15.172093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:15.180553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.182017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.183918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.184698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.353267 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5ce41e1a-51ce-43be-bf84-4ab3f2761932 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/c87862cb-e955-4a5a-9412-ba3a9bac9e3c" status: 202 len: 0 microversion: 2.1 time: 0.816154 Jul 25 16:18:15.355131 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1368/2826] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:18:14 2022] DELETE /compute/v2.1/os-security-groups/c87862cb-e955-4a5a-9412-ba3a9bac9e3c => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:15.359634 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24943725-4a56-40a3-8bc3-9a48aeb959ce tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.206687 Jul 25 16:18:15.361664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1459/2827] 10.222.0.105 () {58 vars in 1179 bytes} [Mon Jul 25 16:18:15 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:18:15.366793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f7b35fd-7855-4755-a52e-953a65bb163d tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9da4a851f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:15.379666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:15.386463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:15.387423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:15.396601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.397294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.399178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.400291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.560457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d2c9f26-d492-4703-8b1c-22ccc6f360fb tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.186790 Jul 25 16:18:15.563268 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1460/2828] 10.222.0.105 () {58 vars in 1189 bytes} [Mon Jul 25 16:18:15 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:18:15.581675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:15.583488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:15.600864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.601588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.603060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.604353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.878623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f7b35fd-7855-4755-a52e-953a65bb163d tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/01c99d82-0093-4ad8-8ef2-7540ae4d17dc" status: 202 len: 0 microversion: 2.1 time: 0.516642 Jul 25 16:18:15.879568 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1369/2829] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:18:15 2022] DELETE /compute/v2.1/os-security-groups/01c99d82-0093-4ad8-8ef2-7540ae4d17dc => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:15.889214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:15.916594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:15.920383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:15.939898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.940991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.945023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:15.945523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:15.974482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:15.985917 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c1f1f4f-5a16-46f5-9360-0647e7850be6 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1481 microversion: 2.1 time: 0.420135 Jul 25 16:18:15.986866 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1461/2830] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:15 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1481 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:15.995076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1659b02e-cfe5-4b14-811f-420688813b3c tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9d92a101f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:16.013981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:18:16.131372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:16.141745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:16.142544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:16.580811 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1659b02e-cfe5-4b14-811f-420688813b3c tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/462a1208-e8e0-4e3c-a123-b5c1d83041f1" status: 202 len: 0 microversion: 2.1 time: 0.592489 Jul 25 16:18:16.585968 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1462/2831] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:18:15 2022] DELETE /compute/v2.1/os-security-groups/462a1208-e8e0-4e3c-a123-b5c1d83041f1 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:16.591311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:16.591967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:16.609703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:16.610173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:16.611138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:16.611588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:16.621983 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67bbc254-4274-4742-9d11-483129f2eff6 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 3032 microversion: 2.1 time: 0.740878 Jul 25 16:18:16.625576 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1370/2832] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:18:15 2022] GET /compute/v2.1/servers/detail => generated 3032 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:16.632354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-54c65974-df1e-40b0-ae16-5bd7579e9fa3 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9d93e3f280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:16.968941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:16.992494 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9977dde9-61c3-46a8-b203-92623fa10e7c tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.395988 Jul 25 16:18:17.006213 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1463/2833] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:16 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:17.024257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-05e9ed27-cd22-4de4-a8cd-1c49ef590b8c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:17.031984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-05e9ed27-cd22-4de4-a8cd-1c49ef590b8c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:17.033568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-05e9ed27-cd22-4de4-a8cd-1c49ef590b8c tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.018909 Jul 25 16:18:17.041349 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1464/2834] 10.222.0.105 () {58 vars in 1183 bytes} [Mon Jul 25 16:18:17 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:18:17.050293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:17.051251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:17.079664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:17.084930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:17.088844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:17.092138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:17.950993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:17.962891 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9612a9dd-6c39-4d04-871d-b688998b29a8 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1466 microversion: 2.1 time: 0.918746 Jul 25 16:18:17.981890 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1465/2835] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:17 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1466 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:18.004817 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-54c65974-df1e-40b0-ae16-5bd7579e9fa3 tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/3aea486c-f151-45a1-913b-74465fbd6fc9" status: 202 len: 0 microversion: 2.1 time: 1.376823 Jul 25 16:18:18.006925 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1371/2836] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:18:16 2022] DELETE /compute/v2.1/os-security-groups/3aea486c-f151-45a1-913b-74465fbd6fc9 => generated 0 bytes in 1380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:18.023010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:18.024681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:18.031148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:18.031866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Searching by: {'deleted': False, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:18:18.048593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.049448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.050561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.051299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.052645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:18.062419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.063673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.065554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.066274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.083129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:18.099354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:18:18.141643 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1c7ca09-73d8-4a80-8bc9-9a40e6461789 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 685 microversion: 2.1 time: 0.158295 Jul 25 16:18:18.150001 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1466/2837] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:18:17 2022] GET /compute/v2.1/servers => generated 685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:18.155842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dfcd42d-6cef-4460-a2ae-5a45cf9056ab tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] Calling method '.version_select at 0x7f9d938f0d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:18.222922 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5800512d-f5cc-405e-aacb-8e84050e124d tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 0 microversion: 2.1 time: 0.212692 Jul 25 16:18:18.224784 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1372/2838] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:18:18 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:18.231765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:18.232473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:18.251247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.254077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.254932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.258489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.648653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:18.726137 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f6d73a3-10d5-4c51-aad9-e21264d79dc7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.499977 Jul 25 16:18:18.729437 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1373/2839] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:18 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:18.746817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-70aa8e1a-7f98-4659-9fb2-3eafe4ca8a2d req-2d2864fe-7ccf-463a-ab0b-072e49ede592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf904be-f686-4f48-8a1f-dd55644b1973", "name": "network-vif-plugged", "status": "completed", "tag": "cdc27e7d-6c64-4d22-8cf8-468485ab9596"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:18.765635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-70aa8e1a-7f98-4659-9fb2-3eafe4ca8a2d req-2d2864fe-7ccf-463a-ab0b-072e49ede592 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.766408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-70aa8e1a-7f98-4659-9fb2-3eafe4ca8a2d req-2d2864fe-7ccf-463a-ab0b-072e49ede592 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.772886 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1dfcd42d-6cef-4460-a2ae-5a45cf9056ab tempest-SecurityGroupRulesNegativeTestJSON-356169383 tempest-SecurityGroupRulesNegativeTestJSON-356169383-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/cd6c95b0-d768-44e1-b229-7b01c3ae0e3e" status: 202 len: 0 microversion: 2.1 time: 0.621289 Jul 25 16:18:18.773501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1467/2840] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:18:18 2022] DELETE /compute/v2.1/os-security-groups/cd6c95b0-d768-44e1-b229-7b01c3ae0e3e => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:18.778468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:18.779356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:18.793599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.794294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.800538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.801193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.830606 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] HTTP exception thrown: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:18.836988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-70aa8e1a-7f98-4659-9fb2-3eafe4ca8a2d req-2d2864fe-7ccf-463a-ab0b-072e49ede592 service nova] Creating event network-vif-plugged:cdc27e7d-6c64-4d22-8cf8-468485ab9596 for instance 3cf904be-f686-4f48-8a1f-dd55644b1973 on n-h1-846219-13 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f HTTP/1.1 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0a673cff-0a94-4f74-9d71-4d58a6ef306f'} Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:18.839131 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:18.843485 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:18.848266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 404 to user: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:18.852400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-14e244ff-4d84-47f8-87a7-f488fbc10334 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "DELETE /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 404 len: 111 microversion: 2.1 time: 0.077479 Jul 25 16:18:18.854724 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-70aa8e1a-7f98-4659-9fb2-3eafe4ca8a2d req-2d2864fe-7ccf-463a-ab0b-072e49ede592 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117087 Jul 25 16:18:18.858452 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1374/2841] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:18.858840 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1468/2842] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:18 2022] DELETE /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:18.867622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:18.872752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:18.874933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:18.876304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:18.894535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.895081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.897712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.898450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.954809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.955500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:18.956357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:18.957880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:18.966296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.137849 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e6a38d0-2ede-4ecd-9911-604057d1dcf4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 204 len: 0 microversion: 2.1 time: 0.277178 Jul 25 16:18:19.140243 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1469/2843] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:18 2022] DELETE /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:19.143099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:19.150295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.150946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.151766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lazy-loading 'fault' on Instance uuid ed5f296c-0785-4c9a-a14c-56f011027564 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:18:19.157188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:19.160002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:19.171997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.173709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.174805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.175512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.221408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:19.338242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-025f8f1e-7d53-4342-8c1e-b908845d54a4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "DELETE /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 204 len: 0 microversion: 2.1 time: 0.191480 Jul 25 16:18:19.340560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1470/2844] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:19 2022] DELETE /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:19.360315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:19.364925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 0a673cff-0a94-4f74-9d71-4d58a6ef306f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:19.379599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.380918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.383535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.385166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.418361 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cac06f9e-166e-44ed-8d32-35578093ed80 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1602 microversion: 2.1 time: 0.555418 Jul 25 16:18:19.420933 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1375/2845] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:18 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1602 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:19.436678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] HTTP exception thrown: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f HTTP/1.1 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0a673cff-0a94-4f74-9d71-4d58a6ef306f'} Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:19.438647 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 404 to user: Instance 0a673cff-0a94-4f74-9d71-4d58a6ef306f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0696a98-e892-47d2-9036-86680d4ebaaf tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f" status: 404 len: 111 microversion: 2.1 time: 0.093032 Jul 25 16:18:19.444669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1471/2846] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:19 2022] GET /compute/v2.1/servers/0a673cff-0a94-4f74-9d71-4d58a6ef306f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:18:19.450338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:19.451075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:19.453542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:19.456650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:19.458361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.458817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.459664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.460086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.492804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.495953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.497161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.499293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.650022 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-abfb1c38-1ca4-4dae-ab20-3696c5b3adf2 tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action" status: 202 len: 0 microversion: 2.1 time: 0.211293 Jul 25 16:18:19.651397 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1376/2847] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:18:19 2022] POST /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:18:19.671535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:19.672681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:19.681133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.681757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.682715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.683354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.771378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:19.783781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4314ac83-102c-4a51-8d3f-ed9c7445af92 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1526 microversion: 2.1 time: 0.337949 Jul 25 16:18:19.812620 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1472/2848] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:19 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1526 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:19.818785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:19.820038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:19.827942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.829011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.830698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:19.831732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:19.865325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:20.283292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:20.290392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8f2ca2a-19c6-47b5-bbeb-468400f72aae tempest-ServersAdminTestJSON-2034904778 tempest-ServersAdminTestJSON-2034904778-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1619 microversion: 2.1 time: 0.631762 Jul 25 16:18:20.291071 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1377/2849] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:19 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1619 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:20.304028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-550b2dae-d9a9-4f53-90e4-5a54be9321a4 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.489353 Jul 25 16:18:20.305450 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1473/2850] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:19 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:20.318870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:20.318870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:20.335359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:20.335860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:20.336686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:20.337144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:20.390193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:20.627415 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-85e2e395-8d5d-4f84-a029-0e18ce505f94 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 204 len: 0 microversion: 2.1 time: 0.315022 Jul 25 16:18:20.628090 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1378/2851] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:20 2022] DELETE /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:18:20.639302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:20.640385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:20.659815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:20.660322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:20.671327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:20.672084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:20.823342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:20.825661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:20.848072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:20.848895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:20.850029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:20.850470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:21.293436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:21.305921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-382b6ec6-9f98-4abb-b30e-02e1cbcb446d tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1472 microversion: 2.1 time: 0.671951 Jul 25 16:18:21.317126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1474/2852] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:20 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1472 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:21.334080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:21.334924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:21.342484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:21.342973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:21.344132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:21.344742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:21.373965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:21.387087 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e7a1eab6-5bd2-4810-92ac-cd7a0cc41f90 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1526 microversion: 2.1 time: 0.575246 Jul 25 16:18:21.397148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1379/2853] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:20 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1526 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:18:21.837772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:21.857724 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d3587e9-767e-4a7a-876b-a51c28ba67d8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 0.527308 Jul 25 16:18:21.861288 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1475/2854] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:21 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:22.337143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:22.338575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:22.352610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:22.353392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:22.354864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:22.355504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:22.417322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:22.419492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:22.435310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:22.436809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:22.439331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:22.440493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:23.756278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:23.766880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-547bfa85-f75b-4821-adf6-41be7d24c235 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1472 microversion: 2.1 time: 1.439662 Jul 25 16:18:23.769227 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1380/2855] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:22 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1472 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:23.774611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:23.786098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:23.805752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:23.806497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:23.807474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:23.808069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:24.047154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:24.061776 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3bda1d00-0176-4127-82a2-5e09da0add99 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1526 microversion: 2.1 time: 1.654757 Jul 25 16:18:24.062780 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1476/2856] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:22 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1526 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:24.501530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0062b64e-8ac5-45d0-b531-4c04f46f4d1a req-96310822-4ec6-4218-a3db-5b7c96b6de22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aee42a0-abee-4e87-b7b1-856cd504173e", "name": "network-vif-deleted", "tag": "347e5825-ff44-471c-8fb7-0f01116a1e4a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:24.527059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0062b64e-8ac5-45d0-b531-4c04f46f4d1a req-96310822-4ec6-4218-a3db-5b7c96b6de22 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:24.536131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0062b64e-8ac5-45d0-b531-4c04f46f4d1a req-96310822-4ec6-4218-a3db-5b7c96b6de22 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:24.576906 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0062b64e-8ac5-45d0-b531-4c04f46f4d1a req-96310822-4ec6-4218-a3db-5b7c96b6de22 service nova] Creating event network-vif-deleted:347e5825-ff44-471c-8fb7-0f01116a1e4a for instance 9aee42a0-abee-4e87-b7b1-856cd504173e on n-h2-846219-13 Jul 25 16:18:24.601704 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0062b64e-8ac5-45d0-b531-4c04f46f4d1a req-96310822-4ec6-4218-a3db-5b7c96b6de22 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109485 Jul 25 16:18:24.608946 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1477/2857] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:18:24.811835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:24.822433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:24.833974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:24.851050 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b520db75-2620-4f03-8412-493ebac9a2bb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1370 microversion: 2.1 time: 1.080420 Jul 25 16:18:24.851794 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1381/2858] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:23 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1370 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:24.852662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:24.854602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:24.860090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:24.860855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:25.086869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:25.087607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:25.103869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:25.104355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:25.105234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:25.107798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:25.757862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:25.775557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f5dae993-148f-4a95-816e-ab8098b53ce3 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1472 microversion: 2.1 time: 0.969887 Jul 25 16:18:25.776721 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1478/2859] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:24 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:25.888005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:25.888986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:25.917243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:25.918069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:25.919325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:25.930882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:25.957970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:26.053734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:26.072904 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d8f4451-f64d-4646-a21c-5a491f196eb4 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1526 microversion: 2.1 time: 0.992433 Jul 25 16:18:26.074080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1382/2860] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:25 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1526 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:18:26.799661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:26.801059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:26.804935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:26.814426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:26.815370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:26.816557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:26.817419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:27.290256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:27.309495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-56c6d5bd-d6f0-4e0a-a5f1-24c999dc60df tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1561 microversion: 2.1 time: 1.426735 Jul 25 16:18:27.326254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1479/2861] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:25 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1561 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:18:27.349227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:27.351292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:27.373120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:27.373938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:27.375325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:27.376125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:27.803834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3542a7652a43698af59ef2b5d792d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c1131868ba4d308aff6536e5c4a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:27.829547 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a51ca5e-054f-4ba7-9436-e9c1ab7d78e9 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 200 len: 1484 microversion: 2.1 time: 0.498959 Jul 25 16:18:27.834987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1480/2862] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:27 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 1484 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:27.842130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:27.846104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:27.873345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:27.874021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:27.876074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:27.878090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:27.931815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:27.953615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-458205cf-2315-465c-bad1-143a936ec321 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1472 microversion: 2.1 time: 1.159197 Jul 25 16:18:27.975080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1383/2863] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:26 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1472 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:18:27.981808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-48b534ca-3e77-491f-ae7d-157b6c13c1f0 req-7b6a5e07-3132-40b4-8673-2bead8e9d87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29c02ac-5630-45b5-aa72-87c62deefd77", "name": "network-vif-deleted", "tag": "c2fc2466-d0a4-4c9e-a582-57fc00dc9f63"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:28.002660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-48b534ca-3e77-491f-ae7d-157b6c13c1f0 req-7b6a5e07-3132-40b4-8673-2bead8e9d87e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:28.003463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-48b534ca-3e77-491f-ae7d-157b6c13c1f0 req-7b6a5e07-3132-40b4-8673-2bead8e9d87e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:28.028448 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-48b534ca-3e77-491f-ae7d-157b6c13c1f0 req-7b6a5e07-3132-40b4-8673-2bead8e9d87e service nova] Creating event network-vif-deleted:c2fc2466-d0a4-4c9e-a582-57fc00dc9f63 for instance d29c02ac-5630-45b5-aa72-87c62deefd77 on n-h1-846219-13 Jul 25 16:18:28.045533 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-48b534ca-3e77-491f-ae7d-157b6c13c1f0 req-7b6a5e07-3132-40b4-8673-2bead8e9d87e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068496 Jul 25 16:18:28.047321 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1384/2864] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:28.079187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:28.183495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef3f915f-f29a-47e6-a0f3-759fc090c3e8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.346875 Jul 25 16:18:28.184822 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1481/2865] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:18:27 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-interface => generated 285 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:28.853598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:28.854364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: d29c02ac-5630-45b5-aa72-87c62deefd77] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:28.868168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:28.868630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:28.872153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:28.872594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:28.898865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:28.945592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] HTTP exception thrown: Instance d29c02ac-5630-45b5-aa72-87c62deefd77 could not be found. Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 HTTP/1.1 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d29c02ac-5630-45b5-aa72-87c62deefd77 could not be found. Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd29c02ac-5630-45b5-aa72-87c62deefd77'} Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29c02ac-5630-45b5-aa72-87c62deefd77 could not be found. Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29c02ac-5630-45b5-aa72-87c62deefd77 could not be found. Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:28.953496 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29c02ac-5630-45b5-aa72-87c62deefd77 could not be found. Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 404 to user: Instance d29c02ac-5630-45b5-aa72-87c62deefd77 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:28.962739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5521a8c2-25c7-421e-84c8-64e178cc8b17 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77" status: 404 len: 111 microversion: 2.1 time: 0.106818 Jul 25 16:18:28.967867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:28.970073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] [instance: 9aee42a0-abee-4e87-b7b1-856cd504173e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:28.972390 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1385/2866] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:28 2022] GET /compute/v2.1/servers/d29c02ac-5630-45b5-aa72-87c62deefd77 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:28.982643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:28.983365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:28.991163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:28.994172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:28.997920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:29.003366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:29.019740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:29.020296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:29.027799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:29.045737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:29.072924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] HTTP exception thrown: Instance 9aee42a0-abee-4e87-b7b1-856cd504173e could not be found. Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Request method failure captured: Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e HTTP/1.1 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sINMKj-KuWkW0d-EWKmDLVZzysBm1sCW5NNHUiAdRzTZCYXAarD8OCWDGy8Dr3vj9a6EJynx20emZ_TcqujJmpsFFjmlVAkzzCmY-2NAcni4lPAjh9VaxMobqdO-mwITgaC4iXOIlTJFwSWB3cq6aMOMy1t7DOz5-klOKxUqjdRSUs Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/31c1131868ba4d308aff6536e5c4a8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_31c1131868ba4d308aff6536e5c4a8ab"}]}] Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 31c1131868ba4d308aff6536e5c4a8ab Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1318152850 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 6d3542a7652a43698af59ef2b5d792d9 Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServersNegativeTestJSON-1318152850-project Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 9aee42a0-abee-4e87-b7b1-856cd504173e could not be found. Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '9aee42a0-abee-4e87-b7b1-856cd504173e'} Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aee42a0-abee-4e87-b7b1-856cd504173e could not be found. Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aee42a0-abee-4e87-b7b1-856cd504173e could not be found. Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:29.075454 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aee42a0-abee-4e87-b7b1-856cd504173e could not be found. Jul 25 16:18:29.080117 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:18:29.082684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] Returning 404 to user: Instance 9aee42a0-abee-4e87-b7b1-856cd504173e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:29.084239 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b997c272-521a-4144-a2dd-771e2f5ff751 tempest-ListServersNegativeTestJSON-1318152850 tempest-ListServersNegativeTestJSON-1318152850-project] 10.222.0.105 "GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e" status: 404 len: 111 microversion: 2.1 time: 0.123548 Jul 25 16:18:29.085501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1482/2867] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:28 2022] GET /compute/v2.1/servers/9aee42a0-abee-4e87-b7b1-856cd504173e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:29.187789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:29.188563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:29.189251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lazy-loading 'fault' on Instance uuid ff738b41-10e1-4002-bc15-02f562e1e707 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:18:29.666507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:29.676468 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc15c3f9-d3b0-4999-b905-d9ae02ef1277 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 200 len: 1307 microversion: 2.1 time: 0.697812 Jul 25 16:18:29.678318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1386/2868] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:28 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 1307 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:18:30.110890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-98c52bd8-b1a8-47ac-9cb6-079e6117f88e req-009200d6-9ab2-4980-b9f4-8f36203517cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff738b41-10e1-4002-bc15-02f562e1e707", "name": "network-vif-deleted", "tag": "a2aef440-40c1-46b9-9ebc-d1dc9c07bdc8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:30.125826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:30.141051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-98c52bd8-b1a8-47ac-9cb6-079e6117f88e req-009200d6-9ab2-4980-b9f4-8f36203517cc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:30.141891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-98c52bd8-b1a8-47ac-9cb6-079e6117f88e req-009200d6-9ab2-4980-b9f4-8f36203517cc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:30.185532 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-98c52bd8-b1a8-47ac-9cb6-079e6117f88e req-009200d6-9ab2-4980-b9f4-8f36203517cc service nova] Creating event network-vif-deleted:a2aef440-40c1-46b9-9ebc-d1dc9c07bdc8 for instance ff738b41-10e1-4002-bc15-02f562e1e707 on n-h1-846219-13 Jul 25 16:18:30.191697 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-98c52bd8-b1a8-47ac-9cb6-079e6117f88e req-009200d6-9ab2-4980-b9f4-8f36203517cc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085356 Jul 25 16:18:30.193154 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1483/2869] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:30.715669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:30.716614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ff738b41-10e1-4002-bc15-02f562e1e707] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:30.730751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:30.731206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:30.732011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:30.732464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] HTTP exception thrown: Instance ff738b41-10e1-4002-bc15-02f562e1e707 could not be found. Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Request method failure captured: Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 HTTP/1.1 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sGWSvgxYLONZM2tAeb1JZxAe7XrhXx9zWXRLjS41YHJQZh42Xk5nvf8I4uXLlfAeeXqphRAtNBEmmuIlhQRS-LoT45oZl2OvG1hndv12MC6ZXORPIJLHaIQxzFR80tWbu7jMiLFnri6y2-6hS4dUXr4R1w5UXXzfvICwAfFKM60_TI Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 959f5a2108434bf58ee07e6126258124 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/959f5a2108434bf58ee07e6126258124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/959f5a2108434bf58ee07e6126258124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/959f5a2108434bf58ee07e6126258124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_959f5a2108434bf58ee07e6126258124"}]}] Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 959f5a2108434bf58ee07e6126258124 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminTestJSON-920077167-project Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c27015dd9c294b0fb05d8c555fe57362 Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminTestJSON-920077167-project Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance ff738b41-10e1-4002-bc15-02f562e1e707 could not be found. Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'ff738b41-10e1-4002-bc15-02f562e1e707'} Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff738b41-10e1-4002-bc15-02f562e1e707 could not be found. Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:30.805993 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff738b41-10e1-4002-bc15-02f562e1e707 could not be found. Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff738b41-10e1-4002-bc15-02f562e1e707 could not be found. Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Returning 404 to user: Instance ff738b41-10e1-4002-bc15-02f562e1e707 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84ed74b0-c43c-41bc-a8d0-f0a2bed73750 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707" status: 404 len: 111 microversion: 2.1 time: 0.103261 Jul 25 16:18:30.813122 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1387/2870] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:30 2022] GET /compute/v2.1/servers/ff738b41-10e1-4002-bc15-02f562e1e707 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:30.819861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:30.820135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:30.852464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:30.853033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:30.857004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:30.857814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:30.938694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:31.256078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-58b971ae-83d3-4374-a241-2ee98e15318c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "DELETE /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 204 len: 0 microversion: 2.1 time: 0.441397 Jul 25 16:18:31.260637 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1484/2871] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:30 2022] DELETE /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:31.275295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:31.276221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:31.295904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:31.296658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:31.297794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:31.298519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:32.193814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:32.216045 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c10add9-4602-4fa8-90bb-5a78fe1aec54 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1474 microversion: 2.1 time: 0.950726 Jul 25 16:18:32.261484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1388/2872] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:31 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1474 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:33.286027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:33.287969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:33.314142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:33.315403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:33.317842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:33.318942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:33.886217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ac91370b-6019-49c9-82b6-bde629c8203f req-381b6077-ff76-4338-94c4-d14880975254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf904be-f686-4f48-8a1f-dd55644b1973", "tag": "cdc27e7d-6c64-4d22-8cf8-468485ab9596"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:33.936033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ac91370b-6019-49c9-82b6-bde629c8203f req-381b6077-ff76-4338-94c4-d14880975254 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:33.941039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ac91370b-6019-49c9-82b6-bde629c8203f req-381b6077-ff76-4338-94c4-d14880975254 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:33.978670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ac91370b-6019-49c9-82b6-bde629c8203f req-381b6077-ff76-4338-94c4-d14880975254 service nova] Creating event network-changed:cdc27e7d-6c64-4d22-8cf8-468485ab9596 for instance 3cf904be-f686-4f48-8a1f-dd55644b1973 on n-h1-846219-13 Jul 25 16:18:33.988768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ac91370b-6019-49c9-82b6-bde629c8203f req-381b6077-ff76-4338-94c4-d14880975254 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124665 Jul 25 16:18:33.989900 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1389/2873] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:34.427234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:34.439154 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4b444fbc-7f33-4ff5-8edc-e97a3a4fa25b tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1474 microversion: 2.1 time: 1.162516 Jul 25 16:18:34.445986 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1485/2874] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:33 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1474 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:35.481469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:35.483204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:35.508488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:35.512651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:35.513918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:35.514600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:35.819924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:35.832924 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5fe70ad0-642a-4b76-9e82-0398c09e0446 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 200 len: 1432 microversion: 2.1 time: 0.360221 Jul 25 16:18:35.834501 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1390/2875] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:35 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 1432 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:36.075853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-930e8764-6cec-4149-bf82-3f8755a0fbfd req-66516ef9-cd18-40b7-a815-ad30a42478d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db0aa9e-0897-4142-b8c1-03b4f979f863", "name": "network-vif-deleted", "tag": "2c61b534-2639-48ec-833f-eb2807c3a5a5"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:36.119881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-930e8764-6cec-4149-bf82-3f8755a0fbfd req-66516ef9-cd18-40b7-a815-ad30a42478d1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:36.120588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-930e8764-6cec-4149-bf82-3f8755a0fbfd req-66516ef9-cd18-40b7-a815-ad30a42478d1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:36.167398 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-930e8764-6cec-4149-bf82-3f8755a0fbfd req-66516ef9-cd18-40b7-a815-ad30a42478d1 service nova] Creating event network-vif-deleted:2c61b534-2639-48ec-833f-eb2807c3a5a5 for instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 on n-h2-846219-13 Jul 25 16:18:36.180760 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-930e8764-6cec-4149-bf82-3f8755a0fbfd req-66516ef9-cd18-40b7-a815-ad30a42478d1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111048 Jul 25 16:18:36.183027 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1486/2876] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:36.862142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:36.863111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: 0db0aa9e-0897-4142-b8c1-03b4f979f863] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:36.878885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:36.879490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:36.880295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:36.880734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:36.920705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] HTTP exception thrown: Instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 could not be found. Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Request method failure captured: Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 HTTP/1.1 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sGWSvgxYLONZM2tAeb1JZxAe7XrhXx9zWXRLjS41YHJQZh42Xk5nvf8I4uXLlfAeeXqphRAtNBEmmuIlhQRS-LoT45oZl2OvG1hndv12MC6ZXORPIJLHaIQxzFR80tWbu7jMiLFnri6y2-6hS4dUXr4R1w5UXXzfvICwAfFKM60_TI Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 959f5a2108434bf58ee07e6126258124 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/959f5a2108434bf58ee07e6126258124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/959f5a2108434bf58ee07e6126258124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/959f5a2108434bf58ee07e6126258124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_959f5a2108434bf58ee07e6126258124"}]}] Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 959f5a2108434bf58ee07e6126258124 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminTestJSON-920077167-project Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c27015dd9c294b0fb05d8c555fe57362 Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminTestJSON-920077167-project Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 could not be found. Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '0db0aa9e-0897-4142-b8c1-03b4f979f863'} Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 could not be found. Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 could not be found. Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:36.923875 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 could not be found. Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Returning 404 to user: Instance 0db0aa9e-0897-4142-b8c1-03b4f979f863 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81823fd0-ad7c-420e-adc9-f84def7ab41c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863" status: 404 len: 111 microversion: 2.1 time: 0.068269 Jul 25 16:18:36.928937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1391/2877] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:36 2022] GET /compute/v2.1/servers/0db0aa9e-0897-4142-b8c1-03b4f979f863 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:18:36.936204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:36.936812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:36.947659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:36.948123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:36.948932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:36.949398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:36.983634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:18:37.124499 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b3ffe9c-b823-467c-a03c-46db2b85c72c tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 204 len: 0 microversion: 2.1 time: 0.191844 Jul 25 16:18:37.138112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:37.140282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:37.143477 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1487/2878] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:18:36 2022] DELETE /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:18:37.157177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:37.158149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:37.159203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:37.162958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:37.959983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:37.977967 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c56788fe-8d58-467d-a766-8d4ea6e0695f tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1472 microversion: 2.1 time: 0.845512 Jul 25 16:18:37.978570 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1392/2879] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:37 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1472 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:39.000779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:39.001589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:39.014666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:39.027040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:39.028316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:39.032958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:39.687557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:39.712616 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-301fef08-4c77-427a-9ae3-702210aad1a0 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1472 microversion: 2.1 time: 0.715789 Jul 25 16:18:39.730672 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1488/2880] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:38 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1472 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:40.580183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-88822ec9-8175-4684-911f-8d0ffbff7f1f req-d3834685-584a-4ce0-884e-ad1646ef32c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5f296c-0785-4c9a-a14c-56f011027564", "name": "network-vif-deleted", "tag": "f91a4fdf-06f3-4d42-aee7-f6892cec218d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:40.601644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-88822ec9-8175-4684-911f-8d0ffbff7f1f req-d3834685-584a-4ce0-884e-ad1646ef32c4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:40.603898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-88822ec9-8175-4684-911f-8d0ffbff7f1f req-d3834685-584a-4ce0-884e-ad1646ef32c4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:40.621487 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-88822ec9-8175-4684-911f-8d0ffbff7f1f req-d3834685-584a-4ce0-884e-ad1646ef32c4 service nova] Creating event network-vif-deleted:f91a4fdf-06f3-4d42-aee7-f6892cec218d for instance ed5f296c-0785-4c9a-a14c-56f011027564 on n-h1-846219-13 Jul 25 16:18:40.636404 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-88822ec9-8175-4684-911f-8d0ffbff7f1f req-d3834685-584a-4ce0-884e-ad1646ef32c4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078794 Jul 25 16:18:40.639234 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1393/2881] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:40.765739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:40.768057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:40.793682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:40.794718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:40.796513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:40.797192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:40.838256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:40.855775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:40.857855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:40.858529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lazy-loading 'fault' on Instance uuid ed5f296c-0785-4c9a-a14c-56f011027564 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:18:41.000231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27015dd9c294b0fb05d8c555fe57362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959f5a2108434bf58ee07e6126258124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:41.015781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9815e3b-2a81-4211-9004-241b6458bc60 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 200 len: 1307 microversion: 2.1 time: 0.261231 Jul 25 16:18:41.017501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1489/2882] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:40 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 1307 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:42.044247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:42.045677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] [instance: ed5f296c-0785-4c9a-a14c-56f011027564] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:42.064463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:42.065359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:42.066475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:42.067766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:42.099052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] HTTP exception thrown: Instance ed5f296c-0785-4c9a-a14c-56f011027564 could not be found. Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Request method failure captured: Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 HTTP/1.1 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sGWSvgxYLONZM2tAeb1JZxAe7XrhXx9zWXRLjS41YHJQZh42Xk5nvf8I4uXLlfAeeXqphRAtNBEmmuIlhQRS-LoT45oZl2OvG1hndv12MC6ZXORPIJLHaIQxzFR80tWbu7jMiLFnri6y2-6hS4dUXr4R1w5UXXzfvICwAfFKM60_TI Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 959f5a2108434bf58ee07e6126258124 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/959f5a2108434bf58ee07e6126258124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/959f5a2108434bf58ee07e6126258124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/959f5a2108434bf58ee07e6126258124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_959f5a2108434bf58ee07e6126258124"}]}] Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 959f5a2108434bf58ee07e6126258124 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminTestJSON-920077167 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminTestJSON-920077167-project Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c27015dd9c294b0fb05d8c555fe57362 Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminTestJSON-920077167-project Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance ed5f296c-0785-4c9a-a14c-56f011027564 could not be found. Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'ed5f296c-0785-4c9a-a14c-56f011027564'} Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5f296c-0785-4c9a-a14c-56f011027564 could not be found. Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5f296c-0785-4c9a-a14c-56f011027564 could not be found. Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:18:42.100892 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5f296c-0785-4c9a-a14c-56f011027564 could not be found. Jul 25 16:18:42.105200 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:18:42.107360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] Returning 404 to user: Instance ed5f296c-0785-4c9a-a14c-56f011027564 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:18:42.108549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-859d2436-9893-4a70-9989-0df515024ff7 tempest-ServersAdminTestJSON-920077167 tempest-ServersAdminTestJSON-920077167-project] 10.222.0.105 "GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564" status: 404 len: 111 microversion: 2.1 time: 0.068556 Jul 25 16:18:42.112520 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1394/2883] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:42 2022] GET /compute/v2.1/servers/ed5f296c-0785-4c9a-a14c-56f011027564 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:18:48.250743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:48.251608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:48.281194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:48.283047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:48.285392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:48.291519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:48.723587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:48.732222 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8adc1d4-762b-4eae-9b9b-92bcddece500 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.489644 Jul 25 16:18:48.732841 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1490/2884] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:48 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:48.757422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:48.758177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:48.785176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:48.785176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:48.785176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:48.790991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:49.168087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:49.179284 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d292478b-f6a1-4d67-be56-6fe339694db7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.425885 Jul 25 16:18:49.200690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1395/2885] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:48 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:49.209775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:49.210854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:49.227375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:49.227841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:49.228729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:49.229521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:49.522483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:49.539090 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c640282d-077c-439d-8559-6a1abe018134 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.335967 Jul 25 16:18:49.540093 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1491/2886] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:49 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:49.564609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1058600600"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:49.569277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:49.601286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:49.606498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:49.608152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:49.609579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:49.610228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:50.163242 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3feefefe-bb2f-4a18-8daf-fc703bd1b96e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.604609 Jul 25 16:18:50.165052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1396/2887] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:18:49 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Jul 25 16:18:51.411352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-583760263", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:18:51.542784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:18:52.416934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:18:52.417828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:18:52.418432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:18:52.418948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:18:52.419483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:18:52.462645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:52.467878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:52.470918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:52.478961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:52.548574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Getting quotas for project a8056e2216b24a9b92f7143f0660956b. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:18:52.564694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Getting quotas for user a7cd4c3e36314b4eb141cd3a672c3b0a and project a8056e2216b24a9b92f7143f0660956b. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:18:52.628122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:18:52.634396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:18:52.756131 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de59af85-83c4-4f37-accb-be3d3c3b4528 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.847237 Jul 25 16:18:52.762982 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1492/2888] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:18:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:18:52.775486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4edf81fd-78e5-48f0-a49e-752aafa6d707 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:52.776279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4edf81fd-78e5-48f0-a49e-752aafa6d707 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:53.043538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4edf81fd-78e5-48f0-a49e-752aafa6d707 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:53.072519 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4edf81fd-78e5-48f0-a49e-752aafa6d707 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1225 microversion: 2.1 time: 0.302362 Jul 25 16:18:53.086638 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1397/2889] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:52 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1225 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:54.097728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53703d3e-f91d-442f-a3b9-5816b70a0519 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:54.099258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53703d3e-f91d-442f-a3b9-5816b70a0519 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:54.503312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53703d3e-f91d-442f-a3b9-5816b70a0519 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:54.572291 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53703d3e-f91d-442f-a3b9-5816b70a0519 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1225 microversion: 2.1 time: 0.480848 Jul 25 16:18:54.577415 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1493/2890] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:54 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1225 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:55.611213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:55.612779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:55.636594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:55.638449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:55.642009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:55.643288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:56.374344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:56.389804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e7dfb42-80f5-4c22-95e6-babbcf647dd5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1295 microversion: 2.1 time: 0.782821 Jul 25 16:18:56.392532 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1398/2891] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:55 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1295 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:57.424869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:57.426355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:57.442948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:57.444578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:57.447050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:57.447701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:57.615554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:57.639949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6f3b386-f643-4752-8b29-0a2aa30d87e4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1283 microversion: 2.1 time: 0.218243 Jul 25 16:18:57.641288 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1494/2892] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:57 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1283 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:58.686418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:58.687850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:18:58.704564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:58.706798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:58.708778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:18:58.710590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:18:58.950429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:18:58.996716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0471c1b-f089-4f84-b8f5-d28b5fe6a79b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1283 microversion: 2.1 time: 0.316708 Jul 25 16:18:58.997862 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1399/2893] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:18:58 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1283 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:00.068997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:00.070593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:00.102251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:00.103176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:00.104140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:00.104664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:01.452158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:01.507009 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fabfd457-065c-432c-8bc8-bffc0ef08c95 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 1.468702 Jul 25 16:19:01.536294 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1495/2894] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:00 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:02.547040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:02.549812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:02.614498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:02.616364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:02.619627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:02.620461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:02.633030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:02.872689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:03.052201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:03.929131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-34eea61e-7594-436c-8bc1-58a6e36dcb43 req-09c45f0f-7bba-49a0-9772-23e82c33bd57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-plugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:03.961835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:03.980210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-34eea61e-7594-436c-8bc1-58a6e36dcb43 req-09c45f0f-7bba-49a0-9772-23e82c33bd57 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:03.980697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-34eea61e-7594-436c-8bc1-58a6e36dcb43 req-09c45f0f-7bba-49a0-9772-23e82c33bd57 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:04.119127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:04.141825 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4491d33-8d24-4158-8bf0-fa5c51955850 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 1.589159 Jul 25 16:19:04.143541 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-34eea61e-7594-436c-8bc1-58a6e36dcb43 req-09c45f0f-7bba-49a0-9772-23e82c33bd57 service nova] Creating event network-vif-plugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:19:04.144444 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1400/2895] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:02 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:04.199225 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-34eea61e-7594-436c-8bc1-58a6e36dcb43 req-09c45f0f-7bba-49a0-9772-23e82c33bd57 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.348052 Jul 25 16:19:04.207293 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1496/2896] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:05.170938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:05.172342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:05.196457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:05.218866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:05.223822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:05.225383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:06.297905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:06.307658 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21238f67-ef2b-405d-b842-2262a507f55c tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 1.141666 Jul 25 16:19:06.314730 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1401/2897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:05 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:06.761676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:07.248682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a0836546-13a8-4696-b989-513b2eaa788f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d92980040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1995068084", "description": "tempest-description-450682780"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:07.335964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:07.338465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:07.369845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:07.372623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:07.381211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:07.384158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:09.014923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:09.028463 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10b53af7-7d33-418e-8613-076af589bae9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 1.697153 Jul 25 16:19:09.054816 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1402/2898] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:07 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:09.565390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bf795cf4-6092-4f76-a677-c5aa0203cdff req-b2b8862e-0a33-4bb7-983c-69da00a42c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177a0689-fe36-400d-8854-8254202549f6", "tag": "d3b43cd0-a1e0-4de7-aba6-15a1c467a210"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:09.613456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bf795cf4-6092-4f76-a677-c5aa0203cdff req-b2b8862e-0a33-4bb7-983c-69da00a42c9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:09.626894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bf795cf4-6092-4f76-a677-c5aa0203cdff req-b2b8862e-0a33-4bb7-983c-69da00a42c9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:09.714735 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bf795cf4-6092-4f76-a677-c5aa0203cdff req-b2b8862e-0a33-4bb7-983c-69da00a42c9b service nova] Creating event network-changed:d3b43cd0-a1e0-4de7-aba6-15a1c467a210 for instance 177a0689-fe36-400d-8854-8254202549f6 on n-h2-846219-13 Jul 25 16:19:09.755305 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bf795cf4-6092-4f76-a677-c5aa0203cdff req-b2b8862e-0a33-4bb7-983c-69da00a42c9b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185676 Jul 25 16:19:09.763059 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1403/2899] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:10.078862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:10.085527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:10.136836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:10.146539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:10.157789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:10.159838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:10.437318 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a0836546-13a8-4696-b989-513b2eaa788f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.703460 Jul 25 16:19:10.448553 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1497/2900] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:19:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:10.460514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81f2d795-26a1-44db-b854-c4ff0b62e5e6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d93853820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-892842131", "description": "tempest-description-712446410"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:11.427475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:11.439749 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4a51295-42e7-4fd6-b485-f9f08bf247d5 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 1.381217 Jul 25 16:19:11.453124 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1404/2901] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:10 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:11.685655 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81f2d795-26a1-44db-b854-c4ff0b62e5e6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.235322 Jul 25 16:19:11.686910 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1498/2902] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:19:10 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:11.790176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1653051372", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "bc55adf3-2eb0-4513-90ea-bd718828a6db"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:12.606009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1453976213", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "abffa439-0b7e-47fa-a065-401d5f2e4107"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:14.128947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=32 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:21.436096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=25 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:21.826116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=21 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:22.674843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:27.057962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] validate_networks() for [('abffa439-0b7e-47fa-a065-401d5f2e4107', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:19:27.076892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] validate_networks() for [('bc55adf3-2eb0-4513-90ea-bd718828a6db', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:19:28.475944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:19:28.477748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:19:28.478319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:19:28.478676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:19:28.481347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:19:28.523649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:28.528865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:28.531208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:28.537965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:28.614951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Getting quotas for project 1386c86aa05447c9b6c0fc23e6bc3363. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:19:28.622564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Getting quotas for user 2bb63f23a2284170a095a7dbf23fb9a7 and project 1386c86aa05447c9b6c0fc23e6bc3363. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:19:28.656292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:19:28.668763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:19:28.680881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:19:28.684464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:19:28.685936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:19:28.686541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:19:28.688332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:19:28.774804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:28.788333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:28.792798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:28.794894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:28.875672 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8b21494-d4ed-4b82-9e98-f0778772a346 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 16.507674 Jul 25 16:19:28.877972 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1499/2903] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:19:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 16512 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:19:28.885427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Getting quotas for project fe557f25c6cd4c3d806cfb25a2408c02. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:19:28.892063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:28.903284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Getting quotas for user 1834237759744f1f9c512cbeabfc56fc and project fe557f25c6cd4c3d806cfb25a2408c02. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:19:28.934834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:28.937454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:19:28.940807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:19:28.960728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:28.976895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:28.978300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:28.979295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:29.043922 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3386879f-3b0e-469b-9952-eb9bd1a76e15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 17.256880 Jul 25 16:19:29.046605 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1405/2904] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:19:11 2022] POST /compute/v2.1/servers => generated 382 bytes in 17262 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:19:29.312131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:29.322135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c490e7fa-1719-4039-95f8-7f803bea7c6e tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 0.434409 Jul 25 16:19:29.322737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1500/2905] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:28 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:29.339974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:29.340601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:29.361224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:29.363164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:29.363988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:29.364419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:29.398864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f48292e-921d-4010-a8c0-0bb79225600d tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Action: 'create', calling method: .version_select at 0x7f9d930de280>, body: {"keypair": {"name": "tempest-keypair-1209624962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELtQWfxbMOxc0MdKPu657AnkR3QVLFOyKnUAwVEzaE2IrsqNVz4lwEOOgRdsjY34XS/AacTuFUyh/Bu5Vv72BUn2JUNJqx7cEu3wE+UITN+/3H5SNDUZTt+C9iYc7yqpg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:29.494278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-5f48292e-921d-4010-a8c0-0bb79225600d tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Getting quotas for project 571268d62a5349cc898193a8c27d0f21. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:19:29.513899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-5f48292e-921d-4010-a8c0-0bb79225600d tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Getting quotas for user a1d0ef72b53042069e269d9cdada90b5 and project 571268d62a5349cc898193a8c27d0f21. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:19:29.606566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f48292e-921d-4010-a8c0-0bb79225600d tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.552945 Jul 25 16:19:29.619708 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1406/2906] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:19:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:29.646779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e020572e-7715-4172-ae7c-bb04f07da8c4 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:29.650525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e020572e-7715-4172-ae7c-bb04f07da8c4 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:30.008081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e020572e-7715-4172-ae7c-bb04f07da8c4 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:30.022493 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e020572e-7715-4172-ae7c-bb04f07da8c4 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1221 microversion: 2.1 time: 0.399783 Jul 25 16:19:30.026076 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1407/2907] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:29 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1221 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:30.070811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3489f0a7-7b5b-4739-9a8a-8023a94389fe tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:30.072791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3489f0a7-7b5b-4739-9a8a-8023a94389fe tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:30.709010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3489f0a7-7b5b-4739-9a8a-8023a94389fe tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:30.733470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3489f0a7-7b5b-4739-9a8a-8023a94389fe tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1220 microversion: 2.1 time: 0.702569 Jul 25 16:19:30.734499 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1408/2908] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:30 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1220 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:30.753973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3b1c3b83-9688-4ef3-847f-6f78aa63a534 req-13d06237-0aeb-4958-9b0d-56606f89e39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177a0689-fe36-400d-8854-8254202549f6", "name": "network-vif-plugged", "status": "completed", "tag": "d3b43cd0-a1e0-4de7-aba6-15a1c467a210"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:30.789927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:30.804875 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3386e798-a23b-4d92-9fb3-5259ae1be8cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.479436 Jul 25 16:19:30.805760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1501/2909] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:29 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:30.825861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:30.826593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3b1c3b83-9688-4ef3-847f-6f78aa63a534 req-13d06237-0aeb-4958-9b0d-56606f89e39c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:30.827153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:30.827308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3b1c3b83-9688-4ef3-847f-6f78aa63a534 req-13d06237-0aeb-4958-9b0d-56606f89e39c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:30.835919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:30.836691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:30.837938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:30.838567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:30.854728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3b1c3b83-9688-4ef3-847f-6f78aa63a534 req-13d06237-0aeb-4958-9b0d-56606f89e39c service nova] Creating event network-vif-plugged:d3b43cd0-a1e0-4de7-aba6-15a1c467a210 for instance 177a0689-fe36-400d-8854-8254202549f6 on n-h2-846219-13 Jul 25 16:19:30.864588 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3b1c3b83-9688-4ef3-847f-6f78aa63a534 req-13d06237-0aeb-4958-9b0d-56606f89e39c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128527 Jul 25 16:19:30.869788 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1409/2910] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:30.885689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1801088591"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:30.893130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:30.911565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:30.912031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:30.915269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:30.915736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:31.306440 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f09661dd-cc54-47ce-b6c6-c82df6e68b66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.432287 Jul 25 16:19:31.309000 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1410/2911] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:19:30 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Jul 25 16:19:31.359235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:31.363462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:31.392009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:31.392799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:31.404231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:31.424088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:31.700354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:31.724746 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2185b32f-650e-4bb2-9c79-cbbccdc6dbb5 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1281 microversion: 2.1 time: 0.412684 Jul 25 16:19:31.741000 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1411/2912] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:31 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1281 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:31.763281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:31.764182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:31.776370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:31.777521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:31.779134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:31.779909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:32.834393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:32.847684 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-edd1cc42-78ab-46b9-9859-958682b37cd2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1280 microversion: 2.1 time: 1.090477 Jul 25 16:19:32.849206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1412/2913] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:31 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1280 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:32.858002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:32.859133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:32.872568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:32.872568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:32.874280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:32.875095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:33.077247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:33.105265 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-717b774b-d2b0-4b7e-b74b-d69306f9bac6 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1279 microversion: 2.1 time: 0.254149 Jul 25 16:19:33.105895 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1413/2914] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:32 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1279 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:33.115609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4e409957-df05-4b57-a21f-0f3298bd88f6 req-4cf23c14-4d4d-48ab-88fc-110a19c4654f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-unplugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:33.128298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4e409957-df05-4b57-a21f-0f3298bd88f6 req-4cf23c14-4d4d-48ab-88fc-110a19c4654f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:33.129423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4e409957-df05-4b57-a21f-0f3298bd88f6 req-4cf23c14-4d4d-48ab-88fc-110a19c4654f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:33.145031 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4e409957-df05-4b57-a21f-0f3298bd88f6 req-4cf23c14-4d4d-48ab-88fc-110a19c4654f service nova] Creating event network-vif-unplugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:19:33.154117 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4e409957-df05-4b57-a21f-0f3298bd88f6 req-4cf23c14-4d4d-48ab-88fc-110a19c4654f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043801 Jul 25 16:19:33.155483 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1414/2915] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:33.232046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:33.248929 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30c8ef80-a485-479d-a43f-094c996bc1dd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 2.441850 Jul 25 16:19:33.250233 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1502/2916] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:30 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:33.871314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:33.872039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:33.896323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:33.897031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:33.904688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:33.905561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:34.128912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:34.134777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:34.146059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:34.147147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:34.148172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:34.149197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:34.241025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:34.258973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc07f700-5f44-419b-a894-6901177ad55b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1278 microversion: 2.1 time: 0.392590 Jul 25 16:19:34.259962 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1415/2917] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:33 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1278 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:34.271271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:34.271895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:34.291164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:34.297515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:34.298529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:34.298980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:34.313158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:34.334208 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b4c8938-d9ec-40f7-89f9-5395a88294eb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1279 microversion: 2.1 time: 0.207750 Jul 25 16:19:34.335050 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1503/2918] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:34 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:34.886015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:34.894952 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89b5a90f-d617-453b-92a4-fc20434a07d0 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1325 microversion: 2.1 time: 0.627421 Jul 25 16:19:34.905838 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1416/2919] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:34 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1325 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:35.283898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:35.284861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:35.298970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:35.299764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:35.300802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:35.301470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:35.372496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:35.373456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:35.388098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:35.388773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:35.389785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:35.390418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:35.746755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:35.755916 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a453670-7b22-4d0a-927c-40f753a3332f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 0.475812 Jul 25 16:19:35.759210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1504/2920] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:35 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:35.861628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:35.872020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48a70dc1-a286-42bb-a671-4d1591879c47 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 0.503518 Jul 25 16:19:35.876912 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1417/2921] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:35 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:35.946475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:35.947401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:35.955750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:35.956595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:35.959647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:35.960211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:36.394751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:36.417658 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d51b2ca3-898a-4936-adf8-734c9ff3939d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1474 microversion: 2.1 time: 0.468055 Jul 25 16:19:36.419283 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1505/2922] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:35 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1474 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:36.620792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84c5666a-0295-46e4-be54-f83e5659a213 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:36.622720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84c5666a-0295-46e4-be54-f83e5659a213 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] [instance: e3b8ba09-1dee-425e-96fa-9598cbbe0fe4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:36.631093 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-84c5666a-0295-46e4-be54-f83e5659a213 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] HTTP exception thrown: Instance e3b8ba09-1dee-425e-96fa-9598cbbe0fe4 could not be found. Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84c5666a-0295-46e4-be54-f83e5659a213 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Request method failure captured: Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/e3b8ba09-1dee-425e-96fa-9598cbbe0fe4/action HTTP/1.1 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 15 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJqP73ZcKHRkDLgIs0K5CnR7kQTR4NcHaSxNo16sV73rHpkWTF4niC6mJ1sLO9pYyGIG5AQil52KlcXR7yqZRcezXyXAkXJkPn6UMkCTDXBAb-FK-09tfEAPPJe4zmDB8Ye-WjnxAqjah_MHyzPjzmxS1Tgq1nctnDoHPFYUsOBxeQ Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21878844f61740689497402cad1ec059 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21878844f61740689497402cad1ec059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21878844f61740689497402cad1ec059"}]}] Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21878844f61740689497402cad1ec059 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a20aa1b94f5449228ec406faffc3d710 Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: {"migrate": {}} Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance e3b8ba09-1dee-425e-96fa-9598cbbe0fe4 could not be found. Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'e3b8ba09-1dee-425e-96fa-9598cbbe0fe4', 'body': {'migrate': {}}} Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b8ba09-1dee-425e-96fa-9598cbbe0fe4 could not be found. Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b8ba09-1dee-425e-96fa-9598cbbe0fe4 could not be found. Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:19:36.633043 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b8ba09-1dee-425e-96fa-9598cbbe0fe4 could not be found. Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:19:36.638332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84c5666a-0295-46e4-be54-f83e5659a213 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Returning 404 to user: Instance e3b8ba09-1dee-425e-96fa-9598cbbe0fe4 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:19:36.642184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84c5666a-0295-46e4-be54-f83e5659a213 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/e3b8ba09-1dee-425e-96fa-9598cbbe0fe4/action" status: 404 len: 111 microversion: 2.1 time: 0.202302 Jul 25 16:19:36.658923 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1418/2923] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:19:36 2022] POST /compute/v2.1/servers/e3b8ba09-1dee-425e-96fa-9598cbbe0fe4/action => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:19:36.783318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:36.784197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:36.797843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:36.799370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:36.807726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:36.808815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:36.868644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1268182140", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:36.969898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:19:37.346377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:37.359438 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38d30f36-32d7-4be3-98d8-4696509059ac tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 0.580696 Jul 25 16:19:37.360513 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1506/2924] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:36 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:37.378642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1980955a-f55a-49a8-8ad2-34fc1b2eba94 req-c62164f9-1df6-482d-9e0e-ff985452ff0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a767be8e-a4fe-4edd-9dae-a502891200dc", "tag": "3d6ffc83-7855-443b-a9f0-97039c2179ab"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:37.397956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1980955a-f55a-49a8-8ad2-34fc1b2eba94 req-c62164f9-1df6-482d-9e0e-ff985452ff0a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:37.398630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1980955a-f55a-49a8-8ad2-34fc1b2eba94 req-c62164f9-1df6-482d-9e0e-ff985452ff0a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:37.423730 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1980955a-f55a-49a8-8ad2-34fc1b2eba94 req-c62164f9-1df6-482d-9e0e-ff985452ff0a service nova] Creating event network-changed:3d6ffc83-7855-443b-a9f0-97039c2179ab for instance a767be8e-a4fe-4edd-9dae-a502891200dc on n-h1-846219-13 Jul 25 16:19:37.434446 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1980955a-f55a-49a8-8ad2-34fc1b2eba94 req-c62164f9-1df6-482d-9e0e-ff985452ff0a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072168 Jul 25 16:19:37.435522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1507/2925] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:37.447223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:37.448904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:37.458522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:37.459556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:37.461571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:37.463002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:37.982668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:19:37.984603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:19:37.985326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:19:37.988470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:19:37.990230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:19:38.011463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:38.012367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:38.013410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:38.014403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:38.021387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:38.032497 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f9e7dad-f5e7-4759-8887-98705f328c03 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 0.595391 Jul 25 16:19:38.045754 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1508/2926] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:37 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:38.046018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Getting quotas for project a8056e2216b24a9b92f7143f0660956b. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:19:38.057231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Getting quotas for user a7cd4c3e36314b4eb141cd3a672c3b0a and project a8056e2216b24a9b92f7143f0660956b. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:19:38.078616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:19:38.083374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:19:38.198463 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17c17e51-0a87-4982-a70e-4e9219d1a503 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.337225 Jul 25 16:19:38.201527 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1419/2927] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:19:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:19:38.216073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e211808b-cb14-4f49-b460-acedd9a2a3b9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:38.217086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e211808b-cb14-4f49-b460-acedd9a2a3b9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:38.384595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:38.385730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:38.411567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:38.412438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:38.413850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:38.421564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:38.581219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:38.641428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:39.264153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e211808b-cb14-4f49-b460-acedd9a2a3b9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:39.281772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e211808b-cb14-4f49-b460-acedd9a2a3b9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1226 microversion: 2.1 time: 1.070866 Jul 25 16:19:39.282907 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1509/2928] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:38 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1226 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:39.298656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-832887176", "imageRef": "1b22c881-c16a-4015-8bb0-728845fd435d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6ea43c23-6d54-4e96-84d0-d43a90c4b06a"}], "security_groups": [{"name": "tempest-securitygroup--34440207"}], "key_name": "tempest-keypair-1209624962", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:39.649934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:39.658351 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff1c3da8-885a-4050-bf36-adc6b07627fd tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 1.281048 Jul 25 16:19:39.659015 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1420/2929] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:38 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:39.671335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:39.672222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:39.689667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] validate_networks() for [('6ea43c23-6d54-4e96-84d0-d43a90c4b06a', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:19:39.690695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:39.691346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:39.692328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:39.693199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.206151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:40.218446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20420d76-c9ec-4b5c-8fc2-63d3f7ee6ebf tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 0.551049 Jul 25 16:19:40.219321 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1421/2930] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:39 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:40.239771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-61133669-ff35-4de1-bd3e-a831c9e800f4 req-d117b344-4fcb-4872-817b-93f13f3c380c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50969ee-a3eb-4bed-9dca-9f314207267e", "tag": "52f4d1e0-36b1-41ec-a968-13426b92c8d0"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:40.271787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-61133669-ff35-4de1-bd3e-a831c9e800f4 req-d117b344-4fcb-4872-817b-93f13f3c380c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.274170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-61133669-ff35-4de1-bd3e-a831c9e800f4 req-d117b344-4fcb-4872-817b-93f13f3c380c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.295370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-61133669-ff35-4de1-bd3e-a831c9e800f4 req-d117b344-4fcb-4872-817b-93f13f3c380c service nova] Creating event network-changed:52f4d1e0-36b1-41ec-a968-13426b92c8d0 for instance d50969ee-a3eb-4bed-9dca-9f314207267e on n-h1-846219-13 Jul 25 16:19:40.310216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-61133669-ff35-4de1-bd3e-a831c9e800f4 req-d117b344-4fcb-4872-817b-93f13f3c380c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088772 Jul 25 16:19:40.311024 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1422/2931] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:40.319092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-17249762-a0f1-4023-bf2e-b29570729ada req-a31ed448-e298-4a04-8ba2-90119696ea7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-plugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:40.331972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-17249762-a0f1-4023-bf2e-b29570729ada req-a31ed448-e298-4a04-8ba2-90119696ea7e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.332583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-17249762-a0f1-4023-bf2e-b29570729ada req-a31ed448-e298-4a04-8ba2-90119696ea7e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.356531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-17249762-a0f1-4023-bf2e-b29570729ada req-a31ed448-e298-4a04-8ba2-90119696ea7e service nova] Creating event network-vif-plugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:19:40.369134 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-17249762-a0f1-4023-bf2e-b29570729ada req-a31ed448-e298-4a04-8ba2-90119696ea7e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056083 Jul 25 16:19:40.373159 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1423/2932] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:40.381699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:40.382895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:40.395017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.395880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.396944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.397661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.582024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:40.599498 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eedbf2c2-c019-4663-99b6-1d508fb1d92f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1284 microversion: 2.1 time: 0.224049 Jul 25 16:19:40.600702 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1424/2933] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:40 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:40.699762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:40.700806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:40.716264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.717652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.721431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.722924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.923471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:19:40.924533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:19:40.926332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:19:40.927051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:19:40.927679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:19:40.945058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.946614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.947730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:40.948446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:40.978815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Getting quotas for project 571268d62a5349cc898193a8c27d0f21. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:19:40.986944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Getting quotas for user a1d0ef72b53042069e269d9cdada90b5 and project 571268d62a5349cc898193a8c27d0f21. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:19:41.009420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:19:41.013555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b22c881-c16a-4015-8bb0-728845fd435d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:19:41.029362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:41.051476 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86cebbf1-ab43-4f7b-a735-3f323667de2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 0.360994 Jul 25 16:19:41.052587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1425/2934] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:40 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:41.186754 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4bfe56ec-fa01-44c2-b811-f0774547297f tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.901965 Jul 25 16:19:41.187898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1510/2935] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:19:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:19:41.200478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d3dda33f-0810-45a9-b2b6-3f0025eac1a2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:41.201633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d3dda33f-0810-45a9-b2b6-3f0025eac1a2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:41.242237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:41.243161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:41.257608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:41.261432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:41.265643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:41.266541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:41.370424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d3dda33f-0810-45a9-b2b6-3f0025eac1a2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:41.380429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d3dda33f-0810-45a9-b2b6-3f0025eac1a2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1249 microversion: 2.1 time: 0.183872 Jul 25 16:19:41.395894 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1426/2936] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:41 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1249 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:41.574846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:41.586951 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-978ea548-b207-4926-9ac1-1d8216362efe tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 0.350728 Jul 25 16:19:41.589884 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1511/2937] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:41 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:41.635902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:41.637128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:41.657462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:41.657947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:41.658854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:41.661546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:41.978863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:41.989241 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4f65aba-54be-459f-9810-9068c65daddd tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 0.358867 Jul 25 16:19:41.992380 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1427/2938] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:41 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:42.076634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:42.078914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:42.093387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:42.094766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:42.098137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:42.099093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:42.439998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:42.440624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:42.467107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:42.467613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:42.470148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:42.470855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:42.490947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:42.536921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe08c6e9-e8e5-44bc-93d7-1391ab40f5d4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 0.463978 Jul 25 16:19:42.538335 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1512/2939] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:42 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:42.615586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:42.616774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:42.631166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:42.632708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:42.643200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:42.643948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:42.762197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:42.774795 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b901618b-cb89-43eb-9c2c-5374f09f32f9 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1301 microversion: 2.1 time: 0.340149 Jul 25 16:19:42.775786 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1428/2940] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:42 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1301 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:43.033740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:43.036077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:43.049797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:43.072940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a277d70d-b53e-4040-91e0-56e9f0664a41 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 0.452182 Jul 25 16:19:43.081086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:43.082067 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1513/2941] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:42 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:43.083017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:43.085032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:43.085796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:43.093604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:43.578663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:43.579497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:43.593702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:43.594171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:43.595007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:43.595459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:44.587769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:44.618196 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b87073d6-e93f-499e-a436-615dc07d8d5a tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 1.599145 Jul 25 16:19:44.619453 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1429/2942] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:43 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:44.664898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:44.666121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:44.690099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:44.690861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:44.698544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:44.699287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:46.014048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:46.059458 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4b467f1-5826-4e1b-80a2-abc91e2bc149 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1307 microversion: 2.1 time: 1.438772 Jul 25 16:19:46.074319 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1430/2943] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:44 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1307 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:46.094727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:46.096818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:46.130976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:46.136969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:46.140900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:46.154566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:46.682423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:46.737865 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-206e9cb9-2b77-475c-aa11-5baa65284111 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 3.156757 Jul 25 16:19:46.739509 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1514/2944] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:43 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 3168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:46.771860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:46.774097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:46.816023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:46.816944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:46.818487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:46.819412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:46.951320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:46.978307 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-93722b9d-ea07-48fb-99d8-1d6e12ea5af7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 0.916983 Jul 25 16:19:46.986215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1431/2945] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:46 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:47.011572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ccdf8b1c-ff4f-4e83-9efa-78c975b059a7 req-638f002b-c67e-447c-866e-41809cbe6e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a767be8e-a4fe-4edd-9dae-a502891200dc", "name": "network-vif-plugged", "status": "completed", "tag": "3d6ffc83-7855-443b-a9f0-97039c2179ab"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:47.046855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ccdf8b1c-ff4f-4e83-9efa-78c975b059a7 req-638f002b-c67e-447c-866e-41809cbe6e63 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:47.048593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ccdf8b1c-ff4f-4e83-9efa-78c975b059a7 req-638f002b-c67e-447c-866e-41809cbe6e63 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:47.083811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ccdf8b1c-ff4f-4e83-9efa-78c975b059a7 req-638f002b-c67e-447c-866e-41809cbe6e63 service nova] Creating event network-vif-plugged:3d6ffc83-7855-443b-a9f0-97039c2179ab for instance a767be8e-a4fe-4edd-9dae-a502891200dc on n-h1-846219-13 Jul 25 16:19:47.102542 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ccdf8b1c-ff4f-4e83-9efa-78c975b059a7 req-638f002b-c67e-447c-866e-41809cbe6e63 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106993 Jul 25 16:19:47.106859 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1432/2946] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:47.132419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:47.142508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:47.156791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:47.192255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:47.197638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:47.199667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:47.200815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:47.407908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:47.420284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e405d3d7-14c3-46fd-9bf5-be33bb00624d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 0.675935 Jul 25 16:19:47.425042 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1515/2947] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:46 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:47.513016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:47.525783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f8fa47f4-fe89-4e70-97a6-633231d299bb tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 0.411144 Jul 25 16:19:47.530815 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1433/2948] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:47 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:47.662984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fa566c34-7b3f-41eb-8ac3-bcaeb820e9f8 req-20b077c7-ea52-45cf-93a6-309eb333824f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a771c8ea-8a7c-4c05-aa91-615a1bd77788", "tag": "2f0f3a6d-e306-4860-8a74-7a3f40436ddc"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:47.709842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fa566c34-7b3f-41eb-8ac3-bcaeb820e9f8 req-20b077c7-ea52-45cf-93a6-309eb333824f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:47.711390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fa566c34-7b3f-41eb-8ac3-bcaeb820e9f8 req-20b077c7-ea52-45cf-93a6-309eb333824f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:47.730620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fa566c34-7b3f-41eb-8ac3-bcaeb820e9f8 req-20b077c7-ea52-45cf-93a6-309eb333824f service nova] Creating event network-changed:2f0f3a6d-e306-4860-8a74-7a3f40436ddc for instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 on n-h2-846219-13 Jul 25 16:19:47.737224 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fa566c34-7b3f-41eb-8ac3-bcaeb820e9f8 req-20b077c7-ea52-45cf-93a6-309eb333824f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080520 Jul 25 16:19:47.740971 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1516/2949] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:19:47.764485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:47.765882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:47.797906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:47.799487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:47.800701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:47.801523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:48.016962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:48.017938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:48.030690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:48.046234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:48.046719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:48.047639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:48.048187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:48.457870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:48.484976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4c4c3281-2038-4178-98c1-cab8a08fb4af tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 0.716207 Jul 25 16:19:48.489136 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1434/2950] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:47 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:48.513585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:48.525339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:48.562301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:48.570262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:48.572478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:48.577828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:49.608701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:49.617509 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9812dd0c-3b6a-434c-98a5-fbeeea158819 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 1.606637 Jul 25 16:19:49.625630 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1517/2951] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:48 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:19:49.652184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:49.660599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:49.691811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:49.692272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:49.709779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:49.712076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:50.300126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:50.310393 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-588d383d-6731-478d-b64c-07e10fd117b2 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 1.818262 Jul 25 16:19:50.314379 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1435/2952] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:48 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:50.329252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:50.330422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:50.344798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:50.345573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:50.347275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:50.349946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:50.968064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:50.999920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.375772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=22 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.583447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:51.629464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97a72538-67e7-411d-996f-dc8436ecc3bf tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 1.999061 Jul 25 16:19:51.637247 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1518/2953] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:49 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:51.660976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:51.668744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:51.710187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:51.712788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:51.715047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:51.719074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:51.764056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:51.819619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-081c4fa2-db2e-4944-99de-b243cfbe1587 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1320 microversion: 2.1 time: 1.503351 Jul 25 16:19:51.820454 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1436/2954] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:50 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1320 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:51.860728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:51.865523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:51.866689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.884364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:51.884933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:51.891110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:51.891691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:54.145758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:54.192692 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2654a9c6-714f-4128-8eb9-40e468179814 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 2.539505 Jul 25 16:19:54.194568 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1519/2955] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:51 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:54.223599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:54.225089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:54.247168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:54.263048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:54.269464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:54.272523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:54.274017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:54.628966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:54.658437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef00354c-47ec-4fbe-b80b-7b37272f485d tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 2.822594 Jul 25 16:19:54.662900 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1437/2956] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:51 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 2842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:54.685426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:54.687105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:54.717177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:54.718716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:54.724436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:54.730899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:55.448073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:55.469719 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7c13f629-d005-4073-a378-bab3a6549165 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 1.273187 Jul 25 16:19:55.492121 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1520/2957] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:54 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:55.721661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-14228219-eb0a-4d29-899e-d8b8eca99148 req-f761da32-e210-4335-8cc5-20e3caec2caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f607753-b3cb-4845-a1f8-d33b12d069eb", "tag": "aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:55.752902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-14228219-eb0a-4d29-899e-d8b8eca99148 req-f761da32-e210-4335-8cc5-20e3caec2caf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:55.755440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-14228219-eb0a-4d29-899e-d8b8eca99148 req-f761da32-e210-4335-8cc5-20e3caec2caf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:55.807088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-14228219-eb0a-4d29-899e-d8b8eca99148 req-f761da32-e210-4335-8cc5-20e3caec2caf service nova] Creating event network-changed:aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9 for instance 4f607753-b3cb-4845-a1f8-d33b12d069eb on n-h2-846219-13 Jul 25 16:19:55.824898 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-14228219-eb0a-4d29-899e-d8b8eca99148 req-f761da32-e210-4335-8cc5-20e3caec2caf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329609 Jul 25 16:19:55.827513 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1521/2958] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:55.842479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:55.844975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:55.872235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:55.877428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:55.883397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:55.889993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:55.984635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:56.019373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5cfbec7e-5441-4056-952d-f582b7db9806 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1507 microversion: 2.1 time: 1.353952 Jul 25 16:19:56.020471 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1438/2959] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:54 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1507 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:56.058098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:56.068100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:56.105927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:56.107335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:56.115069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:56.117145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:57.630913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:57.724430 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8b0961a-f2f4-4d64-a8f4-30ee367d8aeb tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 1.893658 Jul 25 16:19:57.725678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1522/2960] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:55 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:57.779527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e7df468e-77b7-4513-a545-8947e3e96cdb req-f5ff5a17-3a52-4d18-81b8-73620cc6469e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50969ee-a3eb-4bed-9dca-9f314207267e", "name": "network-vif-plugged", "status": "completed", "tag": "52f4d1e0-36b1-41ec-a968-13426b92c8d0"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:57.812014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e7df468e-77b7-4513-a545-8947e3e96cdb req-f5ff5a17-3a52-4d18-81b8-73620cc6469e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:57.813365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e7df468e-77b7-4513-a545-8947e3e96cdb req-f5ff5a17-3a52-4d18-81b8-73620cc6469e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:57.880454 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e7df468e-77b7-4513-a545-8947e3e96cdb req-f5ff5a17-3a52-4d18-81b8-73620cc6469e service nova] Creating event network-vif-plugged:52f4d1e0-36b1-41ec-a968-13426b92c8d0 for instance d50969ee-a3eb-4bed-9dca-9f314207267e on n-h1-846219-13 Jul 25 16:19:57.920642 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e7df468e-77b7-4513-a545-8947e3e96cdb req-f5ff5a17-3a52-4d18-81b8-73620cc6469e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141613 Jul 25 16:19:57.930537 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1523/2961] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:19:57.992603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:58.004679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1995068084"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:19:58.006268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:58.010409 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f8cacd6-e0d0-4adf-b896-f5949d71d79f tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 1.973282 Jul 25 16:19:58.015595 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1439/2962] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:56 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:58.038406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:58.039591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:58.054513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:58.058056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:58.059519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:58.060427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:58.087295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:58.096308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:58.099458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:58.099458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:59.759921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:19:59.778716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b808aa20-c3a6-4e53-9201-0f29ef83bcc1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 1.760432 Jul 25 16:19:59.781063 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1440/2963] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:58 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:19:59.798341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:19:59.802290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:19:59.830782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:59.835056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:19:59.837518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:19:59.838043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:00.007325 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.network.security_group_api [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Adding security group 24fc9604-7d39-411b-8806-23877cf82a01 to port 3d6ffc83-7855-443b-a9f0-97039c2179ab Jul 25 16:20:02.009051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:02.046712 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08b0b87b-1e5d-4804-9ebf-cb57d9059347 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1321 microversion: 2.1 time: 2.255286 Jul 25 16:20:02.051658 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1441/2964] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:19:59 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1321 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:02.109263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:02.110916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:02.162401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:02.166276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:02.168189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:02.172584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:03.902596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:03.932779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5113ec2-e0f9-437c-a621-ce7a80847469 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 1.861203 Jul 25 16:20:03.940747 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1442/2965] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:02 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:03.986820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-427973f5-8466-4c6b-b5ac-0b0ae397df08 req-bc9c64d4-2b33-44a3-98cd-ac9e9c0e49c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a771c8ea-8a7c-4c05-aa91-615a1bd77788", "name": "network-vif-plugged", "status": "completed", "tag": "2f0f3a6d-e306-4860-8a74-7a3f40436ddc"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:04.032029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-427973f5-8466-4c6b-b5ac-0b0ae397df08 req-bc9c64d4-2b33-44a3-98cd-ac9e9c0e49c4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:04.050608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-427973f5-8466-4c6b-b5ac-0b0ae397df08 req-bc9c64d4-2b33-44a3-98cd-ac9e9c0e49c4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:04.107490 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-427973f5-8466-4c6b-b5ac-0b0ae397df08 req-bc9c64d4-2b33-44a3-98cd-ac9e9c0e49c4 service nova] Creating event network-vif-plugged:2f0f3a6d-e306-4860-8a74-7a3f40436ddc for instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 on n-h2-846219-13 Jul 25 16:20:04.130621 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-427973f5-8466-4c6b-b5ac-0b0ae397df08 req-bc9c64d4-2b33-44a3-98cd-ac9e9c0e49c4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187575 Jul 25 16:20:04.137254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1443/2966] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:04.166932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:04.171321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:04.199881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:04.207593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:04.211104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:04.211901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:04.513455 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-878e9f28-ea5a-4a2b-b726-b4d38b6a49a1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc/action" status: 202 len: 0 microversion: 2.1 time: 6.578839 Jul 25 16:20:04.514606 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1524/2967] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:19:57 2022] POST /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc/action => generated 0 bytes in 6583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:04.521675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:04.522340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:04.545065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:04.545813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:04.546851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:04.547311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:04.996224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:05.040995 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17babc68-8f0e-4e47-93f2-c2ea90f21673 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1509 microversion: 2.1 time: 0.524935 Jul 25 16:20:05.047273 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1525/2968] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:04 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:05.059985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e00c61f-4828-4914-80af-69ce2fa427e0"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:05.073088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:05.091430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:05.093806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:05.095197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:05.103482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:05.104473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:05.124810 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ffad0abf-003c-45ab-ba6f-0e53bebdb5a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 0.985736 Jul 25 16:20:05.126256 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1444/2969] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:04 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:05.152878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-892842131"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:05.154048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:05.224572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:05.228725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:05.230466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:05.231084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:06.051919 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Adding security group 87162384-a725-4f47-ac3a-beae13b0bce2 to port 3d6ffc83-7855-443b-a9f0-97039c2179ab Jul 25 16:20:06.162525 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f967dc21-5081-41e0-8e3b-8b815774d57f tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "POST /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112754 Jul 25 16:20:06.165336 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1526/2970] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:20:05 2022] POST /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:06.200386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3f08fe51-ae3f-4bd5-8a89-07bbba5a148f req-8f72b5cf-e9f6-490b-a068-0cfbfac9ae32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a767be8e-a4fe-4edd-9dae-a502891200dc", "tag": "3d6ffc83-7855-443b-a9f0-97039c2179ab"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:06.265389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3f08fe51-ae3f-4bd5-8a89-07bbba5a148f req-8f72b5cf-e9f6-490b-a068-0cfbfac9ae32 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:06.266896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3f08fe51-ae3f-4bd5-8a89-07bbba5a148f req-8f72b5cf-e9f6-490b-a068-0cfbfac9ae32 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:06.311909 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3f08fe51-ae3f-4bd5-8a89-07bbba5a148f req-8f72b5cf-e9f6-490b-a068-0cfbfac9ae32 service nova] Creating event network-changed:3d6ffc83-7855-443b-a9f0-97039c2179ab for instance a767be8e-a4fe-4edd-9dae-a502891200dc on n-h1-846219-13 Jul 25 16:20:06.340229 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3f08fe51-ae3f-4bd5-8a89-07bbba5a148f req-8f72b5cf-e9f6-490b-a068-0cfbfac9ae32 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171668 Jul 25 16:20:06.342116 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1527/2971] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:06.362238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:06.366166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:06.413808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:06.414397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:06.415445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:06.415906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:07.335021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:07.349344 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc2bfd9c-3845-4662-bea2-da66a32cd734 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1326 microversion: 2.1 time: 1.000700 Jul 25 16:20:07.350940 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1528/2972] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:06 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1326 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:07.364219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:07.367374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:07.383695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:07.384588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:07.387693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:07.392052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:07.478007 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41e0068c-4404-4683-8e57-5944e6133144 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e/ips" status: 200 len: 108 microversion: 2.1 time: 0.121111 Jul 25 16:20:07.490424 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1529/2973] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:20:07 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e/ips => generated 108 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:07.518841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:07.520817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:07.537344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:07.543960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:07.547204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:07.548524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:08.456100 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4ef5861-a32d-4e65-a47f-6e8ae3708616 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc/action" status: 202 len: 0 microversion: 2.1 time: 3.327801 Jul 25 16:20:08.457536 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1445/2974] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:05 2022] POST /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc/action => generated 0 bytes in 3330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:08.488224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:08.489809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:08.515705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:08.521333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:08.523557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:08.524779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:08.626174 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e94be297-c567-40f9-a499-b0bc5701bb2e tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e/ips" status: 200 len: 108 microversion: 2.1 time: 0.166624 Jul 25 16:20:08.628585 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1446/2975] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:20:08 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e/ips => generated 108 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:08.650594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:08.652797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:08.667209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:08.668409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:08.670249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:08.671253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:08.716383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:08.780458 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e19ed900-ace7-4390-8b23-4ae4589a4371 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 1.282052 Jul 25 16:20:08.785702 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1530/2976] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:07 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:08.810210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:08.820728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:08.855196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:08.856084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:08.858790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:08.860079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:09.371697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:09.392307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:09.406132 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5d17a99-d2eb-454a-82e5-565fc0cdfe31 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.772483 Jul 25 16:20:09.410480 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1447/2977] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:08 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:09.444747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:09.445687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:09.483583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:09.486347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:09.488975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:09.489815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:09.835056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:09.891282 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f3f2d66-472b-43e9-bce0-7e60e4ac7d45 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1476 microversion: 2.1 time: 1.102496 Jul 25 16:20:09.896511 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1531/2978] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:08 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1476 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:09.905898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:09.906883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:09.947416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:09.948220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:09.949937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:09.950720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:10.009750 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c5f65e9-19f1-4aca-b929-2789c311c3a7 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e/ips/tempest-ServerAddressesTestJSON-185220462-network" status: 200 len: 93 microversion: 2.1 time: 0.111683 Jul 25 16:20:10.011231 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1532/2979] 10.222.0.105 () {58 vars in 1403 bytes} [Mon Jul 25 16:20:09 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e/ips/tempest-ServerAddressesTestJSON-185220462-network => generated 93 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:20:10.022004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-afeccf0f-ef94-45b5-af07-0ee92156c520 req-2359e1a1-ff34-45f2-9803-e4af46b0a730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a767be8e-a4fe-4edd-9dae-a502891200dc", "tag": "3d6ffc83-7855-443b-a9f0-97039c2179ab"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:10.054485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-afeccf0f-ef94-45b5-af07-0ee92156c520 req-2359e1a1-ff34-45f2-9803-e4af46b0a730 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:10.055588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-afeccf0f-ef94-45b5-af07-0ee92156c520 req-2359e1a1-ff34-45f2-9803-e4af46b0a730 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:10.122557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-afeccf0f-ef94-45b5-af07-0ee92156c520 req-2359e1a1-ff34-45f2-9803-e4af46b0a730 service nova] Creating event network-changed:3d6ffc83-7855-443b-a9f0-97039c2179ab for instance a767be8e-a4fe-4edd-9dae-a502891200dc on n-h1-846219-13 Jul 25 16:20:10.136159 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-afeccf0f-ef94-45b5-af07-0ee92156c520 req-2359e1a1-ff34-45f2-9803-e4af46b0a730 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122684 Jul 25 16:20:10.137326 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1533/2980] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:10.161022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:10.163791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:10.171897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:10.172541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:10.174157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:10.174921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:10.872699 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ebe9d66c-96f9-4b70-a033-450bbf0857a5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.458255 Jul 25 16:20:10.873773 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1448/2981] 10.222.0.105 () {58 vars in 1298 bytes} [Mon Jul 25 16:20:09 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc/os-security-groups => generated 1156 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:10.885659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:10.885659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:10.906475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:10.910366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:10.916397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:10.919155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:10.991178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lazy-loading 'flavor' on Instance uuid a771c8ea-8a7c-4c05-aa91-615a1bd77788 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:20:11.143050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:11.161795 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08ef077a-9df6-4a95-8759-664b002cbb7a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 1.011921 Jul 25 16:20:11.163162 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1534/2982] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:10 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:11.173250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:11.182006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:11.193255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:11.194480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:11.198220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:11.199620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:11.217743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-134f1b87-3145-48b4-a9e7-6dc97fc01778 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788/action" status: 202 len: 0 microversion: 2.1 time: 0.341515 Jul 25 16:20:11.219016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1449/2983] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:10 2022] POST /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:11.243838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:20:11.268203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:11.270320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:11.319331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:11.319955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:11.321131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:11.329511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:11.461444 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f5be7db9-ee3b-4265-ab32-c0728c0e9258 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 204 len: 0 microversion: 2.1 time: 0.288313 Jul 25 16:20:11.468259 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1535/2984] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:20:11 2022] DELETE /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:20:11.477312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69e8372c-57d8-4e49-be11-147a19a8948c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d9351a310>, body: {"security_group": {"name": " tempest-securitygroup -2011278495 ", "description": "tempest-description-1569699930"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:12.075382 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69e8372c-57d8-4e49-be11-147a19a8948c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.602470 Jul 25 16:20:12.075932 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1536/2985] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:20:11 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:12.093441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:12.095656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:12.096934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:12.104429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9e8917e2-dcd7-4f6f-8c35-44c426cc129d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.879188 Jul 25 16:20:12.109771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:12.110814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:12.112307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:12.113276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:12.125277 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1450/2986] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:11 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:12.154306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:12.155853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:12.181395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:12.183981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:12.189229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:12.190626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:12.192523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:12.563485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:12.582233 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5720c4d8-7f92-4d47-a486-afdc52744513 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1515 microversion: 2.1 time: 0.454651 Jul 25 16:20:12.582875 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1451/2987] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:12 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1515 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:12.621188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a164703e-5b0e-46c1-8d26-c4a581fbc2f2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d930cbdc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:12.731118 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a164703e-5b0e-46c1-8d26-c4a581fbc2f2 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1" status: 200 len: 224 microversion: 2.1 time: 0.119862 Jul 25 16:20:12.732629 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1452/2988] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:20:12 2022] GET /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 => generated 224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:12.756626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-812351312"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:12.762301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:12.775048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:12.776320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:12.779857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:12.781308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:12.991440 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-80eaa267-e4a8-4d03-b7ca-3241c1470d92 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1620 microversion: 2.1 time: 0.912917 Jul 25 16:20:12.994744 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1537/2989] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:12 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1620 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:13.032406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:13.045734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:13.071192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.072917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.074837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.075844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.276116 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a432571a-1fab-411d-a2a6-7d51eb139b9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.531266 Jul 25 16:20:13.278122 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1453/2990] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:12 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Jul 25 16:20:13.288941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22578a29-19ce-4be0-822d-98e50fc5feb7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d9311af70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:13.498381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:13.510630 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e30e289-750f-40c2-9ce2-bdfcc70f8749 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 0.513742 Jul 25 16:20:13.511404 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1538/2991] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:12 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:13.517416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-044b07ac-20b6-47dc-ba87-bfd71be2072d req-324f771f-638c-4e43-9b9a-f1360d912a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-unplugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:13.529220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-044b07ac-20b6-47dc-ba87-bfd71be2072d req-324f771f-638c-4e43-9b9a-f1360d912a79 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.530121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-044b07ac-20b6-47dc-ba87-bfd71be2072d req-324f771f-638c-4e43-9b9a-f1360d912a79 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.547933 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-044b07ac-20b6-47dc-ba87-bfd71be2072d req-324f771f-638c-4e43-9b9a-f1360d912a79 service nova] Creating event network-vif-unplugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:20:13.555523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-044b07ac-20b6-47dc-ba87-bfd71be2072d req-324f771f-638c-4e43-9b9a-f1360d912a79 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042182 Jul 25 16:20:13.556981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1539/2992] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:13.564772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:13.565770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:13.575298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.576263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.577353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.578103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.666544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] HTTP exception thrown: Cannot 'migrate' instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 while it is in vm_state suspended Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Request method failure captured: Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788/action HTTP/1.1 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 15 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJqP73ZcKHRkDLgIs0K5CnR7kQTR4NcHaSxNo16sV73rHpkWTF4niC6mJ1sLO9pYyGIG5AQil52KlcXR7yqZRcezXyXAkXJkPn6UMkCTDXBAb-FK-09tfEAPPJe4zmDB8Ye-WjnxAqjah_MHyzPjzmxS1Tgq1nctnDoHPFYUsOBxeQ Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21878844f61740689497402cad1ec059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21878844f61740689497402cad1ec059"}]}] Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a20aa1b94f5449228ec406faffc3d710 Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: {"migrate": {}} Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'migrate' instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 while it is in vm_state suspended Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'a771c8ea-8a7c-4c05-aa91-615a1bd77788', 'body': {'migrate': {}}} Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 in vm_state suspended. Cannot resize while the instance is in this state. Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:13.669208 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 while it is in vm_state suspended Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 while it is in vm_state suspended Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Returning 409 to user: Cannot 'migrate' instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 while it is in vm_state suspended {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1dd84a59-f954-4d04-b7a0-60e4896d92d3 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788/action" status: 409 len: 148 microversion: 2.1 time: 0.113169 Jul 25 16:20:13.675543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1540/2993] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:13 2022] POST /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788/action => generated 148 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:20:13.691959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:13.692741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:13.705145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.705921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.707833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.708526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.923755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:13.935782 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07142461-9c7d-4fc0-a710-926bcd523090 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.260693 Jul 25 16:20:13.936959 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1541/2994] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:13 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:13.942998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:13.943893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:13.961127 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22578a29-19ce-4be0-822d-98e50fc5feb7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1" status: 202 len: 0 microversion: 2.1 time: 0.681209 Jul 25 16:20:13.964863 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1454/2995] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:20:13 2022] DELETE /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:13.972075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e641ed0-db08-439a-86ef-c700b945a043 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:13.980204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.980972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.981989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:13.983351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e641ed0-db08-439a-86ef-c700b945a043 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Request method failure captured: Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6/action HTTP/1.1 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 39 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJqP73ZcKHRkDLgIs0K5CnR7kQTR4NcHaSxNo16sV73rHpkWTF4niC6mJ1sLO9pYyGIG5AQil52KlcXR7yqZRcezXyXAkXJkPn6UMkCTDXBAb-FK-09tfEAPPJe4zmDB8Ye-WjnxAqjah_MHyzPjzmxS1Tgq1nctnDoHPFYUsOBxeQ Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21878844f61740689497402cad1ec059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21878844f61740689497402cad1ec059"}]}] Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a20aa1b94f5449228ec406faffc3d710 Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: {"os-resetState": {"state": "invalid"}} Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '177a0689-fe36-400d-8854-8254202549f6', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:20:13.989681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 16:20:13.994000 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:13.995918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e641ed0-db08-439a-86ef-c700b945a043 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:13.996965 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e641ed0-db08-439a-86ef-c700b945a043 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6/action" status: 400 len: 144 microversion: 2.1 time: 0.033891 Jul 25 16:20:13.998111 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1455/2996] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:13 2022] POST /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6/action => generated 144 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:20:14.007164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da4a851f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:14.081530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:20:14.082350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:20:14.082898 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.082898 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 HTTP/1.1 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1'} Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:20:14.084805 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-def20ac1-59bb-4382-9b22-96495c659407'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:14.089638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-527ac609-6cb4-415c-87bd-37b7ecc424a8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1" status: 404 len: 194 microversion: 2.1 time: 0.085469 Jul 25 16:20:14.093323 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1456/2997] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:20:13 2022] GET /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:14.097956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d882f2c0-2399-4035-bbf6-25bb29a962aa tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d882f2c0-2399-4035-bbf6-25bb29a962aa tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Request method failure captured: Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6/action HTTP/1.1 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 31 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJqP73ZcKHRkDLgIs0K5CnR7kQTR4NcHaSxNo16sV73rHpkWTF4niC6mJ1sLO9pYyGIG5AQil52KlcXR7yqZRcezXyXAkXJkPn6UMkCTDXBAb-FK-09tfEAPPJe4zmDB8Ye-WjnxAqjah_MHyzPjzmxS1Tgq1nctnDoHPFYUsOBxeQ Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21878844f61740689497402cad1ec059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21878844f61740689497402cad1ec059"}]}] Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a20aa1b94f5449228ec406faffc3d710 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: {"os-resetState": {"state": 1}} Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '177a0689-fe36-400d-8854-8254202549f6', 'body': {'os-resetState': {'state': 1}}} Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 1 Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 16:20:14.113194 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d882f2c0-2399-4035-bbf6-25bb29a962aa tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d882f2c0-2399-4035-bbf6-25bb29a962aa tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6/action" status: 400 len: 120 microversion: 2.1 time: 0.021014 Jul 25 16:20:14.124751 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1457/2998] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:14 2022] POST /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6/action => generated 120 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:20:14.129623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b17b564-3e26-47bb-8579-0ae22a874ab3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d93084310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-646988704", "description": "tempest-description-1639757924"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:14.289377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:14.308348 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7ca7aa8e-40a4-45fd-bc55-c04a43e9ad50 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1515 microversion: 2.1 time: 0.370083 Jul 25 16:20:14.332102 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1542/2999] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:13 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:14.351174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46832de9-09c3-4f90-b92c-eb0c0a964e14 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:14.354593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-46832de9-09c3-4f90-b92c-eb0c0a964e14 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Failed to fetch instance by id 999 {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:20:14.355381 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-46832de9-09c3-4f90-b92c-eb0c0a964e14 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46832de9-09c3-4f90-b92c-eb0c0a964e14 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Request method failure captured: Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 37 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJqP73ZcKHRkDLgIs0K5CnR7kQTR4NcHaSxNo16sV73rHpkWTF4niC6mJ1sLO9pYyGIG5AQil52KlcXR7yqZRcezXyXAkXJkPn6UMkCTDXBAb-FK-09tfEAPPJe4zmDB8Ye-WjnxAqjah_MHyzPjzmxS1Tgq1nctnDoHPFYUsOBxeQ Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21878844f61740689497402cad1ec059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21878844f61740689497402cad1ec059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21878844f61740689497402cad1ec059"}]}] Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21878844f61740689497402cad1ec059 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1429623844 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a20aa1b94f5449228ec406faffc3d710 Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1429623844-project-admin Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: {"os-resetState": {"state": "error"}} Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 999 could not be found. Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:14.370115 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:14.376233 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:14.376233 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 16:20:14.376233 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:14.376233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46832de9-09c3-4f90-b92c-eb0c0a964e14 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:14.376233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-46832de9-09c3-4f90-b92c-eb0c0a964e14 tempest-ServersAdminNegativeTestJSON-1429623844 tempest-ServersAdminNegativeTestJSON-1429623844-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.039074 Jul 25 16:20:14.380159 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1543/3000] 10.222.0.105 () {60 vars in 1184 bytes} [Mon Jul 25 16:20:14 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:20:14.386940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:14.387566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:14.410138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:14.411167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:14.412564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:14.413066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:14.486403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:20:14.493635 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b17b564-3e26-47bb-8579-0ae22a874ab3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.363378 Jul 25 16:20:14.502864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1458/3001] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:20:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:14.514119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cfa710e2-c087-49d0-ba4a-981832ce4860 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d9311a670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1210998476", "description": "tempest-description-242253463"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:14.684819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65c59e7c-ac2a-4538-981a-7a94fd7cdd94 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 204 len: 0 microversion: 2.1 time: 0.302127 Jul 25 16:20:14.687373 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1544/3002] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:20:14 2022] DELETE /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:20:14.719438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:14.722741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:14.733212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:14.734672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:14.736314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:14.737112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:14.868358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cfa710e2-c087-49d0-ba4a-981832ce4860 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.360019 Jul 25 16:20:14.873928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1459/3003] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:20:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:14.879550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:14.890993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:14.905019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:14.906043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:14.907319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:14.908300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.009719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:15.047048 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c269814-ce30-4fa0-b59a-57c0a195035e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 0.353681 Jul 25 16:20:15.050154 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1545/3004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:14 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:15.072605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea9a18ca-6b36-4d31-b926-86eff583fbfc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d938695e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-410468602", "description": "tempest-description-516634454"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:15.206040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:15.219372 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7bba908f-7b07-45a6-b8ce-c4b3794eecc4 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1473 microversion: 2.1 time: 0.343560 Jul 25 16:20:15.220945 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1460/3005] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:14 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1473 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:15.240380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:15.241025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:15.262725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.263177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.263976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.272891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.617355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:15.634540 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de97eab6-a4f2-4905-a3ec-596a45719452 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.410865 Jul 25 16:20:15.648169 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1461/3006] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:15 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:15.664003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:15.665277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:15.694190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.703631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.705806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.707195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.750248 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea9a18ca-6b36-4d31-b926-86eff583fbfc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.694421 Jul 25 16:20:15.752244 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1546/3007] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:20:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:15.785505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f3d371a5-fe5d-47ad-abfb-5d3e1fbf50b8 req-39260036-6155-42a6-bb3d-0f0322d56668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50969ee-a3eb-4bed-9dca-9f314207267e", "name": "network-vif-deleted", "tag": "52f4d1e0-36b1-41ec-a968-13426b92c8d0"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:15.803012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.803468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.803934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lazy-loading 'fault' on Instance uuid d50969ee-a3eb-4bed-9dca-9f314207267e {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:20:15.853342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f3d371a5-fe5d-47ad-abfb-5d3e1fbf50b8 req-39260036-6155-42a6-bb3d-0f0322d56668 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.853794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f3d371a5-fe5d-47ad-abfb-5d3e1fbf50b8 req-39260036-6155-42a6-bb3d-0f0322d56668 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:15.930329 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f3d371a5-fe5d-47ad-abfb-5d3e1fbf50b8 req-39260036-6155-42a6-bb3d-0f0322d56668 service nova] Creating event network-vif-deleted:52f4d1e0-36b1-41ec-a968-13426b92c8d0 for instance d50969ee-a3eb-4bed-9dca-9f314207267e on n-h1-846219-13 Jul 25 16:20:15.950733 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f3d371a5-fe5d-47ad-abfb-5d3e1fbf50b8 req-39260036-6155-42a6-bb3d-0f0322d56668 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196415 Jul 25 16:20:15.951458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb63f23a2284170a095a7dbf23fb9a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1386c86aa05447c9b6c0fc23e6bc3363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:15.952378 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1547/3008] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:15.960316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-518af32f-a2ae-4f1e-836b-085e571a2d13 req-c3145d0a-3837-4345-9328-5209c852c290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f607753-b3cb-4845-a1f8-d33b12d069eb", "name": "network-vif-plugged", "status": "completed", "tag": "aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:15.960741 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48e9db27-7c0a-4911-af0c-ab3e7c9cc0f0 tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 200 len: 1311 microversion: 2.1 time: 0.310449 Jul 25 16:20:15.965793 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1462/3009] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:15 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:15.976356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03207861-5dda-4822-ac3b-b488adfe7ad4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d931f0670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:15.988077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-518af32f-a2ae-4f1e-836b-085e571a2d13 req-c3145d0a-3837-4345-9328-5209c852c290 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:15.989001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-518af32f-a2ae-4f1e-836b-085e571a2d13 req-c3145d0a-3837-4345-9328-5209c852c290 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:16.004005 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-518af32f-a2ae-4f1e-836b-085e571a2d13 req-c3145d0a-3837-4345-9328-5209c852c290 service nova] Creating event network-vif-plugged:aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9 for instance 4f607753-b3cb-4845-a1f8-d33b12d069eb on n-h2-846219-13 Jul 25 16:20:16.010793 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-518af32f-a2ae-4f1e-836b-085e571a2d13 req-c3145d0a-3837-4345-9328-5209c852c290 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056128 Jul 25 16:20:16.012066 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1548/3010] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:16.100157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:16.100895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:16.131347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:16.131821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:16.132618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:16.133052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:16.563478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:16.582753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34f5e92a-2774-44a8-af5c-d791bbec31a7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 0.495835 Jul 25 16:20:16.583376 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1549/3011] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:16 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:16.589172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:16.589665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:16.598012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:16.599552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:16.600765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:16.601639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:16.611206 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03207861-5dda-4822-ac3b-b488adfe7ad4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.648229 Jul 25 16:20:16.612273 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1463/3012] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:20:15 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:16.630565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9a05e4f-e43d-41ee-acb4-bff81546667a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d938073a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:16.964441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:16.975739 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b79e73a-75d1-4dd5-ad57-e540ea9f07cb tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1473 microversion: 2.1 time: 0.390952 Jul 25 16:20:16.978564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1550/3013] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:16 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:16.986043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:16.987675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:16.997319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:16.998351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:16.999375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:17.000034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:17.790855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:17.827283 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9a05e4f-e43d-41ee-acb4-bff81546667a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae" status: 202 len: 0 microversion: 2.1 time: 1.204692 Jul 25 16:20:17.833795 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1464/3014] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:20:16 2022] DELETE /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:20:17.854820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97ede326-b545-4067-9029-6a1a56848737 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.874613 Jul 25 16:20:17.859577 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1551/3015] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:16 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:17.863380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:17.865529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] [instance: d50969ee-a3eb-4bed-9dca-9f314207267e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:17.872437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:17.878465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:17.883119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=47 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:17.889009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:17.890270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:17.892577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:17.895959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:17.896214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:17.896508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:17.903266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:17.904483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:17.960576 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] HTTP exception thrown: Instance d50969ee-a3eb-4bed-9dca-9f314207267e could not be found. Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Request method failure captured: Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e HTTP/1.1 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ_GzSFcebwfQoUaLIp3x_gn-VISaf_MyN96MOTWFMnNry5oh58woK7mkBEFOKesGqXBmYmC9VxAXXTr3rxD5mT3OeEHkuGVzYvFhXKYrqsKrXVHKD6m8BPm_29aGd4Pq6MpBEMED_1hBNWPkW74HnXlQDGp7BGqP0g3SlGQeWlFiA Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 1386c86aa05447c9b6c0fc23e6bc3363 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerAddressesTestJSON-518994898 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1386c86aa05447c9b6c0fc23e6bc3363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1386c86aa05447c9b6c0fc23e6bc3363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/1386c86aa05447c9b6c0fc23e6bc3363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_1386c86aa05447c9b6c0fc23e6bc3363"}]}] Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerAddressesTestJSON-518994898 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 1386c86aa05447c9b6c0fc23e6bc3363 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerAddressesTestJSON-518994898 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerAddressesTestJSON-518994898-project Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2bb63f23a2284170a095a7dbf23fb9a7 Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerAddressesTestJSON-518994898-project Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d50969ee-a3eb-4bed-9dca-9f314207267e could not be found. Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd50969ee-a3eb-4bed-9dca-9f314207267e'} Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50969ee-a3eb-4bed-9dca-9f314207267e could not be found. Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50969ee-a3eb-4bed-9dca-9f314207267e could not be found. Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:17.970106 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50969ee-a3eb-4bed-9dca-9f314207267e could not be found. Jul 25 16:20:17.982671 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:17.987445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] Returning 404 to user: Instance d50969ee-a3eb-4bed-9dca-9f314207267e could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:17.991631 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9dcb8e0f-adeb-4ce7-9142-a620c0b017ee tempest-ServerAddressesTestJSON-518994898 tempest-ServerAddressesTestJSON-518994898-project] 10.222.0.105 "GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e" status: 404 len: 111 microversion: 2.1 time: 0.159442 Jul 25 16:20:17.993611 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1465/3016] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:17 2022] GET /compute/v2.1/servers/d50969ee-a3eb-4bed-9dca-9f314207267e => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:18.005577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d930981f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:18.225839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:20:18.233022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group f22baf2e-a395-4332-8502-1e56606398ae not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:20:18.234276 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.234276 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae HTTP/1.1 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'f22baf2e-a395-4332-8502-1e56606398ae'} Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:20:18.240363 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-2575e0bf-85be-492e-9fb9-2b2577b6be77'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd5800e7-668f-4b16-b0be-6b3c2c7036c1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae" status: 404 len: 194 microversion: 2.1 time: 0.246200 Jul 25 16:20:18.256438 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1466/3017] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:20:17 2022] GET /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae => generated 194 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:18.263549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:18.265296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:18.276799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:18.277580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:18.278769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:18.279440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:18.750426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:18.782317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1c5f34a-09d1-4169-8b6b-c773a6e083e6 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1373 microversion: 2.1 time: 0.920137 Jul 25 16:20:18.784318 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1552/3018] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:17 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1373 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:18.795440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46040878-b400-4b04-b5f3-7cb5192b39bf tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d92f0a5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:19.073827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:19.120434 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04b441d0-8c4f-4d4b-af36-bf4935ce2b8b tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 200 len: 1473 microversion: 2.1 time: 0.867566 Jul 25 16:20:19.122662 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1467/3019] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:18 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 1473 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:19.134694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:19.136374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:19.157984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:19.160140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:19.165982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:19.167592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:19.604750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:19.634477 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac0ae34f-c508-487b-abbc-299825c97d51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1691 microversion: 2.1 time: 0.509010 Jul 25 16:20:19.635303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1468/3020] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:19 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1691 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:19.656982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-07bc1630-5fd1-4071-bcef-a1e86d106c2d req-3bd22d48-34af-4394-948a-a4d6e65640d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a771c8ea-8a7c-4c05-aa91-615a1bd77788", "name": "network-vif-deleted", "tag": "2f0f3a6d-e306-4860-8a74-7a3f40436ddc"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:19.695732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-07bc1630-5fd1-4071-bcef-a1e86d106c2d req-3bd22d48-34af-4394-948a-a4d6e65640d7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:19.696837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-07bc1630-5fd1-4071-bcef-a1e86d106c2d req-3bd22d48-34af-4394-948a-a4d6e65640d7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:19.720120 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-07bc1630-5fd1-4071-bcef-a1e86d106c2d req-3bd22d48-34af-4394-948a-a4d6e65640d7 service nova] Creating event network-vif-deleted:2f0f3a6d-e306-4860-8a74-7a3f40436ddc for instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 on n-h2-846219-13 Jul 25 16:20:19.726975 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-46040878-b400-4b04-b5f3-7cb5192b39bf tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503" status: 202 len: 0 microversion: 2.1 time: 0.940375 Jul 25 16:20:19.728245 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1553/3021] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:20:18 2022] DELETE /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503 => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:19.733965 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-07bc1630-5fd1-4071-bcef-a1e86d106c2d req-3bd22d48-34af-4394-948a-a4d6e65640d7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093119 Jul 25 16:20:19.742587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da4b31b80>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:19.758280 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1469/3022] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:19.814484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:20:19.821653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group c0f50dc2-35ad-4681-90ac-61b342aed503 not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:20:19.823244 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.823244 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503 HTTP/1.1 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'c0f50dc2-35ad-4681-90ac-61b342aed503'} Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:20:19.833782 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] Jul 25 16:20:19.839719 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:19.846468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:20:19.846468 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-6a0dcace-3328-41b2-9a47-a935226e2a6d'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:19.847896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30ac72b8-f1db-4e04-8c87-080f37bbc2e3 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503" status: 404 len: 194 microversion: 2.1 time: 0.111281 Jul 25 16:20:19.848643 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1554/3023] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:20:19 2022] GET /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:19.850813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:19.852244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:19.874191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:19.875485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:19.876866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:19.878202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:19.896398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30211ca8-31cc-49fd-b1a2-80fb019a1ed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da01c9ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:20.308790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:20.323543 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-676c759c-469c-443f-92d5-ea2f8d62ae11 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1559 microversion: 2.1 time: 0.505523 Jul 25 16:20:20.338695 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1470/3024] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:19 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1559 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:20.344143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:20.344707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: a771c8ea-8a7c-4c05-aa91-615a1bd77788] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:20.379197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.381878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.383754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.386085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.425235 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] HTTP exception thrown: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 could not be found. Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Request method failure captured: Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 HTTP/1.1 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJpjT0wC6T2v_6ChYnq8JfnCOLvUiuIZow5jyL_tA3gWIRPam9OCDyAP-mdyeLYoEjgiWF_zrq4yDbwNM0U0_QH4xmjHO4ziLoQNc_ZGGaZjMCdpV7S1UpqXGfyo11gf2UdUR2_sMKDnfrkIwQ2uPv9MDWJ9b1fN_EKzZBX_iND-Kg Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8056e2216b24a9b92f7143f0660956b Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1604350319 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8056e2216b24a9b92f7143f0660956b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8056e2216b24a9b92f7143f0660956b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8056e2216b24a9b92f7143f0660956b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8056e2216b24a9b92f7143f0660956b"}]}] Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1604350319 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8056e2216b24a9b92f7143f0660956b Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1604350319 Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminNegativeTestJSON-1604350319-project Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a7cd4c3e36314b4eb141cd3a672c3b0a Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1604350319-project Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 could not be found. Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'a771c8ea-8a7c-4c05-aa91-615a1bd77788'} Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 could not be found. Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 could not be found. Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.430284 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 could not be found. Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Returning 404 to user: Instance a771c8ea-8a7c-4c05-aa91-615a1bd77788 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-005c4daa-9438-48bc-a505-589e4cc633a9 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788" status: 404 len: 111 microversion: 2.1 time: 0.096262 Jul 25 16:20:20.445696 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1471/3025] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:20 2022] GET /compute/v2.1/servers/a771c8ea-8a7c-4c05-aa91-615a1bd77788 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:20.469522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:20.469522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:20.486376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.486690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.487990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.488524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.628268 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30211ca8-31cc-49fd-b1a2-80fb019a1ed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167" status: 202 len: 0 microversion: 2.1 time: 0.767119 Jul 25 16:20:20.628533 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9aa1ac8-95f6-4fba-8bf4-418b73a3ec24 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185277 Jul 25 16:20:20.631267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1472/3026] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:20:20 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:20.631454 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1555/3027] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:20:19 2022] DELETE /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:20.638461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:20.639734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:20.644848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d9304aca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:20.655014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.656267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.657602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.658950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.703050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:20:20.764274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:20:20.765310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group 93ea0541-4a46-4bf7-a953-cc8afa234167 not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:20:20.765982 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.765982 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167 HTTP/1.1 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '93ea0541-4a46-4bf7-a953-cc8afa234167'} Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:20:20.769142 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-1742dd55-e5f3-4779-9483-e7cc08dc9194'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa3e4e0a-1054-4c94-b39c-a48c8507eed8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167" status: 404 len: 194 microversion: 2.1 time: 0.134087 Jul 25 16:20:20.779263 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1473/3028] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:20:20 2022] GET /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167 => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:20.802057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:20.805867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:20.843054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.844262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.846578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:20.847879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:20.936555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e5c409d-1ecd-4bbf-8480-91aaf2e136b6 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "DELETE /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 204 len: 0 microversion: 2.1 time: 0.301096 Jul 25 16:20:20.943345 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1556/3029] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:20:20 2022] DELETE /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:20:20.980593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d30f509a-1d5c-4518-a40e-868fa66130f9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d92e70700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:22.196212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:22.202915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:22.220000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d30f509a-1d5c-4518-a40e-868fa66130f9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.273760 Jul 25 16:20:22.221079 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1557/3030] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:20:20 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:22.233631 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-102453d1-f020-4264-992b-30cec3a0ed0a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1691 microversion: 2.1 time: 1.455650 Jul 25 16:20:22.239759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:22.242071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:22.254453 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1474/3031] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:20 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1691 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:22.280402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:22.289528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2798179f-7e83-430d-826d-edb9e80e335a req-6bd23498-aa26-43b8-8fca-53ab1b899b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-plugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:22.291043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:22.300503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:22.302123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:22.365205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2798179f-7e83-430d-826d-edb9e80e335a req-6bd23498-aa26-43b8-8fca-53ab1b899b77 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:22.366198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2798179f-7e83-430d-826d-edb9e80e335a req-6bd23498-aa26-43b8-8fca-53ab1b899b77 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:22.392502 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2798179f-7e83-430d-826d-edb9e80e335a req-6bd23498-aa26-43b8-8fca-53ab1b899b77 service nova] Creating event network-vif-plugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:20:22.411092 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2798179f-7e83-430d-826d-edb9e80e335a req-6bd23498-aa26-43b8-8fca-53ab1b899b77 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154113 Jul 25 16:20:22.417653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1475/3032] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:22.432810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71766cae-1985-4d08-bed5-2440bebb4899 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d9304a940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1623732773", "description": "tempest-description-511172448"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:23.197437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:23.227631 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-55fb6786-fe8b-4825-a33b-67e1024fd005 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1480 microversion: 2.1 time: 1.000450 Jul 25 16:20:23.233290 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1558/3033] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:22 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1480 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:23.287603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:23.289982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:23.320299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:23.324569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:23.326614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:23.332846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:23.359775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:23.940614 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71766cae-1985-4d08-bed5-2440bebb4899 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.519937 Jul 25 16:20:23.943087 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1476/3034] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:20:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:23.966760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65e50b0a-627f-482f-8c9b-3bc856bff457 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d930cbf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2021265229", "description": "tempest-description-150102097"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:24.213055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:24.223093 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e18ebd3-1947-4e62-b5b1-8642b57dafa4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1691 microversion: 2.1 time: 0.944044 Jul 25 16:20:24.238441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1559/3035] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:23 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1691 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:24.742540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "bf3065ac-39f1-4061-8c71-2ac131cdc6d3"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:24.748662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:24.756742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:24.762161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:24.763150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:24.766734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:24.770643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:25.012396 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] HTTP exception thrown: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Request method failure captured: Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments/1e00c61f-4828-4914-80af-69ce2fa427e0 HTTP/1.1 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 74 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sIlf_NvBc2WuNqDI-0A7Q3fKHgAx35G0J2PVVVAHLF4fcYOR6B3xiCavfgKbOiueRk-z5HgIqxSikpCgBMbPxJPHWu7LhonOIhZlXe0yzCJFhYAZtVbneefeyf9AR_Kdzz_0BNcZw7ofXyy1JfGwsZuS-6fTEf_xK2k3bnEo0N1KG8 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7aea0849f8594a7d84576865f79e81b9 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesAdminNegativeTest-1777645035 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7aea0849f8594a7d84576865f79e81b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7aea0849f8594a7d84576865f79e81b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7aea0849f8594a7d84576865f79e81b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7aea0849f8594a7d84576865f79e81b9"}]}] Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesAdminNegativeTest-1777645035 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7aea0849f8594a7d84576865f79e81b9 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1777645035 Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesAdminNegativeTest-1777645035-project-admin Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d2b9496d86c647fb8315f9e229b519ef Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesAdminNegativeTest-1777645035-project-admin Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: {"volumeAttachment": {"volumeId": "bf3065ac-39f1-4061-8c71-2ac131cdc6d3"}} Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': '3cf904be-f686-4f48-8a1f-dd55644b1973', 'id': '1e00c61f-4828-4914-80af-69ce2fa427e0', 'body': {'volumeAttachment': {'volumeId': 'bf3065ac-39f1-4061-8c71-2ac131cdc6d3'}}} Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. (HTTP 404) (Request-ID: req-b3ebfb56-3156-4737-85ec-978ce1cec262) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:20:25.045796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. Jul 25 16:20:25.051388 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:25.071723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Returning 400 to user: Volume bf3065ac-39f1-4061-8c71-2ac131cdc6d3 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:25.073357 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82378562-c1b5-45c8-b4d5-97ee708a786a tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] 10.222.0.105 "PUT /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments/1e00c61f-4828-4914-80af-69ce2fa427e0" status: 400 len: 107 microversion: 2.1 time: 0.832889 Jul 25 16:20:25.074569 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1560/3036] 10.222.0.105 () {60 vars in 1438 bytes} [Mon Jul 25 16:20:24 2022] PUT /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments/1e00c61f-4828-4914-80af-69ce2fa427e0 => generated 107 bytes in 835 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:20:25.093273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:25.098742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:25.119700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:25.124297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:25.127220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:25.128078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:25.707254 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65e50b0a-627f-482f-8c9b-3bc856bff457 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.751806 Jul 25 16:20:25.709323 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1477/3037] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:20:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:25.727533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:25.736387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:25.780247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:25.790349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:25.792487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:25.809315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:26.030358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:26.056802 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-658eac70-8867-45ad-bf8b-873546e58fe3 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1480 microversion: 2.1 time: 0.980177 Jul 25 16:20:26.057526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1561/3038] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:25 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1480 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:26.096601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:26.109928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:26.125990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:26.130163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:26.131145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:26.131604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:26.132429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lazy-loading 'services' on Instance uuid 3cf904be-f686-4f48-8a1f-dd55644b1973 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:20:26.346352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-285a7955-5ea5-43d8-b2b1-46d50d9a4916 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments/1e00c61f-4828-4914-80af-69ce2fa427e0" status: 202 len: 0 microversion: 2.1 time: 0.611467 Jul 25 16:20:26.372593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1478/3039] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:20:25 2022] DELETE /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments/1e00c61f-4828-4914-80af-69ce2fa427e0 => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:26.400580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-750529804", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "bc55adf3-2eb0-4513-90ea-bd718828a6db"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:26.611407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] validate_networks() for [('bc55adf3-2eb0-4513-90ea-bd718828a6db', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:20:26.750749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:26.769359 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f0e31d0-c2d8-40dd-b75c-dbb56699256f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.682863 Jul 25 16:20:26.770079 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1562/3040] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:26 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:26.797607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6c7e6e8b-5205-4055-aacd-305592137265 req-8bc44290-e1df-43f6-9b3b-872ed764f69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f607753-b3cb-4845-a1f8-d33b12d069eb", "tag": "aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:26.846121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6c7e6e8b-5205-4055-aacd-305592137265 req-8bc44290-e1df-43f6-9b3b-872ed764f69f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:26.846636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6c7e6e8b-5205-4055-aacd-305592137265 req-8bc44290-e1df-43f6-9b3b-872ed764f69f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:26.877490 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6c7e6e8b-5205-4055-aacd-305592137265 req-8bc44290-e1df-43f6-9b3b-872ed764f69f service nova] Creating event network-changed:aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9 for instance 4f607753-b3cb-4845-a1f8-d33b12d069eb on n-h2-846219-13 Jul 25 16:20:26.909493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6c7e6e8b-5205-4055-aacd-305592137265 req-8bc44290-e1df-43f6-9b3b-872ed764f69f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116113 Jul 25 16:20:26.915129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1563/3041] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:26.934900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:26.947295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:26.983141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:26.983609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:26.984429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:26.984900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:27.069698 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ec4f979-ddb8-4368-85f2-284e687d51f6 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147255 Jul 25 16:20:27.075019 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1564/3042] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:26 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:27.085649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:27.086034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:27.095888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:27.096346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:27.097216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:27.097676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:27.287689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:27.288255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:27.288605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lazy-loading 'fault' on Instance uuid 177a0689-fe36-400d-8854-8254202549f6 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:20:27.861285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cd4c3e36314b4eb141cd3a672c3b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8056e2216b24a9b92f7143f0660956b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:27.870160 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da719dd9-79f3-44a1-9241-bed2eb6bd419 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 200 len: 1315 microversion: 2.1 time: 0.788742 Jul 25 16:20:27.886213 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1565/3043] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:27 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:27.892952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:27.895028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:27.902402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:27.903240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:27.904278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:27.905606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:28.902620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:20:28.903242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:20:28.903509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:20:28.903911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:20:28.904519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:20:28.928352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:28.936021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:28.937435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:28.938066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:28.989787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Getting quotas for project fe557f25c6cd4c3d806cfb25a2408c02. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:20:28.999824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Getting quotas for user 1834237759744f1f9c512cbeabfc56fc and project fe557f25c6cd4c3d806cfb25a2408c02. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:20:29.035863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:20:29.049000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:20:29.056709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:29.065895 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0f8ad4b5-59c9-4e9c-ba20-de40548386b1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 1.177937 Jul 25 16:20:29.089016 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1566/3044] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:27 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:29.106994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:29.113652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:29.128097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:29.128818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:29.129942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:29.130680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:29.211529 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86818dc0-e1b7-4fe0-b0bb-ad8a747da6b7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.833248 Jul 25 16:20:29.225041 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1479/3045] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:20:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:20:29.225670 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-23a1a39b-1a41-4e3b-a83b-b28a843a4160 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127211 Jul 25 16:20:29.226506 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1567/3046] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:29 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:29.230986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:29.236208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] [instance: 177a0689-fe36-400d-8854-8254202549f6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:29.243614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ddc3b277-3f61-499d-a498-9884c67378d2 req-e3c1029a-a8c2-436d-ab7a-860e8a7c5465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177a0689-fe36-400d-8854-8254202549f6", "name": "network-vif-deleted", "tag": "d3b43cd0-a1e0-4de7-aba6-15a1c467a210"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:29.252692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:29.261545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:29.265624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:29.275102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:29.314238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ddc3b277-3f61-499d-a498-9884c67378d2 req-e3c1029a-a8c2-436d-ab7a-860e8a7c5465 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:29.314701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ddc3b277-3f61-499d-a498-9884c67378d2 req-e3c1029a-a8c2-436d-ab7a-860e8a7c5465 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:29.326565 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] HTTP exception thrown: Instance 177a0689-fe36-400d-8854-8254202549f6 could not be found. Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Request method failure captured: Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 HTTP/1.1 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJpjT0wC6T2v_6ChYnq8JfnCOLvUiuIZow5jyL_tA3gWIRPam9OCDyAP-mdyeLYoEjgiWF_zrq4yDbwNM0U0_QH4xmjHO4ziLoQNc_ZGGaZjMCdpV7S1UpqXGfyo11gf2UdUR2_sMKDnfrkIwQ2uPv9MDWJ9b1fN_EKzZBX_iND-Kg Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8056e2216b24a9b92f7143f0660956b Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1604350319 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8056e2216b24a9b92f7143f0660956b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8056e2216b24a9b92f7143f0660956b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8056e2216b24a9b92f7143f0660956b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8056e2216b24a9b92f7143f0660956b"}]}] Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1604350319 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8056e2216b24a9b92f7143f0660956b Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1604350319 Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminNegativeTestJSON-1604350319-project Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a7cd4c3e36314b4eb141cd3a672c3b0a Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1604350319-project Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 177a0689-fe36-400d-8854-8254202549f6 could not be found. Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '177a0689-fe36-400d-8854-8254202549f6'} Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177a0689-fe36-400d-8854-8254202549f6 could not be found. Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177a0689-fe36-400d-8854-8254202549f6 could not be found. Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:29.341026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177a0689-fe36-400d-8854-8254202549f6 could not be found. Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] Returning 404 to user: Instance 177a0689-fe36-400d-8854-8254202549f6 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:29.345917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4b01b91-1156-4b74-94bc-3fe0101e3570 tempest-ServersAdminNegativeTestJSON-1604350319 tempest-ServersAdminNegativeTestJSON-1604350319-project] 10.222.0.105 "GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6" status: 404 len: 111 microversion: 2.1 time: 0.116060 Jul 25 16:20:29.350129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1480/3047] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:29 2022] GET /compute/v2.1/servers/177a0689-fe36-400d-8854-8254202549f6 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:29.368149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb6680d5-7c24-4dc0-adc2-71c53131f8e5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:29.369456 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ddc3b277-3f61-499d-a498-9884c67378d2 req-e3c1029a-a8c2-436d-ab7a-860e8a7c5465 service nova] Creating event network-vif-deleted:d3b43cd0-a1e0-4de7-aba6-15a1c467a210 for instance 177a0689-fe36-400d-8854-8254202549f6 on n-h2-846219-13 Jul 25 16:20:29.375169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb6680d5-7c24-4dc0-adc2-71c53131f8e5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:29.389468 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ddc3b277-3f61-499d-a498-9884c67378d2 req-e3c1029a-a8c2-436d-ab7a-860e8a7c5465 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154171 Jul 25 16:20:29.390952 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1568/3048] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:29.652050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fb6680d5-7c24-4dc0-adc2-71c53131f8e5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:29.664686 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb6680d5-7c24-4dc0-adc2-71c53131f8e5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1219 microversion: 2.1 time: 0.307966 Jul 25 16:20:29.665379 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1481/3049] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:29 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1219 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:30.098670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:30.100064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:30.131957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:30.156677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:30.160743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:30.169702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:30.238905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:30.243072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:30.276156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:30.276612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:30.277467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:30.277915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:30.365272 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-adbb22a5-e1d4-49b6-86ec-894d5353c414 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130701 Jul 25 16:20:30.377498 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1482/3050] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:30 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:30.697342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:30.698106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:30.709504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:30.709980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:30.711030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:30.716927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:30.776762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:30.785347 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca24ec0a-36ef-4034-abcb-849b42f9bd18 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.692533 Jul 25 16:20:30.810828 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1569/3051] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:30 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:30.888323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:30.908431 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d3e1cae-868d-4f78-943f-f5bc908b194e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1223 microversion: 2.1 time: 0.221734 Jul 25 16:20:30.911843 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1483/3052] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:30 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1223 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:31.379161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:31.381612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:31.426409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:31.426976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:31.437044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:31.438295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:31.514445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-075129d5-125e-45b5-b845-b25b02b16b34 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139824 Jul 25 16:20:31.516376 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1570/3053] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:31 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:31.827785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:31.829655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:31.917853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:31.919914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:31.932323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:31.949790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:31.950845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:31.955158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:32.026655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:32.030015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:32.040604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:32.043933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:32.556989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:32.585676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-61b708e6-6db7-4b59-b4b0-6e2a2c534182 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1279 microversion: 2.1 time: 0.645741 Jul 25 16:20:32.586654 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1571/3054] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:31 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1279 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:32.606830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:32.620612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:32.667224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:32.672954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:32.680232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:32.682736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:32.772636 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c4727312-8c88-4191-8980-ab3df2c4eabf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184796 Jul 25 16:20:32.774345 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1572/3055] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:32 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:33.084025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:33.146823 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f76983c4-eab0-4c0d-a24c-c1fa71dd12ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 1.324167 Jul 25 16:20:33.171926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1484/3056] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:31 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:33.626805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:33.628066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:33.644216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:33.645071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:33.646128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:33.646748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:33.790038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:33.792798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:33.809085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:33.809945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:33.811032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:33.811674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:33.831768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:33.846534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b5194997-6107-48e9-9a40-a1fe92f1806a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1277 microversion: 2.1 time: 0.225785 Jul 25 16:20:33.865581 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1573/3057] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:33 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:33.899556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04b9559c-8993-41dd-b41d-4f8a57b92a16 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115385 Jul 25 16:20:33.900909 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1485/3058] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:33 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:20:34.200022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:34.201069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:34.209348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:34.210318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:34.211374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:34.212061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:34.877787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:34.879826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:34.895921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:34.896934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:34.898065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:34.898738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:35.068427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:35.081030 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c710f629-e1bb-46fb-b12a-20db99141237 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.885201 Jul 25 16:20:35.090150 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1574/3059] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:34 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:35.122841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:35.137449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:35.148384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:35.149711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:35.150827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:35.151588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:35.216403 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89f06896-5915-4f21-b12c-7fc376ab8dbf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107762 Jul 25 16:20:35.220981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1575/3060] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:35 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:36.113237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:36.113993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:36.126556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:36.127606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:36.130428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:36.131003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75c6e33d-4a90-4233-8b29-113c899beb27 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 1.656478 Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1486/3061] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:34 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:36.552029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:36.603592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3bd432a8-489d-4568-8247-6f580ffbf9d7 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071071 Jul 25 16:20:36.605087 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1487/3062] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:20:36 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:20:36.934523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:36.949772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f39169c2-a973-42fa-9813-56af0dd155d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.840291 Jul 25 16:20:36.974847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1576/3063] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:36 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:37.024309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-916806776", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2ce4d82d-6868-453d-9a90-220914af0e74"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:37.182657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] validate_networks() for [('2ce4d82d-6868-453d-9a90-220914af0e74', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:20:37.572781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:37.575125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:37.615350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:37.616170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:37.617500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:37.617989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:37.646295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:38.836107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:20:38.836678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:20:38.837180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:20:38.837649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:20:38.838121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:20:38.862051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:38.862765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:38.866119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:38.868186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:38.897967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Getting quotas for project 5fbadf69c41746339f1711ec9cea2ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:20:38.906674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Getting quotas for user 83bf735d88e34c6caa3514f80a4e1560 and project 5fbadf69c41746339f1711ec9cea2ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:20:38.934945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:20:38.940123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:20:39.052294 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-be1b86b1-4e50-49b2-a892-93b84c31469d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.011113 Jul 25 16:20:39.056724 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1488/3064] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:20:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:20:39.121408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:39.123979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:39.164674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:39.166761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:39.169868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:39.172029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:39.249010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:39.273062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ce13dade-118e-4e89-b2f3-e20c1f00e9fc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 1.701372 Jul 25 16:20:39.274706 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1577/3065] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:37 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:39.281764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-39e623f2-d229-4f39-bd19-3ce3148f2999 req-aeb045a5-0fbc-4c91-b5cf-04c381c23649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2c8571-777f-4f24-8782-06f68d769ec8", "tag": "dde606b2-3916-498b-8d22-d9dfa91080d9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:39.309352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-39e623f2-d229-4f39-bd19-3ce3148f2999 req-aeb045a5-0fbc-4c91-b5cf-04c381c23649 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:39.310288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-39e623f2-d229-4f39-bd19-3ce3148f2999 req-aeb045a5-0fbc-4c91-b5cf-04c381c23649 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:39.363105 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-39e623f2-d229-4f39-bd19-3ce3148f2999 req-aeb045a5-0fbc-4c91-b5cf-04c381c23649 service nova] Creating event network-changed:dde606b2-3916-498b-8d22-d9dfa91080d9 for instance 5a2c8571-777f-4f24-8782-06f68d769ec8 on n-h1-846219-13 Jul 25 16:20:39.388962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-39e623f2-d229-4f39-bd19-3ce3148f2999 req-aeb045a5-0fbc-4c91-b5cf-04c381c23649 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110804 Jul 25 16:20:39.393765 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1578/3066] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:39.412320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f60dfd74-1d93-44d7-8e68-95c2812a63d2 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:39.414562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f60dfd74-1d93-44d7-8e68-95c2812a63d2 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:39.632139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f60dfd74-1d93-44d7-8e68-95c2812a63d2 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:39.640590 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f60dfd74-1d93-44d7-8e68-95c2812a63d2 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1221 microversion: 2.1 time: 0.244982 Jul 25 16:20:39.643723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1579/3067] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:39 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1221 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:39.907569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:39.921404 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cb3124f2-407b-4d8a-bbdd-3b6053c626b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.863058 Jul 25 16:20:39.934625 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1489/3068] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:39 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:40.316577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:40.317661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:40.333717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:40.334461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:40.336285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:40.337529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:40.664518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:40.665625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:40.674029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:40.674906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:40.676398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:40.677234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:40.856570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:40.868308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:40.909968 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c488665-b409-451e-9ed0-a49dd9b2d189 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 0.583519 Jul 25 16:20:40.914045 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1580/3069] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:40 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:40.916304 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97369716-25cc-4ba4-9739-e7ed27efbfb9 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1273 microversion: 2.1 time: 0.255929 Jul 25 16:20:40.919824 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1490/3070] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:40 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:40.956129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:40.957595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:40.969361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:40.970253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:40.971388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:40.972179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:41.517617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:41.547323 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5064d457-e45b-4b89-ad28-f8ee3dded1da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.595133 Jul 25 16:20:41.550898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1581/3071] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:40 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:41.951962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:41.952795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:41.954229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:41.954580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:41.982387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:41.984651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:41.987014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:41.987671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:41.988068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:41.989037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:41.994978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:41.996267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:42.149537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:42.182269 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49f07e1d-8ec5-49e5-bee7-1b227c6f5acf tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1279 microversion: 2.1 time: 0.242093 Jul 25 16:20:42.184237 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1582/3072] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:41 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:42.370503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:42.381959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1bc25f1a-1f93-44cf-8955-d9dfcf1b6f15 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 0.449827 Jul 25 16:20:42.384900 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1491/3073] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:41 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:42.579292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:42.580159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:42.594331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:42.595220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:42.597896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:42.600193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:43.209464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:43.218107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:43.253426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:43.254280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:43.255705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:43.256507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:44.547446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:44.567907 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f616d494-9047-4c8a-870b-9d49f036e1ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 1.992759 Jul 25 16:20:44.568951 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1583/3074] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:42 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:44.593003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:44.598683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:44.614338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:44.617350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:44.619343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:44.626383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:45.279426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:45.299813 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd3e668a-856a-460a-a117-ff05f1860f28 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 2.097789 Jul 25 16:20:45.302853 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1492/3075] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:43 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:45.576966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:45.591336 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c4b3486-b8cb-4d6a-82d1-00f951462258 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 1.002415 Jul 25 16:20:45.592576 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1584/3076] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:44 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:45.593358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:45.594287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:45.611893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:45.615921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:45.617545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:45.618323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:46.329450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:46.330560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:46.354017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:46.355013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:46.356307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:46.360632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:46.435799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:46.455777 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5dca93eb-0ae6-4b45-8e60-d6005e32ae8e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.868262 Jul 25 16:20:46.456428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1493/3077] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:45 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:46.614991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:46.616248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:46.637004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:46.637492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:46.638299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:46.638832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:47.547480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:47.561554 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-749375b9-da35-4cd1-bd91-2dda4c5c3419 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 1.239959 Jul 25 16:20:47.565632 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1585/3078] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:46 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:47.573562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:47.582262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:47.596932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:47.602091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:47.603513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:47.604192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:47.638867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:47.659365 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-96b0d48f-592f-4c8d-a26c-b6b71949677b tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 1.049128 Jul 25 16:20:47.665309 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1494/3079] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:46 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:20:48.330860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:48.344265 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67a28adc-7fcb-473c-9d1f-c7343267b608 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.777003 Jul 25 16:20:48.348052 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1586/3080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:47 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:48.595896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:48.596701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-08b75c96-80c8-4c3a-bb9a-25f818aa319a req-c5c943b4-9fb3-4204-beb0-094f79d18d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5304703b-01e9-4326-8711-a3313b59142f", "tag": "63b87af8-6e62-49a6-a685-e3a2a0114881"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:48.597953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:48.640483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:48.649716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:48.650529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:48.657750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:48.658315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:48.670215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-08b75c96-80c8-4c3a-bb9a-25f818aa319a req-c5c943b4-9fb3-4204-beb0-094f79d18d37 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:48.670794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-08b75c96-80c8-4c3a-bb9a-25f818aa319a req-c5c943b4-9fb3-4204-beb0-094f79d18d37 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:48.744276 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-08b75c96-80c8-4c3a-bb9a-25f818aa319a req-c5c943b4-9fb3-4204-beb0-094f79d18d37 service nova] Creating event network-changed:63b87af8-6e62-49a6-a685-e3a2a0114881 for instance 5304703b-01e9-4326-8711-a3313b59142f on n-h2-846219-13 Jul 25 16:20:48.767825 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-08b75c96-80c8-4c3a-bb9a-25f818aa319a req-c5c943b4-9fb3-4204-beb0-094f79d18d37 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182883 Jul 25 16:20:48.770522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1587/3081] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:48.777514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:48.779057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:48.786442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:48.787463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:48.788699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:48.789613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:48.881296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:48.921192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=14 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:49.400878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:49.407232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:49.414903 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b76c89b-a2b5-4cc8-8dc5-37603b239edc tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 0.831503 Jul 25 16:20:49.426699 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8a9411f4-06d7-4d5a-81be-bba27c3efc2d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 0.653669 Jul 25 16:20:49.427389 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1588/3082] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:48 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:49.435343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1495/3083] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:48 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:49.454529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:49.455131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:49.471179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:49.472220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:49.473821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:49.474925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:49.593498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c3d382db-269d-433b-9210-deb346785c96 req-38753682-0fd5-4cdd-abde-f55a0703ae07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2c8571-777f-4f24-8782-06f68d769ec8", "name": "network-vif-plugged", "status": "completed", "tag": "dde606b2-3916-498b-8d22-d9dfa91080d9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:49.633359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c3d382db-269d-433b-9210-deb346785c96 req-38753682-0fd5-4cdd-abde-f55a0703ae07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:49.635604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c3d382db-269d-433b-9210-deb346785c96 req-38753682-0fd5-4cdd-abde-f55a0703ae07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:49.637689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:49.689894 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c3d382db-269d-433b-9210-deb346785c96 req-38753682-0fd5-4cdd-abde-f55a0703ae07 service nova] Creating event network-vif-plugged:dde606b2-3916-498b-8d22-d9dfa91080d9 for instance 5a2c8571-777f-4f24-8782-06f68d769ec8 on n-h1-846219-13 Jul 25 16:20:49.733716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c3d382db-269d-433b-9210-deb346785c96 req-38753682-0fd5-4cdd-abde-f55a0703ae07 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145956 Jul 25 16:20:49.740002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1496/3084] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:49.978855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:49.994132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c992e5a-cd85-43bb-bb7f-00b9eb91dfc3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.561296 Jul 25 16:20:50.000142 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1589/3085] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:49 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:50.442294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:50.453917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:50.454648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:50.455009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:50.463060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:50.463950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:50.464906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:50.465574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:50.472606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:50.474166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:50.479902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:50.480782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:50.562767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:50.752122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:50.761415 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc81bce3-0e38-4d0e-bd2d-80c921465e79 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 0.311595 Jul 25 16:20:50.769507 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1590/3086] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:50 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:50.814234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:50.824141 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f9131b7-0667-40c2-976a-1b1ffe7e3f74 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 0.388102 Jul 25 16:20:50.828696 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1497/3087] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:50 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:51.018024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:51.019537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:51.035395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:51.036099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:51.037281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:51.037890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:51.654593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:51.670371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1b929cf-f513-4612-bbb0-ba4a760b83eb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 0.656229 Jul 25 16:20:51.693126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1591/3088] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:51 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:51.792188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:51.793297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:51.815163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:51.815985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:51.816860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:51.819803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:51.851388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:51.852352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:51.868176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:51.870943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:51.872877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:51.875571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:53.080554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:53.090892 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5245601a-34e8-4893-9694-706373ab4ce8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 1.245347 Jul 25 16:20:53.099990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1592/3089] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:51 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:53.119521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:53.120623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:53.142055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:53.142954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:53.146272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:53.147193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:53.574978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:53.591704 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40186bea-59b1-415e-b39f-c23729b39eae tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1319 microversion: 2.1 time: 1.803754 Jul 25 16:20:53.599349 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1498/3090] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:51 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1319 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:54.129585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:54.130281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:54.208326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:54.231462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:54.235973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:54.239076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:55.145856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:55.200720 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9eb2344d-86af-46f2-b61d-d670a5718938 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1686 microversion: 2.1 time: 2.098790 Jul 25 16:20:55.204343 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1593/3091] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:53 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1686 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:55.215779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:55.217143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:55.231011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=72 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:55.237301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:55.243710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:55.245810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:55.248795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:55.430804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:55.457972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0dc1e454-e1f3-4c18-982d-04703fe927ba tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 1.335901 Jul 25 16:20:55.485732 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1499/3092] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:54 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:55.777683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:55.793065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-47b08380-14d3-48f9-bbcf-422b683b62f8 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1506 microversion: 2.1 time: 0.587385 Jul 25 16:20:55.813421 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1594/3093] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:55 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:55.828222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1623732773"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:55.829706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:55.846853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:55.847332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:55.848329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:55.859295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:56.225538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:56.226270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:56.241272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:56.243485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:56.245417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:56.248085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:56.428349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Adding security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 to port dde606b2-3916-498b-8d22-d9dfa91080d9 Jul 25 16:20:56.699663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:56.711396 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b586b5e-e201-46bc-a5fb-a144f0662982 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.489174 Jul 25 16:20:56.730572 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1595/3094] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:56 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:56.735835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:56.739291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:56.749451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:56.750229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:56.751209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:56.751802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:56.802141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:57.372675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:57.390949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a60c3372-4a11-40f6-93cf-c9e4c94c6054 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 0.659035 Jul 25 16:20:57.394522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1596/3095] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:56 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:57.580198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-25500a89-b0ea-4be1-ad1d-2288a2ee2806 req-7eae17d3-2d49-4df7-a8c5-e376650d4150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5304703b-01e9-4326-8711-a3313b59142f", "name": "network-vif-plugged", "status": "completed", "tag": "63b87af8-6e62-49a6-a685-e3a2a0114881"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:57.620956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-25500a89-b0ea-4be1-ad1d-2288a2ee2806 req-7eae17d3-2d49-4df7-a8c5-e376650d4150 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:57.622027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-25500a89-b0ea-4be1-ad1d-2288a2ee2806 req-7eae17d3-2d49-4df7-a8c5-e376650d4150 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:57.647190 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-25500a89-b0ea-4be1-ad1d-2288a2ee2806 req-7eae17d3-2d49-4df7-a8c5-e376650d4150 service nova] Creating event network-vif-plugged:63b87af8-6e62-49a6-a685-e3a2a0114881 for instance 5304703b-01e9-4326-8711-a3313b59142f on n-h2-846219-13 Jul 25 16:20:57.661498 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-25500a89-b0ea-4be1-ad1d-2288a2ee2806 req-7eae17d3-2d49-4df7-a8c5-e376650d4150 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089388 Jul 25 16:20:57.662181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1597/3096] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:20:57.888833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:57.890037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:57.921460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:57.922150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:57.932168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:57.934156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:58.618906 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22f52e34-cf7e-4c49-a61f-f8a54410d57d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8/action" status: 202 len: 0 microversion: 2.1 time: 2.798591 Jul 25 16:20:58.619737 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1500/3097] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:55 2022] POST /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8/action => generated 0 bytes in 2800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:58.624722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:58.625599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:58.638059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:58.650013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:58.652097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:58.652821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:58.678471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:58.697603 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf800d14-8a6e-42a4-9973-04922dc93f20 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.813702 Jul 25 16:20:58.698535 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1598/3098] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:57 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:58.703633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a2446ec-d570-4d6c-89a5-f9e0e19b2589 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da4a5bdc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:59.123857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-1a2446ec-d570-4d6c-89a5-f9e0e19b2589 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use.", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:20:59.124900 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1a2446ec-d570-4d6c-89a5-f9e0e19b2589 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.124900 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a2446ec-d570-4d6c-89a5-f9e0e19b2589 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383 HTTP/1.1 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: exception: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3ae85ea0-a39d-4bdf-9c19-67eadadc7383'} Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:20:59.127938 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a2446ec-d570-4d6c-89a5-f9e0e19b2589 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 400 to user: Security Group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 in use. Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-822d8729-6a23-4a57-a7dc-ac3f9544d09a'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a2446ec-d570-4d6c-89a5-f9e0e19b2589 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383" status: 400 len: 185 microversion: 2.1 time: 0.429923 Jul 25 16:20:59.136353 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1599/3099] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:20:58 2022] DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383 => generated 185 bytes in 431 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:20:59.148399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:20:59.148692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3bc6ffea-1c63-4020-8535-da9c7eb4b037 req-2d5139d1-602e-415c-8178-10c8e2add6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2c8571-777f-4f24-8782-06f68d769ec8", "tag": "dde606b2-3916-498b-8d22-d9dfa91080d9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:59.151818 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7370b023-0724-4038-b61e-d40837d531c8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1321 microversion: 2.1 time: 0.530957 Jul 25 16:20:59.152444 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1501/3100] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:58 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:20:59.182293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:20:59.198752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3bc6ffea-1c63-4020-8535-da9c7eb4b037 req-2d5139d1-602e-415c-8178-10c8e2add6b2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:59.198954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3bc6ffea-1c63-4020-8535-da9c7eb4b037 req-2d5139d1-602e-415c-8178-10c8e2add6b2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:59.207767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:59.233057 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3bc6ffea-1c63-4020-8535-da9c7eb4b037 req-2d5139d1-602e-415c-8178-10c8e2add6b2 service nova] Creating event network-changed:dde606b2-3916-498b-8d22-d9dfa91080d9 for instance 5a2c8571-777f-4f24-8782-06f68d769ec8 on n-h1-846219-13 Jul 25 16:20:59.238391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:59.248509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:59.250654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:59.255552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:59.258024 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3bc6ffea-1c63-4020-8535-da9c7eb4b037 req-2d5139d1-602e-415c-8178-10c8e2add6b2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126431 Jul 25 16:20:59.265233 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1600/3101] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:20:59.544547 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bae71ff3-610a-44cf-b691-7977470fb7f4 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8/action" status: 202 len: 0 microversion: 2.1 time: 0.377445 Jul 25 16:20:59.548561 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1502/3102] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:20:59 2022] POST /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:20:59.568125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:20:59.569130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:20:59.594350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:59.595785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:20:59.597305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:20:59.599970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:00.122164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-935178467", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2d092cd9-2c7a-465d-800a-441e40e4458e"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:00.192684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:00.229886 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c6b72697-aced-4499-a803-1a741c5f051c tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1577 microversion: 2.1 time: 0.672043 Jul 25 16:21:00.244173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1601/3103] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:20:59 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1577 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:00.258007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:00.258870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:00.271165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] validate_networks() for [('2d092cd9-2c7a-465d-800a-441e40e4458e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:21:00.277447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:00.282896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:00.323310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:00.323874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:00.879293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:00.893650 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f561ed71-9fd6-4487-bc1b-7adacf394fcb tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1511 microversion: 2.1 time: 0.661459 Jul 25 16:21:00.899113 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1602/3104] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:00 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1511 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:01.252247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:01.252927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:01.271332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:01.271796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:01.272653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:01.273118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.159997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:02.169274 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d4a26a9-1726-4442-9cee-c96332cc777e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1577 microversion: 2.1 time: 0.920850 Jul 25 16:21:02.173917 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1603/3105] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:01 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1577 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:21:02.180030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:02.180564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:02.213637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.214218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.215416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.216059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.360725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:21:02.361329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:21:02.361675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:21:02.362090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:21:02.362510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:21:02.392081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.393492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.394601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.395229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.437994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:02.460005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for user ccbaed5ca4f5414b9e06fa95dbbac29c and project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:02.494555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:21:02.497509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:21:02.631585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1f042739-9a5f-4de5-992e-7e0d10ea60e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.877619 Jul 25 16:21:02.652147 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1503/3106] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:20:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:21:02.701336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8dbe9e3d-8b14-4b77-a865-25944556d226 req-93b63160-1c11-48ca-8d3a-89f4de58e52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-unplugged", "status": "completed", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:02.735712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:02.750994 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7662e265-f4d2-4962-92ee-b600e42ef2d3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.575232 Jul 25 16:21:02.754774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8dbe9e3d-8b14-4b77-a865-25944556d226 req-93b63160-1c11-48ca-8d3a-89f4de58e52c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.755730 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1604/3107] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:02 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:02.764981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8dbe9e3d-8b14-4b77-a865-25944556d226 req-93b63160-1c11-48ca-8d3a-89f4de58e52c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.769959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e59e376-21e8-45db-ae7f-9ed0cc8c1138 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:02.777410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e59e376-21e8-45db-ae7f-9ed0cc8c1138 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:02.827174 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8dbe9e3d-8b14-4b77-a865-25944556d226 req-93b63160-1c11-48ca-8d3a-89f4de58e52c service nova] Creating event network-vif-unplugged:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:21:02.835529 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8dbe9e3d-8b14-4b77-a865-25944556d226 req-93b63160-1c11-48ca-8d3a-89f4de58e52c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181705 Jul 25 16:21:02.837579 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1504/3108] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:02.847812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:02.848850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:02.872071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.876324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.878974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:02.881479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:02.915165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8e59e376-21e8-45db-ae7f-9ed0cc8c1138 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:02.929909 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e59e376-21e8-45db-ae7f-9ed0cc8c1138 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1211 microversion: 2.1 time: 0.169955 Jul 25 16:21:02.933128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1605/3109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:02 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:03.090956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a3da35d-fe57-4edb-89f6-8f6e8a809077 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Action: 'create', calling method: .version_select at 0x7f9da4a1b3a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-768332017", "policies": ["affinity"]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:03.161420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-9a3da35d-fe57-4edb-89f6-8f6e8a809077 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:03.206620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-9a3da35d-fe57-4edb-89f6-8f6e8a809077 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:03.252422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:03.267432 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9b615f58-04d4-4aa5-b3ef-13357e52816a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.428082 Jul 25 16:21:03.269597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1505/3110] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:02 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:03.292603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:03.296688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:03.328451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:03.330507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:03.334274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:03.337038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:03.375080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-9a3da35d-fe57-4edb-89f6-8f6e8a809077 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:03.395546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-9a3da35d-fe57-4edb-89f6-8f6e8a809077 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:03.446251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a3da35d-fe57-4edb-89f6-8f6e8a809077 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.485886 Jul 25 16:21:03.457692 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1606/3111] 10.222.0.105 () {60 vars in 1179 bytes} [Mon Jul 25 16:21:02 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:03.464206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:03.465216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:03.474137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:03.476039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:03.477166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:03.478471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.398252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:04.408014 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-392cc864-e99b-4e14-9be6-536415a4cad1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.948441 Jul 25 16:21:04.410362 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1607/3112] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:03 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:04.415570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be77a3fb-f0fb-42af-b7e4-da9b1db6460b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Action: 'create', calling method: .version_select at 0x7f9da499b1f0>, body: {"server_group": {"name": "tempest-server-group-713717542", "policies": ["affinity"]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:04.430533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:04.443829 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-131d4e95-ac9c-4161-b77f-f38fe7610884 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1577 microversion: 2.1 time: 1.167822 Jul 25 16:21:04.444596 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1506/3113] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:03 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1577 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:04.449798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:04.451765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:04.452781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-be77a3fb-f0fb-42af-b7e4-da9b1db6460b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:04.459749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:04.460208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.461155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:04.463328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-be77a3fb-f0fb-42af-b7e4-da9b1db6460b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:04.466386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.534165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-be77a3fb-f0fb-42af-b7e4-da9b1db6460b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:04.542428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-be77a3fb-f0fb-42af-b7e4-da9b1db6460b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:04.561423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be77a3fb-f0fb-42af-b7e4-da9b1db6460b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.149278 Jul 25 16:21:04.564300 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1608/3114] 10.222.0.105 () {60 vars in 1178 bytes} [Mon Jul 25 16:21:04 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:04.585240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03efef55-9b5f-4801-ad06-dfbec47c3e81"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:04.588279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:04.597934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:04.598397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.599201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:04.599639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.627669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:04.642232 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24a5388b-53d5-4063-824a-4b16afdc80b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1263 microversion: 2.1 time: 0.196558 Jul 25 16:21:04.643138 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1507/3115] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:04 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:04.662265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:04.664810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:04.675060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:04.675397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.682465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:04.683178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:04.860972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1005317d-7a03-4f9e-98f4-bf6700358b43 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.216351 Jul 25 16:21:04.862728 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1508/3116] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:21:04 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:04.869059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17c30640-d23d-45e9-8b32-0060f4f19584 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Action: 'create', calling method: .version_select at 0x7f9d938871f0>, body: {"server_group": {"name": "tempest-server-group-713717542", "policies": ["affinity"]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:04.891867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17c30640-d23d-45e9-8b32-0060f4f19584 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:04.899794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17c30640-d23d-45e9-8b32-0060f4f19584 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:04.986894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17c30640-d23d-45e9-8b32-0060f4f19584 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:05.001744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17c30640-d23d-45e9-8b32-0060f4f19584 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:05.039756 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17c30640-d23d-45e9-8b32-0060f4f19584 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.174085 Jul 25 16:21:05.045207 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53b925ba-d615-4a88-be1e-1ac6c6da77d8 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "POST /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476369 Jul 25 16:21:05.045207 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1609/3117] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:21:04 2022] POST /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:05.049208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1509/3118] 10.222.0.105 () {60 vars in 1178 bytes} [Mon Jul 25 16:21:04 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:05.066923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-baaa71b6-8eba-494b-b6fd-fe6bc0743eab tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:05.071335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:05.074436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:05.092845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:05.093664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:05.094258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:05.094703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:05.145732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-baaa71b6-8eba-494b-b6fd-fe6bc0743eab tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/9ba19bb2-99af-49fe-bb57-e115b202f771" status: 204 len: 0 microversion: 2.1 time: 0.094675 Jul 25 16:21:05.150376 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1510/3119] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/9ba19bb2-99af-49fe-bb57-e115b202f771 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:05.162701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "432c32a8-589b-4a71-9bab-e0b166618732"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:05.169842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:05.193828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:05.195141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:05.197543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:05.202852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:05.294219 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] HTTP exception thrown: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Request method failure captured: Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: request: PUT /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f/os-volume_attachments/8964d0e8-0981-4cbc-a269-b967d2429734 HTTP/1.1 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 74 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sIlf_NvBc2WuNqDI-0A7Q3fKHgAx35G0J2PVVVAHLF4fcYOR6B3xiCavfgKbOiueRk-z5HgIqxSikpCgBMbPxJPHWu7LhonOIhZlXe0yzCJFhYAZtVbneefeyf9AR_Kdzz_0BNcZw7ofXyy1JfGwsZuS-6fTEf_xK2k3bnEo0N1KG8 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7aea0849f8594a7d84576865f79e81b9 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesAdminNegativeTest-1777645035 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7aea0849f8594a7d84576865f79e81b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7aea0849f8594a7d84576865f79e81b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7aea0849f8594a7d84576865f79e81b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7aea0849f8594a7d84576865f79e81b9"}]}] Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesAdminNegativeTest-1777645035 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7aea0849f8594a7d84576865f79e81b9 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1777645035 Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesAdminNegativeTest-1777645035-project-admin Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: d2b9496d86c647fb8315f9e229b519ef Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesAdminNegativeTest-1777645035-project-admin Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: {"volumeAttachment": {"volumeId": "432c32a8-589b-4a71-9bab-e0b166618732"}} Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: exception: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '5304703b-01e9-4326-8711-a3313b59142f', 'id': '8964d0e8-0981-4cbc-a269-b967d2429734', 'body': {'volumeAttachment': {'volumeId': '432c32a8-589b-4a71-9bab-e0b166618732'}}} Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. (HTTP 404) (Request-ID: req-fd7c8570-7bde-4227-9a11-a4ab363f7b3d) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:21:05.299459 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] Returning 404 to user: Volume 8964d0e8-0981-4cbc-a269-b967d2429734 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b6b2a25-7dbf-4edf-a358-ad03b7f4900c tempest-VolumesAdminNegativeTest-1777645035 tempest-VolumesAdminNegativeTest-1777645035-project-admin] 10.222.0.105 "PUT /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f/os-volume_attachments/8964d0e8-0981-4cbc-a269-b967d2429734" status: 404 len: 109 microversion: 2.1 time: 0.150119 Jul 25 16:21:05.306633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1511/3120] 10.222.0.105 () {60 vars in 1438 bytes} [Mon Jul 25 16:21:05 2022] PUT /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f/os-volume_attachments/8964d0e8-0981-4cbc-a269-b967d2429734 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:05.320899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6355e9f4-68b8-4c21-9585-2bc4682194b5 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:05.360399 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6355e9f4-68b8-4c21-9585-2bc4682194b5 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.049065 Jul 25 16:21:05.369482 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1512/3121] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:21:05 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:05.375295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dfb90607-2285-48a8-bf94-77fd63b2199c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:05.422858 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dfb90607-2285-48a8-bf94-77fd63b2199c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/a6b7e152-b370-4487-8713-5641b1a41a15" status: 204 len: 0 microversion: 2.1 time: 0.050169 Jul 25 16:21:05.430277 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1513/3122] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:05 2022] DELETE /compute/v2.1/os-server-groups/a6b7e152-b370-4487-8713-5641b1a41a15 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:05.444193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d93bf002-4746-4250-aa25-31cbdd8997a7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:05.471527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d93bf002-4746-4250-aa25-31cbdd8997a7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038644 Jul 25 16:21:05.484079 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1514/3123] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:21:05 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:05.495294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:05.497980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:05.507020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:05.514785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:05.516098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:05.517065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:06.095719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:06.107257 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-29ca5b7e-7e0e-4b56-a922-d4bf19a91d49 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1675 microversion: 2.1 time: 1.043983 Jul 25 16:21:06.110599 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1610/3124] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:05 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1675 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:06.122441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acac4265-58e0-48ce-afed-a9874733ab66 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Action: 'create', calling method: .version_select at 0x7f9d92a11040>, body: {"server_group": {"name": "tempest-server-group-2143123745", "policies": ["affinity"]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:06.153923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-acac4265-58e0-48ce-afed-a9874733ab66 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:06.162971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-acac4265-58e0-48ce-afed-a9874733ab66 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:06.204836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:06.238570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-acac4265-58e0-48ce-afed-a9874733ab66 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:06.245873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-acac4265-58e0-48ce-afed-a9874733ab66 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:06.264350 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-acac4265-58e0-48ce-afed-a9874733ab66 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.151641 Jul 25 16:21:06.265395 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1611/3125] 10.222.0.105 () {60 vars in 1178 bytes} [Mon Jul 25 16:21:06 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:06.270778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:06.272709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:06.281428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:06.282146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:06.283393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:06.284050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:06.625080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:06.651491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0e12b651-33e2-4664-89d3-04c3cacdc14e tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1582 microversion: 2.1 time: 1.163519 Jul 25 16:21:06.656857 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1515/3126] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:05 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1582 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:06.671858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:06.683342 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-70271778-3ef0-4aad-aae6-dae2fe984cee tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1269 microversion: 2.1 time: 0.416177 Jul 25 16:21:06.683615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33518ae5-4381-490b-b86d-e3cf9b197b39 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:06.688435 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1612/3127] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:06 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1269 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:06.797313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:06.829423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33518ae5-4381-490b-b86d-e3cf9b197b39 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/017a0eb1-62af-4b77-9645-cdc178812dc9" status: 204 len: 0 microversion: 2.1 time: 0.167111 Jul 25 16:21:06.832783 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1516/3128] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:06 2022] DELETE /compute/v2.1/os-server-groups/017a0eb1-62af-4b77-9645-cdc178812dc9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:06.840922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f184abfe-8293-41f6-8363-185430883349 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:06.899542 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f184abfe-8293-41f6-8363-185430883349 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.063199 Jul 25 16:21:06.915711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f02bc6bb-f936-4120-8617-45d29541287e tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Action: 'create', calling method: .version_select at 0x7f9da4a744c0>, body: {"server_group": {"name": "tempest-server-group-394009516", "policies": ["anti-affinity"]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:06.917006 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1613/3129] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:21:06 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:06.976908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f02bc6bb-f936-4120-8617-45d29541287e tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:06.991483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f02bc6bb-f936-4120-8617-45d29541287e tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:07.088626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f02bc6bb-f936-4120-8617-45d29541287e tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:07.095115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f02bc6bb-f936-4120-8617-45d29541287e tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_groups'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:07.111532 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f02bc6bb-f936-4120-8617-45d29541287e tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.199639 Jul 25 16:21:07.113125 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1517/3130] 10.222.0.105 () {60 vars in 1178 bytes} [Mon Jul 25 16:21:06 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:21:07.124029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc86e14d-4d16-49b4-b150-9dd8a0347bd9 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:07.143339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:07.152612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:07.169721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:07.170170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:07.170963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:07.180778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:07.215385 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc86e14d-4d16-49b4-b150-9dd8a0347bd9 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/67ce4a3c-02b3-49b6-93c1-123d17abac32" status: 204 len: 0 microversion: 2.1 time: 0.095646 Jul 25 16:21:07.221585 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1614/3131] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:07 2022] DELETE /compute/v2.1/os-server-groups/67ce4a3c-02b3-49b6-93c1-123d17abac32 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:07.234947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a685c6a-5f7c-4659-aff5-5d50f2b25b28 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:07.258842 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a685c6a-5f7c-4659-aff5-5d50f2b25b28 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.035273 Jul 25 16:21:07.260563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1615/3132] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:21:07 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:07.331632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-929131013", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "41f95def-b9b9-48ba-aa17-f03b57ba6fa9"}]}, "os:scheduler_hints": {"group": "45551d3e-127f-4126-ae29-006201e4c0bf"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:07.472679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] validate_networks() for [('41f95def-b9b9-48ba-aa17-f03b57ba6fa9', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:21:08.139778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:08.148300 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a25730a5-98de-47ff-b4f4-a00bb8b46135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1680 microversion: 2.1 time: 1.019757 Jul 25 16:21:08.161362 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1518/3133] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:07 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1680 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:08.166481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:08.166481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:08.182763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:08.183221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:08.184019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:08.184462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:08.961839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:08.985405 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d3de1a9-f4f2-47ca-be59-7b3c783420f6 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1575 microversion: 2.1 time: 0.829095 Jul 25 16:21:08.988590 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1519/3134] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:08 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1575 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:09.004964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:09.010900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:09.044686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:09.047948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:09.050866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:09.056123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:10.501080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:10.508616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:10.517000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa1f4e74-5dde-4020-a4f2-17a6250b36fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 1.522214 Jul 25 16:21:10.553871 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1520/3135] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:08 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:10.559832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2021265229"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:10.560293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:10.580386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:10.584920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:10.586210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:10.588692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:11.268819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:21:11.270203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:21:11.271096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:21:11.271875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:21:11.272515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:21:11.315434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:11.315900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:11.318159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:11.318609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:11.382523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:11.407692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:11.450353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:21:11.461333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:21:11.588367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:11.609816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:11.709044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:11.717539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Getting quotas for user 684c5d26a73f477b909a2baabdff021b and project 816e64a7052b4875ac52b887aafe21f3. Resources: {'server_group_members'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:11.771863 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a1a65fc2-3dbd-43bb-acab-4d1d6f5349ee tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.446680 Jul 25 16:21:11.778723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1616/3136] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:21:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 4454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:21:11.797329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:11.799290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:11.817409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:11.819012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:11.824049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:11.824774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:12.087091 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Adding security group f925fc44-cba4-45cc-9e0a-96ceeee0171c to port dde606b2-3916-498b-8d22-d9dfa91080d9 Jul 25 16:21:12.420484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:13.660531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:13.675789 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15effaf3-cf10-41bc-8f9a-b909322ae673 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.895478 Jul 25 16:21:13.682766 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1617/3137] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:11 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:13.688156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:13.688666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:13.718500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:13.718983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:13.721484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:13.721938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:13.790133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:21:14.016671 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a8d82df0-8908-4055-903f-a60a1560509d tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 204 len: 0 microversion: 2.1 time: 0.332371 Jul 25 16:21:14.017402 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1618/3138] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:13 2022] DELETE /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:14.055232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:14.062602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:14.082416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:14.083453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:14.086001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:14.086813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:14.803725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:14.811849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:14.824148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ababdadf-b092-48f7-be3b-b10e225819cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 0.803375 Jul 25 16:21:14.825031 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1619/3139] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:14 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:14.834071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:14.834871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:14.845685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:14.846612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:14.847649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:14.848257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:15.169263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:15.178254 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e684b11c-4068-40cc-bcb9-12114635ca50 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1276 microversion: 2.1 time: 0.351584 Jul 25 16:21:15.178867 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1620/3140] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:14 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1276 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:15.223358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0adcafd5-5f67-4031-bf8b-9199320dbbfe req-bfa76181-8cc2-4429-8a8b-5c6c44a4aeee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619749d4-64ec-4540-bbdb-e5de46fcaceb", "tag": "c405ec60-9082-4e73-a6b1-6d05a7dda98c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:15.254785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0adcafd5-5f67-4031-bf8b-9199320dbbfe req-bfa76181-8cc2-4429-8a8b-5c6c44a4aeee service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:15.255230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0adcafd5-5f67-4031-bf8b-9199320dbbfe req-bfa76181-8cc2-4429-8a8b-5c6c44a4aeee service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:15.280490 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0adcafd5-5f67-4031-bf8b-9199320dbbfe req-bfa76181-8cc2-4429-8a8b-5c6c44a4aeee service nova] Creating event network-changed:c405ec60-9082-4e73-a6b1-6d05a7dda98c for instance 619749d4-64ec-4540-bbdb-e5de46fcaceb on n-h1-846219-13 Jul 25 16:21:15.300820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0adcafd5-5f67-4031-bf8b-9199320dbbfe req-bfa76181-8cc2-4429-8a8b-5c6c44a4aeee service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087692 Jul 25 16:21:15.301675 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1621/3141] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:15.311378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:15.336212 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-820afb7d-87d5-44a8-9233-2ea82f4f9ae1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8/action" status: 202 len: 0 microversion: 2.1 time: 4.781008 Jul 25 16:21:15.337451 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1521/3142] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:21:10 2022] POST /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8/action => generated 0 bytes in 4783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:15.341159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:15.345473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:15.346353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:15.359822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:15.361832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:15.365910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:15.366439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:15.366707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:15.367164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:15.371151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:15.371613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:15.917035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:15.926579 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d0a3f76-b7a6-433d-a3d7-20a3438faf21 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 200 len: 1517 microversion: 2.1 time: 0.587401 Jul 25 16:21:15.929805 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1522/3143] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:15 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 1517 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:15.944103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05ce2026-6341-4088-9c23-b12ca9ced885 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d93900ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:16.337590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-05ce2026-6341-4088-9c23-b12ca9ced885 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use.", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:16.339259 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-05ce2026-6341-4088-9c23-b12ca9ced885 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.339259 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05ce2026-6341-4088-9c23-b12ca9ced885 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c HTTP/1.1 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: exception: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'f925fc44-cba4-45cc-9e0a-96ceeee0171c'} Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:16.341908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] Jul 25 16:21:16.346341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:16.354912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05ce2026-6341-4088-9c23-b12ca9ced885 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 400 to user: Security Group f925fc44-cba4-45cc-9e0a-96ceeee0171c in use. Jul 25 16:21:16.354912 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-7185eafa-e3d7-4aae-8bee-27ebb27b6ad7'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:16.356464 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-05ce2026-6341-4088-9c23-b12ca9ced885 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c" status: 400 len: 185 microversion: 2.1 time: 0.425318 Jul 25 16:21:16.357640 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1523/3144] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:15 2022] DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c => generated 185 bytes in 427 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:21:16.366296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:16.369660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:16.390776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:16.393381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:16.401009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:16.401769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:16.874529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:16.932814 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f702bfba-5119-4451-ac9b-a8c46e80bc3e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 0.570241 Jul 25 16:21:16.934850 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1524/3145] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:16 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:16.950598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:16.957567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:16.982359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:16.983800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:16.985603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:16.986653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:17.103060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=22 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:17.638875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:17.659917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56fac3f3-ce01-454b-ac4b-1546a8102876 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.723213 Jul 25 16:21:17.660576 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1525/3146] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:16 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:17.666924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:17.679896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:17.708141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:17.708947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:17.710058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:17.710509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:17.784605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:21:18.043152 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b3787d69-f93c-4268-b0ea-37dbde9f73b9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 204 len: 0 microversion: 2.1 time: 0.374254 Jul 25 16:21:18.043921 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1526/3147] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:17 2022] DELETE /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:18.056255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:18.066703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 5304703b-01e9-4326-8711-a3313b59142f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:18.090643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.094331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.098811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.099751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.129526 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] HTTP exception thrown: Instance 5304703b-01e9-4326-8711-a3313b59142f could not be found. Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Request method failure captured: Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f HTTP/1.1 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sIJswPRAnpKbMH3LlJ6fXz0O3gAcyM-4f27p5QaK-szhgB5TG9AFsJkg_xoC-asNDCjejI9KOVg2zyD05l6VIu3SsqV8rB-VxbQRRi347a2DsDC8eLZZhFiX1vS3XyQ3UP6jVSFa6I9SGt5ORBVK6oTU_i9CHbLyIm78qPOJ9IMNdE Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 5fbadf69c41746339f1711ec9cea2ac9 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesAdminNegativeTest-477898869 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5fbadf69c41746339f1711ec9cea2ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5fbadf69c41746339f1711ec9cea2ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5fbadf69c41746339f1711ec9cea2ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5fbadf69c41746339f1711ec9cea2ac9"}]}] Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesAdminNegativeTest-477898869 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 5fbadf69c41746339f1711ec9cea2ac9 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-477898869 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesAdminNegativeTest-477898869-project Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 83bf735d88e34c6caa3514f80a4e1560 Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesAdminNegativeTest-477898869-project Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 5304703b-01e9-4326-8711-a3313b59142f could not be found. Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5304703b-01e9-4326-8711-a3313b59142f'} Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5304703b-01e9-4326-8711-a3313b59142f could not be found. Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5304703b-01e9-4326-8711-a3313b59142f could not be found. Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:18.131600 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5304703b-01e9-4326-8711-a3313b59142f could not be found. Jul 25 16:21:18.136304 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:18.139584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Returning 404 to user: Instance 5304703b-01e9-4326-8711-a3313b59142f could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:18.141206 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5a3178b9-1c9e-4041-88ef-4b9f1a7849ea tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f" status: 404 len: 111 microversion: 2.1 time: 0.092031 Jul 25 16:21:18.142026 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1527/3148] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:18 2022] GET /compute/v2.1/servers/5304703b-01e9-4326-8711-a3313b59142f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:18.163124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-dba03e86-f942-4382-806a-44c633bcf8d0 req-846fff2c-f818-4440-8bae-47fc456a7493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5304703b-01e9-4326-8711-a3313b59142f", "name": "network-vif-deleted", "tag": "63b87af8-6e62-49a6-a685-e3a2a0114881"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:18.212298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-dba03e86-f942-4382-806a-44c633bcf8d0 req-846fff2c-f818-4440-8bae-47fc456a7493 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.217668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-dba03e86-f942-4382-806a-44c633bcf8d0 req-846fff2c-f818-4440-8bae-47fc456a7493 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.243290 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3258c32d-69e2-499c-9b26-175e2c47aa04 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 200 len: 324 microversion: 2.1 time: 2.937375 Jul 25 16:21:18.244104 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1622/3149] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:21:15 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 324 bytes in 2942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:18.253630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-dba03e86-f942-4382-806a-44c633bcf8d0 req-846fff2c-f818-4440-8bae-47fc456a7493 service nova] Creating event network-vif-deleted:63b87af8-6e62-49a6-a685-e3a2a0114881 for instance 5304703b-01e9-4326-8711-a3313b59142f on n-h2-846219-13 Jul 25 16:21:18.257412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b6a7028e-7423-43c4-8404-ad1946b20f67 req-2279264a-c734-4025-b96d-23e837eab545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2c8571-777f-4f24-8782-06f68d769ec8", "tag": "dde606b2-3916-498b-8d22-d9dfa91080d9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:18.284594 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-dba03e86-f942-4382-806a-44c633bcf8d0 req-846fff2c-f818-4440-8bae-47fc456a7493 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140688 Jul 25 16:21:18.299045 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1528/3150] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:18.330309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:18.331031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:18.331626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b6a7028e-7423-43c4-8404-ad1946b20f67 req-2279264a-c734-4025-b96d-23e837eab545 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.332364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b6a7028e-7423-43c4-8404-ad1946b20f67 req-2279264a-c734-4025-b96d-23e837eab545 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.349336 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b6a7028e-7423-43c4-8404-ad1946b20f67 req-2279264a-c734-4025-b96d-23e837eab545 service nova] Creating event network-changed:dde606b2-3916-498b-8d22-d9dfa91080d9 for instance 5a2c8571-777f-4f24-8782-06f68d769ec8 on n-h1-846219-13 Jul 25 16:21:18.351937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.352403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.353223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.353657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.364164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b6a7028e-7423-43c4-8404-ad1946b20f67 req-2279264a-c734-4025-b96d-23e837eab545 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112069 Jul 25 16:21:18.364783 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1623/3151] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:18.371831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:18.372727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:18.383849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.384614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.385917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.386505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.787251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:18.802135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc201cd7-f8f2-4531-8eb0-e886a1bc5fcc tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1650 microversion: 2.1 time: 0.435896 Jul 25 16:21:18.805607 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1624/3152] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:18 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1650 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:18.815234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:18.817829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:18.834020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.834771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:18.835748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:18.836367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:19.083998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:19.097480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f8f1c3c-a2ac-4011-a55e-44f733f392a3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 0.795348 Jul 25 16:21:19.099333 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1529/3153] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:18 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:19.113946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:19.115096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:19.130767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:19.131490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:19.132520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:19.133472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:19.617766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:19.627047 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e58c073-1f1f-48e5-8a7c-c7bc5ae03926 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.819967 Jul 25 16:21:19.627663 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1625/3154] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:18 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:19.658699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:19.659312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:19.673301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:19.673747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:19.674528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:19.674961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:19.905965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:19.914860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6eac988b-d796-4623-bf81-f77c6cad8096 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.813094 Jul 25 16:21:19.919553 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1530/3155] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:19 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:19.933005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:19.936406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:19.954916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:19.955833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:19.957494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:19.975696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:20.645564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:20.660605 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d17a9bc-06f9-407c-a4e2-a8eaa1ce54de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.002489 Jul 25 16:21:20.662022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1626/3156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:19 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:20.669570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:20.670493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:20.694906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:20.701864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:20.703003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:20.703619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:21.264930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:21.283904 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1fdc1f34-0671-4c3b-96a9-83aaf255359a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 0.618850 Jul 25 16:21:21.285961 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1627/3157] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:20 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:21.294698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:21.299335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:21.300194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:21.309419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:21.310150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:21.311182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:21.311805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:21.321460 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f2a078ee-6f8f-4e14-a09e-c72fabf9835d tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1650 microversion: 2.1 time: 1.385993 Jul 25 16:21:21.323131 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1531/3158] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:19 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1650 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:21.327458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:21.328084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:21.365473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:21.385542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:21.386186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:21.389533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:21.391851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:21.732549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=40 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:22.298881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:22.301678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:22.315373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72ff34c2-911e-42e5-8314-6795df44a08b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.991665 Jul 25 16:21:22.318050 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1532/3159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:21 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:22.321128 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02dc4358-45e2-4554-9316-df139d2c9a44 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.029414 Jul 25 16:21:22.325127 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1628/3160] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:21 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:22.345943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-26989ab1-f28f-4355-971a-fef62ecf9af4 req-4295ae33-e157-48c7-8016-f7259f2aa5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3b4607-055a-4702-9dc0-bc28c7bfd271", "tag": "08a7c54a-bec6-4aea-b365-e6e3568421f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:22.352102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:22.352726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:22.371720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-26989ab1-f28f-4355-971a-fef62ecf9af4 req-4295ae33-e157-48c7-8016-f7259f2aa5db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:22.372513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-26989ab1-f28f-4355-971a-fef62ecf9af4 req-4295ae33-e157-48c7-8016-f7259f2aa5db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:22.383402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:22.383853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:22.396030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:22.398207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:22.406357 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-26989ab1-f28f-4355-971a-fef62ecf9af4 req-4295ae33-e157-48c7-8016-f7259f2aa5db service nova] Creating event network-changed:08a7c54a-bec6-4aea-b365-e6e3568421f3 for instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 on n-h2-846219-13 Jul 25 16:21:22.423096 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-26989ab1-f28f-4355-971a-fef62ecf9af4 req-4295ae33-e157-48c7-8016-f7259f2aa5db service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100090 Jul 25 16:21:22.425969 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1533/3161] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:22.438480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:22.439246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:22.459833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:22.462163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:22.464510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:22.467693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:23.532873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:23.547007 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4cb0c751-4240-45c6-a3b9-432d494eea86 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 1.219033 Jul 25 16:21:23.549003 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1629/3162] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:22 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:23.562028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:23.566121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:23.580396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:23.595833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:23.596564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:23.597626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:23.598234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:23.744617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:23.760541 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d2213db-f8d1-4cf6-a86d-66fe2cfcf743 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 200 len: 1650 microversion: 2.1 time: 1.329934 Jul 25 16:21:23.761222 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1534/3163] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:22 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 1650 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:23.774568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:23.792965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:23.823759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:23.824220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:23.829061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:23.829626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:23.943191 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83138aa1-4143-4bf6-a6bd-2956325727d4 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175643 Jul 25 16:21:23.943412 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1535/3164] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:21:23 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:23.964196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:23.980336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:24.003487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.004019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.004904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.016702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.252046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:24.264311 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f814e4d-eaec-49a7-a0a7-07036d384ed6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.711870 Jul 25 16:21:24.264797 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1630/3165] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:23 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:24.286072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:24.286589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:24.313899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.314358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.315168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.315606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.571980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:24.576963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lazy-loading 'services' on Instance uuid 4f607753-b3cb-4845-a1f8-d33b12d069eb {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:21:24.584846 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5417833d-ced6-49a2-a7ec-5486b7c6d75c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.640277 Jul 25 16:21:24.585498 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1536/3166] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:23 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:24.591634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cf01faff-f3e7-4fcd-bdac-4a7ae11b08c5 req-1580b8a1-a30c-4389-b246-2386654b316b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2c8571-777f-4f24-8782-06f68d769ec8", "name": "network-vif-deleted", "tag": "dde606b2-3916-498b-8d22-d9dfa91080d9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:24.617058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cf01faff-f3e7-4fcd-bdac-4a7ae11b08c5 req-1580b8a1-a30c-4389-b246-2386654b316b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.619929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cf01faff-f3e7-4fcd-bdac-4a7ae11b08c5 req-1580b8a1-a30c-4389-b246-2386654b316b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.635171 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cf01faff-f3e7-4fcd-bdac-4a7ae11b08c5 req-1580b8a1-a30c-4389-b246-2386654b316b service nova] Creating event network-vif-deleted:dde606b2-3916-498b-8d22-d9dfa91080d9 for instance 5a2c8571-777f-4f24-8782-06f68d769ec8 on n-h1-846219-13 Jul 25 16:21:24.652865 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cf01faff-f3e7-4fcd-bdac-4a7ae11b08c5 req-1580b8a1-a30c-4389-b246-2386654b316b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064659 Jul 25 16:21:24.653518 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1537/3167] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:24.666568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1254245235", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "6caa10b5-bb0b-47f3-bbd9-62b23141517a"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:24.738918 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04f01b57-83f0-4768-8f83-9c704820c651 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments/03efef55-9b5f-4801-ad06-dfbec47c3e81" status: 202 len: 0 microversion: 2.1 time: 0.462743 Jul 25 16:21:24.745490 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1631/3168] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:21:24 2022] DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments/03efef55-9b5f-4801-ad06-dfbec47c3e81 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:24.756394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:24.767281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:24.786174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.793476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.795247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:24.796000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:24.796140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] validate_networks() for [('6caa10b5-bb0b-47f3-bbd9-62b23141517a', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:21:25.333042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:25.345020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc394230-baed-4fd7-8258-b2fbe8449c44 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 0.596579 Jul 25 16:21:25.346807 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1632/3169] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:24 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:25.355795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:25.361445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:25.392568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:25.399983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:25.410434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:25.410891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:25.444197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 HTTP/1.1 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5a2c8571-777f-4f24-8782-06f68d769ec8'} Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:25.449915 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:25.456312 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:25.458440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:25.459923 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-065d6275-2ff6-40b1-9dba-caf2a563e680 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 404 len: 111 microversion: 2.1 time: 0.112069 Jul 25 16:21:25.466004 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1633/3170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:25 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:25.472406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:25.473945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:25.496772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:25.498051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:25.500361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:25.505492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:25.553493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:21:25.732050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d5117b1-8bb0-4b00-90f9-3aa773715579 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 204 len: 0 microversion: 2.1 time: 0.263977 Jul 25 16:21:25.738161 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1634/3171] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:25 2022] DELETE /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:25.751483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5417c9bb-05a0-4348-85e5-949beea71677 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d92f0a5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:26.504620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:21:26.505248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:21:26.505554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:21:26.506083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:21:26.506498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:21:26.543855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:26.544619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:26.545678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:26.546274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:26.592869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:21:26.618466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for user ed4735185f84421f92bc1404d62f26e3 and project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:21:26.646481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:21:26.651405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:21:26.755901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b472c964-e838-43c3-8807-380667cc7e9b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.101114 Jul 25 16:21:26.761938 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1538/3172] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:21:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:21:26.775060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:26.776159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:26.793266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:26.794340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:26.796352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:26.796924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:27.275018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:27.314778 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-31474d6a-83a2-4b60-8470-1ef9e7577a6d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.550203 Jul 25 16:21:27.317761 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1539/3173] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:26 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:27.327505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-437ff191-f34b-45ba-bd30-950fda3bcdfa req-f95ac8e9-b588-45ff-af22-27b509db3d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619749d4-64ec-4540-bbdb-e5de46fcaceb", "name": "network-vif-plugged", "status": "completed", "tag": "c405ec60-9082-4e73-a6b1-6d05a7dda98c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:27.348279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5417c9bb-05a0-4348-85e5-949beea71677 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383" status: 202 len: 0 microversion: 2.1 time: 1.608279 Jul 25 16:21:27.349869 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1635/3174] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:25 2022] DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383 => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:27.352519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-437ff191-f34b-45ba-bd30-950fda3bcdfa req-f95ac8e9-b588-45ff-af22-27b509db3d37 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:27.355302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-437ff191-f34b-45ba-bd30-950fda3bcdfa req-f95ac8e9-b588-45ff-af22-27b509db3d37 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:27.356622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:27.357578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:27.378956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:27.379683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:27.381824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:27.383034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:27.390973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-437ff191-f34b-45ba-bd30-950fda3bcdfa req-f95ac8e9-b588-45ff-af22-27b509db3d37 service nova] Creating event network-vif-plugged:c405ec60-9082-4e73-a6b1-6d05a7dda98c for instance 619749d4-64ec-4540-bbdb-e5de46fcaceb on n-h1-846219-13 Jul 25 16:21:27.423416 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-437ff191-f34b-45ba-bd30-950fda3bcdfa req-f95ac8e9-b588-45ff-af22-27b509db3d37 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102093 Jul 25 16:21:27.424818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1540/3175] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:27.434270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:27.439170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:27.457253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:27.461598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:27.463697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:27.466743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:27.553142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:27.932285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:27.941431 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c4deb25c-6c33-4883-9f6b-47d1df4e75e0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1685 microversion: 2.1 time: 0.589564 Jul 25 16:21:27.969059 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1636/3176] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:27 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1685 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:27.993849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:27.997428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:28.019150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:28.019841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:28.020828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:28.021461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:28.080417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:28.107624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:28.140707 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-455c3aba-4ae4-4fdb-b48c-ece2d7e704e7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1311 microversion: 2.1 time: 0.713332 Jul 25 16:21:28.147102 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1541/3177] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:27 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1311 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:28.173791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bfcb0d33-0220-4b2e-a1e9-6d167acac810 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d938871f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:28.389817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:28.409861 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f7dd4ad3-2ad1-4543-a1d3-d1c7f30d007d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1215 microversion: 2.1 time: 0.437251 Jul 25 16:21:28.425871 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1637/3178] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:27 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1215 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:28.432895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:28.433923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:28.443471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:28.444445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:28.446309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:28.447794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:29.123063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:29.159033 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2791f94c-2829-4f55-b7a8-2847c17f71fd tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.731682 Jul 25 16:21:29.159644 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1638/3179] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:28 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:29.172764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:29.185004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:29.206578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:29.207142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:29.207947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:29.208393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:30.366953 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bfcb0d33-0220-4b2e-a1e9-6d167acac810 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c" status: 202 len: 0 microversion: 2.1 time: 2.214287 Jul 25 16:21:30.367556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1542/3180] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:28 2022] DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c => generated 0 bytes in 2217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:30.383289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:30.384434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:30.403919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:30.406770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:30.408066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:30.409698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:30.536649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:30.550117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-58479067-1d69-4b3d-bc17-7f8c5106caf8 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1685 microversion: 2.1 time: 1.389132 Jul 25 16:21:30.553757 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1639/3181] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:29 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1685 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:30.566896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:30.567853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:30.591569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:30.592037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:30.592865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:30.593350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:30.741956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:30.759202 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2928b947-9a08-42dd-b53e-729794ec93c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1277 microversion: 2.1 time: 0.203828 Jul 25 16:21:30.761563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1640/3182] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:30 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:30.777394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:30.778465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:30.791265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:30.792963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:30.795460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:30.801467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:31.017176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:31.029933 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce5782c3-ca3d-4a6d-8e68-bdd1c8bd3d03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1491 microversion: 2.1 time: 0.660702 Jul 25 16:21:31.030508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1543/3183] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:30 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1491 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:31.071317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0116da1a-c22a-4b0d-be6f-b697ad0aecb1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'create', calling method: .version_select at 0x7f9d93887550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-945393308", "description": "tempest-description-2038336569"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:31.630759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:31.643087 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1bb404f6-ad70-454b-9832-b593e2413b8c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.879826 Jul 25 16:21:31.645324 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1641/3184] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:30 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:31.668576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:31.686204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:31.734903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:31.744798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:31.748763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:31.749454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:31.990154 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4085dd5f-28a8-4a6c-b884-f1a33a15d8e6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb/action" status: 202 len: 0 microversion: 2.1 time: 0.340042 Jul 25 16:21:32.001216 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1642/3185] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:21:31 2022] POST /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:32.021235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:32.025241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:32.071445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:32.074366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:32.077879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:32.079632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:32.638611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:32.656431 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8050a10a-a391-44b6-97ae-e6456dc5d083 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1618 microversion: 2.1 time: 0.652179 Jul 25 16:21:32.657051 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1643/3186] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:32 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1618 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:32.690914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:32.698325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:32.708183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:32.708632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:32.709474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:32.710056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:32.985823 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0116da1a-c22a-4b0d-be6f-b697ad0aecb1 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.949512 Jul 25 16:21:32.987043 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1544/3187] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:21:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:32.992406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:32.993473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:33.013306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:33.014320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:33.017588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:33.018407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:33.636213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:33.645917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-66310723-ee13-4929-a77b-103154693702 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 200 len: 1476 microversion: 2.1 time: 0.657339 Jul 25 16:21:33.648473 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1545/3188] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:32 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 1476 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:33.659280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-361dd5d1-f3e2-4dbe-8e05-0429e20e7105 req-cb49255d-c97a-446b-93f8-8504440125d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3b4607-055a-4702-9dc0-bc28c7bfd271", "name": "network-vif-plugged", "status": "completed", "tag": "08a7c54a-bec6-4aea-b365-e6e3568421f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:33.685157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-361dd5d1-f3e2-4dbe-8e05-0429e20e7105 req-cb49255d-c97a-446b-93f8-8504440125d6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:33.686049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-361dd5d1-f3e2-4dbe-8e05-0429e20e7105 req-cb49255d-c97a-446b-93f8-8504440125d6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:33.714494 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-361dd5d1-f3e2-4dbe-8e05-0429e20e7105 req-cb49255d-c97a-446b-93f8-8504440125d6 service nova] Creating event network-vif-plugged:08a7c54a-bec6-4aea-b365-e6e3568421f3 for instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 on n-h2-846219-13 Jul 25 16:21:33.726856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:33.729187 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-361dd5d1-f3e2-4dbe-8e05-0429e20e7105 req-cb49255d-c97a-446b-93f8-8504440125d6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076906 Jul 25 16:21:33.732725 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1546/3189] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:33.737711 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59e07854-a7a1-4645-b22f-ac5ab24048bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 1.070774 Jul 25 16:21:33.751501 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1644/3190] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:32 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:33.758881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:33.764174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:33.766576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee8b6208-5fad-4467-a86f-ac3e97467dd7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Action: 'update', calling method: .version_select at 0x7f9d92e9cca0>, body: {"security_group": {"name": "tempest-sg-hth-1876867389", "description": "tempest-description-hth-1616524021"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:33.771642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:33.775052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:33.776765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:33.778448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:33.779148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:34.336371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:34.345204 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6646ccca-c6aa-42ed-958c-804099cb487b tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1316 microversion: 2.1 time: 0.610669 Jul 25 16:21:34.356121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1547/3191] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:33 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:34.361428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-854027013"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:34.397217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:34.412906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:34.427027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:34.427942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:34.428390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:34.969591 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-855ee650-e688-45e3-b4b3-da031582303a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb/action" status: 202 len: 0 microversion: 2.1 time: 0.611890 Jul 25 16:21:34.975905 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1548/3192] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:21:34 2022] POST /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:21:34.984017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:34.990784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:35.009453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.010098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.015777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.016468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.106950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.107491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.107957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lazy-loading 'fault' on Instance uuid 3cf904be-f686-4f48-8a1f-dd55644b1973 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:21:35.516235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bf735d88e34c6caa3514f80a4e1560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbadf69c41746339f1711ec9cea2ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:35.530988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bb060d1-1ed6-432c-afa2-9d3aac3194c0 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 200 len: 1335 microversion: 2.1 time: 0.553387 Jul 25 16:21:35.555709 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1549/3193] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:34 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 1335 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:35.574727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d8efb43f-b47b-4bd1-b830-72f018ab55e3 req-2ad1715d-c87a-4af8-93f3-ec0f86c26f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf904be-f686-4f48-8a1f-dd55644b1973", "name": "network-vif-deleted", "tag": "cdc27e7d-6c64-4d22-8cf8-468485ab9596"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:35.613110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d8efb43f-b47b-4bd1-b830-72f018ab55e3 req-2ad1715d-c87a-4af8-93f3-ec0f86c26f78 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.618679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d8efb43f-b47b-4bd1-b830-72f018ab55e3 req-2ad1715d-c87a-4af8-93f3-ec0f86c26f78 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.659732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d8efb43f-b47b-4bd1-b830-72f018ab55e3 req-2ad1715d-c87a-4af8-93f3-ec0f86c26f78 service nova] Creating event network-vif-deleted:cdc27e7d-6c64-4d22-8cf8-468485ab9596 for instance 3cf904be-f686-4f48-8a1f-dd55644b1973 on n-h1-846219-13 Jul 25 16:21:35.675200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d8efb43f-b47b-4bd1-b830-72f018ab55e3 req-2ad1715d-c87a-4af8-93f3-ec0f86c26f78 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118001 Jul 25 16:21:35.683840 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1550/3194] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:35.684551 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee8b6208-5fad-4467-a86f-ac3e97467dd7 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "PUT /compute/v2.1/os-security-groups/907d1dd0-c5eb-4344-adfd-a6776404400c" status: 200 len: 218 microversion: 2.1 time: 1.931768 Jul 25 16:21:35.685191 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1645/3195] 10.222.0.105 () {60 vars in 1295 bytes} [Mon Jul 25 16:21:33 2022] PUT /compute/v2.1/os-security-groups/907d1dd0-c5eb-4344-adfd-a6776404400c => generated 218 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:35.704814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:35.707473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:35.720217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8afea2d5-5e0c-4d73-9a20-68ed11e70130 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e429d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:35.732780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.739377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.743718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.749031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.856276 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8afea2d5-5e0c-4d73-9a20-68ed11e70130 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.160113 Jul 25 16:21:35.856975 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1646/3196] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:35 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:35.878327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:35.882508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:35.908585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.910104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:35.912510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:35.919659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:36.568050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:36.640511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:36.671146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:36.681767 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e159f237-f5f8-410f-8b26-2b826bde2d91 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1501 microversion: 2.1 time: 0.822464 Jul 25 16:21:36.700983 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1647/3197] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:35 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1501 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:36.706124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f725ae11-4472-4546-9bbe-e44ab05a8033 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da49fe790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:36.711948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:36.723341 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25b5d25d-7c71-437d-8126-a326d2adef32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 1.034724 Jul 25 16:21:36.732696 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1551/3198] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:35 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:36.747410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:36.748091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] [instance: 3cf904be-f686-4f48-8a1f-dd55644b1973] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:36.765028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:36.765533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:36.766346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:36.766787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:36.791250 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] HTTP exception thrown: Instance 3cf904be-f686-4f48-8a1f-dd55644b1973 could not be found. Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Request method failure captured: Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 HTTP/1.1 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sIJswPRAnpKbMH3LlJ6fXz0O3gAcyM-4f27p5QaK-szhgB5TG9AFsJkg_xoC-asNDCjejI9KOVg2zyD05l6VIu3SsqV8rB-VxbQRRi347a2DsDC8eLZZhFiX1vS3XyQ3UP6jVSFa6I9SGt5ORBVK6oTU_i9CHbLyIm78qPOJ9IMNdE Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 5fbadf69c41746339f1711ec9cea2ac9 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesAdminNegativeTest-477898869 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5fbadf69c41746339f1711ec9cea2ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5fbadf69c41746339f1711ec9cea2ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5fbadf69c41746339f1711ec9cea2ac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5fbadf69c41746339f1711ec9cea2ac9"}]}] Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesAdminNegativeTest-477898869 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 5fbadf69c41746339f1711ec9cea2ac9 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-477898869 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesAdminNegativeTest-477898869-project Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 83bf735d88e34c6caa3514f80a4e1560 Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesAdminNegativeTest-477898869-project Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 3cf904be-f686-4f48-8a1f-dd55644b1973 could not be found. Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '3cf904be-f686-4f48-8a1f-dd55644b1973'} Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf904be-f686-4f48-8a1f-dd55644b1973 could not be found. Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf904be-f686-4f48-8a1f-dd55644b1973 could not be found. Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:36.797713 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf904be-f686-4f48-8a1f-dd55644b1973 could not be found. Jul 25 16:21:36.803265 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:36.807663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Returning 404 to user: Instance 3cf904be-f686-4f48-8a1f-dd55644b1973 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:36.808801 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aafb6574-e01b-4f38-b74a-390d225fff22 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973" status: 404 len: 111 microversion: 2.1 time: 0.075072 Jul 25 16:21:36.809972 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1552/3199] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:36 2022] GET /compute/v2.1/servers/3cf904be-f686-4f48-8a1f-dd55644b1973 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:36.830970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d8c6fc7-267d-4a7a-8625-c4b4795204cc tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:36.881175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.server_groups [None req-2d8c6fc7-267d-4a7a-8625-c4b4795204cc tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Querying cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) for 1 instances {{(pid=119598) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 16:21:36.882020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d8c6fc7-267d-4a7a-8625-c4b4795204cc tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:36.882465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d8c6fc7-267d-4a7a-8625-c4b4795204cc tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:36.944513 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d8c6fc7-267d-4a7a-8625-c4b4795204cc tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups/45551d3e-127f-4126-ae29-006201e4c0bf" status: 200 len: 221 microversion: 2.1 time: 0.117951 Jul 25 16:21:36.945157 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1553/3200] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:21:36 2022] GET /compute/v2.1/os-server-groups/45551d3e-127f-4126-ae29-006201e4c0bf => generated 221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:36.958451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9372905d-847c-4d0e-91eb-8082e741c843 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] Calling method '.version_select at 0x7f9d939039d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:36.999974 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f725ae11-4472-4546-9bbe-e44ab05a8033 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/os-security-groups/907d1dd0-c5eb-4344-adfd-a6776404400c" status: 200 len: 218 microversion: 2.1 time: 0.297699 Jul 25 16:21:37.001497 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1648/3201] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:21:36 2022] GET /compute/v2.1/os-security-groups/907d1dd0-c5eb-4344-adfd-a6776404400c => generated 218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:37.006873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-024aca80-c2ff-4e14-9fdc-700306bcb71b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e424c0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:37.039466 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9372905d-847c-4d0e-91eb-8082e741c843 tempest-VolumesAdminNegativeTest-477898869 tempest-VolumesAdminNegativeTest-477898869-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654953733" status: 202 len: 0 microversion: 2.1 time: 0.084905 Jul 25 16:21:37.041942 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1554/3202] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:21:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654953733 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:37.055638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:37.067475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:37.087335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:37.093491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:37.094529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-024aca80-c2ff-4e14-9fdc-700306bcb71b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.091702 Jul 25 16:21:37.094818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:37.095126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1649/3203] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:37 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:37.104323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:37.116945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d95d910c-2179-4ab1-83b0-30cece6f4c93 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da4a5b8b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:37.175190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:21:37.406623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db31ef19-84ff-490a-b4b8-455a4dfe6c77 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 204 len: 0 microversion: 2.1 time: 0.354158 Jul 25 16:21:37.408016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1555/3204] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:37 2022] DELETE /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:37.431248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:37.433369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:37.480242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:37.482441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:37.483684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:37.493824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:37.982873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:37.995074 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3bbed20-1eed-4262-9110-66080c6279c7 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1507 microversion: 2.1 time: 0.581328 Jul 25 16:21:38.014517 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1556/3205] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:37 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:38.029772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.042718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:38.068695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.071913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.074092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.075325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.145334 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3db40fe0-e3d1-41d9-a3fc-c4fa282e2389 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127272 Jul 25 16:21:38.146247 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1557/3206] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:21:38 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:21:38.158944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-173f17f6-b85a-49c6-a9e5-0e5fed7cb4bd req-31119b63-27c9-4a87-9c75-ed00cc599489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f43cc78-3ee1-43d2-a010-c844af4d767a", "tag": "7e82df10-1f35-4f42-8607-171ec06fb049"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:38.181973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-173f17f6-b85a-49c6-a9e5-0e5fed7cb4bd req-31119b63-27c9-4a87-9c75-ed00cc599489 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.183893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-173f17f6-b85a-49c6-a9e5-0e5fed7cb4bd req-31119b63-27c9-4a87-9c75-ed00cc599489 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.205640 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-173f17f6-b85a-49c6-a9e5-0e5fed7cb4bd req-31119b63-27c9-4a87-9c75-ed00cc599489 service nova] Creating event network-changed:7e82df10-1f35-4f42-8607-171ec06fb049 for instance 5f43cc78-3ee1-43d2-a010-c844af4d767a on n-h2-846219-13 Jul 25 16:21:38.211408 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-173f17f6-b85a-49c6-a9e5-0e5fed7cb4bd req-31119b63-27c9-4a87-9c75-ed00cc599489 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057984 Jul 25 16:21:38.212441 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1558/3207] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:38.231850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.233548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:38.242394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.243084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.258462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.259037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.402221 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d95d910c-2179-4ab1-83b0-30cece6f4c93 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/907d1dd0-c5eb-4344-adfd-a6776404400c" status: 202 len: 0 microversion: 2.1 time: 1.305705 Jul 25 16:21:38.403013 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1650/3208] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:37 2022] DELETE /compute/v2.1/os-security-groups/907d1dd0-c5eb-4344-adfd-a6776404400c => generated 0 bytes in 1307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:38.409472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9ab4ed2-656f-4d94-aef3-0102633c7ae7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d935003a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.486641 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9ab4ed2-656f-4d94-aef3-0102633c7ae7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.081558 Jul 25 16:21:38.487821 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1651/3209] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:38 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:38.500520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.509843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:38.532471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.532925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.536043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.536581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.611810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f9955fc0-8381-4517-a90d-834c23d81a93 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121798 Jul 25 16:21:38.615199 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1652/3210] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:21:38 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:21:38.627534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.628034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:38.638118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.638896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.639896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.640502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.657157 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 HTTP/1.1 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5a2c8571-777f-4f24-8782-06f68d769ec8'} Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:38.662149 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1621077f-52fe-4238-9c8d-68958cd115aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 404 len: 111 microversion: 2.1 time: 0.048047 Jul 25 16:21:38.666918 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1653/3211] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:38 2022] DELETE /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:38.674190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.676888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: 5a2c8571-777f-4f24-8782-06f68d769ec8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:38.692762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.697153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.698179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.698600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.740375 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 HTTP/1.1 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5a2c8571-777f-4f24-8782-06f68d769ec8'} Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:38.742461 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. Jul 25 16:21:38.747022 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:38.757842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Instance 5a2c8571-777f-4f24-8782-06f68d769ec8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:38.761914 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-56e54d62-c4be-417a-8eaa-716aa71d9941 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8" status: 404 len: 111 microversion: 2.1 time: 0.090746 Jul 25 16:21:38.767549 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1654/3212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:38 2022] GET /compute/v2.1/servers/5a2c8571-777f-4f24-8782-06f68d769ec8 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:38.781526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:38.783543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:38.811299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.818722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.820036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:38.820682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:38.890060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:21:38.936512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:38.947395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-02d576fc-1b17-4575-9ee7-dc4d30b78da3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 0.733227 Jul 25 16:21:38.961598 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1559/3213] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:38 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:38.976706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d9399bf70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:39.181194 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d7cf145-1275-4fb7-8f09-c30fa8a5a41e tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 204 len: 0 microversion: 2.1 time: 0.407234 Jul 25 16:21:39.182984 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1655/3214] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:38 2022] DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:39.198938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:39.203507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:39.233258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:39.233820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:39.235162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:39.240444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:39.375235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:39.376697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group f925fc44-cba4-45cc-9e0a-96ceeee0171c not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:21:39.384750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.384750 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c HTTP/1.1 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'f925fc44-cba4-45cc-9e0a-96ceeee0171c'} Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:39.390724 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] Jul 25 16:21:39.400704 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:39.415527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group f925fc44-cba4-45cc-9e0a-96ceeee0171c does not exist Jul 25 16:21:39.415527 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-9192c655-6322-4816-9171-52ed1c6f71a2'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:39.416746 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c972637b-2ece-4bbe-bdbb-2057febb2a59 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c" status: 404 len: 194 microversion: 2.1 time: 0.450077 Jul 25 16:21:39.417760 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1560/3215] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:38 2022] DELETE /compute/v2.1/os-security-groups/f925fc44-cba4-45cc-9e0a-96ceeee0171c => generated 194 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:39.464497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:39.470533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:39.513316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:39.513881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:39.514742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:39.515185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:39.587272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:39.836404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:39.845656 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-98398761-f452-41bc-82c6-98d373e16725 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1507 microversion: 2.1 time: 0.661338 Jul 25 16:21:39.863138 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1656/3216] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:39 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1507 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:39.872427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da49384c0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:40.516045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:40.516901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:21:40.517476 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.517476 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383 HTTP/1.1 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3ae85ea0-a39d-4bdf-9c19-67eadadc7383'} Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:40.519509 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group 3ae85ea0-a39d-4bdf-9c19-67eadadc7383 does not exist Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-15d57660-f16d-4b20-9c92-fb1259f6686a'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f3be0dc-781c-4bdb-a076-21df31155207 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383" status: 404 len: 194 microversion: 2.1 time: 0.653193 Jul 25 16:21:40.524371 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1657/3217] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:39 2022] DELETE /compute/v2.1/os-security-groups/3ae85ea0-a39d-4bdf-9c19-67eadadc7383 => generated 194 bytes in 658 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:40.529417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8dc6c31-d7e0-4283-bd5e-a13171a43c19 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92fe5670>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:40.581054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:40.595686 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-478feaf8-7a8a-4d75-bded-f6dfee3daaa3 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1684 microversion: 2.1 time: 1.165816 Jul 25 16:21:40.596918 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1561/3218] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:39 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1684 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:40.607889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:40.611054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:40.625168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:40.625625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:40.628998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:40.631005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:40.655763 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8dc6c31-d7e0-4283-bd5e-a13171a43c19 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.132960 Jul 25 16:21:40.656435 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1658/3219] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:40 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:40.664925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9da49381f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:40.845583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:40.846818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group 93ea0541-4a46-4bf7-a953-cc8afa234167 not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:21:40.847595 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.847595 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167 HTTP/1.1 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '93ea0541-4a46-4bf7-a953-cc8afa234167'} Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:40.853979 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] Jul 25 16:21:40.859326 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:40.866258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group 93ea0541-4a46-4bf7-a953-cc8afa234167 does not exist Jul 25 16:21:40.866258 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-923fb639-6f3d-446f-b98c-a9362828d8ca'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:40.867434 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a695857f-4de4-4fc4-ab3a-4633d84ec9fa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167" status: 404 len: 194 microversion: 2.1 time: 0.210061 Jul 25 16:21:40.873970 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1659/3220] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:40 2022] DELETE /compute/v2.1/os-security-groups/93ea0541-4a46-4bf7-a953-cc8afa234167 => generated 194 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:40.880871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:40.881758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:40.890971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:40.891623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:40.892554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:40.893227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:41.340833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:41.351894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:41.368345 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-231dadc5-6001-4274-8e4d-6c73537b3202 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1507 microversion: 2.1 time: 0.491145 Jul 25 16:21:41.370735 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8890b024-8fe2-48f1-a70b-fd8273c2583f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 0.771337 Jul 25 16:21:41.371680 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1562/3221] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:40 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:41.376574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d9399b790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:41.392285 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1660/3222] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:40 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1507 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:41.482957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:41.483643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group c0f50dc2-35ad-4681-90ac-61b342aed503 not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:21:41.484403 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.484403 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503 HTTP/1.1 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'c0f50dc2-35ad-4681-90ac-61b342aed503'} Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:41.486642 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group c0f50dc2-35ad-4681-90ac-61b342aed503 does not exist Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-1da62ab7-75b3-49a0-a906-c04f240aa182'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-acb44f2d-acf0-4445-9e18-ec2f93c44662 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503" status: 404 len: 194 microversion: 2.1 time: 0.115232 Jul 25 16:21:41.503804 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1563/3223] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:41 2022] DELETE /compute/v2.1/os-security-groups/c0f50dc2-35ad-4681-90ac-61b342aed503 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:41.519193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d92eb38b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:41.559910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG neutronclient.v2_0.client [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist", "detail": ""}} {{(pid=119599) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:41.560514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.security_group_api [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group f22baf2e-a395-4332-8502-1e56606398ae not found {{(pid=119599) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:21:41.561386 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.561386 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae HTTP/1.1 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: exception: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'f22baf2e-a395-4332-8502-1e56606398ae'} Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:41.562898 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] Jul 25 16:21:41.569470 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.575032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group f22baf2e-a395-4332-8502-1e56606398ae does not exist Jul 25 16:21:41.575032 n-d-846219-13 devstack@n-api.service[119599]: Neutron server returns request_ids: ['req-014db753-b057-41d1-82ba-0435db34b34d'] {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:41.575032 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ae644a1-e6db-4864-919b-058cf2caeb8a tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae" status: 404 len: 194 microversion: 2.1 time: 0.081516 Jul 25 16:21:41.575032 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1661/3224] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:41 2022] DELETE /compute/v2.1/os-security-groups/f22baf2e-a395-4332-8502-1e56606398ae => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:41.584101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d93961d30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:41.620951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:41.621605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:41.639996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG neutronclient.v2_0.client [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist", "detail": ""}} {{(pid=119598) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 16:21:41.641266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.security_group_api [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Neutron security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 not found {{(pid=119598) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 16:21:41.642041 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.642041 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 HTTP/1.1 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: exception: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1'} Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 16:21:41.644896 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] Jul 25 16:21:41.650725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:41.653973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:41.653973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:41.654649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:41.655100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:41.655280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Security group 4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 does not exist Jul 25 16:21:41.655280 n-d-846219-13 devstack@n-api.service[119598]: Neutron server returns request_ids: ['req-b743c29c-faca-44f7-8164-6679f8330687'] {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:41.656414 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34131182-0285-4c5e-a484-040933bee9be tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1" status: 404 len: 194 microversion: 2.1 time: 0.076897 Jul 25 16:21:41.657501 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1564/3225] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:41 2022] DELETE /compute/v2.1/os-security-groups/4931fbb3-416f-4d5c-9fa0-27bf0e2ba8f1 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:41.671682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:41.673169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:41.690635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:41.691926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:41.695738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:41.697368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:41.771748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:21:41.992862 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6ed731b-9c23-42ce-930e-83d4f7f2f222 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 204 len: 0 microversion: 2.1 time: 0.331032 Jul 25 16:21:41.994193 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1565/3226] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:41 2022] DELETE /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:42.014622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-786c51d4-bb85-4434-8f21-8751c0a91b79 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d930cbee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:42.138874 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-786c51d4-bb85-4434-8f21-8751c0a91b79 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.134552 Jul 25 16:21:42.150321 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1566/3227] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:41 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:42.175241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:42.184223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:42.235746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:42.241926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:42.242802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:42.243254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:42.354088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:42.358794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:42.373192 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b658aa1b-1342-4b2c-8a8d-2b735d1cd58b tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1684 microversion: 2.1 time: 0.756909 Jul 25 16:21:42.378737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1662/3228] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:41 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1684 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:42.396682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f05cf68c-1731-4cae-9575-a09a8071f1c6 req-fc3d557b-0846-466b-903c-d0e053d61eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3b4607-055a-4702-9dc0-bc28c7bfd271", "name": "network-vif-deleted", "tag": "08a7c54a-bec6-4aea-b365-e6e3568421f3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:42.425022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f05cf68c-1731-4cae-9575-a09a8071f1c6 req-fc3d557b-0846-466b-903c-d0e053d61eff service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:42.429443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f05cf68c-1731-4cae-9575-a09a8071f1c6 req-fc3d557b-0846-466b-903c-d0e053d61eff service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:42.466791 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f05cf68c-1731-4cae-9575-a09a8071f1c6 req-fc3d557b-0846-466b-903c-d0e053d61eff service nova] Creating event network-vif-deleted:08a7c54a-bec6-4aea-b365-e6e3568421f3 for instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 on n-h2-846219-13 Jul 25 16:21:42.481412 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f05cf68c-1731-4cae-9575-a09a8071f1c6 req-fc3d557b-0846-466b-903c-d0e053d61eff service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093849 Jul 25 16:21:42.483255 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1663/3229] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:42.493985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:42.510407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:42.537237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:42.537744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:42.540330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:42.542464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.078237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:43.088900 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0b8a8c5a-c0ff-4748-8ca3-01df9a6fa0aa tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1650 microversion: 2.1 time: 0.934432 Jul 25 16:21:43.092174 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1567/3230] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:42 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1650 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:43.109378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:43.110529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:43.126906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:43.128419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.129545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:43.132006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.201981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:43.202437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.203491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lazy-loading 'fault' on Instance uuid 6a3b4607-055a-4702-9dc0-bc28c7bfd271 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:21:43.344828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684c5d26a73f477b909a2baabdff021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e64a7052b4875ac52b887aafe21f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:43.354058 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ded7f0d0-0d54-43c9-83b1-6cb2c552ef8f tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 200 len: 1306 microversion: 2.1 time: 0.254801 Jul 25 16:21:43.354675 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1568/3231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:43 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 1306 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:43.367410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-88635a90-2683-461d-b039-1bda0c34bd57 req-2d689aac-60e2-4391-abe2-23242e80ed44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f607753-b3cb-4845-a1f8-d33b12d069eb", "name": "network-vif-unplugged", "status": "completed", "tag": "aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:43.386776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-88635a90-2683-461d-b039-1bda0c34bd57 req-2d689aac-60e2-4391-abe2-23242e80ed44 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:43.387381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-88635a90-2683-461d-b039-1bda0c34bd57 req-2d689aac-60e2-4391-abe2-23242e80ed44 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.416218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:43.423322 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-88635a90-2683-461d-b039-1bda0c34bd57 req-2d689aac-60e2-4391-abe2-23242e80ed44 service nova] Creating event network-vif-unplugged:aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9 for instance 4f607753-b3cb-4845-a1f8-d33b12d069eb on n-h2-846219-13 Jul 25 16:21:43.424328 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-480899eb-157e-437b-b3e3-47ca593eb0da tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 0.939624 Jul 25 16:21:43.431177 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1664/3232] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:42 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:43.442220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51b4ba26-05b3-491f-ad56-3207c304f006 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92fe63a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:43.453782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-88635a90-2683-461d-b039-1bda0c34bd57 req-2d689aac-60e2-4391-abe2-23242e80ed44 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094609 Jul 25 16:21:43.454687 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1569/3233] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:43.464046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:43.465042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:43.487904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:43.488372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.489679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:43.489961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:43.508630 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51b4ba26-05b3-491f-ad56-3207c304f006 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.076010 Jul 25 16:21:43.522097 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1665/3234] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:43 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:43.851379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:43.864129 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ade72d7-1f6d-40d7-aacf-8b4acbb5efb2 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1684 microversion: 2.1 time: 0.407683 Jul 25 16:21:43.869118 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1570/3235] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:43 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1684 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:44.115496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:44.116296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:44.158238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:44.159222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:44.165116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:44.165565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:44.378687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:44.382655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:44.398398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:44.399867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:44.402305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:44.403736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:44.461270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 HTTP/1.1 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6a3b4607-055a-4702-9dc0-bc28c7bfd271'} Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:44.466584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:44.471932 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:44.478105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:44.479581 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4f3122e3-d6d4-4a9b-9d17-94ff073abf20 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 404 len: 111 microversion: 2.1 time: 0.105203 Jul 25 16:21:44.481677 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1571/3236] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:44 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:44.487200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:44.489809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:44.511076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:44.511268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:44.511958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:44.512379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.169603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:46.181840 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-addb5357-0682-4946-9e62-8ce9f1d15760 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1650 microversion: 2.1 time: 2.072016 Jul 25 16:21:46.202560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1666/3237] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:44 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1650 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:46.221548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2d11e64-f7c8-4e90-b079-0de6f2a8a5f8 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.242859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:46.255852 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7b05c1fe-153b-4e35-9ec2-c043946ea9c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 1.771884 Jul 25 16:21:46.273934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1572/3238] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:44 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:46.279325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87871b30-9770-412d-958c-b77646bb75be tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93900430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.293173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.server_groups [None req-d2d11e64-f7c8-4e90-b079-0de6f2a8a5f8 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Querying cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) for 1 instances {{(pid=119599) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 16:21:46.303961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2d11e64-f7c8-4e90-b079-0de6f2a8a5f8 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.307026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2d11e64-f7c8-4e90-b079-0de6f2a8a5f8 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.344249 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2d11e64-f7c8-4e90-b079-0de6f2a8a5f8 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.139906 Jul 25 16:21:46.345022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1667/3239] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:21:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:46.359591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.361802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:46.383174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.385220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.386187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.387423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.392037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87871b30-9770-412d-958c-b77646bb75be tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.116569 Jul 25 16:21:46.392863 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1573/3240] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:46 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:46.407346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cbe8616b-3953-4f19-b21d-05498282a6f2 req-d0b1e1af-5266-4801-a028-ea8e6fb5662f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619749d4-64ec-4540-bbdb-e5de46fcaceb", "name": "network-vif-plugged", "status": "completed", "tag": "c405ec60-9082-4e73-a6b1-6d05a7dda98c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:46.442067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cbe8616b-3953-4f19-b21d-05498282a6f2 req-d0b1e1af-5266-4801-a028-ea8e6fb5662f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.442508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cbe8616b-3953-4f19-b21d-05498282a6f2 req-d0b1e1af-5266-4801-a028-ea8e6fb5662f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.476737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.477633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.478395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lazy-loading 'fault' on Instance uuid 4f607753-b3cb-4845-a1f8-d33b12d069eb {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:21:46.491331 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cbe8616b-3953-4f19-b21d-05498282a6f2 req-d0b1e1af-5266-4801-a028-ea8e6fb5662f service nova] Creating event network-vif-plugged:c405ec60-9082-4e73-a6b1-6d05a7dda98c for instance 619749d4-64ec-4540-bbdb-e5de46fcaceb on n-h1-846219-13 Jul 25 16:21:46.500218 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cbe8616b-3953-4f19-b21d-05498282a6f2 req-d0b1e1af-5266-4801-a028-ea8e6fb5662f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105967 Jul 25 16:21:46.506842 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1574/3241] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:46.543700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7af7cbfa-ef60-49b4-9373-b4ee21d0fa13 req-32903302-302f-478e-86bf-a65f00888eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f607753-b3cb-4845-a1f8-d33b12d069eb", "name": "network-vif-deleted", "tag": "aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:46.597080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7af7cbfa-ef60-49b4-9373-b4ee21d0fa13 req-32903302-302f-478e-86bf-a65f00888eec service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.597621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7af7cbfa-ef60-49b4-9373-b4ee21d0fa13 req-32903302-302f-478e-86bf-a65f00888eec service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.626568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d0ef72b53042069e269d9cdada90b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571268d62a5349cc898193a8c27d0f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:46.641816 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7af7cbfa-ef60-49b4-9373-b4ee21d0fa13 req-32903302-302f-478e-86bf-a65f00888eec service nova] Creating event network-vif-deleted:aa5bd3a9-c2a8-4f77-89f7-35adc60b32c9 for instance 4f607753-b3cb-4845-a1f8-d33b12d069eb on n-h2-846219-13 Jul 25 16:21:46.653380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6a48f2b-c6b5-46a7-a198-daa8c1f4eea5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 200 len: 1335 microversion: 2.1 time: 0.301065 Jul 25 16:21:46.654352 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1668/3242] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:46 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 1335 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:46.662395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35a9a780-c4db-4b43-969d-47c25a1f5496 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.668172 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7af7cbfa-ef60-49b4-9373-b4ee21d0fa13 req-32903302-302f-478e-86bf-a65f00888eec service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152033 Jul 25 16:21:46.669369 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1575/3243] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:46.718534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.server_groups [None req-35a9a780-c4db-4b43-969d-47c25a1f5496 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Querying cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) for 1 instances {{(pid=119599) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 16:21:46.724749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35a9a780-c4db-4b43-969d-47c25a1f5496 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.725641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35a9a780-c4db-4b43-969d-47c25a1f5496 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.777806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35a9a780-c4db-4b43-969d-47c25a1f5496 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups/45551d3e-127f-4126-ae29-006201e4c0bf" status: 200 len: 183 microversion: 2.1 time: 0.122007 Jul 25 16:21:46.784452 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1669/3244] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:21:46 2022] GET /compute/v2.1/os-server-groups/45551d3e-127f-4126-ae29-006201e4c0bf => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:46.791198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.791810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:46.812793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.816911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.817918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.818593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.841863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 HTTP/1.1 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6a3b4607-055a-4702-9dc0-bc28c7bfd271'} Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:46.844162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.851887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.857918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:46.861140 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-120575a8-9009-4447-87f3-69494ce32e1c tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 404 len: 111 microversion: 2.1 time: 0.074716 Jul 25 16:21:46.882809 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1576/3245] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:21:46 2022] DELETE /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:21:46.885903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.886544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] [instance: 6a3b4607-055a-4702-9dc0-bc28c7bfd271] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:46.903286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.903740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.904567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:46.904986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:46.930710 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 HTTP/1.1 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '6a3b4607-055a-4702-9dc0-bc28c7bfd271'} Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.932414 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance 6a3b4607-055a-4702-9dc0-bc28c7bfd271 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e42b6f53-4889-4e39-95e2-201a8958a127 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271" status: 404 len: 111 microversion: 2.1 time: 0.052057 Jul 25 16:21:46.944379 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1670/3246] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:46 2022] GET /compute/v2.1/servers/6a3b4607-055a-4702-9dc0-bc28c7bfd271 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:21:46.946226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b83a21e3-d7df-4dad-8c12-2a7b13d19a30 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.954160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b83a21e3-d7df-4dad-8c12-2a7b13d19a30 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance group 67ce4a3c-02b3-49b6-93c1-123d17abac32 could not be found. Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b83a21e3-d7df-4dad-8c12-2a7b13d19a30 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-server-groups/67ce4a3c-02b3-49b6-93c1-123d17abac32 HTTP/1.1 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance group 67ce4a3c-02b3-49b6-93c1-123d17abac32 could not be found. Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '67ce4a3c-02b3-49b6-93c1-123d17abac32'} Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 67ce4a3c-02b3-49b6-93c1-123d17abac32 could not be found. Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 67ce4a3c-02b3-49b6-93c1-123d17abac32 could not be found. Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.962577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 67ce4a3c-02b3-49b6-93c1-123d17abac32 could not be found. Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.968815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b83a21e3-d7df-4dad-8c12-2a7b13d19a30 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance group 67ce4a3c-02b3-49b6-93c1-123d17abac32 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:46.973293 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b83a21e3-d7df-4dad-8c12-2a7b13d19a30 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/67ce4a3c-02b3-49b6-93c1-123d17abac32" status: 404 len: 117 microversion: 2.1 time: 0.033912 Jul 25 16:21:46.974652 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1577/3247] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:46 2022] DELETE /compute/v2.1/os-server-groups/67ce4a3c-02b3-49b6-93c1-123d17abac32 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:46.983117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba7ecf7e-6df5-46a1-acb5-03ee769e2031 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:46.996491 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ba7ecf7e-6df5-46a1-acb5-03ee769e2031 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance group 017a0eb1-62af-4b77-9645-cdc178812dc9 could not be found. Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba7ecf7e-6df5-46a1-acb5-03ee769e2031 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-server-groups/017a0eb1-62af-4b77-9645-cdc178812dc9 HTTP/1.1 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance group 017a0eb1-62af-4b77-9645-cdc178812dc9 could not be found. Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '017a0eb1-62af-4b77-9645-cdc178812dc9'} Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 017a0eb1-62af-4b77-9645-cdc178812dc9 could not be found. Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 017a0eb1-62af-4b77-9645-cdc178812dc9 could not be found. Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:46.998626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 017a0eb1-62af-4b77-9645-cdc178812dc9 could not be found. Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba7ecf7e-6df5-46a1-acb5-03ee769e2031 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance group 017a0eb1-62af-4b77-9645-cdc178812dc9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:47.003865 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ba7ecf7e-6df5-46a1-acb5-03ee769e2031 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/017a0eb1-62af-4b77-9645-cdc178812dc9" status: 404 len: 117 microversion: 2.1 time: 0.020886 Jul 25 16:21:47.004650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1671/3248] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:46 2022] DELETE /compute/v2.1/os-server-groups/017a0eb1-62af-4b77-9645-cdc178812dc9 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:47.010748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4362390f-55af-4357-a740-e5817836cfc1 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.032356 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4362390f-55af-4357-a740-e5817836cfc1 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance group a6b7e152-b370-4487-8713-5641b1a41a15 could not be found. Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4362390f-55af-4357-a740-e5817836cfc1 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-server-groups/a6b7e152-b370-4487-8713-5641b1a41a15 HTTP/1.1 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance group a6b7e152-b370-4487-8713-5641b1a41a15 could not be found. Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'a6b7e152-b370-4487-8713-5641b1a41a15'} Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a6b7e152-b370-4487-8713-5641b1a41a15 could not be found. Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a6b7e152-b370-4487-8713-5641b1a41a15 could not be found. Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.036782 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.041437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.041437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.041437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:47.041437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:47.041437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a6b7e152-b370-4487-8713-5641b1a41a15 could not be found. Jul 25 16:21:47.041437 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.047623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4362390f-55af-4357-a740-e5817836cfc1 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance group a6b7e152-b370-4487-8713-5641b1a41a15 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:47.053720 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4362390f-55af-4357-a740-e5817836cfc1 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/a6b7e152-b370-4487-8713-5641b1a41a15" status: 404 len: 117 microversion: 2.1 time: 0.047358 Jul 25 16:21:47.069637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c14e40bd-8a8f-4f16-a8f6-56e7887303b4 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.071291 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1578/3249] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:47 2022] DELETE /compute/v2.1/os-server-groups/a6b7e152-b370-4487-8713-5641b1a41a15 => generated 117 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:47.086949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c14e40bd-8a8f-4f16-a8f6-56e7887303b4 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] HTTP exception thrown: Instance group 9ba19bb2-99af-49fe-bb57-e115b202f771 could not be found. Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c14e40bd-8a8f-4f16-a8f6-56e7887303b4 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Request method failure captured: Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-server-groups/9ba19bb2-99af-49fe-bb57-e115b202f771 HTTP/1.1 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLuXmJ7NdV4JH0fgzw9gC23z7vSUe7krwHDjuy_LnE78Aiml4cHnlsotmkCL0kNWsU3br40ubqkD4nxjhScvnqMZwFIZm7rWVwx4lIILY-f7aKpW4hU15k7YlufJl0YRNZX1wGBSHBMDOGradjk-KbVTlvwXtoGfUFZ0QNvciI6yyE Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/816e64a7052b4875ac52b887aafe21f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_816e64a7052b4875ac52b887aafe21f3"}]}] Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 816e64a7052b4875ac52b887aafe21f3 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerGroupTestJSON-621873543 Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 684c5d26a73f477b909a2baabdff021b Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerGroupTestJSON-621873543-project Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance group 9ba19bb2-99af-49fe-bb57-e115b202f771 could not be found. Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '9ba19bb2-99af-49fe-bb57-e115b202f771'} Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9ba19bb2-99af-49fe-bb57-e115b202f771 could not be found. Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9ba19bb2-99af-49fe-bb57-e115b202f771 could not be found. Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.089051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.095001 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.095001 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.095001 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:47.095001 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:47.095001 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9ba19bb2-99af-49fe-bb57-e115b202f771 could not be found. Jul 25 16:21:47.095001 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.102653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c14e40bd-8a8f-4f16-a8f6-56e7887303b4 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Returning 404 to user: Instance group 9ba19bb2-99af-49fe-bb57-e115b202f771 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:47.103911 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c14e40bd-8a8f-4f16-a8f6-56e7887303b4 tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/9ba19bb2-99af-49fe-bb57-e115b202f771" status: 404 len: 117 microversion: 2.1 time: 0.038572 Jul 25 16:21:47.105035 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1672/3250] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:47 2022] DELETE /compute/v2.1/os-server-groups/9ba19bb2-99af-49fe-bb57-e115b202f771 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:47.115731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62d6abf7-f17f-494f-975e-76f11f67572d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.209297 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-62d6abf7-f17f-494f-975e-76f11f67572d tempest-ServerGroupTestJSON-621873543 tempest-ServerGroupTestJSON-621873543-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/45551d3e-127f-4126-ae29-006201e4c0bf" status: 204 len: 0 microversion: 2.1 time: 0.099125 Jul 25 16:21:47.214372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1579/3251] 10.222.0.105 () {58 vars in 1271 bytes} [Mon Jul 25 16:21:47 2022] DELETE /compute/v2.1/os-server-groups/45551d3e-127f-4126-ae29-006201e4c0bf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:21:47.214973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.215695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:47.230842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:47.231912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:47.233076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:47.233666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:47.281039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.286274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:47.294424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:47.295207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:47.305699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:47.306712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:47.480363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:47.490764 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3adde71a-61c9-4916-8eaf-df5e0b033dd9 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1471 microversion: 2.1 time: 0.280076 Jul 25 16:21:47.492703 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1673/3252] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:47 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:47.503227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bbfcf2ce-ca73-4dea-9634-6006881ac8c7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da4aea8b0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.626716 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bbfcf2ce-ca73-4dea-9634-6006881ac8c7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.131130 Jul 25 16:21:47.628133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1674/3253] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:47 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:47.679016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.679733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:47.695739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:47.696205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:47.697119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:47.697579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:47.728213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:47.742321 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10df2f50-7068-48bf-ba72-4c3f102dd4a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 0.465252 Jul 25 16:21:47.825514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1580/3254] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:47 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:47.854573 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] HTTP exception thrown: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Request method failure captured: Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb HTTP/1.1 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJUTm-vXiLtHkTC9sRu_ra5x6fFhjbILnTy3fh7b_hy8dObWUHM_RJpNtAzbKufiTEYZ_zrFyFLPDHaTzGPWToi0FHxwzicjVnkcCgVGZkpQAWigrex1LrVpqzoupGyJK07yE0R3oHPjx6levnSnK0KWtO7Qe3y-UR1jMxOTl_hSH0 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 571268d62a5349cc898193a8c27d0f21 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_571268d62a5349cc898193a8c27d0f21"}]}] Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 571268d62a5349cc898193a8c27d0f21 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachSCSIVolumeTestJSON-911156263-project Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: a1d0ef72b53042069e269d9cdada90b5 Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-911156263-project Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4f607753-b3cb-4845-a1f8-d33b12d069eb'} Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:47.862886 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:21:47.868799 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:47.875204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Returning 404 to user: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:47.880350 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5830158f-7d52-4d3c-882c-b1adadf6b7a5 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 404 len: 111 microversion: 2.1 time: 0.205360 Jul 25 16:21:47.884947 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1675/3255] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:47 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:21:47.894262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ed417a3-90fb-4899-b0e0-58e3c8d6ac3a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '.version_select at 0x7f9d93e67550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:47.969338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6ed417a3-90fb-4899-b0e0-58e3c8d6ac3a tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209624962" status: 202 len: 0 microversion: 2.1 time: 0.078424 Jul 25 16:21:47.972395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1581/3256] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:21:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209624962 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:21:48.516495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:48.519240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:48.555394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:48.559057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:48.566991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:48.571436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:48.645274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da82a381-6dc6-4c42-96ab-ecfa843b47cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d939611f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:48.803106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:48.805489 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da82a381-6dc6-4c42-96ab-ecfa843b47cf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.165586 Jul 25 16:21:48.806837 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1582/3257] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:48 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:48.809966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:48.813662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lazy-loading 'fault' on Instance uuid a767be8e-a4fe-4edd-9dae-a502891200dc {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:21:48.819278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fb2e5e32-6ee4-4fe0-a7e6-df13d083ca80 req-1381d0d9-62dd-4cb4-884e-1976e5bb0428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f43cc78-3ee1-43d2-a010-c844af4d767a", "name": "network-vif-plugged", "status": "completed", "tag": "7e82df10-1f35-4f42-8607-171ec06fb049"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:48.855162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fb2e5e32-6ee4-4fe0-a7e6-df13d083ca80 req-1381d0d9-62dd-4cb4-884e-1976e5bb0428 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:48.856966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fb2e5e32-6ee4-4fe0-a7e6-df13d083ca80 req-1381d0d9-62dd-4cb4-884e-1976e5bb0428 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:48.879664 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fb2e5e32-6ee4-4fe0-a7e6-df13d083ca80 req-1381d0d9-62dd-4cb4-884e-1976e5bb0428 service nova] Creating event network-vif-plugged:7e82df10-1f35-4f42-8607-171ec06fb049 for instance 5f43cc78-3ee1-43d2-a010-c844af4d767a on n-h2-846219-13 Jul 25 16:21:48.892888 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fb2e5e32-6ee4-4fe0-a7e6-df13d083ca80 req-1381d0d9-62dd-4cb4-884e-1976e5bb0428 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084119 Jul 25 16:21:48.896298 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1583/3258] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:21:48.921517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:48.922306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:48.946712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:48.949966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:48.950851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:48.954485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:49.176363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1834237759744f1f9c512cbeabfc56fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe557f25c6cd4c3d806cfb25a2408c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:49.187071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d17529fc-df2c-4a73-aa4b-c29a135b5424 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 200 len: 1310 microversion: 2.1 time: 0.676549 Jul 25 16:21:49.203239 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1676/3259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:48 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 1310 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:49.274524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9c76a447-dd22-41cf-aeb8-77ce98962f3f req-d2c20cd1-a380-4ce3-a0a2-fc804b97a578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a767be8e-a4fe-4edd-9dae-a502891200dc", "name": "network-vif-deleted", "tag": "3d6ffc83-7855-443b-a9f0-97039c2179ab"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:49.322114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9c76a447-dd22-41cf-aeb8-77ce98962f3f req-d2c20cd1-a380-4ce3-a0a2-fc804b97a578 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:49.322571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9c76a447-dd22-41cf-aeb8-77ce98962f3f req-d2c20cd1-a380-4ce3-a0a2-fc804b97a578 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:49.364599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9c76a447-dd22-41cf-aeb8-77ce98962f3f req-d2c20cd1-a380-4ce3-a0a2-fc804b97a578 service nova] Creating event network-vif-deleted:3d6ffc83-7855-443b-a9f0-97039c2179ab for instance a767be8e-a4fe-4edd-9dae-a502891200dc on n-h1-846219-13 Jul 25 16:21:49.380065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9c76a447-dd22-41cf-aeb8-77ce98962f3f req-d2c20cd1-a380-4ce3-a0a2-fc804b97a578 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109385 Jul 25 16:21:49.386129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1677/3260] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:21:49.824084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37d41799-fed6-441f-bacf-5fead873e62c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92fe6280>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:49.937377 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37d41799-fed6-441f-bacf-5fead873e62c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.118438 Jul 25 16:21:49.948014 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1678/3261] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:49 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:50.221433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:50.222944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] [instance: a767be8e-a4fe-4edd-9dae-a502891200dc] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:50.238754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:50.239212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:50.240012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:50.248699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:50.312117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] HTTP exception thrown: Instance a767be8e-a4fe-4edd-9dae-a502891200dc could not be found. Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Request method failure captured: Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc HTTP/1.1 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sJ678e67t-6eTYwh-I2c6qZnOi9Kyu4TDhcDBA6WlnM3z39Rylj5cAiWlZtCdsFoti-RrCx0_dwuYo_H7Sz47ABFYTZtRlwSBGrmB7fNGLe1NDNy9fywEsnVvAA58to8xAhrFBP_uZsDFuB5olb1qY6s1mTIzZueD5is4edkVqYfJY Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/fe557f25c6cd4c3d806cfb25a2408c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_fe557f25c6cd4c3d806cfb25a2408c02"}]}] Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: fe557f25c6cd4c3d806cfb25a2408c02 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-33562869 Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 1834237759744f1f9c512cbeabfc56fc Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-SecurityGroupsTestJSON-33562869-project Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance a767be8e-a4fe-4edd-9dae-a502891200dc could not be found. Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'a767be8e-a4fe-4edd-9dae-a502891200dc'} Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a767be8e-a4fe-4edd-9dae-a502891200dc could not be found. Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a767be8e-a4fe-4edd-9dae-a502891200dc could not be found. Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:21:50.314822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a767be8e-a4fe-4edd-9dae-a502891200dc could not be found. Jul 25 16:21:50.320777 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:21:50.321968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:50.324792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Returning 404 to user: Instance a767be8e-a4fe-4edd-9dae-a502891200dc could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:21:50.326535 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6ea4f78a-f5d8-4878-b8a4-00a114a25c2f tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc" status: 404 len: 111 microversion: 2.1 time: 0.110779 Jul 25 16:21:50.328280 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1679/3262] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:50 2022] GET /compute/v2.1/servers/a767be8e-a4fe-4edd-9dae-a502891200dc => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:50.328578 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8fe127e2-fa7a-4e07-8905-f6a43eae46c0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 1.430917 Jul 25 16:21:50.341410 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1584/3263] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:48 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:50.341660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d8acecc-2be8-4a33-a554-17ce21734818 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d92a11dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:50.919924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4d8acecc-2be8-4a33-a554-17ce21734818 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/87162384-a725-4f47-ac3a-beae13b0bce2" status: 202 len: 0 microversion: 2.1 time: 0.584918 Jul 25 16:21:50.921708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1680/3264] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:50 2022] DELETE /compute/v2.1/os-security-groups/87162384-a725-4f47-ac3a-beae13b0bce2 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:50.956691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-448afed2-c4db-4bcd-9ff4-7d94dff3dfb5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] Calling method '.version_select at 0x7f9d939155e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:50.971533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aa6cfd47-ff1d-4681-8a74-5e40abc84983 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92fe5af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:51.081311 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aa6cfd47-ff1d-4681-8a74-5e40abc84983 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.127841 Jul 25 16:21:51.083656 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1681/3265] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:50 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:51.307361 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-448afed2-c4db-4bcd-9ff4-7d94dff3dfb5 tempest-SecurityGroupsTestJSON-33562869 tempest-SecurityGroupsTestJSON-33562869-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/24fc9604-7d39-411b-8806-23877cf82a01" status: 202 len: 0 microversion: 2.1 time: 0.381531 Jul 25 16:21:51.308110 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1585/3266] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:21:50 2022] DELETE /compute/v2.1/os-security-groups/24fc9604-7d39-411b-8806-23877cf82a01 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:51.358701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:51.360663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:51.381801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:51.383621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:51.385074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:51.388140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:51.991441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:52.008804 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd12c901-698f-4927-90de-f3ae58e07792 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1319 microversion: 2.1 time: 0.659011 Jul 25 16:21:52.014272 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1682/3267] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:51 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:52.098419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6de88219-7aee-4236-a3ba-923f63d05e59 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a51af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:53.044868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:53.046783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:53.065321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:53.065776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:53.066640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:53.067221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:53.221416 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6de88219-7aee-4236-a3ba-923f63d05e59 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 1.126781 Jul 25 16:21:53.229790 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1586/3268] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:52 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:21:53.522349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:53.532298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fbe73fec-8ddf-4c23-bdac-15b6f7d01587 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1507 microversion: 2.1 time: 0.498095 Jul 25 16:21:53.533218 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1683/3269] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:53 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:53.558413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-207afda7-1f59-4ca1-923e-17ab698c6b15 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:21:53.574654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-207afda7-1f59-4ca1-923e-17ab698c6b15 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:53.581910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-207afda7-1f59-4ca1-923e-17ab698c6b15 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:53.772759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-207afda7-1f59-4ca1-923e-17ab698c6b15 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Going to try to stop instance {{(pid=119598) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:21:53.870068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-207afda7-1f59-4ca1-923e-17ab698c6b15 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a/action" status: 202 len: 0 microversion: 2.1 time: 0.318933 Jul 25 16:21:53.871027 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1587/3270] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:21:53 2022] POST /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:21:53.879785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:53.880546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:53.883826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:53.907289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:53.915808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:53.917684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:53.919508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:54.255043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-020727c8-ab6a-42df-8a2e-9ceaa001f81d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a0c1f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:54.378660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-020727c8-ab6a-42df-8a2e-9ceaa001f81d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.134382 Jul 25 16:21:54.379281 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1588/3271] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:54 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:55.018081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:55.026335 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3aa417e1-0254-46b1-8480-fea1cb2f82a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.150708 Jul 25 16:21:55.029976 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1684/3272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:53 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:55.412935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-638dc4bb-326a-42ed-aab5-e3ee23f30b37 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93900820>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:55.606511 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-638dc4bb-326a-42ed-aab5-e3ee23f30b37 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.214519 Jul 25 16:21:55.621621 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1589/3273] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:55 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:56.062463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:56.070674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:56.155468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:56.156105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:56.186992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:56.187643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:56.640299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84a1ae85-ab69-4759-b74c-5dcca48b36f3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d939be8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:56.776419 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84a1ae85-ab69-4759-b74c-5dcca48b36f3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.151890 Jul 25 16:21:56.794565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1590/3274] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:56 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:57.690791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:57.700313 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e41146a-fa1c-44e9-86c1-4e2bc8297185 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.646420 Jul 25 16:21:57.713124 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1685/3275] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:56 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:57.821194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f91ba891-aa05-4095-8809-4d8dc4634fc2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da02b4790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:57.958040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f91ba891-aa05-4095-8809-4d8dc4634fc2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.142023 Jul 25 16:21:57.965521 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1591/3276] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:57 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:21:58.734701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:58.736068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:21:58.749603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:58.750414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:58.752355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:21:58.758039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:21:58.974450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17cf5ae7-157e-41e9-827b-5ec333bea4c7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a51430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:21:59.100805 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17cf5ae7-157e-41e9-827b-5ec333bea4c7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.131054 Jul 25 16:21:59.105715 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1592/3277] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:21:58 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:21:59.523099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:21:59.531365 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7a31852-dbb0-42a3-ac81-094b966645b6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.801018 Jul 25 16:21:59.537341 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1686/3278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:21:58 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:00.117696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-af61dd91-fe23-4515-a19f-7cf0deb78439 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a0cc10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:00.256001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-af61dd91-fe23-4515-a19f-7cf0deb78439 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.143821 Jul 25 16:22:00.256747 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1593/3279] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:00 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:00.561989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:00.563911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:00.580276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:00.580740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:00.581641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:00.582076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:01.274807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4aaf9fe3-11d0-4c8c-9e7e-32276f23ce06 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a8a940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:01.355399 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4aaf9fe3-11d0-4c8c-9e7e-32276f23ce06 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.085659 Jul 25 16:22:01.355990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1594/3280] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:01 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:01.407120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:01.407897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:01.424145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:01.424597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:01.425505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:01.425944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:01.492240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] HTTP exception thrown: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Request method failure captured: Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb HTTP/1.1 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJUTm-vXiLtHkTC9sRu_ra5x6fFhjbILnTy3fh7b_hy8dObWUHM_RJpNtAzbKufiTEYZ_zrFyFLPDHaTzGPWToi0FHxwzicjVnkcCgVGZkpQAWigrex1LrVpqzoupGyJK07yE0R3oHPjx6levnSnK0KWtO7Qe3y-UR1jMxOTl_hSH0 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 571268d62a5349cc898193a8c27d0f21 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_571268d62a5349cc898193a8c27d0f21"}]}] Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 571268d62a5349cc898193a8c27d0f21 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachSCSIVolumeTestJSON-911156263-project Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a1d0ef72b53042069e269d9cdada90b5 Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-911156263-project Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4f607753-b3cb-4845-a1f8-d33b12d069eb'} Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:22:01.495647 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.500999 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.502723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Returning 404 to user: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:22:01.509476 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e5a3fcec-ce95-4fbe-94c5-adc11400a3d1 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 404 len: 111 microversion: 2.1 time: 0.105795 Jul 25 16:22:01.514470 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1595/3281] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:22:01 2022] DELETE /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:22:01.525642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:01.526723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] [instance: 4f607753-b3cb-4845-a1f8-d33b12d069eb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:01.547210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:01.548076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:01.549164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:01.551286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:01.588736 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] HTTP exception thrown: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Request method failure captured: Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb HTTP/1.1 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sJUTm-vXiLtHkTC9sRu_ra5x6fFhjbILnTy3fh7b_hy8dObWUHM_RJpNtAzbKufiTEYZ_zrFyFLPDHaTzGPWToi0FHxwzicjVnkcCgVGZkpQAWigrex1LrVpqzoupGyJK07yE0R3oHPjx6levnSnK0KWtO7Qe3y-UR1jMxOTl_hSH0 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 571268d62a5349cc898193a8c27d0f21 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/571268d62a5349cc898193a8c27d0f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_571268d62a5349cc898193a8c27d0f21"}]}] Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 571268d62a5349cc898193a8c27d0f21 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-911156263 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachSCSIVolumeTestJSON-911156263-project Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: a1d0ef72b53042069e269d9cdada90b5 Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-911156263-project Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4f607753-b3cb-4845-a1f8-d33b12d069eb'} Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:22:01.591041 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. Jul 25 16:22:01.596010 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:22:01.600222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] Returning 404 to user: Instance 4f607753-b3cb-4845-a1f8-d33b12d069eb could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:22:01.606958 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25c52cd1-f2d2-4e4e-a381-d4028c687bf7 tempest-AttachSCSIVolumeTestJSON-911156263 tempest-AttachSCSIVolumeTestJSON-911156263-project] 10.222.0.105 "GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb" status: 404 len: 111 microversion: 2.1 time: 0.090929 Jul 25 16:22:01.612137 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1596/3282] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:01 2022] GET /compute/v2.1/servers/4f607753-b3cb-4845-a1f8-d33b12d069eb => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:22:01.822393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:01.830323 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-442efdac-c7ad-4387-ba64-f086577a9273 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.273122 Jul 25 16:22:01.844271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1687/3283] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:00 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:02.376390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f29ea2e7-5984-4342-989e-96d8bac431e1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93961670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:02.474146 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f29ea2e7-5984-4342-989e-96d8bac431e1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.107459 Jul 25 16:22:02.481808 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1597/3284] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:02 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:02.852667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:02.853478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:02.866081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:02.881073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:02.882477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:02.886069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:03.492045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8b327ce-d354-45f5-adf8-7a277bce951e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a8af70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:03.585600 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8b327ce-d354-45f5-adf8-7a277bce951e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.099761 Jul 25 16:22:03.587116 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1598/3285] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:03 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:04.507024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:04.521685 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3913668d-2a97-475a-9a4f-337543237faa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.672439 Jul 25 16:22:04.522360 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1688/3286] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:02 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:04.603334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec773471-0c63-4da1-b665-c3d1e64bf081 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da0115670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:04.692160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec773471-0c63-4da1-b665-c3d1e64bf081 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.093327 Jul 25 16:22:04.701882 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1599/3287] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:04 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:05.546851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:05.548191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:05.577932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:05.583761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:05.585455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:05.589323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:05.710128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dd4055a-94e7-4529-bf59-99b7778a441f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da02b4790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:05.794335 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5dd4055a-94e7-4529-bf59-99b7778a441f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.090061 Jul 25 16:22:05.795286 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1600/3288] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:05 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:06.613817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:06.635112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d9db14e-8dcb-425d-932d-01be278b4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.095096 Jul 25 16:22:06.641534 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1689/3289] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:05 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:06.812235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0fbd5d88-adef-46c8-b297-eb480a341d81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93961c10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:06.884384 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0fbd5d88-adef-46c8-b297-eb480a341d81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.078323 Jul 25 16:22:06.885673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1601/3290] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:06 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:07.317140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-971910453", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": "none"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:07.419030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:22:07.419861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:22:07.420356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:22:07.421524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:22:07.421961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:22:07.432851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:07.433725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:07.434765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:07.435382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:07.462574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Getting quotas for project 8703005fab754aaf8560d8fdce4ee817. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:07.473390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Getting quotas for user 4675039200f64e7f998e090c8e90ede3 and project 8703005fab754aaf8560d8fdce4ee817. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:07.512424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:22:07.516994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:22:07.609282 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c225a770-5a78-47c3-9ed2-72f23f2c6568 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.688262 Jul 25 16:22:07.612414 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1690/3291] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:22:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:22:07.625139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3462659-e8e1-4bbe-b9b0-ee4a299d0d9f tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:07.626057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3462659-e8e1-4bbe-b9b0-ee4a299d0d9f tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:07.628440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:07.664455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:07.665089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:07.674669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:07.678278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:07.679703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:07.680333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:07.712342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:07.996342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3462659-e8e1-4bbe-b9b0-ee4a299d0d9f tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:08.013987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3462659-e8e1-4bbe-b9b0-ee4a299d0d9f tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:08.022212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3462659-e8e1-4bbe-b9b0-ee4a299d0d9f tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:08.028199 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3462659-e8e1-4bbe-b9b0-ee4a299d0d9f tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef" status: 200 len: 1280 microversion: 2.47 time: 0.405030 Jul 25 16:22:08.030935 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1602/3292] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:07 2022] GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef => generated 1280 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:08.047623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67cf717f-b2e4-482e-abdb-d491cf099061 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a8a1f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:08.172425 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67cf717f-b2e4-482e-abdb-d491cf099061 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.139629 Jul 25 16:22:08.175192 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1603/3293] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:08 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:08.245759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1272608145", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": "none"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:08.357386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:08.374766 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4643854-ce25-4525-94ec-74a95ff6ded0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.715448 Jul 25 16:22:08.384885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:22:08.386537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:22:08.387622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:22:08.388375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:22:08.390512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:22:08.394605 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1691/3294] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:07 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:08.418058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:08.418848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:08.423685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:08.425840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:08.495396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Getting quotas for project 8703005fab754aaf8560d8fdce4ee817. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:08.516384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Getting quotas for user 4675039200f64e7f998e090c8e90ede3 and project 8703005fab754aaf8560d8fdce4ee817. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:08.595738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:22:08.616140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:22:08.796549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20bc9246-9c3b-4eb7-98cc-57a586138148 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.550787 Jul 25 16:22:08.805514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1604/3295] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:22:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:22:08.809512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b9a1389-5a85-4398-9bf2-48d77ee801c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:08.812234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b9a1389-5a85-4398-9bf2-48d77ee801c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:08.923894 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b9a1389-5a85-4398-9bf2-48d77ee801c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "PUT /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 995 microversion: 2.47 time: 0.118670 Jul 25 16:22:08.925320 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1692/3296] 10.222.0.105 () {62 vars in 1302 bytes} [Mon Jul 25 16:22:08 2022] PUT /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 995 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:22:08.947935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-130b1bc6-fbcc-4afb-8fee-64065c62fc12 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:08.949005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-130b1bc6-fbcc-4afb-8fee-64065c62fc12 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:09.194486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecd67534-7471-4265-af23-4e5b7ff7e29f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92a11040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:09.308379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecd67534-7471-4265-af23-4e5b7ff7e29f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.113952 Jul 25 16:22:09.319844 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1693/3297] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:09 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:09.398865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:09.399842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:09.413168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:09.425835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:09.427757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:09.428215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:09.521869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-130b1bc6-fbcc-4afb-8fee-64065c62fc12 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:09.542381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-130b1bc6-fbcc-4afb-8fee-64065c62fc12 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:09.544847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-130b1bc6-fbcc-4afb-8fee-64065c62fc12 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:09.546846 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-130b1bc6-fbcc-4afb-8fee-64065c62fc12 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1281 microversion: 2.47 time: 0.603104 Jul 25 16:22:09.549327 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1605/3298] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:08 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1281 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:10.160723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:10.170268 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08fd767a-1a66-4681-a21f-880ca01051ac tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.776956 Jul 25 16:22:10.176042 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1694/3299] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:09 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:10.328527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69430b79-fc48-485e-8e3c-e5b21cf473cd tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da0115790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:10.428753 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69430b79-fc48-485e-8e3c-e5b21cf473cd tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.108483 Jul 25 16:22:10.453208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1606/3300] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:10 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:10.571997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:10.578782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:10.601613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:10.614032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:10.615181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:10.615810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:11.059687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:11.077341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:11.078950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:11.080168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a05cb223-4f28-4cb7-bbcc-ce38bd4e03a6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1333 microversion: 2.47 time: 0.512190 Jul 25 16:22:11.080765 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1695/3301] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:10 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1333 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:11.201292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:11.202747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:11.219687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:11.220048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:11.223850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:11.224368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:11.238709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:11.458410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07288696-e735-4390-86f3-115dc736ef6f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d9389e940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:11.503664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:11.513200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f842bd07-9f21-44ca-a23e-5fd33049ea08 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.318921 Jul 25 16:22:11.517173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1607/3302] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:11 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:11.587679 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07288696-e735-4390-86f3-115dc736ef6f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.134108 Jul 25 16:22:11.630192 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1696/3303] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:11 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:12.109952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:12.111209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:12.132896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:12.133370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:12.134157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:12.134772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:12.427703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:12.440732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:12.442300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:12.443536 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5c9a0c3-eab1-4459-9187-a7e9eda803ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1341 microversion: 2.47 time: 0.339159 Jul 25 16:22:12.462523 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1608/3304] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:12 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1341 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:12.540700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:12.542009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:12.566386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:12.567088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:12.568704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:12.569405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:12.603695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b641cd67-6889-44c6-b211-697df051893e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a8ad30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:12.676574 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b641cd67-6889-44c6-b211-697df051893e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1416 microversion: 2.1 time: 0.075915 Jul 25 16:22:12.682282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1609/3305] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:12 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1416 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:13.477202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:13.477865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:13.489705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:13.490155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:13.490949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:13.491387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:13.789890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:13.808882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:13.810706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:13.811912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5b01eee-ea07-49f7-b3a8-2cb4dd4d5be7 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1339 microversion: 2.47 time: 0.339046 Jul 25 16:22:13.812484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1610/3306] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:13 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1339 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:22:13.819203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2b590dd-4188-46e9-8c4f-b1b075d6dc6b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93a8a8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:13.861449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:13.875368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7264a19c-a931-478b-9731-7437c50058b4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.341012 Jul 25 16:22:13.878572 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2b590dd-4188-46e9-8c4f-b1b075d6dc6b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1425 microversion: 2.1 time: 0.064311 Jul 25 16:22:13.879583 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1697/3308] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:12 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:13.883788 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1611/3308] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:13 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1425 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:13.898044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8b3e2ee-2b72-4c89-b3cd-0d3756494cf5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d929899d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:13.999754 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8b3e2ee-2b72-4c89-b3cd-0d3756494cf5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 200 len: 1425 microversion: 2.1 time: 0.108279 Jul 25 16:22:14.000374 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1698/3309] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:13 2022] GET /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 1425 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:14.018083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81e38c74-bfb3-4a5d-9e38-8f556082dfe0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93903ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:14.840517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:14.841546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:14.859883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:14.860343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:14.861207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:14.861644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:15.057567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:15.067738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:15.070315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:15.071588 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f97d1eb-a725-40fa-b059-277b720aa061 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1339 microversion: 2.47 time: 0.236746 Jul 25 16:22:15.072176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1699/3310] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:14 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1339 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:22:15.080589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:15.081297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:15.099891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:15.100248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:15.103641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:15.104088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:15.164961 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81e38c74-bfb3-4a5d-9e38-8f556082dfe0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 204 len: 0 microversion: 2.1 time: 1.151006 Jul 25 16:22:15.166174 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1612/3311] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:14 2022] DELETE /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 0 bytes in 1153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:15.178954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:15.180146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:15.197884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:15.203405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:15.206266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:15.207205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:15.252239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:22:15.456336 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e6a11a8-a68d-43d3-a9ae-34f4808a94b0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 204 len: 0 microversion: 2.1 time: 0.279104 Jul 25 16:22:15.457767 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1613/3312] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:22:15 2022] DELETE /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:15.731004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-592135987", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2d092cd9-2c7a-465d-800a-441e40e4458e"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:15.753234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:15.761530 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dde1ba3a-81e3-411f-a261-20664afd986e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.687843 Jul 25 16:22:15.776004 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1700/3313] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:15 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:15.817430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] validate_networks() for [('2d092cd9-2c7a-465d-800a-441e40e4458e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:22:16.099572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:16.101185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:16.111015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:16.112163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:16.113225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:16.114733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:16.435225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:16.449406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:16.451458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:16.452993 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-20cc4a70-d45b-4c16-8b3e-c89684c017b5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1339 microversion: 2.47 time: 0.359021 Jul 25 16:22:16.454596 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1701/3314] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:16 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:22:16.783992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:16.785943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:16.799730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:16.800235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:16.801028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:16.801552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:17.450388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:17.500055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:17.632443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:17.644960 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-981c3794-63b2-4fd6-b4e8-31b5fd177bc9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.862057 Jul 25 16:22:17.664215 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1702/3315] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:16 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:17.671605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:17.672230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:17.686177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:17.687498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:17.688514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:17.689529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:18.456326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:18.599859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:22:18.600282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:22:18.601147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:22:18.601563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:22:18.601983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:22:18.624996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:18.625479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:18.626275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:18.626708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:18.675784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:18.690729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for user ccbaed5ca4f5414b9e06fa95dbbac29c and project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:18.720140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:18.736257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:22:18.738785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:22:18.754216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:18.755954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:18.763935 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e5d32bb-8829-4d00-9237-9cef41afe78b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1339 microversion: 2.47 time: 1.096999 Jul 25 16:22:18.765944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1703/3316] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:17 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1339 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:18.781412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f33be677-23bb-4e63-947d-d1364d5b0e0c req-8eac5688-86e6-40d5-8d65-5554ee4e53e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619749d4-64ec-4540-bbdb-e5de46fcaceb", "name": "network-vif-unplugged", "status": "completed", "tag": "c405ec60-9082-4e73-a6b1-6d05a7dda98c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:18.815786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f33be677-23bb-4e63-947d-d1364d5b0e0c req-8eac5688-86e6-40d5-8d65-5554ee4e53e9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:18.816229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f33be677-23bb-4e63-947d-d1364d5b0e0c req-8eac5688-86e6-40d5-8d65-5554ee4e53e9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:18.843740 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f33be677-23bb-4e63-947d-d1364d5b0e0c req-8eac5688-86e6-40d5-8d65-5554ee4e53e9 service nova] Creating event network-vif-unplugged:c405ec60-9082-4e73-a6b1-6d05a7dda98c for instance 619749d4-64ec-4540-bbdb-e5de46fcaceb on n-h1-846219-13 Jul 25 16:22:18.857911 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f33be677-23bb-4e63-947d-d1364d5b0e0c req-8eac5688-86e6-40d5-8d65-5554ee4e53e9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090535 Jul 25 16:22:18.861173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1704/3317] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:18.868776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:18.881765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:18.883540 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-85587d5e-3f87-4467-99fc-ea9763820048 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.157336 Jul 25 16:22:18.889871 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1614/3318] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:22:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 3165 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:22:18.898429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:18.898886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:18.899842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:18.900281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:18.907817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c478d6e5-a076-4e17-adb9-78e3f79dc8ea tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:18.908637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c478d6e5-a076-4e17-adb9-78e3f79dc8ea tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:19.172247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c478d6e5-a076-4e17-adb9-78e3f79dc8ea tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:19.185993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c478d6e5-a076-4e17-adb9-78e3f79dc8ea tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1211 microversion: 2.1 time: 0.294676 Jul 25 16:22:19.186617 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1615/3319] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:18 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1211 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:19.749853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:19.759460 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ffa999f-92ea-4f19-9617-f82744298fcb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.896686 Jul 25 16:22:19.760011 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1705/3320] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:18 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:19.793969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:19.795122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:19.815278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:19.818701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:19.820242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:19.820802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:20.181786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:20.204675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:20.208452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:20.212253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-355295ee-c653-45ec-abd2-8d9dced2aeb2 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1339 microversion: 2.47 time: 0.424550 Jul 25 16:22:20.215403 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1616/3321] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:19 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1339 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:20.241780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:20.244616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:20.275654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:20.277042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:20.278908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:20.279789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:20.419361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:20.435934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c198d7cf-6d4b-4dc2-96c2-a4466e19a271 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1263 microversion: 2.1 time: 0.206179 Jul 25 16:22:20.436846 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1706/3322] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:20 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:20.785702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:20.786531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:20.795187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:20.795896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:20.797076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:20.797843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.241845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:21.243412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:21.252935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.255288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.257446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.258080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.502201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:21.515479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:21.520033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:21.521731 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be1a2585-e28c-4ae2-a7d1-2a1bf57b0da3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1360 microversion: 2.47 time: 0.285075 Jul 25 16:22:21.522327 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1707/3323] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:21 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1360 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:21.532766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:21.533883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:21.551611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.551949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.552856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.553242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.562134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:21.572999 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da829b95-d9b1-4d14-9742-4e36c9fdf11c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 0.792817 Jul 25 16:22:21.576826 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1617/3324] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:20 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:21.595049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:21.607434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:21.628096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.629773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.630597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.631039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.775387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:22:21.775838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:22:21.776311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:22:21.776758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:22:21.782893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:22:21.880582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:21.897057 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ac036bc-9344-4fa6-82ec-1ffce3a5b648 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1269 microversion: 2.1 time: 0.368050 Jul 25 16:22:21.901636 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1708/3325] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:21 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1269 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:21.925954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:21.948728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.950650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:21.954073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:21.954957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.039575 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1714a2b7-28ee-48db-b20a-15b90ac4d454 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "POST /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e/action" status: 202 len: 1082 microversion: 2.47 time: 0.457129 Jul 25 16:22:22.042070 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1618/3326] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:22:21 2022] POST /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e/action => generated 1082 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Jul 25 16:22:22.064807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.066012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:22.096164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.096983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.099368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.101217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.541675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78355bef-2205-475a-bf3f-5202007d3077 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.560728 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78355bef-2205-475a-bf3f-5202007d3077 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.586315 Jul 25 16:22:22.564535 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1709/3327] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:21 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:22.578882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c5819d5-fa94-40bd-9d83-379a968edae6 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.615469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:22.621397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c5819d5-fa94-40bd-9d83-379a968edae6 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors" status: 200 len: 2622 microversion: 2.1 time: 0.048854 Jul 25 16:22:22.624556 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1710/3328] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/flavors => generated 2622 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:22.632062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.632705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:22.635533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:22.637167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:22.641956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.644113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.644499 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35bed374-399f-4832-928e-a1c5eddb699b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.583540 Jul 25 16:22:22.655109 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1619/3329] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:22.661127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9bd4c490-de17-4881-8c97-71c12ae777fc tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.662273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.662937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.704941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9bd4c490-de17-4881-8c97-71c12ae777fc tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.045682 Jul 25 16:22:22.709593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1620/3330] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:22.733481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f20a9aa9-1442-40fe-99fb-b02db858986d tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.769330 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f20a9aa9-1442-40fe-99fb-b02db858986d tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.049353 Jul 25 16:22:22.770577 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1621/3331] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:22.790031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d39874d6-8770-47c9-9f41-15c32b0759f3 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.840911 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d39874d6-8770-47c9-9f41-15c32b0759f3 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3227 microversion: 2.1 time: 0.057523 Jul 25 16:22:22.853662 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1622/3332] 10.222.0.105 () {58 vars in 1170 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3227 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:22.870238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5db22926-6b76-4891-87d8-bc37f44af3ad tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.883223 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5db22926-6b76-4891-87d8-bc37f44af3ad tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.018600 Jul 25 16:22:22.884704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1623/3333] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:22.903251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b198b0eb-2e0a-45e7-bd3f-6cc96b2c23a2 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.958022 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b198b0eb-2e0a-45e7-bd3f-6cc96b2c23a2 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2157 microversion: 2.1 time: 0.056906 Jul 25 16:22:22.959503 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1624/3334] 10.222.0.105 () {58 vars in 1174 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2157 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:22.977722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.978952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:22.986412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.990494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.994439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.995161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:23.511820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:23.519893 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e7732eb-aac9-4b92-99ca-3ee0fe940db2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1269 microversion: 2.1 time: 0.559068 Jul 25 16:22:23.523304 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1625/3335] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1269 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:23.541741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e53b74eb-59b5-46e1-88e6-adfe46a3ad80 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:23.563433 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e53b74eb-59b5-46e1-88e6-adfe46a3ad80 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 479 microversion: 2.1 time: 0.038720 Jul 25 16:22:23.564593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1626/3336] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:22:23 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 479 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:23.609988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48a249e9-573c-480e-af21-a2a492a37477 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:23.650216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48a249e9-573c-480e-af21-a2a492a37477 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.066946 Jul 25 16:22:23.652250 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1627/3337] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:23 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:23.692571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd749765-b288-447e-a60b-76500b07c81d tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:23.800976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd749765-b288-447e-a60b-76500b07c81d tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2514 microversion: 2.1 time: 0.125374 Jul 25 16:22:23.804986 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1628/3338] 10.222.0.105 () {58 vars in 1172 bytes} [Mon Jul 25 16:22:23 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2514 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:23.814464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:23.815087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:23.845846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:23.846300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:23.847158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:23.847649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:24.034990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:24.049726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:24.052830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:24.057587 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97b273df-13b8-4de9-af9d-15320d366dce tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.250608 Jul 25 16:22:24.059013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1629/3339] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:23 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:24.080277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2eec251f-6d9e-41df-956b-3c66fd72e8f5 req-d5de3de8-7766-4f57-9eb6-8edcbb213def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619749d4-64ec-4540-bbdb-e5de46fcaceb", "name": "network-vif-deleted", "tag": "c405ec60-9082-4e73-a6b1-6d05a7dda98c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:24.093230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2eec251f-6d9e-41df-956b-3c66fd72e8f5 req-d5de3de8-7766-4f57-9eb6-8edcbb213def service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:24.093771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2eec251f-6d9e-41df-956b-3c66fd72e8f5 req-d5de3de8-7766-4f57-9eb6-8edcbb213def service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:24.107854 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2eec251f-6d9e-41df-956b-3c66fd72e8f5 req-d5de3de8-7766-4f57-9eb6-8edcbb213def service nova] Creating event network-vif-deleted:c405ec60-9082-4e73-a6b1-6d05a7dda98c for instance 619749d4-64ec-4540-bbdb-e5de46fcaceb on n-h1-846219-13 Jul 25 16:22:24.114128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2eec251f-6d9e-41df-956b-3c66fd72e8f5 req-d5de3de8-7766-4f57-9eb6-8edcbb213def service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053224 Jul 25 16:22:24.114824 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1630/3340] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:24.120644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2452df0b-54b7-40dc-a286-bd5c7ec42133 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.129777 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2452df0b-54b7-40dc-a286-bd5c7ec42133 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.013493 Jul 25 16:22:24.130651 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1631/3341] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:24.142419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b96f6af9-a437-486d-9203-8d7f2c8b34ed tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.148382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:24.161664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e60bce5-359c-4e8a-b2c5-d3ebf3dde350 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1517 microversion: 2.1 time: 1.535260 Jul 25 16:22:24.165266 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b96f6af9-a437-486d-9203-8d7f2c8b34ed tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1681 microversion: 2.1 time: 0.023325 Jul 25 16:22:24.166709 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1711/3342] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1517 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:24.169238 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1632/3343] 10.222.0.105 () {58 vars in 1149 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1681 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:24.177615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a35d37a-e856-45b3-a336-31fff0ad1b6b tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.184466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:24.187290 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a35d37a-e856-45b3-a336-31fff0ad1b6b tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.013802 Jul 25 16:22:24.200295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b49b1243-9ef8-4dae-ae98-a0288afe83bd tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.205777 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1712/3344] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:24.218090 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b49b1243-9ef8-4dae-ae98-a0288afe83bd tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1123 microversion: 2.1 time: 0.021628 Jul 25 16:22:24.219282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1633/3345] 10.222.0.105 () {58 vars in 1153 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1123 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:24.233203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ce5555f-bb07-47b1-a945-45206635d449 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.248350 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ce5555f-bb07-47b1-a945-45206635d449 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 302 microversion: 2.1 time: 0.018505 Jul 25 16:22:24.250048 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1713/3346] 10.222.0.105 () {58 vars in 1145 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors?limit=1 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:24.261032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5c4cee06-07e3-4a91-948c-be0d206041d6 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.265525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:24.271039 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5c4cee06-07e3-4a91-948c-be0d206041d6 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.013139 Jul 25 16:22:24.271653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1634/3347] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:24.283406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e107431-4eed-48f9-a6bd-80381822d43e tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.327798 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e107431-4eed-48f9-a6bd-80381822d43e tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1314 microversion: 2.1 time: 0.048230 Jul 25 16:22:24.329185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1714/3348] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors?marker=452 => generated 1314 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:24.342513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff99333e-90c7-45dd-a035-29a9b145a09d tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.365712 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff99333e-90c7-45dd-a035-29a9b145a09d tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.026945 Jul 25 16:22:24.382012 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1635/3349] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:24.390558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06db7bbd-aa14-4d84-a73a-04107ca13ac9 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.401271 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06db7bbd-aa14-4d84-a73a-04107ca13ac9 tempest-FlavorsV2TestJSON-118272960 tempest-FlavorsV2TestJSON-118272960-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.014720 Jul 25 16:22:24.406782 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1715/3350] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:24.543599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:24.544438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:24.560705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:24.566297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:24.567292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:24.567743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:24.768592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:24.778793 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-93b50dd1-dece-450b-bdf8-5c927210997c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1269 microversion: 2.1 time: 0.237761 Jul 25 16:22:24.783254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1636/3351] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:24 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:25.088465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:25.089372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:25.101263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.102476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.104996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.106894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.197422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:25.198151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:25.221004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.221593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.222518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.222923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.362673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:25.381910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:25.383659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:25.384939 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e26cd67-bd1d-4702-b4f3-ab7c90886aac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.301705 Jul 25 16:22:25.388262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1716/3352] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:25 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:25.796655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:25.803277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:25.807811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:25.828064 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e96f1bd7-56c1-4ce4-9a25-e1e97c11e2ab tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1494 microversion: 2.1 time: 0.635928 Jul 25 16:22:25.831277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.835016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1637/3353] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:25 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1494 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:25.836092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.837189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.840627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.861650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:25.865000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:25.879865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.880566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.881531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:25.885610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:25.925600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:26.045663 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7bf48a5d-19fa-42ee-ad67-641f5fc04a91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 200 len: 162 microversion: 2.1 time: 0.187835 Jul 25 16:22:26.046982 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1638/3354] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:25 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 162 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:22:26.070406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:26.071794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:26.082531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:26.084224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:26.085416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:26.086191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:26.574806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:26.592261 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b66dd0b9-8414-46de-8d84-23115ae13a03 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 0.793791 Jul 25 16:22:26.595114 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1717/3355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:25 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:26.610404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:26.612655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:26.628480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:26.628764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:26.629594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:26.630035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:26.690937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:26.794413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:26.804682 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8c4f62f-a3f6-475c-9dfe-ff4425aaedae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.749118 Jul 25 16:22:26.805302 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1639/3356] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:26 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:26.838552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:26.840865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:26.864245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:26.865224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:26.866331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:26.867040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:26.952202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:26.970023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:26.973427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:26.980759 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8a5be612-1c0c-4fe8-8029-99f2e90af6ae tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.384188 Jul 25 16:22:26.981569 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1718/3357] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:26 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:27.173924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:27.183137 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c97236a-ad54-43da-a0e1-db6de6190d32 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.353727 Jul 25 16:22:27.183673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1640/3358] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:26 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:27.205387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:27.206432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:27.215230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:27.216177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:27.217221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:27.217890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:27.523673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:27.551307 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1af08895-ca79-4de7-a798-d545d80b8227 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.350391 Jul 25 16:22:27.552292 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1719/3359] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:27 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:27.571879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:27.572508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:27.591563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:27.592181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:27.593200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:27.593648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:27.616315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:27.617007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:27.628049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:27.628501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:27.629341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:27.629780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:28.109756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:28.130727 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-31da3f16-a9d4-47d9-a630-54695fc7787c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.558615 Jul 25 16:22:28.134373 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1641/3360] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:27 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:28.148268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:28.149806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:28.174047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:28.178324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:28.181286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:28.182284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:28.222743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:28.235332 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3546b4b-33c7-477d-bc31-e939525597b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 0.623185 Jul 25 16:22:28.241316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1720/3361] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:27 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:28.438072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-331682713", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "6caa10b5-bb0b-47f3-bbd9-62b23141517a"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:28.551998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] validate_networks() for [('6caa10b5-bb0b-47f3-bbd9-62b23141517a', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:22:28.627853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:28.645394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:28.647208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:28.655837 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0c2d247-b02c-4594-a471-ad5eb9218792 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.519860 Jul 25 16:22:28.673303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1642/3362] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:28 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:28.693344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-119372f4-8096-4087-afaf-b2701982849e req-7affbb0d-745a-46fc-96e1-10fd89546fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a03699d-344b-418e-b91f-4b56f275b9cf", "tag": "c6b22d2b-fcd4-4eb1-9395-9e5f23656c74"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:28.712468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:28.731702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-119372f4-8096-4087-afaf-b2701982849e req-7affbb0d-745a-46fc-96e1-10fd89546fe3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:28.732158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-119372f4-8096-4087-afaf-b2701982849e req-7affbb0d-745a-46fc-96e1-10fd89546fe3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:28.755026 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-119372f4-8096-4087-afaf-b2701982849e req-7affbb0d-745a-46fc-96e1-10fd89546fe3 service nova] Creating event network-changed:c6b22d2b-fcd4-4eb1-9395-9e5f23656c74 for instance 2a03699d-344b-418e-b91f-4b56f275b9cf on n-h2-846219-13 Jul 25 16:22:28.767170 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-119372f4-8096-4087-afaf-b2701982849e req-7affbb0d-745a-46fc-96e1-10fd89546fe3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075620 Jul 25 16:22:28.786124 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1643/3363] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:29.266687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:29.272873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:29.286763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=18 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:29.300076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:29.300539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:29.313979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:29.320881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:30.606995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:30.621980 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-28972380-19af-429d-b548-73a551111add tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 1.363699 Jul 25 16:22:30.622666 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1644/3364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:29 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:30.635116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:30.659677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:30.674826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:30.675537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:30.676518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:30.677189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:30.922062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:30.936636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:30.938615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:22:30.939292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:30.941184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d817101-3173-4e8c-aecc-0178b3d10fab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.310638 Jul 25 16:22:30.941396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:22:30.943377 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1645/3365] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:30 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:30.945849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:22:30.946645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:22:30.947328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:22:30.965633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:30.966774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:30.967861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:30.968483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:30.993619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:31.003867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for user ed4735185f84421f92bc1404d62f26e3 and project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:31.023665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:22:31.029517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:22:31.111971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b199adf-e791-4f51-8d4c-32d2403471ef tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.677405 Jul 25 16:22:31.114194 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1721/3366] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:22:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 2681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:22:31.196619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b801a21d-19b7-469c-a1e3-20b5c7c9f22e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Action: 'create', calling method: .version_select at 0x7f9da4a1f670>, body: {"keypair": {"name": "tempest-keypair-1487779037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVJWzyWkv2qmvIbQCsQ/ATTIdXgAeNbbyMst/YgFRSdtRWLYtPml4OJgx4aUP8f3TOg5TbgfBAGjjD3HgB8Db3bB7tK3x+miTCDlrvwSOqwZLwZHaD/SzceKrh0tAlf3w=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:31.221650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b801a21d-19b7-469c-a1e3-20b5c7c9f22e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Getting quotas for project b13a4c5edb33497ba0348afda935754d. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:31.229794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b801a21d-19b7-469c-a1e3-20b5c7c9f22e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Getting quotas for user 51387870067647ea81d15530cf0296cf and project b13a4c5edb33497ba0348afda935754d. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:31.242656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-653701902", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:31.311753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b801a21d-19b7-469c-a1e3-20b5c7c9f22e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195817 Jul 25 16:22:31.314493 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1722/3367] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:22:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:31.359668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] validate_networks() for None {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:22:31.360466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0389051d-dce1-458b-884d-ede2a17d6d6c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:31.363322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0389051d-dce1-458b-884d-ede2a17d6d6c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:31.507945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0389051d-dce1-458b-884d-ede2a17d6d6c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:31.523910 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0389051d-dce1-458b-884d-ede2a17d6d6c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1218 microversion: 2.1 time: 0.205267 Jul 25 16:22:31.527776 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1723/3368] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:31 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:31.654880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:31.655625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:31.672311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:31.678277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:31.683301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:31.683874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:31.924935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:22:31.925776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:22:31.925986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:22:31.926410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:22:31.926831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:22:31.957291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:31.957740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:31.960216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:31.960216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:32.029973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Getting quotas for project a1eb0d89d327413882079e42507cc344. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:32.044440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Getting quotas for user 42600aeea8e04827be40f6ac81b4c40d and project a1eb0d89d327413882079e42507cc344. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:32.088451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:22:32.095614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:22:32.124124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:32.138606 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eef27cba-9b75-44fd-b0be-950cff077ea6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 0.491590 Jul 25 16:22:32.154553 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1724/3369] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:31 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:32.173777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:32.175310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:32.193063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:32.194945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:32.196274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:32.201913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:32.216021 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d54e5ae7-258b-4dd8-a0c0-875fe107339a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.268225 Jul 25 16:22:32.217141 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1646/3370] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:22:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:22:32.248703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b8efaab7-1013-4d32-ad7e-f42d0c92641d tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:32.252236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b8efaab7-1013-4d32-ad7e-f42d0c92641d tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:32.775844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:32.802851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:32.809569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:32.811446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b8efaab7-1013-4d32-ad7e-f42d0c92641d tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:32.814180 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9450ed49-c4a6-4d77-ae07-d9d5bf9a6b24 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.647551 Jul 25 16:22:32.831924 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1725/3371] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:32 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:32.835714 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b8efaab7-1013-4d32-ad7e-f42d0c92641d tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1220 microversion: 2.1 time: 0.605219 Jul 25 16:22:32.838566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1647/3372] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:32 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1220 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:32.858614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:32.860058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:32.878818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:32.880774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:32.887058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:32.888712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:33.018983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:33.071392 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e9383e8-8d61-419d-9635-36a629b84696 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1270 microversion: 2.1 time: 0.238188 Jul 25 16:22:33.074158 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1726/3373] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:32 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1270 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:33.177922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:33.184229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:33.206120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:33.208002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:33.212495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:33.215859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:33.847593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:33.848284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:33.867133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:33.868306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:33.874388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:33.878237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:34.019887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:34.033483 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f4db138-0a66-420c-af02-aa87cddf2521 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 0.864006 Jul 25 16:22:34.034308 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1648/3374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:33 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:34.049396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:34.050644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:34.066191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:34.066993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:34.068400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:34.069239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:34.128270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:34.142227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:34.144390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:34.151482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13048d26-4e80-4083-b015-069ff5664d50 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.308398 Jul 25 16:22:34.152676 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1727/3375] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:33 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:22:34.164332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:34.166907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:34.186994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:34.187733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:34.188745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:34.189556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:34.320629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:34.331526 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2425d003-b10d-40a3-bcc4-217e9c43da88 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1272 microversion: 2.1 time: 0.288898 Jul 25 16:22:34.335480 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1649/3376] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:34 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:34.515975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:34.525914 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-816103b0-c2ca-4906-8922-be0f662f2bbf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1276 microversion: 2.1 time: 0.371280 Jul 25 16:22:34.551878 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1728/3377] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:34 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1276 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:35.055703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:35.056531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:35.082400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:35.083175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:35.087864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:35.088677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:35.177631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:35.179019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:35.194365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:35.195525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:35.201685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:35.202621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:35.876509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:35.897161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:35.899714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:35.903459 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a1af2716-fab3-47df-92c1-e8be7b8adaa3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.729968 Jul 25 16:22:35.904459 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1729/3378] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:35 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:22:35.927598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:35.928247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:35.937040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:35.937546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:35.938329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:35.938767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:36.192820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:36.208623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2d799e7-1d9c-47a7-ad0c-a8e38cb6ea68 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1278 microversion: 2.1 time: 0.302788 Jul 25 16:22:36.213761 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1730/3379] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:35 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1278 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:36.230285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:36.231321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:36.256889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:36.257391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:36.260346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:36.261002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:36.265588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:36.286332 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ecf726f6-b237-44f1-9d70-be29140f1446 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 1.234715 Jul 25 16:22:36.293275 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1650/3380] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:35 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:36.915914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:36.925527 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-668cc6e8-5351-4a18-8bac-e57d81b25aa6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1318 microversion: 2.1 time: 0.708924 Jul 25 16:22:36.935010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1731/3381] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:36 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:36.935686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:36.936358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:36.943343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:36.944094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:36.945158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:36.945794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:37.054318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:37.074758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:37.076433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:37.086812 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94761bc5-f07b-4114-967f-b4acda06e5f3 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.155933 Jul 25 16:22:37.091454 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1651/3382] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:36 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:22:37.246796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:37.252997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:37.278400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:37.279155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:37.280862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:37.281862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:37.311149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:37.312171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:37.353060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:37.364594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:37.375614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:37.376839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:37.591024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:37.608231 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f4648a5-d7b6-48fe-8698-88b33ef92cec tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1278 microversion: 2.1 time: 0.372719 Jul 25 16:22:37.625999 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1732/3383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:37 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1278 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:37.977003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:37.985744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:38.020941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:38.028303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:38.030512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:38.038299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:39.443595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:39.460265 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c52f5664-2e60-464f-a8a9-d01cb60067ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 2.155788 Jul 25 16:22:39.468098 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1652/3384] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:37 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:39.492778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:39.497571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:39.523091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:39.525820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:39.538197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:39.541702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:39.569530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:39.581147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92ae055f-1722-4c64-907b-e55c24f3a01f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1318 microversion: 2.1 time: 1.626218 Jul 25 16:22:39.581838 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1733/3385] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:37 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1318 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:39.600016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-bb3d7a35-ab68-4b5d-8902-faefe811d044 req-a97e332e-4d33-41a1-bd7d-c1bf0ca070ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa3abea-d747-4c7a-a439-831f1775cda3", "tag": "7c7c3e73-089a-4eca-b9b7-3b7bcc209e04"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:39.612179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bb3d7a35-ab68-4b5d-8902-faefe811d044 req-a97e332e-4d33-41a1-bd7d-c1bf0ca070ab service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:39.612901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bb3d7a35-ab68-4b5d-8902-faefe811d044 req-a97e332e-4d33-41a1-bd7d-c1bf0ca070ab service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:39.626487 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-bb3d7a35-ab68-4b5d-8902-faefe811d044 req-a97e332e-4d33-41a1-bd7d-c1bf0ca070ab service nova] Creating event network-changed:7c7c3e73-089a-4eca-b9b7-3b7bcc209e04 for instance dfa3abea-d747-4c7a-a439-831f1775cda3 on n-h2-846219-13 Jul 25 16:22:39.633704 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-bb3d7a35-ab68-4b5d-8902-faefe811d044 req-a97e332e-4d33-41a1-bd7d-c1bf0ca070ab service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037431 Jul 25 16:22:39.634649 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1734/3386] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:39.641322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:39.642487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:39.650128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:39.651024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:39.652193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:39.652846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:39.956331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:39.966169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:39.974955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:39.977004 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25bd35e3-05fa-4656-aa95-4b5426663a62 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.506449 Jul 25 16:22:39.978162 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1653/3387] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:39 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:39.986070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-174459da-606a-4a29-9d7c-29de62f3c8e4 req-4d1022b4-635a-4bd0-a862-dbbcd312296e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a03699d-344b-418e-b91f-4b56f275b9cf", "name": "network-vif-plugged", "status": "completed", "tag": "c6b22d2b-fcd4-4eb1-9395-9e5f23656c74"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:40.022573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-174459da-606a-4a29-9d7c-29de62f3c8e4 req-4d1022b4-635a-4bd0-a862-dbbcd312296e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:40.023348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-174459da-606a-4a29-9d7c-29de62f3c8e4 req-4d1022b4-635a-4bd0-a862-dbbcd312296e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:40.063093 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-174459da-606a-4a29-9d7c-29de62f3c8e4 req-4d1022b4-635a-4bd0-a862-dbbcd312296e service nova] Creating event network-vif-plugged:c6b22d2b-fcd4-4eb1-9395-9e5f23656c74 for instance 2a03699d-344b-418e-b91f-4b56f275b9cf on n-h2-846219-13 Jul 25 16:22:40.071621 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-174459da-606a-4a29-9d7c-29de62f3c8e4 req-4d1022b4-635a-4bd0-a862-dbbcd312296e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090972 Jul 25 16:22:40.073386 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1654/3388] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:40.132775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:40.144845 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8d00586-086d-409c-8526-c3d35904b091 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.507377 Jul 25 16:22:40.145875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1735/3389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:39 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:40.250462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d9e642c-60b5-478f-a824-5c369b378dfe tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9d93c60790>, body: {"keypair": {"name": "tempest-keypair-687238943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJMdku/L1wlwQPFLpjT/AXUXr2NaoGoryUKTJOLx3G3Tx8m4emOg0V2g6rXFYwPjYkXUv9xvxBX/XH5ZD23pFetxj7QK+Uz+2qVEBHEOvBVlQ0y15Nbi/1/v8cYeLomfg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:40.270965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9d9e642c-60b5-478f-a824-5c369b378dfe tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:40.277929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9d9e642c-60b5-478f-a824-5c369b378dfe tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:40.309308 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d9e642c-60b5-478f-a824-5c369b378dfe tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.234262 Jul 25 16:22:40.310539 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1655/3390] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:22:40.324216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85f939f8-0eac-44fe-9f70-228f50f8f51c tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9da4a1fdc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:40.341286 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85f939f8-0eac-44fe-9f70-228f50f8f51c tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs/tempest-keypair-687238943" status: 200 len: 512 microversion: 2.2 time: 0.023825 Jul 25 16:22:40.343542 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1736/3391] 10.222.0.105 () {60 vars in 1260 bytes} [Mon Jul 25 16:22:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-687238943 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:40.363921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-868aa6e2-7547-4698-a572-856d9f2f2fd7 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d93a0c4c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:40.404169 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-868aa6e2-7547-4698-a572-856d9f2f2fd7 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687238943" status: 204 len: 0 microversion: 2.2 time: 0.050558 Jul 25 16:22:40.405418 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1656/3392] 10.222.0.105 () {60 vars in 1263 bytes} [Mon Jul 25 16:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687238943 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:40.428074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ea5614c-2728-4ed9-982a-c0938918d1ea tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9d929f6700>, body: {"keypair": {"name": "tempest-keypair-1433984182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3C7vNXt3ok3/tXEsyi3w6f0w93WCWfqTSwgiidNUnIzmdmW01U0ZGnoieipP+nL/69BSeizsxGUjpvVdpLtXphIEgE2jGfSbgMutJt/R8rXUbHS6qXCerWjauPt9rqHA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:40.448133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5ea5614c-2728-4ed9-982a-c0938918d1ea tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:40.468132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5ea5614c-2728-4ed9-982a-c0938918d1ea tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:40.492710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:40.494384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:40.502991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:40.504125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:40.504895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:40.505334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:40.524667 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ea5614c-2728-4ed9-982a-c0938918d1ea tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.099595 Jul 25 16:22:40.527543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1737/3393] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:22:40.542618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dda2e806-5710-46ed-972d-42859da64743 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d929f6ee0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:40.588163 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dda2e806-5710-46ed-972d-42859da64743 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433984182" status: 204 len: 0 microversion: 2.2 time: 0.055055 Jul 25 16:22:40.590431 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1738/3394] 10.222.0.105 () {60 vars in 1266 bytes} [Mon Jul 25 16:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433984182 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:40.603912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3e03c8a-3aef-4b29-a2b4-1a650c5b7c4d tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9da4a1fe50>, body: {"keypair": {"name": "tempest-keypair-1511393116", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:40.624291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e3e03c8a-3aef-4b29-a2b4-1a650c5b7c4d tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:40.632511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e3e03c8a-3aef-4b29-a2b4-1a650c5b7c4d tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:40.638099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:40.684533 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e3e03c8a-3aef-4b29-a2b4-1a650c5b7c4d tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.088198 Jul 25 16:22:40.685964 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1739/3395] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:40 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 25 16:22:40.698378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:40.700138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:40.716260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:40.718169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:40.724395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:40.725390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:40.796324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:40.805975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d95695ee-c864-424f-acdd-d7638990ae07 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 0.317544 Jul 25 16:22:40.810874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1657/3396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:40 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:40.816540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f0e8e364-f54e-4868-9b6b-d0741a26b722 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d93aa8dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:40.851458 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f0e8e364-f54e-4868-9b6b-d0741a26b722 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511393116" status: 204 len: 0 microversion: 2.2 time: 0.038611 Jul 25 16:22:40.860925 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1658/3397] 10.222.0.105 () {60 vars in 1266 bytes} [Mon Jul 25 16:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511393116 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:40.870661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-70d65e75-6445-45fb-ad6c-7dc4d1047703 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9da0278f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-602847673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOngEAzSdYqsmRsqv9X3xEywn8sfiqRrt/1zuEYlQ7PW3UfTsF+Ot25Go0ToggxZ2Jd6Lwesld8Xu1/hyFjh61KVzscBXxvwZrS/ASzDcI4A1ZXrQkzh7wd9zzDYPxZaWA=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:40.906926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-70d65e75-6445-45fb-ad6c-7dc4d1047703 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:40.914695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-70d65e75-6445-45fb-ad6c-7dc4d1047703 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:40.947860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-70d65e75-6445-45fb-ad6c-7dc4d1047703 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.085566 Jul 25 16:22:40.957880 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1659/3398] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:22:40.972672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4b52583-83a6-4a5c-b86d-4b3426979396 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9da0031940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2113886381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBljzWkAei7BJ1FPvl0OLoCK9E2Cb25wgUt+hWrhXQzjktplc3vZ0EhlccN74PRzC+yr6iKlnIcnWYqpLewo8KYQNDVYk76IFatNYRk9CdeBtbOyM1lgLCBFqTiVacbEQ=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:40.980720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:41.023025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f4b52583-83a6-4a5c-b86d-4b3426979396 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:41.033064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f4b52583-83a6-4a5c-b86d-4b3426979396 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:41.069457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:41.152964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:41.153633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4b52583-83a6-4a5c-b86d-4b3426979396 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.195114 Jul 25 16:22:41.154269 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1660/3399] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:40 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:22:41.170133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-452b3bb8-4b96-4e51-bccd-bc2601550864 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1318 microversion: 2.1 time: 0.482690 Jul 25 16:22:41.170736 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1740/3400] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:40 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:41.170964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.182309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:41.190982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.192790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:41.200212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:41.200975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:41.202865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:41.204088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:41.209841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:41.210280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:41.211061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:41.211516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:41.426780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:41.439946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:41.443252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:41.445037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-afc1ebfd-a01d-4356-aa33-77ed5f10d688 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.289623 Jul 25 16:22:41.459577 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1661/3401] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:41 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:41.474499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3122f1b-270a-442b-b51a-3f72ada54b5e tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9d93aa8dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1029434759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5nBb6br2+NmFCd6y11OuHh2RcrAMUbc3IYPTTgY6FZWTm4lhif0s4PXvTG2snXkdnCOuqhVkfKnee4ZEQy0AkXXMnzNBg6z2UcVYUhIkRBUPZPuRqdC1mh9gn9c47HRg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:41.513908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f3122f1b-270a-442b-b51a-3f72ada54b5e tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:41.525331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f3122f1b-270a-442b-b51a-3f72ada54b5e tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:41.575993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3122f1b-270a-442b-b51a-3f72ada54b5e tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.114014 Jul 25 16:22:41.581205 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1662/3402] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:22:41.591055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d9ab4f1-ab02-4c70-8ffd-7cb95948b498 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d93a8a8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.595726 n-d-846219-13 devstack@n-api.service[119598]: WARNING oslo_db.sqlalchemy.utils [None req-6d9ab4f1-ab02-4c70-8ffd-7cb95948b498 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 16:22:41.602800 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d9ab4f1-ab02-4c70-8ffd-7cb95948b498 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.016648 Jul 25 16:22:41.603667 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1663/3403] 10.222.0.105 () {60 vars in 1182 bytes} [Mon Jul 25 16:22:41 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:41.616706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10d7c9f6-d6a0-4e17-8301-a36db0add7be tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9da0032040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.643704 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10d7c9f6-d6a0-4e17-8301-a36db0add7be tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1029434759" status: 204 len: 0 microversion: 2.2 time: 0.031648 Jul 25 16:22:41.644672 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1664/3404] 10.222.0.105 () {60 vars in 1326 bytes} [Mon Jul 25 16:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1029434759 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:41.654335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-701faa17-8719-47c6-9fe5-0875e6dd3803 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d93bde550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.675925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:41.683962 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-701faa17-8719-47c6-9fe5-0875e6dd3803 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2113886381" status: 204 len: 0 microversion: 2.2 time: 0.035127 Jul 25 16:22:41.685573 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1665/3405] 10.222.0.105 () {60 vars in 1326 bytes} [Mon Jul 25 16:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2113886381 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:22:41.694486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a76ab30c-ba77-4c5a-bf01-feda0574d443 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9da0032f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.695538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-553078f1-ab95-4b56-9f1e-23d79d523830 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.523332 Jul 25 16:22:41.696166 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1741/3406] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:41 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:41.755424 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a76ab30c-ba77-4c5a-bf01-feda0574d443 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-602847673" status: 204 len: 0 microversion: 2.2 time: 0.065498 Jul 25 16:22:41.757227 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1666/3407] 10.222.0.105 () {60 vars in 1323 bytes} [Mon Jul 25 16:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-602847673 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:22:41.769531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a057593a-628a-4f2b-82e0-05c6e6730cfd tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9d92a501f0>, body: {"keypair": {"name": "tempest-keypair-1164022213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeb1jNzvPF7yE2EgVPm9hGWlSlpjAEvOdpZHIO8LbFgUMt6GFMSWR7JUa3Bs6PEWgmMgYd9eKBiKdOM+iSfPTRkuaiLb4bE8dvP0WLP00GI0xB2imKdEJPjnurqjtRViQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:41.791709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a057593a-628a-4f2b-82e0-05c6e6730cfd tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:41.798128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a057593a-628a-4f2b-82e0-05c6e6730cfd tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:41.834708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.835672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:41.836043 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a057593a-628a-4f2b-82e0-05c6e6730cfd tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.071098 Jul 25 16:22:41.837060 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1742/3408] 10.222.0.105 () {62 vars in 1204 bytes} [Mon Jul 25 16:22:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 16:22:41.848889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eca66fc8-4fed-4a3f-83b6-3f8b87e6f815 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d9288b790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.852960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:41.854433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:41.857292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:41.857744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:41.861793 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eca66fc8-4fed-4a3f-83b6-3f8b87e6f815 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs/tempest-keypair-1164022213" status: 200 len: 513 microversion: 2.2 time: 0.017921 Jul 25 16:22:41.863048 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1743/3409] 10.222.0.105 () {60 vars in 1263 bytes} [Mon Jul 25 16:22:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1164022213 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:41.914212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f502ea2b-3b38-402f-85ae-90a800967cdb tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d9289a1f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.920425 n-d-846219-13 devstack@n-api.service[119599]: WARNING oslo_db.sqlalchemy.utils [None req-f502ea2b-3b38-402f-85ae-90a800967cdb tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 16:22:41.929351 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f502ea2b-3b38-402f-85ae-90a800967cdb tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.042347 Jul 25 16:22:41.943521 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1744/3410] 10.222.0.105 () {60 vars in 1182 bytes} [Mon Jul 25 16:22:41 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:41.953220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-16e61169-8a86-4a58-b5bc-f12f82cee852 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d9289ac10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:41.987535 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-16e61169-8a86-4a58-b5bc-f12f82cee852 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164022213" status: 204 len: 0 microversion: 2.2 time: 0.042418 Jul 25 16:22:41.989605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:41.994915 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1745/3411] 10.222.0.105 () {60 vars in 1266 bytes} [Mon Jul 25 16:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164022213 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:42.001207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Action: 'create', calling method: .version_select at 0x7f9d92a33430>, body: {"keypair": {"name": "tempest-keypair-493876887", "type": "x509"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:42.022234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:42.035564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:42.119932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.processutils [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp7quy5ohs/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7quy5ohs/temp.key -subj /CN=60604765c17c4d1bb9ecfcd883086826 -extensions v3_req_client {{(pid=119599) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 16:22:42.276898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:42.304762 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b8bf9bea-3aa5-485e-91e5-45cb91767948 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1311 microversion: 2.1 time: 0.475485 Jul 25 16:22:42.324049 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1667/3412] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:41 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1311 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:42.341831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7bac9dcd-7285-48a8-aecb-8b8706a5d3bf req-0daea2e3-71d3-4229-8bf0-adf4b4685466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:42.377454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7bac9dcd-7285-48a8-aecb-8b8706a5d3bf req-0daea2e3-71d3-4229-8bf0-adf4b4685466 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:42.378292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7bac9dcd-7285-48a8-aecb-8b8706a5d3bf req-0daea2e3-71d3-4229-8bf0-adf4b4685466 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:42.415064 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7bac9dcd-7285-48a8-aecb-8b8706a5d3bf req-0daea2e3-71d3-4229-8bf0-adf4b4685466 service nova] Creating event network-changed:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:22:42.437657 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7bac9dcd-7285-48a8-aecb-8b8706a5d3bf req-0daea2e3-71d3-4229-8bf0-adf4b4685466 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106645 Jul 25 16:22:42.439824 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1668/3413] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:42.455524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:42.457541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:42.471496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:42.471953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:42.472730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:42.473190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:42.489349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:42.759724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.processutils [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp7quy5ohs/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp7quy5ohs/temp.key -subj /CN=60604765c17c4d1bb9ecfcd883086826 -extensions v3_req_client" returned: 0 in 0.641s {{(pid=119599) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 16:22:42.762007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.processutils [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp7quy5ohs/temp.key -password pass: {{(pid=119599) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 16:22:42.860822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.processutils [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp7quy5ohs/temp.key -password pass:" returned: 0 in 0.094s {{(pid=119599) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 16:22:42.937188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:42.951312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:42.957070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Getting quotas for user 60604765c17c4d1bb9ecfcd883086826 and project d196eae799e646b89a73c59060c5fa63. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:42.963584 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fad861e-f690-42ff-8f37-188b8637ba7f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1318 microversion: 2.1 time: 0.521195 Jul 25 16:22:42.980341 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1669/3414] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:42 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:42.992352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:42.992987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:43.008670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.009144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.009933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.010363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.016065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-62257688-d4bf-4268-80ef-bbf8bf356bf4 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.019236 Jul 25 16:22:43.026432 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1746/3415] 10.222.0.105 () {62 vars in 1203 bytes} [Mon Jul 25 16:22:41 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1031 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:43.051149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:43.061955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:43.071295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.071756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.073439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.081553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.146183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:43.179136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:43.192799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:43.194510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:43.198936 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b1b20bb-ea26-4510-a950-ffcd1e08b5ac tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.217449 Jul 25 16:22:43.199722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1670/3416] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:42 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:43.209696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-124b3cb9-076c-49e3-a506-7cc32d75f134 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9da0032dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:43.235552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-124b3cb9-076c-49e3-a506-7cc32d75f134 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs/tempest-keypair-493876887" status: 200 len: 1533 microversion: 2.2 time: 0.034489 Jul 25 16:22:43.257268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1671/3417] 10.222.0.105 () {60 vars in 1260 bytes} [Mon Jul 25 16:22:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-493876887 => generated 1533 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:43.266039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7bcd084b-131d-4121-8f6c-06682a3e690f tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d93e4ce50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:43.281505 n-d-846219-13 devstack@n-api.service[119598]: WARNING oslo_db.sqlalchemy.utils [None req-7bcd084b-131d-4121-8f6c-06682a3e690f tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 16:22:43.302705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7bcd084b-131d-4121-8f6c-06682a3e690f tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.042363 Jul 25 16:22:43.309738 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1672/3418] 10.222.0.105 () {60 vars in 1182 bytes} [Mon Jul 25 16:22:43 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:43.326817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-417cb818-32e1-417d-a939-03dd51c72ce2 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] Calling method '.version_select at 0x7f9d93a0c4c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:43.388456 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-417cb818-32e1-417d-a939-03dd51c72ce2 tempest-KeyPairsV22TestJSON-1819097453 tempest-KeyPairsV22TestJSON-1819097453-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-493876887" status: 204 len: 0 microversion: 2.2 time: 0.076580 Jul 25 16:22:43.390657 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1673/3419] 10.222.0.105 () {60 vars in 1263 bytes} [Mon Jul 25 16:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-493876887 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:22:43.420770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:43.421482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:43.440231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.441977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.443958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.446490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.650668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:43.667510 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c372b8f-0c6f-430b-a617-7af4ec99dec6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.637943 Jul 25 16:22:43.668133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1747/3420] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:43 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:43.904756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:43.914202 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71cbc69c-62fe-4706-9c48-28cb461e632f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1491 microversion: 2.1 time: 0.513447 Jul 25 16:22:43.915113 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1674/3421] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:43 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1491 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:43.938566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e8334ca-8e83-4356-8c1c-4ab05bba9278 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:43.947968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e8334ca-8e83-4356-8c1c-4ab05bba9278 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.948907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e8334ca-8e83-4356-8c1c-4ab05bba9278 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.978082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e8334ca-8e83-4356-8c1c-4ab05bba9278 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:22:43.987202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:43.989197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:43.997197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.997650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:43.998422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:43.998894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.088307 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e8334ca-8e83-4356-8c1c-4ab05bba9278 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf/action" status: 202 len: 0 microversion: 2.1 time: 0.153398 Jul 25 16:22:44.091821 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1748/3422] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:43 2022] POST /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:22:44.106216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:44.110356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:44.119892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.120777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.121924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.122413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.399011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:44.420493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:44.422366 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e28372c8-7f58-4ab0-8f01-c7dd41b7eba5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1318 microversion: 2.1 time: 0.438110 Jul 25 16:22:44.423471 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1675/3423] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:43 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:44.435742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:44.440573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:44.452842 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c076b7ba-7dd9-49fe-8b62-bc19e804a723 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.359413 Jul 25 16:22:44.453526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1749/3424] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:44 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:44.467847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.468911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.470076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.470734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.623386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-062eb6e2-f51e-4453-b207-d9c51376afb6 req-dfef23bc-df8b-45fb-889f-845df38bf759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa3abea-d747-4c7a-a439-831f1775cda3", "name": "network-vif-plugged", "status": "completed", "tag": "7c7c3e73-089a-4eca-b9b7-3b7bcc209e04"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:44.645899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:44.649562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-062eb6e2-f51e-4453-b207-d9c51376afb6 req-dfef23bc-df8b-45fb-889f-845df38bf759 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.651652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-062eb6e2-f51e-4453-b207-d9c51376afb6 req-dfef23bc-df8b-45fb-889f-845df38bf759 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.656723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:44.661246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:44.662807 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4d51ec39-dfa6-4d8e-afcb-28bebcc48573 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.238181 Jul 25 16:22:44.666243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1676/3425] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:44 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:44.692068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:44.692670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:44.693937 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-062eb6e2-f51e-4453-b207-d9c51376afb6 req-dfef23bc-df8b-45fb-889f-845df38bf759 service nova] Creating event network-vif-plugged:7c7c3e73-089a-4eca-b9b7-3b7bcc209e04 for instance dfa3abea-d747-4c7a-a439-831f1775cda3 on n-h2-846219-13 Jul 25 16:22:44.704350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.707476 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-062eb6e2-f51e-4453-b207-d9c51376afb6 req-dfef23bc-df8b-45fb-889f-845df38bf759 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089736 Jul 25 16:22:44.708122 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1750/3426] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:22:44.712553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.714508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:44.715075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:44.979555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:44.997078 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7bdbf0a-e637-445e-9093-605952191fa2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.307566 Jul 25 16:22:44.998099 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1677/3427] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:44 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:45.450321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:45.450938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:45.463074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:45.465006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:45.466226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:45.467004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:45.485660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:45.486750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:45.500031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:45.512096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:45.513332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:45.513975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:46.609843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:46.619238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b0f008f-d9e2-47b4-a75b-67d1e0938e65 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1318 microversion: 2.1 time: 1.174461 Jul 25 16:22:46.625561 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1751/3428] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:45 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1318 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:46.635050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:46.649428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:46.667295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:46.670417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:46.671264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:46.671712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:46.797028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:46.807968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:46.821498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:46.823369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:46.824914 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c32a69ef-5cd5-4114-a458-ec6eef28ef59 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.193856 Jul 25 16:22:46.826266 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f28c1d76-5a3e-46ea-afe8-b71787c867b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 1.354167 Jul 25 16:22:46.827014 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1678/3429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:45 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:46.837947 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1752/3430] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:46 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:46.844214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:46.844923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:46.865610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:46.866081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:46.869265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:46.869720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.315959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:47.325615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74ba1cfa-7e67-4006-aebd-a3bc726fcb83 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.493586 Jul 25 16:22:47.338541 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1679/3431] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:46 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:47.645181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:47.646700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:47.657776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:47.658181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.659316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:47.659972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.852538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:47.853189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:47.860903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:47.861381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.862236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:47.862686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.952570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:47.961368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8740b334-b857-40a6-b505-1c449b36196d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1506 microversion: 2.1 time: 0.320156 Jul 25 16:22:47.961978 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1753/3432] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:47 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:47.967261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:47.968361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:47.978687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:47.981216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:47.982899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.984823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:47.985549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:47.989727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:47.991484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:47.992916 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f799c204-3902-4eae-931d-24578d197c60 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.147105 Jul 25 16:22:47.993523 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1680/3433] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:47 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:47.998391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:48.001026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:48.026555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:48.030460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:48.031568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:48.032212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:48.114340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99181e8f-58bb-4e3b-a545-e7da05bbcadf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.119273 Jul 25 16:22:48.116318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1681/3434] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:47 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:48.358869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:48.363546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:48.386247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:48.388286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:48.390866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:48.393388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:48.885917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:48.897843 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fcf4f82f-ec58-4ac1-ac90-0c15cb6eaca0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.547711 Jul 25 16:22:48.898443 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1682/3435] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:48 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:48.908559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8ac7a157-af22-48b5-9149-be2148dfca69 req-e5cb13b9-9eca-4473-ba25-56df57cca6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "name": "network-vif-plugged", "status": "completed", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:48.958278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8ac7a157-af22-48b5-9149-be2148dfca69 req-e5cb13b9-9eca-4473-ba25-56df57cca6d0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:48.958778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8ac7a157-af22-48b5-9149-be2148dfca69 req-e5cb13b9-9eca-4473-ba25-56df57cca6d0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:48.986765 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8ac7a157-af22-48b5-9149-be2148dfca69 req-e5cb13b9-9eca-4473-ba25-56df57cca6d0 service nova] Creating event network-vif-plugged:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:22:48.993771 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8ac7a157-af22-48b5-9149-be2148dfca69 req-e5cb13b9-9eca-4473-ba25-56df57cca6d0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092413 Jul 25 16:22:48.995194 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1683/3436] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:49.019148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:49.025210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:49.044520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:49.045793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:49.049718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:49.050452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:49.159104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:49.172307 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-76fbbc21-856f-4421-9d49-1708010f3262 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 1.206747 Jul 25 16:22:49.174953 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1754/3437] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:47 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:49.186722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:49.189122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:49.222734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:49.223202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:49.223996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:49.224438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:49.326940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0de76897-d67e-4588-903b-0867418793d9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.144024 Jul 25 16:22:49.328850 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1755/3438] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:49 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:49.361459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:49.379398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:49.389558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:49.399196 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e9cfe99d-2a01-47e5-8bd1-d242e94acbea tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.384816 Jul 25 16:22:49.400840 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1684/3439] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:49 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:49.941548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:49.944175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:49.960525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:49.967594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:49.969223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:49.970198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.197431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:50.198888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:50.215654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:50.219897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.221109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:50.222772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.365658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:50.382898 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ded5230-30e5-4af0-b08a-384be5d03681 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1320 microversion: 2.1 time: 0.464062 Jul 25 16:22:50.383514 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1756/3440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:49 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:50.400456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:50.409112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:50.451265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:50.453043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.457294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:50.460933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.534237 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0293d89-6097-4ec6-8a43-5658f0f53c8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.148989 Jul 25 16:22:50.535739 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1757/3441] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:50 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:50.542516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:50.543232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:50.567500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:50.569255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.570572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:50.571287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:50.807121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:50.821395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74401322-108d-4744-a464-42bba9f7f9ce tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.628356 Jul 25 16:22:50.833130 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1685/3442] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:50 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:50.870921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:50.882392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:50.884627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:50.886767 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-752c4354-df82-4c15-b84b-52e587208091 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.349880 Jul 25 16:22:50.887671 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1758/3443] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:50 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:51.404448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:51.405273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:51.419007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:51.420906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:51.422453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:51.425913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:51.543086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=24 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:51.546374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:51.548629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:51.568407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:51.568990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:51.569964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:51.570818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:51.650100 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-679a811d-92d8-435c-b7ce-965cae7e608c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.107250 Jul 25 16:22:51.654110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1759/3444] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:51 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:51.847995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:51.848995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:51.872604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:51.873801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:51.876667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:51.878968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.107436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:52.123932 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f90d589f-edc8-4123-a46b-55c7039362a2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1469 microversion: 2.1 time: 0.720472 Jul 25 16:22:52.125391 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1686/3445] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:51 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1469 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:52.135508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:52.136143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:52.154402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:52.154928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.155785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:52.156496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.341920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:52.350615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:52.360559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:52.367833 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-908b0796-8c64-4405-9453-1277e8b42c1d tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.241292 Jul 25 16:22:52.382029 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1687/3446] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:52 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:52.382029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1505999219", "metadata": {"image_type": "test"}}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:52.382029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:52.396509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:52.396965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.397799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:52.398234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.458702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Getting quotas for project a1eb0d89d327413882079e42507cc344. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:22:52.464649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Getting quotas for user 42600aeea8e04827be40f6ac81b4c40d and project a1eb0d89d327413882079e42507cc344. Resources: dict_keys(['metadata_items']) {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:22:52.656955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:52.689544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd12dcf6-0e40-41f6-8427-a2a05b710c5e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.838008 Jul 25 16:22:52.691515 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1760/3447] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:51 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:52.708608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:52.712187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:52.726861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:52.727311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.733387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:52.735891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:52.736583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:52.817331 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50d05621-5ffc-4ce5-8155-0318e9aa8f5d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.120643 Jul 25 16:22:52.818481 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1761/3448] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:52 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:52.891647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-63bf9fad-a4c0-40c5-9469-c3a0572ffe0a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "POST /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0/action" status: 202 len: 0 microversion: 2.1 time: 0.519978 Jul 25 16:22:52.892346 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1688/3449] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:52 2022] POST /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:22:52.904011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c4b8b9e3-3cc0-4a62-8d4a-ac8a3764e55b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92ea2af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:52.983396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=32 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:53.027121 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c4b8b9e3-3cc0-4a62-8d4a-ac8a3764e55b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.127532 Jul 25 16:22:53.034517 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1762/3450] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:52 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:53.394103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:53.394808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:53.402358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:53.402857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:53.403682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:53.404376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:53.585674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:53.603000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:53.604730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:53.605989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2accf3e6-bfa6-4e57-b072-e9192510973b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1369 microversion: 2.47 time: 0.216583 Jul 25 16:22:53.607121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1689/3451] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:53 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:53.717062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:53.718111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:53.738257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:53.739885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:53.769688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:53.769688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:53.831279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:53.833803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:53.852970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:53.853466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:53.854271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:53.854837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:53.954841 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-caeb83a1-ceb8-4b70-8318-b506c1b11f8b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.127653 Jul 25 16:22:53.955275 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1690/3452] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:53 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:54.043036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21fd6b5f-bb88-4e3d-a511-fe1456eac45b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93aa8940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:54.115455 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21fd6b5f-bb88-4e3d-a511-fe1456eac45b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.076667 Jul 25 16:22:54.119370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1691/3453] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:54 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:22:54.243796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:54.280719 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f8cb59c-6acd-43d9-8d79-dcec423c323d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.571921 Jul 25 16:22:54.285815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1763/3454] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:53 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:54.633207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:54.635178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:54.657644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:54.658091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:54.659843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:54.661743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:54.842820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:54.854960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:54.860530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:54.868968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-527983f9-fea9-4cf8-98fb-832266747733 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1375 microversion: 2.47 time: 0.239310 Jul 25 16:22:54.870012 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1692/3455] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:54 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:54.967917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:54.974068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:55.002192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:55.005231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:55.008156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:55.008927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:55.126101 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f4acdb9-0772-4051-8497-3149945669ed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.163080 Jul 25 16:22:55.131938 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1764/3456] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:54 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:55.140011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1670926d-853d-4d4e-a55c-c8758933dfd6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93a46ee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:55.272869 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1670926d-853d-4d4e-a55c-c8758933dfd6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.138188 Jul 25 16:22:55.274282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1693/3457] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:55 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:55.323714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:55.324456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:55.338032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:55.341528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:55.343649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:55.346348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:55.727999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:55.743958 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6dda5cf6-ca22-45b4-a341-384e6c6f39a0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.433354 Jul 25 16:22:55.758181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1765/3458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:55 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:55.896707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:55.898099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:55.927267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:55.929877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:55.931606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:55.937433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:56.083616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:56.098489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:56.100418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:56.104237 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-efca1867-64e1-4006-a842-0c605387e9c4 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1375 microversion: 2.47 time: 0.212236 Jul 25 16:22:56.106778 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1694/3459] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:55 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:56.141142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:56.143505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:56.156269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:56.156732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:56.157670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:56.158037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:56.197548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:56.230767 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d95093d5-f5d7-4c5f-99e9-0274dfd39eed tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.093844 Jul 25 16:22:56.232024 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1766/3460] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:56 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:56.288262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11a267b5-11c9-44c9-bcd8-25bce9b0d1e9 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93cffaf0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:56.772372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:56.774428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:56.797733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:56.804050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:56.807143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:56.810327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:57.233910 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11a267b5-11c9-44c9-bcd8-25bce9b0d1e9 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.949780 Jul 25 16:22:57.234577 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1695/3461] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:56 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:57.267496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:57.268175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:57.280996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:57.297416 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65827ada-a648-43ca-bf2b-4c256362a004 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.530804 Jul 25 16:22:57.310167 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1767/3462] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:56 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:57.322000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:57.324607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:57.328817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:57.329530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:57.330363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:57.340678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:57.372995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:57.375634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:57.377315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:57.377946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:57.508571 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff2839f7-c30a-4a92-90aa-287d3a6ce62a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.196230 Jul 25 16:22:57.516440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1768/3463] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:57 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:57.526566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:57.546566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:57.555174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:57.561304 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84199e93-6c43-4a4b-923a-588d73bb0f80 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1375 microversion: 2.47 time: 0.325597 Jul 25 16:22:57.567803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1696/3464] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:57 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1375 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:58.251564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c4558212-6f61-480a-b9ae-3f5b6b170e23 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93536160>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:58.331731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:58.332404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:58.359177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:58.360015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:58.361765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:58.364266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:58.736333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:58.749751 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f4035f1-61d7-4f90-9761-22c8e908f3b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.422748 Jul 25 16:22:58.759584 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1697/3465] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:58 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:58.781812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:58.792068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:58.816054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:58.820037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:58.821295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:58.822142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:58.906010 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f1401a3f-7bfe-4906-a604-a6515964db5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.135685 Jul 25 16:22:58.911035 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1698/3466] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:58 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:22:58.922330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:58.930199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:58.945974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:58.948572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:58.951134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:58.954058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:58.957172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:59.146107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:59.180038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:59.184511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:22:59.190094 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21e609c7-1226-4069-bc8e-5ca87a4c6fcd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1375 microversion: 2.47 time: 0.277328 Jul 25 16:22:59.190866 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1699/3467] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:22:58 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1375 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:59.219735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-88e8b9fc-5778-4335-abbd-b6c2613a8c3f req-29331ba6-d51e-45e4-bed8-de83223ecb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "name": "network-vif-plugged", "status": "completed", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:59.248282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-88e8b9fc-5778-4335-abbd-b6c2613a8c3f req-29331ba6-d51e-45e4-bed8-de83223ecb28 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:59.249946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-88e8b9fc-5778-4335-abbd-b6c2613a8c3f req-29331ba6-d51e-45e4-bed8-de83223ecb28 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:59.288658 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-88e8b9fc-5778-4335-abbd-b6c2613a8c3f req-29331ba6-d51e-45e4-bed8-de83223ecb28 service nova] Creating event network-vif-plugged:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:22:59.314729 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-88e8b9fc-5778-4335-abbd-b6c2613a8c3f req-29331ba6-d51e-45e4-bed8-de83223ecb28 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114945 Jul 25 16:22:59.316056 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1700/3468] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:59.787029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:59.787758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:59.815210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:59.815669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:59.816468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:59.817814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:59.834109 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c4558212-6f61-480a-b9ae-3f5b6b170e23 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 1.587983 Jul 25 16:22:59.835683 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1769/3469] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:22:58 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:59.918904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:22:59.921460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:22:59.945383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:59.945794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:59.946586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:59.965398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:00.082949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94687a44-466d-4e2d-b6e3-c7f4236aef3a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 14 microversion: 2.1 time: 0.168696 Jul 25 16:23:00.084233 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1770/3470] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:22:59 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:23:00.269278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.279450 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61e6340d-2dc4-4e86-bac2-da6f0702511f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.499932 Jul 25 16:23:00.280549 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1701/3471] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:22:59 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:00.286167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:00.287122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:00.294382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:00.295514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:00.296559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:00.297645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:00.423446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.438784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.442971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.444697 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-66cb36d4-fab8-4fe3-b675-dfe1867d98aa tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1360 microversion: 2.47 time: 0.162946 Jul 25 16:23:00.447288 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1702/3472] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:00 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:00.491590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:00.501326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.504201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Searching by: {'deleted': False, 'project_id': '8703005fab754aaf8560d8fdce4ee817'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:23:00.520217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:00.522638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:00.524096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:00.526413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:00.611559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1128091169", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:00.676753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:23:00.768893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] validate_networks() for [('6f3268ad-89cd-4c4f-a295-6ceccc7d2161', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:23:00.781374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.795947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:00.807097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:00.848761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.854594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:00.932528 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9af9017f-c6bd-407f-9a62-dae6b67136cb tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 2712 microversion: 2.47 time: 0.447480 Jul 25 16:23:00.933635 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1703/3473] 10.222.0.105 () {60 vars in 1192 bytes} [Mon Jul 25 16:23:00 2022] GET /compute/v2.1/servers/detail => generated 2712 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:00.938807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d11da8b-597e-4120-a689-294f97858cb5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da4a92ee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:01.110410 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d11da8b-597e-4120-a689-294f97858cb5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.175203 Jul 25 16:23:01.111133 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1704/3474] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:00 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:01.150029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:01.151030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:01.168265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:01.185547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:01.191601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:01.192994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:01.278639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:23:01.471398 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cb417edf-59fc-45ff-ba32-b9156a790de6 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 204 len: 0 microversion: 2.47 time: 0.346035 Jul 25 16:23:01.471398 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1705/3475] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:23:01 2022] DELETE /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:23:01.483695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:01.491066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:01.504576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:01.505042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:01.510189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:01.510189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:01.617134 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d0a55b73-55ed-4a52-a60e-d3e7a87756ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action" status: 200 len: 8208 microversion: 2.1 time: 0.143416 Jul 25 16:23:01.632052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1706/3476] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:01 2022] POST /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3/action => generated 8208 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:01.638314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:01.639024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:01.688419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:01.689141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:01.695089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:01.695644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.309613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:23:02.311705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:23:02.312641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:23:02.313337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:23:02.314104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:23:02.340069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:02.341788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.343256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:02.343700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.393058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:02.427741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Getting quotas for project 33374b29ef0f499a8af07b9a4af13167. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:02.451263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Getting quotas for user 4c81d63d5b0d4c0ebfca190919d848cf and project 33374b29ef0f499a8af07b9a4af13167. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:02.489788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:23:02.492309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:23:02.545891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:02.552646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:02.560769 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-942643e1-aaed-4d90-884e-0e4e9ae60f14 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.926216 Jul 25 16:23:02.578559 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1707/3477] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:01 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:02.597543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:02.598202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:02.610411 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9886f842-3f26-4e59-8a38-0460fcf7aa91 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.524223 Jul 25 16:23:02.611475 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1771/3478] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:23:02.625169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:02.626731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.630781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:02.631602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.637028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:02.637716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:02.656380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:02.656935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.657813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:02.658281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:02.948232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:02.965935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:02.981429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:02.985366 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f86604f-f99b-4096-b61f-536e8b6bbdab tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1366 microversion: 2.47 time: 0.404901 Jul 25 16:23:02.990577 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1708/3479] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:02 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:03.015386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dacf81f0-d5b1-43b0-83d6-554aacfe1a29 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da49405e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:03.182055 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dacf81f0-d5b1-43b0-83d6-554aacfe1a29 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.187265 Jul 25 16:23:03.183315 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1709/3480] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:02 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:03.201583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa43f9f5-6fa5-4062-a741-6ca4dd2011a3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:03.203379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa43f9f5-6fa5-4062-a741-6ca4dd2011a3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:03.237250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:03.250394 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-95abd512-288e-4824-a7d0-824eabd1f28c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.633490 Jul 25 16:23:03.251002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1772/3481] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:02 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:03.278205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:03.280785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:03.302291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:03.303054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:03.304057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:03.304502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:03.322770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aa43f9f5-6fa5-4062-a741-6ca4dd2011a3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:03.350367 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa43f9f5-6fa5-4062-a741-6ca4dd2011a3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1228 microversion: 2.1 time: 0.164113 Jul 25 16:23:03.356751 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1710/3482] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:03 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1228 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:03.586849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:03.587576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:03.598345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:03.604741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:03.606330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:03.608971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:03.609916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:03.616774 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1fa070dd-a415-472c-87a2-1e233f739d71 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.342317 Jul 25 16:23:03.623911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1773/3483] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:03 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:03.642726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:03.646568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:03.654018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:03.654741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:03.656866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:03.657532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.221742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:04.231325 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-034f1be1-a73e-4f2e-b497-c7096702ef67 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.592424 Jul 25 16:23:04.249926 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1774/3484] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:03 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:04.294504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:04.295167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:04.337348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:04.352707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.353973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:04.354495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.399321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:04.426054 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-32d81812-5c8f-45af-80df-1edd5b12a62f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.831427 Jul 25 16:23:04.428764 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1711/3485] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:03 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:04.454632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1c6327b-2cf8-482e-a1be-a349476ba074 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93a8a670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:04.596135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:04.603697 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1c6327b-2cf8-482e-a1be-a349476ba074 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.169752 Jul 25 16:23:04.615959 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1712/3486] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:04 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:04.616849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:04.618392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:04.619794 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9d112d8-66c6-41dc-bfc5-c4303e1acde5 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 200 len: 1366 microversion: 2.47 time: 0.343935 Jul 25 16:23:04.626764 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1775/3487] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:04 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:04.641055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:04.641719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:04.660958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:04.661785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:04.670622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:04.673455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:04.673976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.674567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.674790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:04.675224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.675791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:04.676890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:04.811185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:04.832439 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2adabbd-c91e-4aa8-b571-9376f4855d25 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1280 microversion: 2.1 time: 0.203949 Jul 25 16:23:04.845210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1776/3488] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:04 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:05.052273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:05.068783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-316c82bf-c1a1-403b-9d7b-41d3a1a539b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.455623 Jul 25 16:23:05.071651 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1713/3489] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:04 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:05.093761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:05.094831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:05.128002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:05.128994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:05.131284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:05.132827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:05.296040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Locking {{(pid=119599) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 25 16:23:05.450783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:05.452015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:05.463191 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f36f74f-f471-4b35-8ecd-630ecbef489f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.373105 Jul 25 16:23:05.465341 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1777/3490] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:05 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:05.492625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:05.504677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:05.511693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:05.512508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:05.538191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:05.545959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:05.557232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:05.563202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:05.564469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:05.564927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.286662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:06.299790 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91c69f98-4fff-49c1-b005-88040ebf3200 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.853236 Jul 25 16:23:06.305629 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1714/3491] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:05 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:06.319009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1b95847-a243-401b-8526-5f8ca298fed5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93fdd9d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:06.356478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:06.366755 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ba0ec6e-8487-4183-9619-e6cd11e4694d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.893274 Jul 25 16:23:06.373010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1778/3492] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:05 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:06.380217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:06.385406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 4f64769f-a956-420d-843e-1bd2caccba6e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:06.421160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1b95847-a243-401b-8526-5f8ca298fed5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.113991 Jul 25 16:23:06.431291 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1715/3493] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:06 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:06.432103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.434884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.435855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.442046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.450433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:06.452165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:06.467705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.472370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.473331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.474022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.500054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] HTTP exception thrown: Instance 4f64769f-a956-420d-843e-1bd2caccba6e could not be found. Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Request method failure captured: Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e HTTP/1.1 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sMueM-_NWEDZdIyRCPbA9aV98U4AkfBpC0s5PcqSWDQUfap2EDtC_YzEVLDYz6qgemzLY4a4JxIZ5Zbwt86fRNdGaybf5Z7-1AF47t-W8QedN3zGl7PzlY1v9sOzBOpXAcKYAPjNb4T98faAjukI41y6t9dkSoS6hLsxkwupNK8jyE Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8703005fab754aaf8560d8fdce4ee817 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerShowV247Test-1189295288 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8703005fab754aaf8560d8fdce4ee817"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8703005fab754aaf8560d8fdce4ee817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8703005fab754aaf8560d8fdce4ee817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8703005fab754aaf8560d8fdce4ee817"}]}] Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerShowV247Test-1189295288 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8703005fab754aaf8560d8fdce4ee817 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerShowV247Test-1189295288 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerShowV247Test-1189295288-project Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4675039200f64e7f998e090c8e90ede3 Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerShowV247Test-1189295288-project Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4f64769f-a956-420d-843e-1bd2caccba6e could not be found. Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4f64769f-a956-420d-843e-1bd2caccba6e'} Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f64769f-a956-420d-843e-1bd2caccba6e could not be found. Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f64769f-a956-420d-843e-1bd2caccba6e could not be found. Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:06.506899 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f64769f-a956-420d-843e-1bd2caccba6e could not be found. Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Returning 404 to user: Instance 4f64769f-a956-420d-843e-1bd2caccba6e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:06.512990 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69b8a718-8423-4688-90e8-592d43e5c36b tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e" status: 404 len: 111 microversion: 2.47 time: 0.134153 Jul 25 16:23:06.519686 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1779/3494] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:06 2022] GET /compute/v2.1/servers/4f64769f-a956-420d-843e-1bd2caccba6e => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:23:06.540071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:06.549294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.549994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.590393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] HTTP exception thrown: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 is locked Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Request method failure captured: Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action HTTP/1.1 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 15 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sHrKL098P7kngsgV8LPhRU79kKW31ZdDdD0Pt25wpgPTXNNClnv_xPsRjPvG-4r5kGwQF2Q7mAH2LERbSZyJUtLDB5tDR_vBo7rkZsPVEDU9xy3HaiyXHpJzLW8AYxwAtY1IRumjGA_k1gydIXPTDba57THZur0RQAcfsBM8ccGfi0 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_72a5bf05a4f64e0d84a353f0743d8bf0"}]}] Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-274194738 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ed4735185f84421f92bc1404d62f26e3 Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: {"os-stop": {}} Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 is locked Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'dd0bdba4-a87a-432c-ae9d-63290c249010', 'body': {'os-stop': {}}} Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 is locked Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 is locked Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 is locked Jul 25 16:23:06.592372 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:06.610946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Returning 409 to user: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 is locked {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:06.620423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3992731a-7197-4590-b623-7485ab47842a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 409 len: 107 microversion: 2.1 time: 0.092808 Jul 25 16:23:06.623096 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1780/3495] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:06 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 107 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:23:06.634220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:06.635292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:06.652115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.654625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.656033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.657996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:06.658815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.676036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b267bd7f-6b5e-44d8-a6d3-f1e82577a32e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1286 microversion: 2.1 time: 0.241979 Jul 25 16:23:06.689121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1716/3496] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:06 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:06.720563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:06.734561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:06.763143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.763603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.764398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:06.765008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:06.840962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:23:06.904372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Unlocking {{(pid=119598) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 16:23:07.069533 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d0d2617-4c45-42f9-9816-7381f76c319f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.389789 Jul 25 16:23:07.070739 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1717/3497] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:06 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:07.082146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6177be7-d6d4-402b-8ddc-9c254188ae3b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:07.091899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6177be7-d6d4-402b-8ddc-9c254188ae3b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.092738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6177be7-d6d4-402b-8ddc-9c254188ae3b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.138958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6177be7-d6d4-402b-8ddc-9c254188ae3b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Going to try to stop instance {{(pid=119598) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:23:07.191360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0ac4bdb-41d4-49bb-897b-2aa666c712b9 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "DELETE /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef" status: 204 len: 0 microversion: 2.47 time: 0.565429 Jul 25 16:23:07.192925 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1781/3498] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:23:06 2022] DELETE /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:23:07.208363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:07.209822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:07.222327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.223285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.225010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.226260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.260231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6177be7-d6d4-402b-8ddc-9c254188ae3b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.183883 Jul 25 16:23:07.262571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1718/3499] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:07 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:07.276828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:07.280030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:07.322678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.323402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.323935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.324977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.587770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:07.594199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:07.615775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:07.617586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:07.619101 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-742612f3-ec1c-4f16-b33b-607807f11b4c tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef" status: 200 len: 1365 microversion: 2.47 time: 0.421700 Jul 25 16:23:07.619860 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1782/3500] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:07 2022] GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:07.629263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:07.632160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:07.645355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.652471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.653633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.654233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.803104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:07.820314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-271fd21f-63b6-46a2-a5c3-01cbbb4f6bb0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.552992 Jul 25 16:23:07.821368 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1719/3501] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:07 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:07.830985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a00a671-eea8-48e0-ba1b-2d6de034dee5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93e4c160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:07.923843 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5a00a671-eea8-48e0-ba1b-2d6de034dee5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.101382 Jul 25 16:23:07.924690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1720/3502] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:07 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:07.934513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:07.935548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:07.974542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.975337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:07.976409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:07.978676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:08.396240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:08.404542 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4f5e6ba2-5c38-405f-bb13-1971091c8450 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.478460 Jul 25 16:23:08.413412 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1721/3503] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:07 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:08.416769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:08.429357 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d4f9920-1cbb-49f4-b09d-7c9c6dbb570b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.807250 Jul 25 16:23:08.435125 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1783/3504] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:07 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:08.644697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:08.645366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:08.659752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:08.660213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:08.664859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:08.665743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:08.800063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:08.809965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:08.820250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:08.821831 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b733686d-d876-43f6-881f-7380021521a8 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef" status: 200 len: 1365 microversion: 2.47 time: 0.182063 Jul 25 16:23:08.822930 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1722/3505] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:08 2022] GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:08.867169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:08.869014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:08.885386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:08.886928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:08.888717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:08.890943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:08.943722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19b310b4-f5cd-44f6-8f64-bc0cd39f6b49 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da4ac9430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:09.042292 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-19b310b4-f5cd-44f6-8f64-bc0cd39f6b49 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.105784 Jul 25 16:23:09.050943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1723/3506] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:08 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:09.434112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:09.434861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:09.446791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:09.447275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:09.448073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:09.448514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:09.774000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:09.785724 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c4860e0-71d0-42ea-8f93-966ca7bbe76d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.924859 Jul 25 16:23:09.793574 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1784/3507] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:08 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:09.810311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:09.810934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:09.836005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:09.846689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:09.853062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:09.853690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:10.273605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:10.314331 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71acc6f6-fcd1-4b37-9b6a-1c7bbf2450de tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.870208 Jul 25 16:23:10.315462 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1724/3508] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:09 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:10.324699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:10.325745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:10.336201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:10.336997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:10.340253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:10.341758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:10.392481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:10.393289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:10.394087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lazy-loading 'fault' on Instance uuid 59073c5e-c486-4a3c-ba9e-c93f272423ef {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:23:10.486071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:10.503604 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1486f898-9893-451d-a5c9-5faa94dbde90 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.704676 Jul 25 16:23:10.506650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1785/3509] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:09 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:10.555368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-658c352b-1939-4871-b600-2ff79b9092df tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92e9caf0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:10.581744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:10.598483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:10.600548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4675039200f64e7f998e090c8e90ede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8703005fab754aaf8560d8fdce4ee817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:10.613623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1bdaafd-d880-49d6-b5f0-fd03105b59fd tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef" status: 200 len: 1370 microversion: 2.47 time: 0.292816 Jul 25 16:23:10.615051 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1725/3510] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:10 2022] GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:10.630510 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-658c352b-1939-4871-b600-2ff79b9092df tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.122371 Jul 25 16:23:10.631126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1786/3511] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:10 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:10.795648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:10.819220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:10.819929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:10.838909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:10.839373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:10.845921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:10.847868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:11.390249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:11.401315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2c50d96-3ad1-4352-9c67-acb2eaadab60 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.587106 Jul 25 16:23:11.403924 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1787/3512] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:10 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:11.414716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-33234726-e265-4a88-9dd6-79bfb1d2cafd req-628d2bc7-81ae-471a-b36b-37d5934fca67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e763c856-ccda-4169-a341-0fe6c90d4e0c", "tag": "87eed4f4-49ba-4c33-bf45-461541fefdbd"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:11.417182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:11.418014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:11.431730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:11.436443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:11.438346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:11.440949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-33234726-e265-4a88-9dd6-79bfb1d2cafd req-628d2bc7-81ae-471a-b36b-37d5934fca67 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:11.441192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:11.441419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-33234726-e265-4a88-9dd6-79bfb1d2cafd req-628d2bc7-81ae-471a-b36b-37d5934fca67 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:11.463231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-33234726-e265-4a88-9dd6-79bfb1d2cafd req-628d2bc7-81ae-471a-b36b-37d5934fca67 service nova] Creating event network-changed:87eed4f4-49ba-4c33-bf45-461541fefdbd for instance e763c856-ccda-4169-a341-0fe6c90d4e0c on n-h1-846219-13 Jul 25 16:23:11.496281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-33234726-e265-4a88-9dd6-79bfb1d2cafd req-628d2bc7-81ae-471a-b36b-37d5934fca67 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.714925 Jul 25 16:23:11.504701 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1726/3513] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:11.529611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:11.530514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:11.540650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:11.542101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:11.543106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:11.544439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:11.556675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:12.005587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:12.014206 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d588993-6b89-45c3-bf38-80723caea693 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.605281 Jul 25 16:23:12.019861 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1788/3514] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:11 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:12.042359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:12.049752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] [instance: 59073c5e-c486-4a3c-ba9e-c93f272423ef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:12.063555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:12.071421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:12.073198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:12.074399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:12.102495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] HTTP exception thrown: Instance 59073c5e-c486-4a3c-ba9e-c93f272423ef could not be found. Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Request method failure captured: Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef HTTP/1.1 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sMueM-_NWEDZdIyRCPbA9aV98U4AkfBpC0s5PcqSWDQUfap2EDtC_YzEVLDYz6qgemzLY4a4JxIZ5Zbwt86fRNdGaybf5Z7-1AF47t-W8QedN3zGl7PzlY1v9sOzBOpXAcKYAPjNb4T98faAjukI41y6t9dkSoS6hLsxkwupNK8jyE Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8703005fab754aaf8560d8fdce4ee817 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerShowV247Test-1189295288 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8703005fab754aaf8560d8fdce4ee817"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8703005fab754aaf8560d8fdce4ee817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8703005fab754aaf8560d8fdce4ee817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8703005fab754aaf8560d8fdce4ee817"}]}] Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerShowV247Test-1189295288 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8703005fab754aaf8560d8fdce4ee817 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerShowV247Test-1189295288 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerShowV247Test-1189295288-project Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4675039200f64e7f998e090c8e90ede3 Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerShowV247Test-1189295288-project Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 59073c5e-c486-4a3c-ba9e-c93f272423ef could not be found. Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '59073c5e-c486-4a3c-ba9e-c93f272423ef'} Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59073c5e-c486-4a3c-ba9e-c93f272423ef could not be found. Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59073c5e-c486-4a3c-ba9e-c93f272423ef could not be found. Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:12.104736 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59073c5e-c486-4a3c-ba9e-c93f272423ef could not be found. Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] Returning 404 to user: Instance 59073c5e-c486-4a3c-ba9e-c93f272423ef could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c097118-5496-44cd-bc7f-3684337bfa88 tempest-ServerShowV247Test-1189295288 tempest-ServerShowV247Test-1189295288-project] 10.222.0.105 "GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef" status: 404 len: 111 microversion: 2.47 time: 0.067878 Jul 25 16:23:12.110439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1789/3515] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:12 2022] GET /compute/v2.1/servers/59073c5e-c486-4a3c-ba9e-c93f272423ef => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:23:12.113267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-812bb964-7892-4942-bfd9-1668e86e1cd4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d9288b790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:12.120846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:12.133375 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e00d9c0-7d14-4654-a066-e2a687353a70 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.609502 Jul 25 16:23:12.147682 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1727/3516] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:11 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:12.223151 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-812bb964-7892-4942-bfd9-1668e86e1cd4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.112092 Jul 25 16:23:12.227312 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1790/3517] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:12 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:12.450733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:12.452131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:12.486888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:12.491792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:12.496203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:12.500616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:13.040314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:13.040314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:13.053289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:13.068916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:13.097394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:13.109534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:13.109899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:13.110693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:13.112539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d71a273-54a7-434d-bbcc-ce13fed29803 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.692805 Jul 25 16:23:13.112784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:13.158839 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1728/3518] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:12 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:13.173726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:13.176377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:13.197498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:13.198205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:13.200017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:13.203646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:13.331803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:13.618447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:13.630960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:13.640047 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04c815cd-79dc-4c88-9408-d07b106dc36e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.603801 Jul 25 16:23:13.650102 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b588822-794e-4a3a-ac2b-c5472d708bef tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.487310 Jul 25 16:23:13.653373 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1791/3519] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:13 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:13.656208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1729/3520] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:13 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:13.672889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fdd9fecc-6c3e-45e1-88e6-596c5cd2896f tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d9286c0d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:13.779850 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fdd9fecc-6c3e-45e1-88e6-596c5cd2896f tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.110434 Jul 25 16:23:13.787822 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1792/3521] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:13 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:14.168914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:14.170292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:14.196601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:14.198531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:14.200229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:14.206610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:14.517583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:14.530958 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10587a65-5c2b-4f4f-b97a-1e4185b325b7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.367782 Jul 25 16:23:14.534357 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1730/3522] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:14 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:14.691115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:14.691768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:14.695069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:14.696027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:14.706873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:14.708357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:14.708907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:14.709905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:14.710730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:14.711004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:14.713649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:14.718566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:15.808769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:15.862456 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6528eed3-4331-4c05-a2de-4e12f3be1b81 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 1.171393 Jul 25 16:23:15.870086 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1731/3523] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:14 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:15.887571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4e9927c-596b-4155-a553-c4044c5e973c tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da4a854c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:15.989655 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4e9927c-596b-4155-a553-c4044c5e973c tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.118200 Jul 25 16:23:15.999447 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1732/3524] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:15 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:16.019545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:16.030053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:16.048091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:16.049025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:16.050106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:16.054756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:16.130457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:16.144531 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8db0ef66-88d1-4cdb-a9c5-a79809be465c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 1.458591 Jul 25 16:23:16.145186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1793/3525] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:14 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:16.168863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2073409446", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "45ee8ade-dddb-45e3-b410-971a074fe851"}], "security_groups": [{"name": "tempest-securitygroup--1916635859"}], "key_name": "tempest-keypair-1487779037", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d7051e0b-b6de-4987-8972-665fb0632d70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:16.534995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] validate_networks() for [('45ee8ade-dddb-45e3-b410-971a074fe851', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:23:16.592508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:16.601382 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c56e591f-2922-4063-a43d-626b6a3a9aa2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.603975 Jul 25 16:23:16.605448 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1733/3526] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:15 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:16.894975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:16.896509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:16.907729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:16.908226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:16.909011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:16.909472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:17.618695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:17.629029 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-779a8328-ab96-4b0d-a64a-a76f93e5a623 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.737876 Jul 25 16:23:17.630985 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1734/3527] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:16 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:17.656149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d3747f4-3156-4d22-b8ed-9df23eb2d628 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da49a2af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:17.678145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Getting quotas for project b13a4c5edb33497ba0348afda935754d. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:17.696557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Getting quotas for user 51387870067647ea81d15530cf0296cf and project b13a4c5edb33497ba0348afda935754d. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:17.711659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d3747f4-3156-4d22-b8ed-9df23eb2d628 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.078306 Jul 25 16:23:17.714297 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1735/3528] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:17 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:17.751497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:23:17.752393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:23:17.754759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:23:17.756334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:23:17.757246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:23:17.793538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:17.796096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:17.806920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:17.808628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:17.847004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Getting quotas for project b13a4c5edb33497ba0348afda935754d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:17.861201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Getting quotas for user 51387870067647ea81d15530cf0296cf and project b13a4c5edb33497ba0348afda935754d. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:17.987906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:23:17.990816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7051e0b-b6de-4987-8972-665fb0632d70',volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:23:18.027257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1940276433", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": "none"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:18.136207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:23:18.136939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:23:18.137620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:23:18.138217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:23:18.138815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:23:18.160094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:18.161823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:18.164576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:18.166385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:18.187299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Getting quotas for project 660f19ce08fd4d5794d1e74f0c29f606. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:18.194735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Getting quotas for user e3135746990242b4a071891817ce61e0 and project 660f19ce08fd4d5794d1e74f0c29f606. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:18.214435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:23:18.217246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:23:18.299389 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8ab4ccd-4863-4926-838c-251ede628f91 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.54 time: 0.583693 Jul 25 16:23:18.307425 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1736/3529] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:23:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:23:18.312612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:18.313561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:18.320817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:18.321615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:18.322570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:18.323162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:18.402478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f47a87f8-cda7-41cb-853c-5a0f60e0e862 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.246150 Jul 25 16:23:18.415646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1794/3530] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:23:18.426639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:18.428002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:18.473061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:18.473884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:18.481902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:18.482702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:18.931201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:18.947115 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d78b108-2600-40d8-b5eb-3f286cf8178b tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.638259 Jul 25 16:23:18.951783 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1737/3531] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:18 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:18.956987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5525ddc6-0cb7-46e5-987e-15368b540346 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:18.964213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5525ddc6-0cb7-46e5-987e-15368b540346 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:19.075059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:19.096015 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89cc30b4-0007-43ef-ac52-1a65334368b8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1660 microversion: 2.1 time: 0.676554 Jul 25 16:23:19.106171 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1795/3532] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:18 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1660 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:19.130115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25668502-01ed-4c7d-bfae-86643e4d9eb1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:19.131381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-25668502-01ed-4c7d-bfae-86643e4d9eb1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:19.183459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5525ddc6-0cb7-46e5-987e-15368b540346 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:19.205304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5525ddc6-0cb7-46e5-987e-15368b540346 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:19.208314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5525ddc6-0cb7-46e5-987e-15368b540346 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:19.209656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5525ddc6-0cb7-46e5-987e-15368b540346 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1281 microversion: 2.54 time: 0.256571 Jul 25 16:23:19.220150 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1738/3533] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:18 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:19.237163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:19.237850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:19.250800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-25668502-01ed-4c7d-bfae-86643e4d9eb1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:19.258487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.259020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.259810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.260247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.265934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25668502-01ed-4c7d-bfae-86643e4d9eb1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1125 microversion: 2.1 time: 0.157821 Jul 25 16:23:19.266698 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1796/3534] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:19 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1125 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:19.275750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7d08180e-ea19-41dd-8cc7-9ca5e0bd2b49 req-93d7597b-1c75-4080-9688-192c15766959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e763c856-ccda-4169-a341-0fe6c90d4e0c", "name": "network-vif-plugged", "status": "completed", "tag": "87eed4f4-49ba-4c33-bf45-461541fefdbd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:19.311568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7d08180e-ea19-41dd-8cc7-9ca5e0bd2b49 req-93d7597b-1c75-4080-9688-192c15766959 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.314033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7d08180e-ea19-41dd-8cc7-9ca5e0bd2b49 req-93d7597b-1c75-4080-9688-192c15766959 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.335991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7d08180e-ea19-41dd-8cc7-9ca5e0bd2b49 req-93d7597b-1c75-4080-9688-192c15766959 service nova] Creating event network-vif-plugged:87eed4f4-49ba-4c33-bf45-461541fefdbd for instance e763c856-ccda-4169-a341-0fe6c90d4e0c on n-h1-846219-13 Jul 25 16:23:19.347075 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7d08180e-ea19-41dd-8cc7-9ca5e0bd2b49 req-93d7597b-1c75-4080-9688-192c15766959 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078853 Jul 25 16:23:19.347836 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1797/3535] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:19.354172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b19f14a8-ce72-4817-aade-360ed35d8267 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92a33a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:19.454579 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b19f14a8-ce72-4817-aade-360ed35d8267 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.104370 Jul 25 16:23:19.454579 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1798/3536] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:19 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:19.484534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4097848f-98f6-405b-b345-75d20c9f1b97 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:19.504858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4097848f-98f6-405b-b345-75d20c9f1b97 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.507557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4097848f-98f6-405b-b345-75d20c9f1b97 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.580169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4097848f-98f6-405b-b345-75d20c9f1b97 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Going to try to start instance {{(pid=119599) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:23:19.784040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4097848f-98f6-405b-b345-75d20c9f1b97 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.327103 Jul 25 16:23:19.792449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1799/3537] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:19 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:19.812276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:19.818410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:19.829756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:19.841637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.843392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ef10d56-2737-499c-af1c-16784ada846a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.621710 Jul 25 16:23:19.843972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.844790 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1739/3538] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:19 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:19.857806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.857806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.975151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:19.976943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:19.990417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.991056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:19.993036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:19.993580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:20.137166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:20.149441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d58103a6-7f56-4148-aea6-4159a118c7cd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 0.352735 Jul 25 16:23:20.155770 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1800/3539] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:19 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:20.244817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:20.246798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:20.263118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:20.264630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:20.265741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:20.269050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:20.274842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:20.285863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c34286c7-ae51-4f71-a969-814e8b0848f8 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.314835 Jul 25 16:23:20.286828 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1740/3540] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:19 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:20.292754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:20.294024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:20.307701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:20.308511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:20.309689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:20.310766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:20.372442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:20.383263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:20.385283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:20.386956 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38717b55-995a-4b6e-aec7-6e91dbec99ec tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1277 microversion: 2.54 time: 0.154536 Jul 25 16:23:20.388335 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1801/3541] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:20 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:20.446748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:20.459022 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d4a84bf-5aab-4363-b1c8-bd2b37dd451c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1167 microversion: 2.1 time: 0.169188 Jul 25 16:23:20.460025 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1741/3542] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:20 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1167 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:20.468791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ac8ccf4-0f7d-4f58-bc2c-944207f75bb6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d9289a790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:20.536037 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ac8ccf4-0f7d-4f58-bc2c-944207f75bb6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.071371 Jul 25 16:23:20.545241 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1802/3543] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:20 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:20.874118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:20.875213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:20.891231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:20.893657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:20.895726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:20.896427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.109720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:21.120383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-edbb365b-5259-47b1-9023-90214cab8406 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.252126 Jul 25 16:23:21.132209 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1742/3544] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:20 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:21.178874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:21.180315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:21.189209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.190197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.191602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.192335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.307102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:21.307721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:21.312000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:21.331285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.332064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.332851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.336326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.757809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:21.774840 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd56bff8-4277-48e2-817d-0cad380401d2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 0.602037 Jul 25 16:23:21.791035 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1803/3545] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:21 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:21.803453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:21.803825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:21.805396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:21.812705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c45c9672-9935-4588-9dd2-d64c36f0104d tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1328 microversion: 2.1 time: 0.509349 Jul 25 16:23:21.825516 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1743/3546] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:21 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1328 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:21.825516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:21.825516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:21.830466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.831277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.832162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.832596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.844120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.847695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:21.849330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:21.849925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:22.023918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:22.043303 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39123318-ca25-4396-aa74-216e27e35a48 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1223 microversion: 2.1 time: 0.223057 Jul 25 16:23:22.057121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1744/3547] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:21 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1223 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:22.073656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a3ad8b66-2827-4e39-a6fd-8086197d7a25 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d939dd280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:22.190081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a3ad8b66-2827-4e39-a6fd-8086197d7a25 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.139296 Jul 25 16:23:22.200046 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1745/3548] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:22 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:22.216313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:22.218825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:22.256489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:22.257419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:22.261378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:22.264766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:22.267439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:22.295438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:22.297598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:22.313452 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2333e357-30d1-45b4-b224-8edc83feb497 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1341 microversion: 2.54 time: 0.515003 Jul 25 16:23:22.313638 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1804/3549] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:21 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1341 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:22.806331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:22.808274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:22.817369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:22.821140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:22.823076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:22.824325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:22.825169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:22.911784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:22.936726 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-770a43c6-37eb-4bac-8199-4178b4468cdc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.741711 Jul 25 16:23:22.937772 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1746/3550] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:22 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:22.964219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:22.965161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:22.980855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:22.982159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:22.983221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:22.983853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:23.271338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:23.279219 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fef1e31d-70b9-475f-a112-060ba9e86625 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 0.480844 Jul 25 16:23:23.282863 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1805/3551] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:22 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:23.300650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:23.309454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:23.327857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:23.333206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:23.334309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:23.337477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:23.413428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:23.414980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:23.423741 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35ffcff9-674d-4d5a-b058-b85a8d88ed37 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1524 microversion: 2.1 time: 0.470142 Jul 25 16:23:23.425802 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1747/3552] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:22 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1524 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:23.442200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f729c6a4-75e0-4c44-b76d-099721cb550a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93f22280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:23.570194 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f729c6a4-75e0-4c44-b76d-099721cb550a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.142982 Jul 25 16:23:23.570788 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1748/3553] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:23 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:23.582450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:23.586849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:23.592020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:23.599131 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b10769e7-fc4d-49e3-8898-1aa2c23267e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1241 microversion: 2.1 time: 0.311308 Jul 25 16:23:23.613631 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1806/3554] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:23 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1241 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:23.618791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:23.619241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:23.620191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:23.620632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:23.667837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:23.749241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c847a4a-54e7-4684-ac35-f955474d6483 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-542174771", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:23.749426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c847a4a-54e7-4684-ac35-f955474d6483 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 242 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-542174771", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-542174771', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6f3268ad-89cd-4c4f-a295-6ceccc7d2161'}]}}} Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:23.758418 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.764007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.765577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:23.765577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:23.765798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c847a4a-54e7-4684-ac35-f955474d6483 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:23.765901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f846bc5d-17a7-4c81-8a2d-4c962e05b759 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1339 microversion: 2.54 time: 0.190411 Jul 25 16:23:23.765901 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1749/3555] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:23 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:23.768053 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c847a4a-54e7-4684-ac35-f955474d6483 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021714 Jul 25 16:23:23.778171 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1807/3556] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:23:23.779719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb24111b-7095-436e-a999-2e646fbb5666 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:23.780716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb24111b-7095-436e-a999-2e646fbb5666 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: cfbb3fac-63be-4e32-8c3c-ca1b2452b54b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:23.799255 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-fb24111b-7095-436e-a999-2e646fbb5666 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] HTTP exception thrown: Instance cfbb3fac-63be-4e32-8c3c-ca1b2452b54b could not be found. Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb24111b-7095-436e-a999-2e646fbb5666 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/cfbb3fac-63be-4e32-8c3c-ca1b2452b54b/metadata HTTP/1.1 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance cfbb3fac-63be-4e32-8c3c-ca1b2452b54b could not be found. Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': 'cfbb3fac-63be-4e32-8c3c-ca1b2452b54b'} Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbb3fac-63be-4e32-8c3c-ca1b2452b54b could not be found. Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbb3fac-63be-4e32-8c3c-ca1b2452b54b could not be found. Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:23.806862 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:23.812278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:23.812278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:23.812278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbb3fac-63be-4e32-8c3c-ca1b2452b54b could not be found. Jul 25 16:23:23.812278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.812278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb24111b-7095-436e-a999-2e646fbb5666 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 404 to user: Instance cfbb3fac-63be-4e32-8c3c-ca1b2452b54b could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:23.813503 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb24111b-7095-436e-a999-2e646fbb5666 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/cfbb3fac-63be-4e32-8c3c-ca1b2452b54b/metadata" status: 404 len: 111 microversion: 2.1 time: 0.037839 Jul 25 16:23:23.821260 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1750/3557] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:23:23 2022] GET /compute/v2.1/servers/cfbb3fac-63be-4e32-8c3c-ca1b2452b54b/metadata => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:23:23.929565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acec528d-69df-42c3-bfa5-a6c4f70d01d4 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-254926292", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acec528d-69df-42c3-bfa5-a6c4f70d01d4 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 498 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-254926292", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-254926292', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f3268ad-89cd-4c4f-a295-6ceccc7d2161'}]}}} Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:23:23.935375 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:23.942439 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:23.948659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acec528d-69df-42c3-bfa5-a6c4f70d01d4 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:23.960689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:23.962465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:23.969778 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-acec528d-69df-42c3-bfa5-a6c4f70d01d4 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.044194 Jul 25 16:23:23.971560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1808/3558] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:23:23.973401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:23.974136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:23.977062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:23.977799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.047597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6c7bd5f-a42b-4c9b-9f5d-1dc886f32249 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-696720964", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6c7bd5f-a42b-4c9b-9f5d-1dc886f32249 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 499 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-696720964", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-696720964', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f3268ad-89cd-4c4f-a295-6ceccc7d2161'}]}}} Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:23:24.052481 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.056134 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.085662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6c7bd5f-a42b-4c9b-9f5d-1dc886f32249 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:24.087241 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6c7bd5f-a42b-4c9b-9f5d-1dc886f32249 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.044718 Jul 25 16:23:24.088105 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1809/3559] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:24 2022] POST /compute/v2.1/servers => generated 689 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:23:24.172889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d44c3f9-fce7-470b-80c9-d09549975a00 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1500557880", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d44c3f9-fce7-470b-80c9-d09549975a00 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 754 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1500557880", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1500557880', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f3268ad-89cd-4c4f-a295-6ceccc7d2161'}]}}} Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:23:24.178147 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:23:24.181192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:23:24.187545 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.187545 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.190740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d44c3f9-fce7-470b-80c9-d09549975a00 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:24.191926 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d44c3f9-fce7-470b-80c9-d09549975a00 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023210 Jul 25 16:23:24.192823 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1810/3560] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:24 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 25 16:23:24.309410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:24.312256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:24.334024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.336323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.338375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.339182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.361839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:24.375921 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b23fbd4a-48a5-4be0-a654-0ecbdf79ef29 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.419088 Jul 25 16:23:24.376747 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1751/3561] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:23 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:24.398674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2601e58f-0bc1-42d8-85a6-33c2496d880c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1882781485", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2601e58f-0bc1-42d8-85a6-33c2496d880c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 1266 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1882781485", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f3268ad-89cd-4c4f-a295-6ceccc7d2161"}]}} Jul 25 16:23:24.407084 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1882781485', 'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f3268ad-89cd-4c4f-a295-6ceccc7d2161'}]}}} Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.410085 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:23:24.411718 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:23:24.414441 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 16:23:24.414441 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.417081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2601e58f-0bc1-42d8-85a6-33c2496d880c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:24.418421 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2601e58f-0bc1-42d8-85a6-33c2496d880c tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023899 Jul 25 16:23:24.419603 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1752/3562] 10.222.0.105 () {60 vars in 1153 bytes} [Mon Jul 25 16:23:24 2022] POST /compute/v2.1/servers => generated 2221 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 25 16:23:24.433400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53812234-9016-49b1-9393-b9b64b115bef tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:24.434173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53812234-9016-49b1-9393-b9b64b115bef tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: 337ee01a-5152-4816-87a1-9ac027b3e3a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:24.442946 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-53812234-9016-49b1-9393-b9b64b115bef tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] HTTP exception thrown: Instance 337ee01a-5152-4816-87a1-9ac027b3e3a8 could not be found. Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53812234-9016-49b1-9393-b9b64b115bef tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/337ee01a-5152-4816-87a1-9ac027b3e3a8/metadata/test2 HTTP/1.1 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 337ee01a-5152-4816-87a1-9ac027b3e3a8 could not be found. Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '337ee01a-5152-4816-87a1-9ac027b3e3a8', 'id': 'test2'} Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337ee01a-5152-4816-87a1-9ac027b3e3a8 could not be found. Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337ee01a-5152-4816-87a1-9ac027b3e3a8 could not be found. Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:24.444585 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:24.452162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:24.452162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:24.452162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337ee01a-5152-4816-87a1-9ac027b3e3a8 could not be found. Jul 25 16:23:24.452162 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:24.459637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53812234-9016-49b1-9393-b9b64b115bef tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 404 to user: Instance 337ee01a-5152-4816-87a1-9ac027b3e3a8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:24.461016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53812234-9016-49b1-9393-b9b64b115bef tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/337ee01a-5152-4816-87a1-9ac027b3e3a8/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.034715 Jul 25 16:23:24.462306 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1753/3563] 10.222.0.105 () {58 vars in 1286 bytes} [Mon Jul 25 16:23:24 2022] GET /compute/v2.1/servers/337ee01a-5152-4816-87a1-9ac027b3e3a8/metadata/test2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:23:24.476247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:24.477200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:24.496070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.497287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.498104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.498540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.564236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:23:24.593136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:24.621714 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca4b49a0-e935-4d5e-8761-68b1cb048f91 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 0.325063 Jul 25 16:23:24.624142 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1811/3564] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:24 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:24.630649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be714e93-9bdc-41ac-8757-4d24e605e9c1 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d928b2f70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:24.735460 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be714e93-9bdc-41ac-8757-4d24e605e9c1 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1429 microversion: 2.1 time: 0.109600 Jul 25 16:23:24.737228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1812/3565] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:24 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:24.758574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:24.769001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:24.776455 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-714762b5-6f63-47d2-b0cb-cf967ca302c3 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 204 len: 0 microversion: 2.1 time: 0.304298 Jul 25 16:23:24.781179 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1754/3566] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:23:24 2022] DELETE /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:23:24.792183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.793194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.795238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:24.796527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:24.797492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.799243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.810524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.815182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:24.816370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:24.821590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.166315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.179720 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f12c01c-a954-4294-b3ff-0f2b93896fe6 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1241 microversion: 2.1 time: 0.437869 Jul 25 16:23:25.193978 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1813/3567] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:24 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1241 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:25.212298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:25.213646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:25.223228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:25.224273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.225350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:25.226345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.339556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.368419 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cef85809-3c8d-46a0-a2bd-6faac57a483e tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1530 microversion: 2.1 time: 0.583803 Jul 25 16:23:25.372100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1755/3568] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:24 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1530 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:25.401017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:25.401734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:25.431197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.446749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:25.447132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.447932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:25.448374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.452623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.458077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.467238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4362c1e4-97d1-41ab-a7b8-b25929cb9d71 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1339 microversion: 2.54 time: 0.270237 Jul 25 16:23:25.472238 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1814/3569] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:25 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1339 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:25.648098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:25.649734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:25.662412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:25.666927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.668314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:25.672333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:25.734450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.743370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d655efb-6507-454a-8023-a0286f7244e3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1501 microversion: 2.1 time: 0.348178 Jul 25 16:23:25.744034 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1756/3570] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:25 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1501 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:25.761309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-27f3767d-0391-4856-9be2-9942be19b63b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da4ac9e50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:25.851643 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-27f3767d-0391-4856-9be2-9942be19b63b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1438 microversion: 2.1 time: 0.103442 Jul 25 16:23:25.852297 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1757/3571] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:25 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:25.867745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a45dea4e-c4fa-49b2-a9b0-a06c6bd9ea1c tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93f6bca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:25.952183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:25.965523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49b5ea4c-f85e-43c1-a9d9-f719e843aab2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 0.320208 Jul 25 16:23:25.966804 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1815/3572] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:25 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:25.972436 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a45dea4e-c4fa-49b2-a9b0-a06c6bd9ea1c tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 200 len: 1438 microversion: 2.1 time: 0.108531 Jul 25 16:23:25.974002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1758/3573] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:25 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:25.992522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:25.993284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:26.010430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.011628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.013613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.013975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.205916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:26.206759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:26.230240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.238302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.239302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.240069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.398133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:26.413806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3cc0f5fe-3cb3-49de-a725-6c3013de0193 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1469 microversion: 2.1 time: 0.424445 Jul 25 16:23:26.417242 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1816/3574] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:25 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:26.427727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:26.428824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:26.437463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.438793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.440064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.441372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.664148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:26.681678 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49618928-213e-4a30-9c7d-7c050c083cc9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1309 microversion: 2.1 time: 0.479357 Jul 25 16:23:26.693118 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1759/3575] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:26 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1309 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:26.711214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-93cae21e-05af-4a03-afea-239e03713ed2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93807a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:26.766531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:26.786032 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cf94df6b-9372-4c38-aac5-5cd6609bdee1 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1530 microversion: 2.1 time: 0.366814 Jul 25 16:23:26.786631 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1817/3576] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:26 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1530 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:26.808879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-93cae21e-05af-4a03-afea-239e03713ed2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/984a5010-f259-40b9-952b-c497908cc5d8" status: 200 len: 787 microversion: 2.1 time: 0.113576 Jul 25 16:23:26.809428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1760/3577] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:26 2022] GET /compute/v2.1/images/984a5010-f259-40b9-952b-c497908cc5d8 => generated 787 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:26.813141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:26.813820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:26.821078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:26.821839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:26.834048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.834490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.835344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.835823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.836418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.836898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:26.837866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:26.838314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:27.048966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:27.073627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:27.076988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:27.082090 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4c6b6f2-1a81-4e79-a981-091cc341fa8f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1339 microversion: 2.54 time: 0.280508 Jul 25 16:23:27.083325 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1818/3578] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:26 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:27.093918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82701b6e-9f26-42da-98e5-9996d312a15b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:27.132746 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82701b6e-9f26-42da-98e5-9996d312a15b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.042026 Jul 25 16:23:27.132746 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1819/3579] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:23:27 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:27.142993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:27.143995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:27.160392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:27.161073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:27.161936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:27.162586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:27.170468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:27.179264 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc4bb23f-4b6a-45a3-820f-2d68a29be933 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 200 len: 1478 microversion: 2.1 time: 0.368564 Jul 25 16:23:27.193065 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1761/3580] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:26 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 1478 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:27.201571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9aebcae-5ed0-4a3e-aaaa-eafdc7ddeac3 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da4942ee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:27.508182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:27.523314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ff2ee29-9ccb-4cf3-8b0f-2e67bcb7cc6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 0.389476 Jul 25 16:23:27.524007 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1820/3581] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:27 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:27.541540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2044787951"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:27.544913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:27.559817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:27.560390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:27.569585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:27.570589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:27.831889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:28.103092 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e4ab511-eb3a-4001-a07c-646022dd3fa2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf/action" status: 202 len: 0 microversion: 2.1 time: 0.577647 Jul 25 16:23:28.113119 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1821/3582] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:27 2022] POST /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:23:28.128413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:28.129803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:28.151602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:28.152414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:28.153535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:28.154174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:28.177029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:29.162405 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9aebcae-5ed0-4a3e-aaaa-eafdc7ddeac3 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "DELETE /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 204 len: 0 microversion: 2.1 time: 1.977100 Jul 25 16:23:29.163720 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1762/3583] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:27 2022] DELETE /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 0 bytes in 1980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:23:29.177456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-67ebd88d-e834-4de7-866b-b92d30a14c39 req-c6fac2c5-23ae-4eab-aef7-0999b18cc93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc212827-9380-4526-8c8a-ec4a67bf3b6a", "tag": "97fe1faf-df0e-473e-9146-1d9129e7bd6e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:29.190123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:29.204938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:29.220988 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81275ac6-dce6-4c9f-ad7d-65e8a4bd3295 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1309 microversion: 2.1 time: 1.106103 Jul 25 16:23:29.235414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-67ebd88d-e834-4de7-866b-b92d30a14c39 req-c6fac2c5-23ae-4eab-aef7-0999b18cc93d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.238219 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1822/3584] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:28 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1309 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:29.238784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-67ebd88d-e834-4de7-866b-b92d30a14c39 req-c6fac2c5-23ae-4eab-aef7-0999b18cc93d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.264899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:29.265761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:29.268329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:29.272569 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-67ebd88d-e834-4de7-866b-b92d30a14c39 req-c6fac2c5-23ae-4eab-aef7-0999b18cc93d service nova] Creating event network-changed:97fe1faf-df0e-473e-9146-1d9129e7bd6e for instance dc212827-9380-4526-8c8a-ec4a67bf3b6a on n-h1-846219-13 Jul 25 16:23:29.290580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.291542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.292614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.293176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.297318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-67ebd88d-e834-4de7-866b-b92d30a14c39 req-c6fac2c5-23ae-4eab-aef7-0999b18cc93d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131400 Jul 25 16:23:29.304546 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1763/3585] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:29.326493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:29.329294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:29.338535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.338974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.339740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.340170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.518914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:29.543435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:29.552453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:29.554754 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77990ae7-b3be-4e9c-9189-a31b4fdd462a tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1360 microversion: 2.54 time: 0.248208 Jul 25 16:23:29.558168 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1764/3586] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:29 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1360 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:29.567228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58c3eb42-483b-46bc-8ece-8ca0661f95fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da02be790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:29.680277 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-58c3eb42-483b-46bc-8ece-8ca0661f95fc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.117688 Jul 25 16:23:29.690995 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1765/3587] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:29 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:29.701395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:29.714836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:29.740959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.742194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.743949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:29.745003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:29.772446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81d63d5b0d4c0ebfca190919d848cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33374b29ef0f499a8af07b9a4af13167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:29.784836 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-706fcd40-942b-44c7-bbad-f6ad61402363 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 200 len: 1530 microversion: 2.1 time: 0.544727 Jul 25 16:23:29.802710 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1823/3588] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:29 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 1530 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:29.811748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0185a33b-c1b5-45aa-a1d2-f9b8807557f4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92e42550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:29.842889 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0185a33b-c1b5-45aa-a1d2-f9b8807557f4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] HTTP exception thrown: Image not found. Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0185a33b-c1b5-45aa-a1d2-f9b8807557f4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Request method failure captured: Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 HTTP/1.1 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNFLNzeOsljRMmCBgu8oFCJT9STJhAeP4wGkkqY9IHXDpJFMAaerCvM-1-UAAAiZG7HqeLqEAGmwzzrODxTvKnd2cmes5rGDpOqF8J8jIVHFtpvQo7oHIleLaDSsyz-jBTV3dvB5yFMTLMvNa5Z9AJHR25LqmhCxwn1xNGjbza-Ljs Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a1eb0d89d327413882079e42507cc344 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a1eb0d89d327413882079e42507cc344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a1eb0d89d327413882079e42507cc344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a1eb0d89d327413882079e42507cc344"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a1eb0d89d327413882079e42507cc344"}]}] Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a1eb0d89d327413882079e42507cc344 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerTestJSON-1906100308-project Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 42600aeea8e04827be40f6ac81b4c40d Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerTestJSON-1906100308-project Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5a68accf-0220-4f82-b61b-0cbb3d6c16a5'} Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a68accf-0220-4f82-b61b-0cbb3d6c16a5 Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:23:29.846784 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a68accf-0220-4f82-b61b-0cbb3d6c16a5 could not be found. Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:23:29.852761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0185a33b-c1b5-45aa-a1d2-f9b8807557f4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:29.859655 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0185a33b-c1b5-45aa-a1d2-f9b8807557f4 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 404 len: 62 microversion: 2.1 time: 0.051459 Jul 25 16:23:29.859655 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1824/3589] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:29 2022] GET /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:23:29.866588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7d7b50c-55bb-418a-8714-3fca7c080969 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Action: 'create', calling method: .version_select at 0x7f9d92870940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-96461710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6fzKuL3SPhTLw7plLMGwvJDtFaD2L8JhquJSp5N57hmATpDoQIBzLIGXXVpJh7Y5/6Dy9eFEOFQZykl4Dbm93SJTW9N6Eh4Ql6HmEaMx9ITF3vtEYTnrfZZdBdla0RfQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:29.948997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a7d7b50c-55bb-418a-8714-3fca7c080969 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Getting quotas for project 660f19ce08fd4d5794d1e74f0c29f606. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:29.962877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a7d7b50c-55bb-418a-8714-3fca7c080969 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Getting quotas for user e3135746990242b4a071891817ce61e0 and project 660f19ce08fd4d5794d1e74f0c29f606. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:30.001741 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7d7b50c-55bb-418a-8714-3fca7c080969 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.142393 Jul 25 16:23:30.003698 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1825/3590] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:23:29 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:23:30.017730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1342202995"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:30.023129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:30.084332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.090016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.091432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.092080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.326340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:30.346887 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33ef0cb9-c1a0-446d-9c18-ee92e1382af8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.650284 Jul 25 16:23:30.354818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1766/3591] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:29 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:30.376146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-96461710", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:30.412796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:30.444287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.445922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.451028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.453295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.800541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:23:30.807357 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00d39d28-cd32-492d-88f2-dd794b29c772 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "POST /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0/action" status: 202 len: 0 microversion: 2.1 time: 0.784943 Jul 25 16:23:30.809542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:23:30.810868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:23:30.811117 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1826/3592] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:30 2022] POST /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:23:30.821745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:23:30.822917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:23:30.854435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-66d703c3-1e7b-4a07-abaa-1864c4a717bc req-d02b9d42-6e7f-45e3-bacb-9553320fd28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e763c856-ccda-4169-a341-0fe6c90d4e0c", "name": "network-vif-deleted", "tag": "87eed4f4-49ba-4c33-bf45-461541fefdbd"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:30.906737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-66d703c3-1e7b-4a07-abaa-1864c4a717bc req-d02b9d42-6e7f-45e3-bacb-9553320fd28f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.908771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-66d703c3-1e7b-4a07-abaa-1864c4a717bc req-d02b9d42-6e7f-45e3-bacb-9553320fd28f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.941352 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-66d703c3-1e7b-4a07-abaa-1864c4a717bc req-d02b9d42-6e7f-45e3-bacb-9553320fd28f service nova] Creating event network-vif-deleted:87eed4f4-49ba-4c33-bf45-461541fefdbd for instance e763c856-ccda-4169-a341-0fe6c90d4e0c on n-h1-846219-13 Jul 25 16:23:30.951706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-66d703c3-1e7b-4a07-abaa-1864c4a717bc req-d02b9d42-6e7f-45e3-bacb-9553320fd28f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131099 Jul 25 16:23:30.953393 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1827/3593] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:30.971624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:30.973531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:31.009890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.010914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.014125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.016223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.113140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:31.141625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.142086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.155184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.155963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.234539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f801a959-8524-4d29-9357-7e6566fe1e83 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "POST /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718/action" status: 202 len: 1141 microversion: 2.54 time: 0.877683 Jul 25 16:23:31.249561 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1767/3594] 10.222.0.105 () {62 vars in 1325 bytes} [Mon Jul 25 16:23:30 2022] POST /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718/action => generated 1141 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Jul 25 16:23:31.258968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:31.259590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:31.280059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.281039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.285502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.286529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.661088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:31.694134 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d56d9c79-cd98-4d17-a9cd-012ff9d8ac2b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1309 microversion: 2.1 time: 0.735584 Jul 25 16:23:31.696646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1828/3595] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:30 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1309 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:31.713534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a069076d-0d33-4b64-b84f-1f3eebec579d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d928bc040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:31.808812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:31.841970 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8812687c-b98b-45c3-a129-c2ac34cfddb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.590676 Jul 25 16:23:31.859432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1768/3596] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:31 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:31.873144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a069076d-0d33-4b64-b84f-1f3eebec579d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.167719 Jul 25 16:23:31.873144 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1829/3597] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:31 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:31.875139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:31.887035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3545fa52-6753-4389-a21c-aa8444c0910e tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d928a1dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:31.889707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] [instance: e763c856-ccda-4169-a341-0fe6c90d4e0c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:31.931985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.932678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.933995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.935221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.958607 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3545fa52-6753-4389-a21c-aa8444c0910e tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.090849 Jul 25 16:23:31.959617 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1830/3598] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:31 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:31.967710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:31.970802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:32.002328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.010915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.012854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.014126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.015791 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] HTTP exception thrown: Instance e763c856-ccda-4169-a341-0fe6c90d4e0c could not be found. Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Request method failure captured: Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c HTTP/1.1 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sNjFe_dRVj8ngmGyRBazQG4Snyr4kuFxzACsaU241i7w3SerF3VNG6lQxaNuJ8RTQTZOXDsxY1KMFZMdE_eps_ZBu0lsI5C3Md5QiBUgvxUMjU4VgDrnEhN-Wzfpr8t-0yzk8uZEYa0FbLVpPhvYxmfWaSxmuoLaW3qOVFmIluC8gE Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/33374b29ef0f499a8af07b9a4af13167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_33374b29ef0f499a8af07b9a4af13167"}]}] Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 33374b29ef0f499a8af07b9a4af13167 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1072474865 Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4c81d63d5b0d4c0ebfca190919d848cf Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1072474865-project Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance e763c856-ccda-4169-a341-0fe6c90d4e0c could not be found. Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'e763c856-ccda-4169-a341-0fe6c90d4e0c'} Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e763c856-ccda-4169-a341-0fe6c90d4e0c could not be found. Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e763c856-ccda-4169-a341-0fe6c90d4e0c could not be found. Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:32.023928 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e763c856-ccda-4169-a341-0fe6c90d4e0c could not be found. Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] Returning 404 to user: Instance e763c856-ccda-4169-a341-0fe6c90d4e0c could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d92dbdb-a613-4882-b7c8-31ca473eb564 tempest-ServerMetadataNegativeTestJSON-1072474865 tempest-ServerMetadataNegativeTestJSON-1072474865-project] 10.222.0.105 "GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c" status: 404 len: 111 microversion: 2.1 time: 0.168119 Jul 25 16:23:32.037155 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1769/3599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:31 2022] GET /compute/v2.1/servers/e763c856-ccda-4169-a341-0fe6c90d4e0c => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:23:32.047033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-216b5111-03f9-4f8a-896b-1742770ad57d req-869efc47-8c02-49de-9643-2ee56331a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "name": "network-vif-unplugged", "status": "completed", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:32.079033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:32.087631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-216b5111-03f9-4f8a-896b-1742770ad57d req-869efc47-8c02-49de-9643-2ee56331a9c9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.088366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-216b5111-03f9-4f8a-896b-1742770ad57d req-869efc47-8c02-49de-9643-2ee56331a9c9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.137591 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-216b5111-03f9-4f8a-896b-1742770ad57d req-869efc47-8c02-49de-9643-2ee56331a9c9 service nova] Creating event network-vif-unplugged:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:23:32.154080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-216b5111-03f9-4f8a-896b-1742770ad57d req-869efc47-8c02-49de-9643-2ee56331a9c9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113425 Jul 25 16:23:32.156959 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1770/3600] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:32.172449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:32.179438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:32.200062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.207482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.209127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.210346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.301714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:32.306096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Unlocking {{(pid=119598) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 16:23:32.404906 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3aaaeec-d33e-44a3-a265-a1b3d5ad88f0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.240176 Jul 25 16:23:32.405878 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1771/3601] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:32 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:32.419442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:32.420167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:32.434836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.453477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.454950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.455652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.491520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:32.508744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:32.513770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:32.516988 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fb05568-d44b-485d-9a52-7ecf8cf8a9fa tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.555471 Jul 25 16:23:32.533153 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1831/3602] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:31 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:32.734318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:32.735059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:32.748462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.749463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:32.752683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:32.754419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:33.040270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:33.049822 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e95d026f-3893-4b98-a47a-38900209a7a7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.636509 Jul 25 16:23:33.054530 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1772/3603] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:32 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:33.073959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5188a39f-b84d-4d66-a257-b82041dbd580 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e2f670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:33.152948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:33.172614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8af68d3-2017-432a-959b-be5022d6270f tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1309 microversion: 2.1 time: 0.442456 Jul 25 16:23:33.211124 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1832/3604] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:32 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:33.234864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9efa3376-8ed9-4501-90b5-589d2cfec282 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92870670>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:33.236965 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5188a39f-b84d-4d66-a257-b82041dbd580 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.178257 Jul 25 16:23:33.241055 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1773/3605] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:33 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:33.260848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:33.263728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:33.275467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:33.276385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:33.278734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:33.280451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:33.319317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9efa3376-8ed9-4501-90b5-589d2cfec282 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.104337 Jul 25 16:23:33.320281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1833/3606] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:33 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:33.551192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:33.553562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:33.571662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:33.573713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:33.576019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:33.581503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:34.467819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:34.489562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:34.502054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:34.511051 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad78285b-1fa1-49b1-9676-efeae142ac35 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.958553 Jul 25 16:23:34.511760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1834/3607] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:33 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:34.534564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5b048e03-b380-4763-8889-723e9e017bf3 req-2d8275ab-cb77-46a5-9a4b-21c781b05581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a03699d-344b-418e-b91f-4b56f275b9cf", "name": "network-vif-plugged", "status": "completed", "tag": "c6b22d2b-fcd4-4eb1-9395-9e5f23656c74"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:34.539229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:34.553720 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4383a65c-024f-402a-9f11-3d31540bdb46 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.304047 Jul 25 16:23:34.569164 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1774/3608] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:33 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:34.582481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:34.583751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5b048e03-b380-4763-8889-723e9e017bf3 req-2d8275ab-cb77-46a5-9a4b-21c781b05581 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:34.584207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5b048e03-b380-4763-8889-723e9e017bf3 req-2d8275ab-cb77-46a5-9a4b-21c781b05581 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:34.606269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:34.624250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:34.627638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:34.630895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:34.631565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:34.648699 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5b048e03-b380-4763-8889-723e9e017bf3 req-2d8275ab-cb77-46a5-9a4b-21c781b05581 service nova] Creating event network-vif-plugged:c6b22d2b-fcd4-4eb1-9395-9e5f23656c74 for instance 2a03699d-344b-418e-b91f-4b56f275b9cf on n-h2-846219-13 Jul 25 16:23:34.670926 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5b048e03-b380-4763-8889-723e9e017bf3 req-2d8275ab-cb77-46a5-9a4b-21c781b05581 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157566 Jul 25 16:23:34.677678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1835/3609] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:34.686824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-309ea6f7-3fff-406f-95e0-426346812fea tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d928bc1f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:34.787811 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-309ea6f7-3fff-406f-95e0-426346812fea tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.107360 Jul 25 16:23:34.789484 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1836/3610] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:34 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:34.794994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c52897db-f80b-4e57-b267-c827220c20a8 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da05fce50>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:34.900588 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c52897db-f80b-4e57-b267-c827220c20a8 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.109751 Jul 25 16:23:34.907395 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1837/3611] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:34 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:34.920898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:34.921955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:34.943955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:34.944815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:34.945927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:34.946549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.154351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:35.163797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-27b54cb0-a385-4a04-96c3-abf295f5da2d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1309 microversion: 2.1 time: 0.585418 Jul 25 16:23:35.170862 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1775/3612] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:34 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1309 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:35.302107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:35.317753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11492274-918d-48f1-87d1-ee779d4bcef8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.405335 Jul 25 16:23:35.319693 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1838/3613] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:34 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:35.343663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:35.344586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:35.361762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:35.374911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.385793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:35.386354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.550473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:35.553781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:35.580587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:35.584810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.586668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:35.593501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.662074 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae713dc0-da64-42b3-a2da-90e6c91acb69 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.322152 Jul 25 16:23:35.670544 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1776/3614] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:35 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:35.709902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:35.714388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:35.752301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:35.753452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.755030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:35.756072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:35.854500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:35.888517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:35.895166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:35.896958 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9adab91-7c09-4a8f-bb4e-e29eeb1ab71b tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.361126 Jul 25 16:23:35.906892 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1839/3615] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:35 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:35.918011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecb93d17-a6dd-423d-a25a-e706e7ce9ee2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d9282aee0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:36.011883 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecb93d17-a6dd-423d-a25a-e706e7ce9ee2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.102964 Jul 25 16:23:36.020168 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1840/3616] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:35 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:36.030076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a783842-0a6e-4c04-b0a8-2f6eef65e473 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d9288be50>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:36.124873 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a783842-0a6e-4c04-b0a8-2f6eef65e473 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.103687 Jul 25 16:23:36.126004 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1841/3617] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:36 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:36.199742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:36.200616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:36.216750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:36.217572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:36.218577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:36.219230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:36.627117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:36.662222 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16ca0537-c157-4eed-9ffa-dfd5e31270dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1678 microversion: 2.1 time: 0.985128 Jul 25 16:23:36.664442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1777/3618] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:35 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1678 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:36.842779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:36.860981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2908e2f-531d-4544-b012-f2db16e3ce65 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1297 microversion: 2.1 time: 0.663439 Jul 25 16:23:36.890417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-13a14be0-11e4-46de-8db4-4ee9d2a4407f req-7f8c8363-8567-4965-a522-fc6ee9552e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "name": "network-vif-plugged", "status": "completed", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:36.895460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1842/3619] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:36 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1297 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:36.907211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-13a14be0-11e4-46de-8db4-4ee9d2a4407f req-7f8c8363-8567-4965-a522-fc6ee9552e42 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:36.907953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-13a14be0-11e4-46de-8db4-4ee9d2a4407f req-7f8c8363-8567-4965-a522-fc6ee9552e42 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:36.922455 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-13a14be0-11e4-46de-8db4-4ee9d2a4407f req-7f8c8363-8567-4965-a522-fc6ee9552e42 service nova] Creating event network-vif-plugged:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:23:36.935325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:36.936237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:36.944349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-13a14be0-11e4-46de-8db4-4ee9d2a4407f req-7f8c8363-8567-4965-a522-fc6ee9552e42 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061122 Jul 25 16:23:36.947183 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1778/3620] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:36.950094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:36.950938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:36.952323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:36.952884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:37.036217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-06e1d23e-6aa0-43ac-9216-66c52d55ebfb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da4a85a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:37.057488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:37.077226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:37.078534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:37.080090 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f3b5d147-7daf-43f4-841b-554ca225528f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.150881 Jul 25 16:23:37.091055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1843/3621] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:36 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:23:37.143086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99580de4-3724-48d7-93cf-243368ecf421 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92fe8c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:37.146159 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-06e1d23e-6aa0-43ac-9216-66c52d55ebfb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.107903 Jul 25 16:23:37.146871 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1779/3622] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:37 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:37.214058 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99580de4-3724-48d7-93cf-243368ecf421 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.077861 Jul 25 16:23:37.215651 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1844/3623] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:37 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:37.687403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:37.689375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:37.699170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:37.700223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:37.702896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:37.704569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:37.888080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:37.888693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:37.913257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:37.913723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:37.914536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:37.915010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:38.348609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:38.357028 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67da3eec-ee24-42fe-aeec-5ae9bb4840b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1658 microversion: 2.1 time: 0.675435 Jul 25 16:23:38.362430 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1780/3624] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:37 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1658 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:38.378241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:38.378867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:38.399689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:38.403209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:38.410052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:38.411147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:38.574313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:38.587166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:38.589407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:38.596797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:38.621203 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8cdd3a14-c6d4-4dda-aab1-5c528077e01a tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1297 microversion: 2.1 time: 0.738281 Jul 25 16:23:38.624261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26c4e997-99fb-441e-9b6f-f20d2f98a68f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.260604 Jul 25 16:23:38.632123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1845/3625] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:37 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1297 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:38.632602 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1781/3626] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:38 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:38.643804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9492328-e9da-4db4-8369-668e24262ae3 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92e2faf0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:38.650637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-435879f3-2823-44d4-b1fd-970aba9066b4 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e42dc0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:38.797656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9492328-e9da-4db4-8369-668e24262ae3 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.163606 Jul 25 16:23:38.800037 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1782/3627] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:38 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:38.816446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:38.818319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:38.834339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:38.834501 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-435879f3-2823-44d4-b1fd-970aba9066b4 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.198022 Jul 25 16:23:38.835343 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1846/3628] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:38 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:38.836212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:38.839225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:38.841634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.011340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2061aef9-e0f1-4965-a097-87f89c4db084 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.208403 Jul 25 16:23:39.012532 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1783/3629] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:23:38 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:23:39.028925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:39.032457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:39.064253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:39.065059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.072614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:39.074621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.659952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:39.660746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:39.675873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:39.676330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.677213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:39.677706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.750451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:39.763324 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25e8d41c-7aea-48b7-a667-54333c996f62 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1665 microversion: 2.1 time: 0.746334 Jul 25 16:23:39.767228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1847/3630] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:39 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1665 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:39.776918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:39.778062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:39.786324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:39.787373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.788603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:39.789389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:39.833637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:39.855620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:39.860566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:39.865221 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1c7fa62-d748-4cd1-9f80-4740b9a9417f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.210785 Jul 25 16:23:39.868246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1784/3631] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:39 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:39.898895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35d8e111-8083-48bc-b364-464793ef122a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da49a24c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:39.981524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:40.004878 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35d8e111-8083-48bc-b364-464793ef122a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.131519 Jul 25 16:23:40.007656 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1785/3632] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:39 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:40.021906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1119363-6e67-4ea0-b5b4-d4a607c9262d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da4ac9af0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:40.113870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1119363-6e67-4ea0-b5b4-d4a607c9262d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.104419 Jul 25 16:23:40.115889 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1786/3633] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:40 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:40.289705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:40.305554 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-536dc509-1523-4a50-814b-e91fce74bc6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1297 microversion: 2.1 time: 0.535513 Jul 25 16:23:40.324850 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1848/3634] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:39 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1297 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:40.797427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:40.812640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:40.830542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:40.831575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:40.832403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:40.832850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:40.895232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:40.896353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:40.924117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:40.924632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:40.925828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:40.933649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:41.225179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:41.245472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:41.248274 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80bc6d99-da21-4dcd-9dae-dcc71485f7e1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.464032 Jul 25 16:23:41.248987 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1787/3635] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:40 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:41.268703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e004db45-1125-4e5c-85de-509f8906c90b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92dc7040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:41.274222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:41.277443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:41.291969 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00753c61-a6cd-4831-a5e9-76e29bc34651 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.398594 Jul 25 16:23:41.299536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1849/3636] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:40 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:41.321402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-42b08731-5908-4496-87dd-28d25c66bd77 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d9282a790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:41.424734 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e004db45-1125-4e5c-85de-509f8906c90b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.167112 Jul 25 16:23:41.426400 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1788/3637] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:41 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:41.446643 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-42b08731-5908-4496-87dd-28d25c66bd77 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1417 microversion: 2.1 time: 0.142719 Jul 25 16:23:41.447809 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1850/3638] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:41 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1417 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:41.448792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:41.449373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:41.456866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:41.469526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:41.471136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:41.471572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:41.479748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:41.480310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:41.497146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:41.505623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:41.510996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:41.515798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:41.953652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:41.970264 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b2568daf-0536-4f76-866f-140558826a5b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.541137 Jul 25 16:23:41.971126 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1789/3639] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:41 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:41.996176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:41.996796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:42.011898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:42.012347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:42.013182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:42.013648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:42.061798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:42.077193 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9d07dedc-7bae-4b8c-aeaf-834a3f83d3d2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1297 microversion: 2.1 time: 0.628000 Jul 25 16:23:42.077839 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1851/3640] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:41 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1297 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:42.326896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:42.329707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:42.350842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:42.353737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:42.354962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:42.355396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:42.356675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:42.372365 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-faf44593-fa88-4906-ba63-d5b4ceab61d7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.380726 Jul 25 16:23:42.373189 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1790/3641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:41 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:42.394719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:42.395338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:42.406842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:42.407419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:42.408203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:42.408641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:42.411809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:SELECT=91 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:42.526980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:42.547120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:42.558227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:42.561480 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a6fc87bf-b9bb-4cc9-81f8-3fc58c93444e tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.237727 Jul 25 16:23:42.577930 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1852/3642] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:42 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:42.590907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50c31180-9e43-4981-8920-823e205d678b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d928349d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:42.782660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:42.794222 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b45c7bdc-dd8c-4f6e-bfb2-f47329713bda tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.403102 Jul 25 16:23:42.795128 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1791/3643] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:42 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:23:42.800539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9a33ddf-fe3b-4757-a67b-d6e117002993 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92de0f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:52.341837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:52.406514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:52.532117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=79 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:52.590371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50c31180-9e43-4981-8920-823e205d678b tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 10.018690 Jul 25 16:23:52.593307 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1853/3644] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:42 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 10022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:52.612825 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9a33ddf-fe3b-4757-a67b-d6e117002993 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1426 microversion: 2.1 time: 9.816413 Jul 25 16:23:52.616289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1792/3645] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:42 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1426 bytes in 9820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:52.622454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:52.623073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:52.631775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:52.632528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:52.633512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:52.634113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:52.634385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:52.635017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:52.648343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:52.650151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:52.654835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:52.655294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:52.989630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:53.008388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0bdf8913-73fa-4a3d-b955-06e1ffc4dd4a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.413407 Jul 25 16:23:53.012987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1854/3646] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:52 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:53.024186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:53.024674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:53.024920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:53.039971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.041136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.042276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.045953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.050273 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-107d8268-5f9c-4e7e-a974-678515faa3b5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1297 microversion: 2.1 time: 0.418709 Jul 25 16:23:53.050988 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1793/3647] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:52 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1297 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:53.149245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:53.158359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:53.165452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:53.167878 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b221adeb-0092-47d8-8ce9-9f9572d8b3d4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.152056 Jul 25 16:23:53.168748 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1855/3648] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:53 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:53.175255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-437c888e-3fa6-43aa-84fc-a40f10b702df req-8bdee1d4-d713-4763-8e6c-a46a5212e7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc212827-9380-4526-8c8a-ec4a67bf3b6a", "name": "network-vif-plugged", "status": "completed", "tag": "97fe1faf-df0e-473e-9146-1d9129e7bd6e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:53.194317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-437c888e-3fa6-43aa-84fc-a40f10b702df req-8bdee1d4-d713-4763-8e6c-a46a5212e7e1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.194998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-437c888e-3fa6-43aa-84fc-a40f10b702df req-8bdee1d4-d713-4763-8e6c-a46a5212e7e1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.224669 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-437c888e-3fa6-43aa-84fc-a40f10b702df req-8bdee1d4-d713-4763-8e6c-a46a5212e7e1 service nova] Creating event network-vif-plugged:97fe1faf-df0e-473e-9146-1d9129e7bd6e for instance dc212827-9380-4526-8c8a-ec4a67bf3b6a on n-h1-846219-13 Jul 25 16:23:53.239568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-437c888e-3fa6-43aa-84fc-a40f10b702df req-8bdee1d4-d713-4763-8e6c-a46a5212e7e1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066242 Jul 25 16:23:53.245466 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1856/3649] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:53.251261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e0d7997-3b40-44cc-97e5-2135be887d82 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927d64c0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:53.335494 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e0d7997-3b40-44cc-97e5-2135be887d82 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 200 len: 1426 microversion: 2.1 time: 0.088503 Jul 25 16:23:53.336030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1857/3650] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:53 2022] GET /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:53.343880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:53.344708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:53.371540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.372065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.375036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.377531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.465836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-652281582", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": "none"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:53.540213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:23:53.540831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:23:53.541541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:23:53.542155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:23:53.543049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:23:53.564774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.567945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.569081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:53.572124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:53.626856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Getting quotas for project dc3d826209694e65a624a80dbeca34b7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:53.629930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:53.640730 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecea6606-8018-445f-8c03-61ca27a2b991 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.303615 Jul 25 16:23:53.642148 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1858/3651] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:53 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:53.643583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Getting quotas for user 49917a9d00824e7f8cc2edc8c2852ba1 and project dc3d826209694e65a624a80dbeca34b7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:53.661378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85a371fe-e9e8-4a74-97da-3761a1803601 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927c9310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:53.689479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:23:53.696098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:23:53.797371 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eaec962f-1f92-47c1-afdd-9f003fb9c92e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.57 time: 0.724477 Jul 25 16:23:53.798256 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1794/3652] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:23:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:23:53.827170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2fa95a65-d706-4766-b5b8-25582a3c472a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92e3e160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:55.372278 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85a371fe-e9e8-4a74-97da-3761a1803601 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 204 len: 0 microversion: 2.1 time: 1.728746 Jul 25 16:23:55.372886 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1859/3653] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:53 2022] DELETE /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 0 bytes in 1730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:23:55.383104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:55.384026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:55.406392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:55.407240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:55.408307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:55.408961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:55.464086 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2fa95a65-d706-4766-b5b8-25582a3c472a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 1.652522 Jul 25 16:23:55.469469 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1795/3654] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:53 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:55.474526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:55.477943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:55.490480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:55.498240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:55.500063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:55.500728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:55.552903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.567616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.570020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.581638 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-313e8d03-a618-4187-aad0-e6b629823eb8 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1276 microversion: 2.57 time: 0.192932 Jul 25 16:23:55.582682 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1860/3655] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:55 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:55.593762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:55.596426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:55.612064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:55.614942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:55.617195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:55.626541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:55.936623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.958754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.964262 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b852bde0-4ccf-4202-9cb7-777cf0ef6408 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1297 microversion: 2.1 time: 0.492945 Jul 25 16:23:55.965571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1796/3656] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:55 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1297 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:55.981423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.981423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:55.981423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e7a39fe-fcd5-4342-a4e6-ee8a0ddcd468 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.395030 Jul 25 16:23:55.981423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1861/3657] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:55 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:56.005654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:56.014074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:56.040288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:56.045624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:56.052066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:56.053702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:56.141288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:23:56.371700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bff91ae0-fa1a-480c-81c3-fb57db834774 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 204 len: 0 microversion: 2.1 time: 0.369890 Jul 25 16:23:56.372408 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1862/3658] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:23:55 2022] DELETE /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:23:56.484251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7c8a3a8-ff87-445d-8ad3-b106be1e48a6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da02481f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:56.592566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7c8a3a8-ff87-445d-8ad3-b106be1e48a6 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.115430 Jul 25 16:23:56.598562 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1797/3659] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:56 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:56.625989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:56.628376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:56.646472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:56.650068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:56.651094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:56.651683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:56.671077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1832548143", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2d092cd9-2c7a-465d-800a-441e40e4458e"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:56.766971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:56.794841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:56.801282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:56.803404 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-688a7f12-9c31-4480-8eec-86a145ede8a7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1338 microversion: 2.57 time: 0.200685 Jul 25 16:23:56.808941 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1863/3660] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:56 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1338 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:56.839753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] validate_networks() for [('2d092cd9-2c7a-465d-800a-441e40e4458e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:23:56.872551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5152c67e-6142-4951-98ba-3a071bddefa9 req-a80ebad0-2673-4cc4-8ea0-79bd2f124a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a03699d-344b-418e-b91f-4b56f275b9cf", "name": "network-vif-unplugged", "status": "completed", "tag": "c6b22d2b-fcd4-4eb1-9395-9e5f23656c74"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:23:56.902918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5152c67e-6142-4951-98ba-3a071bddefa9 req-a80ebad0-2673-4cc4-8ea0-79bd2f124a8f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:56.907443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5152c67e-6142-4951-98ba-3a071bddefa9 req-a80ebad0-2673-4cc4-8ea0-79bd2f124a8f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:56.945977 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5152c67e-6142-4951-98ba-3a071bddefa9 req-a80ebad0-2673-4cc4-8ea0-79bd2f124a8f service nova] Creating event network-vif-unplugged:c6b22d2b-fcd4-4eb1-9395-9e5f23656c74 for instance 2a03699d-344b-418e-b91f-4b56f275b9cf on n-h2-846219-13 Jul 25 16:23:56.965347 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5152c67e-6142-4951-98ba-3a071bddefa9 req-a80ebad0-2673-4cc4-8ea0-79bd2f124a8f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106239 Jul 25 16:23:56.974647 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1864/3661] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:57.003493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:57.006014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:57.025898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:57.030312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:57.032442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:57.035417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:57.870569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:57.884288 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da58dc27-0b3c-4128-9682-22f04c65b277 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1488 microversion: 2.1 time: 0.887558 Jul 25 16:23:57.902111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1865/3662] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:56 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1488 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:57.912256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:57.912882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:57.924064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:57.924508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:57.926878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:57.927328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.166623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.175726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.177776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.179179 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b616708-ccd6-426e-83d2-6476994caa76 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.275949 Jul 25 16:23:58.179856 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1866/3663] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:57 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:58.184957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-721d5267-bf2e-4ff1-836c-2648207d5dff tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d927d6040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:58.238930 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-721d5267-bf2e-4ff1-836c-2648207d5dff tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.057464 Jul 25 16:23:58.240537 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1867/3664] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:58 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:58.254471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:58.255502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:58.275428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:58.276164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.277305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:58.278056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.299329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:23:58.300027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:23:58.300849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:23:58.301299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:23:58.301719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:23:58.332305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:58.332747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.339015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:58.339702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.363726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:23:58.380340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for user ccbaed5ca4f5414b9e06fa95dbbac29c and project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:23:58.388512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.404062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.406107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.411326 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f938880-2b62-466a-8945-31a81d89e62d tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1338 microversion: 2.57 time: 0.158537 Jul 25 16:23:58.412049 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1868/3665] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:58 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1338 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:58.417435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:23:58.420775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:23:58.422836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:58.425640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:58.438125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:58.442516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.442905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:58.444881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:58.510461 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b897611c-d236-497f-9a28-ff2e5f8da18f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.847408 Jul 25 16:23:58.511344 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1798/3666] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:23:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:23:58.551864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9475b562-891f-4ec9-b0cb-26f1cfb4ff97 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:58.552498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9475b562-891f-4ec9-b0cb-26f1cfb4ff97 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:58.730263 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91b9918a-44b4-40e6-9d75-c4ff1546c04b tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.316797 Jul 25 16:23:58.731627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1869/3667] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:23:58 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:23:58.741555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9475b562-891f-4ec9-b0cb-26f1cfb4ff97 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:58.752855 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9475b562-891f-4ec9-b0cb-26f1cfb4ff97 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1212 microversion: 2.1 time: 0.228393 Jul 25 16:23:58.773781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1799/3668] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:58 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1212 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:59.209897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:59.211355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:59.226826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:59.234977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:59.236164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:59.239936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:59.256319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-282c10b2-3e44-4e9e-8ef6-1efa3a3cd2a7 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92e3e940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:59.385408 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-282c10b2-3e44-4e9e-8ef6-1efa3a3cd2a7 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.133155 Jul 25 16:23:59.390659 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1800/3669] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:23:59 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:23:59.437838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:59.438979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:59.467572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:59.469618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:59.471930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:59.474426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:59.538142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:59.550041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:59.551970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:59.553292 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dd66a527-4ce2-4fcd-8d3c-6803b00145d9 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.348527 Jul 25 16:23:59.569189 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1870/3670] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:59 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:59.750479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:59.770232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:59.772366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:23:59.774826 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60efcacb-b050-47f0-9052-5176322a7ef4 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1338 microversion: 2.57 time: 0.342446 Jul 25 16:23:59.788103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:23:59.789320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:23:59.805519 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1801/3671] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:23:59 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1338 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:23:59.827743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:59.828926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:59.829932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:59.830584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:00.108614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:00.126798 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d1c83602-2431-4d15-a5ee-1ac4343d730a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1216 microversion: 2.1 time: 0.349280 Jul 25 16:24:00.128072 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1871/3672] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:23:59 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1216 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:00.412091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d16a9f1-2507-4329-bf1c-eb2755ec7658 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9da4ac9700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:00.464746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b9fd58f1-e7c6-44ab-8239-0e1c474d619e req-b9a8da75-f5ae-4e31-89c1-7917c7c2f7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a03699d-344b-418e-b91f-4b56f275b9cf", "name": "network-vif-deleted", "tag": "c6b22d2b-fcd4-4eb1-9395-9e5f23656c74"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:00.516308 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d16a9f1-2507-4329-bf1c-eb2755ec7658 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.115772 Jul 25 16:24:00.520423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b9fd58f1-e7c6-44ab-8239-0e1c474d619e req-b9a8da75-f5ae-4e31-89c1-7917c7c2f7fb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:00.522944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b9fd58f1-e7c6-44ab-8239-0e1c474d619e req-b9a8da75-f5ae-4e31-89c1-7917c7c2f7fb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:00.526618 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1802/3673] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:00 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:00.549073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b9fd58f1-e7c6-44ab-8239-0e1c474d619e req-b9a8da75-f5ae-4e31-89c1-7917c7c2f7fb service nova] Creating event network-vif-deleted:c6b22d2b-fcd4-4eb1-9395-9e5f23656c74 for instance 2a03699d-344b-418e-b91f-4b56f275b9cf on n-h2-846219-13 Jul 25 16:24:00.560027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b9fd58f1-e7c6-44ab-8239-0e1c474d619e req-b9a8da75-f5ae-4e31-89c1-7917c7c2f7fb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101680 Jul 25 16:24:00.562646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1872/3674] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:00.578677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:00.579619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:00.589790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:00.590641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:00.591777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:00.592399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:00.779345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:00.808412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:00.812309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:00.814393 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c3ed337-3803-4c52-b5f9-ec2171327fdd tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.240400 Jul 25 16:24:00.814536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:00.815268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:00.827889 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1803/3675] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:00 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:00.844016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:00.849141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:00.852502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:00.853291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.052591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:01.121745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:01.123451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:01.124740 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b462968-3660-4b48-b7e4-66b914123eb7 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1359 microversion: 2.57 time: 0.315288 Jul 25 16:24:01.146221 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1873/3676] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:00 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:01.150517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:01.151432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:01.168098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.169386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.170627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.171305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.174207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:01.183629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:01.207962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.208474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.209330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.213042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.230954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:01.366915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:01.391726 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-617ef4d0-be25-4c6c-8a0d-8a00da99d59d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1272 microversion: 2.1 time: 0.243064 Jul 25 16:24:01.398121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1804/3677] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:01 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:01.440402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:24:01.440827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:24:01.441337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:24:01.441748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:24:01.442266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:24:01.532836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-200a8cbd-f31d-4b6b-b140-7fe73a2aae7f tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92de0d30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:01.611678 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-200a8cbd-f31d-4b6b-b140-7fe73a2aae7f tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.079782 Jul 25 16:24:01.615111 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1805/3678] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:01 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:01.629605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:01.630431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:01.638228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:01.652960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.653456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.655128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.657854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.666352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.671815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.677883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.679476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.718599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-54ff3ab3-7171-4f82-8489-943ade886dcf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "POST /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2/action" status: 202 len: 1140 microversion: 2.57 time: 0.559983 Jul 25 16:24:01.737253 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1874/3679] 10.222.0.105 () {62 vars in 1325 bytes} [Mon Jul 25 16:24:01 2022] POST /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2/action => generated 1140 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Jul 25 16:24:01.747274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-76d15246-3a00-4a10-98f9-2c7c82f55789 req-48a5196a-c2fc-4237-a422-7e25ba655e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc212827-9380-4526-8c8a-ec4a67bf3b6a", "tag": "97fe1faf-df0e-473e-9146-1d9129e7bd6e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:01.769843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-76d15246-3a00-4a10-98f9-2c7c82f55789 req-48a5196a-c2fc-4237-a422-7e25ba655e56 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.770340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-76d15246-3a00-4a10-98f9-2c7c82f55789 req-48a5196a-c2fc-4237-a422-7e25ba655e56 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.809285 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-76d15246-3a00-4a10-98f9-2c7c82f55789 req-48a5196a-c2fc-4237-a422-7e25ba655e56 service nova] Creating event network-changed:97fe1faf-df0e-473e-9146-1d9129e7bd6e for instance dc212827-9380-4526-8c8a-ec4a67bf3b6a on n-h1-846219-13 Jul 25 16:24:01.820392 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-76d15246-3a00-4a10-98f9-2c7c82f55789 req-48a5196a-c2fc-4237-a422-7e25ba655e56 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081740 Jul 25 16:24:01.824724 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1875/3680] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:01.830459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:01.837080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:01.866247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.875043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:01.876976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:01.877619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:02.198742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.214967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.217452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.245592 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94bb690a-1389-4b77-a353-824ca347c637 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.419427 Jul 25 16:24:02.254586 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1876/3681] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:01 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:02.259754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:02.269842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:02.286744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:02.288303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:02.289724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:02.290847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:02.581528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.600855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.603487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.609426 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-825a5a71-a101-4183-b76e-c011fb38eea5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.351932 Jul 25 16:24:02.610930 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1877/3682] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:02 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:02.627804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:02.628539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:02.666812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:02.667483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:02.677771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:02.685918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:02.748560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.769184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-275289d7-a44d-4b80-aae4-90d8371d01f3 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1488 microversion: 2.1 time: 1.146939 Jul 25 16:24:02.771887 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1806/3683] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:01 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1488 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:02.789363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-734529cc-b6c4-4784-afc7-23003fdf05e2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92df5ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:02.881369 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-734529cc-b6c4-4784-afc7-23003fdf05e2 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1434 microversion: 2.1 time: 0.104724 Jul 25 16:24:02.882623 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1807/3684] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:02 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1434 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:02.916680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:02.943656 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a215d421-8909-4b01-adc2-42e85628a056 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1270 microversion: 2.1 time: 0.315953 Jul 25 16:24:02.945275 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1878/3685] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:02 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1270 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:03.281138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:03.282658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:03.296484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:03.296934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:03.298108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:03.298666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:03.381004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:03.393397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:03.397373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:03.401058 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21dcdca3-551b-4b15-9567-c541199f4805 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.123990 Jul 25 16:24:03.417123 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1808/3686] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:03 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:03.669042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:03.669894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:03.683583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:03.684115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:03.685016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:03.685947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:03.898588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b85506ed-1bc2-43b1-847f-1c0aee1ab445 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92df5040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:03.910374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:03.942821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:03.947947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:03.953311 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-741263a0-32c0-4178-8519-8899bd926409 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1410 microversion: 2.54 time: 0.288532 Jul 25 16:24:03.958162 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1879/3687] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:03 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1410 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:03.974511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:03.975327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:03.995303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:03.997524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:04.002558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:04.004118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:04.005597 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b85506ed-1bc2-43b1-847f-1c0aee1ab445 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1443 microversion: 2.1 time: 0.112061 Jul 25 16:24:04.006283 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1809/3688] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:03 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:04.028039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bdd8cdfb-8351-42da-b679-2df93e8abc9a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d93cff700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:04.147505 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bdd8cdfb-8351-42da-b679-2df93e8abc9a tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 200 len: 1443 microversion: 2.1 time: 0.127151 Jul 25 16:24:04.149472 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1810/3689] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:04 2022] GET /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 1443 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:04.161656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:04.162280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:04.178030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:04.178682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:04.179513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:04.185503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:04.511742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:04.521371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-550086be-4112-46db-8023-352994b16d39 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.554805 Jul 25 16:24:04.535114 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1880/3690] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:03 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:04.542985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:04.543951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:04.551544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:04.552208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:04.553231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:04.553865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:04.592286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:04.602133 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0125c48-2b19-4231-8bfd-447eeecfb672 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1469 microversion: 2.1 time: 0.444416 Jul 25 16:24:04.603141 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1811/3691] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:04 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:04.637530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-542ade9c-0a41-4ae9-8d3a-2e4f0d6f687e tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d92de01f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:04.651670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:04.666414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:04.668269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:04.669378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c81ea5a3-5705-4bde-802f-aa816cc47b65 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.132836 Jul 25 16:24:04.670111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1881/3692] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:04 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:04.987675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:04.988354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:05.002534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.002917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.003881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.004314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.122993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.154394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.159915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.161645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3207bde9-eb5f-40b7-9df7-faf8b7e95a79 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1416 microversion: 2.54 time: 0.182734 Jul 25 16:24:05.163475 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1882/3693] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:04 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1416 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:05.458009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-531c112f-9c5a-4da9-a93a-799cacd4f866 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Action: 'create', calling method: .version_select at 0x7f9d9280fdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-912625498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/G46yzLkSOD6Lzp8JSWqvdB+NVjqn2zRK9o+/kFEuXwkpO35jAf2r0yiF0pH901rl32EEWCeqQjxNjUGifZvdT2VUQO9bHUi1IvUBOM3RXHz7afC+JTCEOd54WKmvzKA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:05.481030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-531c112f-9c5a-4da9-a93a-799cacd4f866 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Getting quotas for project eeb296addf4b46fda315d22fca210662. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:05.492090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-531c112f-9c5a-4da9-a93a-799cacd4f866 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Getting quotas for user be5761637f9b43c3bc4d0008579ed6b3 and project eeb296addf4b46fda315d22fca210662. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:05.525798 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-531c112f-9c5a-4da9-a93a-799cacd4f866 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.360951 Jul 25 16:24:05.526433 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1883/3694] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:05.532894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0021de38-58ef-47bd-8eea-bed51c6bb844 req-b8e1a880-4f11-4bfc-91ac-83ba30438cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49458875-c2e2-478b-8b53-82e8674dd042", "tag": "bf899014-1c65-47ce-bcdc-0d18a8fcc213"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:05.560020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0021de38-58ef-47bd-8eea-bed51c6bb844 req-b8e1a880-4f11-4bfc-91ac-83ba30438cf4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.560660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0021de38-58ef-47bd-8eea-bed51c6bb844 req-b8e1a880-4f11-4bfc-91ac-83ba30438cf4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.577590 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0021de38-58ef-47bd-8eea-bed51c6bb844 req-b8e1a880-4f11-4bfc-91ac-83ba30438cf4 service nova] Creating event network-changed:bf899014-1c65-47ce-bcdc-0d18a8fcc213 for instance 49458875-c2e2-478b-8b53-82e8674dd042 on n-h2-846219-13 Jul 25 16:24:05.585014 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0021de38-58ef-47bd-8eea-bed51c6bb844 req-b8e1a880-4f11-4bfc-91ac-83ba30438cf4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056162 Jul 25 16:24:05.586888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1884/3695] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:05.595033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:05.596163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:05.607462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.608233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.610697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.611710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.754353 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-542ade9c-0a41-4ae9-8d3a-2e4f0d6f687e tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "DELETE /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7" status: 204 len: 0 microversion: 2.1 time: 1.121224 Jul 25 16:24:05.757992 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1812/3696] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:04 2022] DELETE /compute/v2.1/images/bff92f3c-2a01-4fe2-a732-b19bb0a137d7 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:24:05.760575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:05.761342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:05.769409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.769947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.771178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:05.771787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:05.901630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.921306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.934137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.937876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:05.939226 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2629164-a406-4d70-975d-c5219636b42c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.182832 Jul 25 16:24:05.941280 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04393519-75c0-4ddf-adfe-cdcb3934dfc6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.352451 Jul 25 16:24:05.942203 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1885/3697] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:05 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:05.943853 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1813/3698] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:05 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:05.950532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de2fe3bc-761c-426c-a306-0f9eea475ac5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '.version_select at 0x7f9d9280f5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:05.987651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-de2fe3bc-761c-426c-a306-0f9eea475ac5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] HTTP exception thrown: Image not found. Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de2fe3bc-761c-426c-a306-0f9eea475ac5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Request method failure captured: Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 HTTP/1.1 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNFLNzeOsljRMmCBgu8oFCJT9STJhAeP4wGkkqY9IHXDpJFMAaerCvM-1-UAAAiZG7HqeLqEAGmwzzrODxTvKnd2cmes5rGDpOqF8J8jIVHFtpvQo7oHIleLaDSsyz-jBTV3dvB5yFMTLMvNa5Z9AJHR25LqmhCxwn1xNGjbza-Ljs Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: a1eb0d89d327413882079e42507cc344 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a1eb0d89d327413882079e42507cc344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a1eb0d89d327413882079e42507cc344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a1eb0d89d327413882079e42507cc344"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a1eb0d89d327413882079e42507cc344"}]}] Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: a1eb0d89d327413882079e42507cc344 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesOneServerTestJSON-1906100308-project Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 42600aeea8e04827be40f6ac81b4c40d Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesOneServerTestJSON-1906100308-project Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5a68accf-0220-4f82-b61b-0cbb3d6c16a5'} Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a68accf-0220-4f82-b61b-0cbb3d6c16a5 to delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a68accf-0220-4f82-b61b-0cbb3d6c16a5 could not be found. Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.994179 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de2fe3bc-761c-426c-a306-0f9eea475ac5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:05.997402 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de2fe3bc-761c-426c-a306-0f9eea475ac5 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "DELETE /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5" status: 404 len: 62 microversion: 2.1 time: 0.053870 Jul 25 16:24:06.002053 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1886/3699] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:05 2022] DELETE /compute/v2.1/images/5a68accf-0220-4f82-b61b-0cbb3d6c16a5 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:24:06.010318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:06.011001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:06.017651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.018333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.019293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.019898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.062588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:24:06.195080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67414a4b-cfb1-4f51-9043-de8153e4f735 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 204 len: 0 microversion: 2.1 time: 0.179687 Jul 25 16:24:06.195552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:06.195876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:06.197943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1814/3700] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:24:06 2022] DELETE /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:24:06.209526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.210670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.212387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.213475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.216344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:06.217363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:06.229494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.229776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.234228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.235051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.319569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:06.328679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:06.330639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:06.331846 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b03773f-319c-46d0-8788-e255c24697b7 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1416 microversion: 2.54 time: 0.143636 Jul 25 16:24:06.332692 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1887/3701] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:06 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:06.567551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:06.578647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2e94dce-d0c5-46f8-bc4d-140c1701b0d0 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1475 microversion: 2.1 time: 0.375671 Jul 25 16:24:06.580033 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1815/3702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:06 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:06.980188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:06.980989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:06.982995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:06.984339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:06.991694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.992416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:06.993571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:06.994461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.004507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:07.005817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.006749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:07.007266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.147932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.158169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.160334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.161620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6a10272b-d628-42c6-a358-6264e85c4a8c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.187212 Jul 25 16:24:07.162667 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1888/3703] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:06 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:07.357913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:07.358957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:07.366389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:07.367243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.368085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:07.368719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.385141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.395923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3e7cb82-778a-44bd-9d66-4e797dad0ef6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.420680 Jul 25 16:24:07.398161 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1816/3704] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:06 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:07.605565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:07.606637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:07.616224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:07.616819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.618048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:07.618706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:07.903956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.914436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.916407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:07.917744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4fe581c-5d10-40e7-9aa6-5193984c9bb5 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1416 microversion: 2.54 time: 0.563704 Jul 25 16:24:07.918543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1889/3705] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:07 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1416 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:08.063946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:08.073928 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cafcfeeb-195a-4380-a25e-f70588964157 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1475 microversion: 2.1 time: 0.477525 Jul 25 16:24:08.074764 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1817/3706] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:07 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1475 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:08.186393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:08.187081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:08.195378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:08.195616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:08.196374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:08.196810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:08.309735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:08.319553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:08.321143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:08.322620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab013546-82a5-476a-94d1-3fad8fa94c32 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.140371 Jul 25 16:24:08.323232 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1890/3707] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:08 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:08.420152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:08.420915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:08.423674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:08.432121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:08.432932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:08.434449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:08.435192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:08.454981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:08.656516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:08.668744 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-70b91847-62f9-4364-bfc2-7bcc5092afb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.252484 Jul 25 16:24:08.669517 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1818/3708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:08 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:08.948114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:08.948915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:08.974054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:08.974460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:08.977780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:08.978745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:09.101683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:09.102512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:09.110331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=14 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:09.115040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:09.115514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:09.116320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:09.118445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:09.202944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:09.220669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:09.229703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:09.230979 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2d201380-db3e-4ea8-8588-0877c2069ad4 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1416 microversion: 2.54 time: 0.290639 Jul 25 16:24:09.241130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1891/3709] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:08 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1416 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:09.365750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7722d52d-9254-4e26-bcd9-a2e55eb56f1d req-5589beee-490e-45f1-9307-9d3d27193b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "name": "network-vif-unplugged", "status": "completed", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:09.383308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7722d52d-9254-4e26-bcd9-a2e55eb56f1d req-5589beee-490e-45f1-9307-9d3d27193b2f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:09.384018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7722d52d-9254-4e26-bcd9-a2e55eb56f1d req-5589beee-490e-45f1-9307-9d3d27193b2f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:09.390305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:09.408069 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7722d52d-9254-4e26-bcd9-a2e55eb56f1d req-5589beee-490e-45f1-9307-9d3d27193b2f service nova] Creating event network-vif-unplugged:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:24:09.420678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7722d52d-9254-4e26-bcd9-a2e55eb56f1d req-5589beee-490e-45f1-9307-9d3d27193b2f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186001 Jul 25 16:24:09.424711 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1892/3710] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:09.441717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:09.450956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:09.491756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:09.495726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:09.500872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:09.501947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:09.955917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:09.969926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:09.971559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:09.972786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0394a52-cbb9-452d-b774-e2ad7379af0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.541053 Jul 25 16:24:09.973394 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1893/3711] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:09 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:09.985407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:09.994975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:10.012252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.012712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.013549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.014120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.060099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:10.077639 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d096d3f4-efde-4cd8-8853-50a9fb348349 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1475 microversion: 2.1 time: 0.984158 Jul 25 16:24:10.081670 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1819/3712] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:09 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1475 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:10.263532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:10.276432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:10.294336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.297018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.299749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.300326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.487239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:10.537936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:10.548557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:10.560786 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3b0bbc6-08f3-4640-9dba-e50f171f2281 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1401 microversion: 2.54 time: 0.304922 Jul 25 16:24:10.590731 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1820/3713] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:10 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1401 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:10.601787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26e4ed53-5e08-4d07-8643-360d8aefdbf8 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '.version_select at 0x7f9d92dfa670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:10.646778 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26e4ed53-5e08-4d07-8643-360d8aefdbf8 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-96461710" status: 204 len: 0 microversion: 2.54 time: 0.054218 Jul 25 16:24:10.647540 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1821/3714] 10.222.0.105 () {60 vars in 1318 bytes} [Mon Jul 25 16:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-96461710 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:24:10.662842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:10.666280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:10.676047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.676800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.677810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.678863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.719948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:24:10.769814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:10.779546 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a684eae-f0f8-4e96-baec-a58317777e9c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.804985 Jul 25 16:24:10.792804 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1894/3715] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:09 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:10.931326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35f2c924-7be9-4dea-8576-69746e81cffb tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "DELETE /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 204 len: 0 microversion: 2.54 time: 0.271973 Jul 25 16:24:10.932288 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1822/3716] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:24:10 2022] DELETE /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:24:10.941990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:10.942624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:10.950660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.951700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.952747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:10.953591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:10.998213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:10.998929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:11.029136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.040978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:11.040978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.040978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:11.180847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.181771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.190749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.192912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.194553 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-480b46dd-4d86-4f4e-8162-11eb5808370e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.202235 Jul 25 16:24:11.195547 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1823/3717] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:10 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:24:11.200952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:11.201928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:11.209341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.213784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:11.214706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.215077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:11.216355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.218139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.219478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93f7db25-5ef6-4c7d-a59f-f93753b54f28 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1407 microversion: 2.54 time: 0.283120 Jul 25 16:24:11.220600 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1895/3718] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:10 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:11.238015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f8f4ea47-6ef7-4bfb-9e07-6f093b7ba666 req-ae897751-90a5-4c78-ae84-0e2cd03732ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0aaa0b5-8921-45a7-bb25-183abaff3ef0", "name": "network-vif-deleted", "tag": "733ad574-ad4f-419d-9dbb-20f80c845c6c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:11.249657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f8f4ea47-6ef7-4bfb-9e07-6f093b7ba666 req-ae897751-90a5-4c78-ae84-0e2cd03732ea service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.250485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f8f4ea47-6ef7-4bfb-9e07-6f093b7ba666 req-ae897751-90a5-4c78-ae84-0e2cd03732ea service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:11.263610 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f8f4ea47-6ef7-4bfb-9e07-6f093b7ba666 req-ae897751-90a5-4c78-ae84-0e2cd03732ea service nova] Creating event network-vif-deleted:733ad574-ad4f-419d-9dbb-20f80c845c6c for instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 on n-h2-846219-13 Jul 25 16:24:11.270081 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f8f4ea47-6ef7-4bfb-9e07-6f093b7ba666 req-ae897751-90a5-4c78-ae84-0e2cd03732ea service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047972 Jul 25 16:24:11.274768 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1896/3719] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:11.375147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42600aeea8e04827be40f6ac81b4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eb0d89d327413882079e42507cc344', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:11.385849 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-497b21d6-83d9-41fb-848b-054e37839abb tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 200 len: 1305 microversion: 2.1 time: 0.188865 Jul 25 16:24:11.386742 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1824/3720] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:11 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:11.806171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:11.807067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:11.810506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:11.823267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.825459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:11.830253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:11.830928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.222693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:12.224910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:12.244946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:12.245561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.246733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:12.247176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.287761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.321274 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ccf672f-42a6-44e9-9dca-26e1a88455cc tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.520072 Jul 25 16:24:12.322181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1897/3721] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:11 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:12.335509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:12.342164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:12.356127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:12.356588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.357572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:12.358134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.395101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.405994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.408787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.410508 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0137431a-5d77-47d3-945b-4e772a3a08c2 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.194170 Jul 25 16:24:12.412320 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1825/3722] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:12 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:12.418417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:12.419374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] [instance: d0aaa0b5-8921-45a7-bb25-183abaff3ef0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:12.429657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:12.431340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.432776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:12.433603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:12.459006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] HTTP exception thrown: Instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 could not be found. Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Request method failure captured: Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 HTTP/1.1 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sNFLNzeOsljRMmCBgu8oFCJT9STJhAeP4wGkkqY9IHXDpJFMAaerCvM-1-UAAAiZG7HqeLqEAGmwzzrODxTvKnd2cmes5rGDpOqF8J8jIVHFtpvQo7oHIleLaDSsyz-jBTV3dvB5yFMTLMvNa5Z9AJHR25LqmhCxwn1xNGjbza-Ljs Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a1eb0d89d327413882079e42507cc344 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a1eb0d89d327413882079e42507cc344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a1eb0d89d327413882079e42507cc344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a1eb0d89d327413882079e42507cc344"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a1eb0d89d327413882079e42507cc344"}]}] Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a1eb0d89d327413882079e42507cc344 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1906100308 Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesOneServerTestJSON-1906100308-project Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 42600aeea8e04827be40f6ac81b4c40d Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesOneServerTestJSON-1906100308-project Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 could not be found. Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd0aaa0b5-8921-45a7-bb25-183abaff3ef0'} Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 could not be found. Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 could not be found. Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:12.461624 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 could not be found. Jul 25 16:24:12.468733 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:12.492087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] Returning 404 to user: Instance d0aaa0b5-8921-45a7-bb25-183abaff3ef0 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:12.493589 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71514f09-500e-4069-b8f6-7a49a3fc8464 tempest-ImagesOneServerTestJSON-1906100308 tempest-ImagesOneServerTestJSON-1906100308-project] 10.222.0.105 "GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0" status: 404 len: 111 microversion: 2.1 time: 0.080071 Jul 25 16:24:12.504260 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1826/3723] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:12 2022] GET /compute/v2.1/servers/d0aaa0b5-8921-45a7-bb25-183abaff3ef0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:24:12.531235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.553223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.558244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:12.559654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30ea176d-d002-42a1-99e8-89fe54cfed17 tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1407 microversion: 2.54 time: 0.233263 Jul 25 16:24:12.560245 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1898/3724] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:12 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:13.204252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0867d22c-9fe1-465b-84c3-922637c5a340 req-8303860b-21fe-49b4-a135-7d4646fd747b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49458875-c2e2-478b-8b53-82e8674dd042", "name": "network-vif-plugged", "status": "completed", "tag": "bf899014-1c65-47ce-bcdc-0d18a8fcc213"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:13.252641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0867d22c-9fe1-465b-84c3-922637c5a340 req-8303860b-21fe-49b4-a135-7d4646fd747b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.253145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0867d22c-9fe1-465b-84c3-922637c5a340 req-8303860b-21fe-49b4-a135-7d4646fd747b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:13.309913 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0867d22c-9fe1-465b-84c3-922637c5a340 req-8303860b-21fe-49b4-a135-7d4646fd747b service nova] Creating event network-vif-plugged:bf899014-1c65-47ce-bcdc-0d18a8fcc213 for instance 49458875-c2e2-478b-8b53-82e8674dd042 on n-h2-846219-13 Jul 25 16:24:13.332147 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0867d22c-9fe1-465b-84c3-922637c5a340 req-8303860b-21fe-49b4-a135-7d4646fd747b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142851 Jul 25 16:24:13.333536 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1827/3725] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:13.361088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:13.369685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:13.392704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.393443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:13.398871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.399656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:13.450353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:13.457734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:13.478830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.479310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:13.480236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.480678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:13.897998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:13.918435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:13.920054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:13.921539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9a379df-4b4b-4a53-83f9-f55ef12b4ada tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.483398 Jul 25 16:24:13.942941 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1828/3726] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:13 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:13.949555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:13.952427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:13.973919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:13.978940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.979700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:13.981460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:13.981733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:14.065733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:14.071272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:14.078124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lazy-loading 'fault' on Instance uuid f1e709ee-0a52-4431-b193-e2d64ba30718 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:24:14.186574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:14.196388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:14.204841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3135746990242b4a071891817ce61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660f19ce08fd4d5794d1e74f0c29f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:14.206507 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7685067c-5b53-492a-903b-af41e12efe6d tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 200 len: 1412 microversion: 2.54 time: 0.262177 Jul 25 16:24:14.210545 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1829/3727] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:13 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 1412 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:14.260996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:14.275544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9dab19f1-ef57-4eaa-97c3-e6a663a6dc4e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.933574 Jul 25 16:24:14.290788 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1899/3728] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:13 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:14.955390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:14.957482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:14.989561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:14.992053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:14.995876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:14.996894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:15.262859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:15.265172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:15.265908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] [instance: f1e709ee-0a52-4431-b193-e2d64ba30718] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:15.288733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:15.289219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:15.292314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:15.292837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:15.327970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:15.331976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:15.341274 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f46a1acc-3c13-4c82-97d3-7b6881f6ad4e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.385680 Jul 25 16:24:15.349645 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1830/3729] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:14 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:15.360094 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] HTTP exception thrown: Instance f1e709ee-0a52-4431-b193-e2d64ba30718 could not be found. Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Request method failure captured: Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 HTTP/1.1 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sN0hzWv_bOmrVYF8urfi_GOfNqOD3CCdeeilES2pfn6Utz1j6p1FAIRif1XzTr6AdHmKGbc7DVo1pckQDARCCO0tpiMqTuk8JR8K_mPy0kDfsvF_-vaN6F-gPLKjMoqwGYsgVmJJU1O97mi8zlS3juWpjgtIZcyPDTB1EnIC0D_5ws Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.54 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 660f19ce08fd4d5794d1e74f0c29f606 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerShowV254Test-1714845468 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/660f19ce08fd4d5794d1e74f0c29f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/660f19ce08fd4d5794d1e74f0c29f606"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/660f19ce08fd4d5794d1e74f0c29f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_660f19ce08fd4d5794d1e74f0c29f606"}]}] Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerShowV254Test-1714845468 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 660f19ce08fd4d5794d1e74f0c29f606 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerShowV254Test-1714845468 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerShowV254Test-1714845468-project Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e3135746990242b4a071891817ce61e0 Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerShowV254Test-1714845468-project Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance f1e709ee-0a52-4431-b193-e2d64ba30718 could not be found. Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'f1e709ee-0a52-4431-b193-e2d64ba30718'} Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e709ee-0a52-4431-b193-e2d64ba30718 could not be found. Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e709ee-0a52-4431-b193-e2d64ba30718 could not be found. Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:15.362140 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e709ee-0a52-4431-b193-e2d64ba30718 could not be found. Jul 25 16:24:15.366460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:15.371082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:15.371776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:15.377983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] Returning 404 to user: Instance f1e709ee-0a52-4431-b193-e2d64ba30718 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:15.379556 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26f0e71d-9453-4677-8be6-9cd85d33bc0f tempest-ServerShowV254Test-1714845468 tempest-ServerShowV254Test-1714845468-project] 10.222.0.105 "GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718" status: 404 len: 111 microversion: 2.54 time: 0.119315 Jul 25 16:24:15.384247 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1900/3730] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:15 2022] GET /compute/v2.1/servers/f1e709ee-0a52-4431-b193-e2d64ba30718 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:24:15.412827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:15.413313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:15.414125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:15.414608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:16.190230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:16.204269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ce04980-f6cd-408d-a86b-c5a9fee928ae tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1312 microversion: 2.1 time: 0.853000 Jul 25 16:24:16.220035 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1831/3731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:15 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1312 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:16.400634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:16.403269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:16.410631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:16.433019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:16.435553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:16.436928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:16.449009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:16.705121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:16.732952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:16.742753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:16.745020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31ddf721-288b-41ce-9e23-dee2f308f47c tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.357075 Jul 25 16:24:16.746618 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1901/3732] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:16 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:24:17.184112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-302449533-access_point-696011045", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "ae93d2bd-b778-43ef-8c9a-45c96bfbaff1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-912625498", "security_groups": [{"name": "tempest-secgroup_access--738570401"}, {"name": "tempest-secgroup_general--927174258"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:17.242089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:17.246980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:17.290646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:17.291850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:17.294677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:17.295924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:17.570600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] validate_networks() for [('ae93d2bd-b778-43ef-8c9a-45c96bfbaff1', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:24:17.794171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:17.834283 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e78fc6e2-9754-4b7c-aa9e-8947f9cbf6bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1492 microversion: 2.1 time: 0.602064 Jul 25 16:24:17.835817 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1902/3733] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:17 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1492 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:18.856404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-60b7c014-5ab7-4e97-b9af-dbf42c55fea4 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9da4a1fdc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrjJSDMNrzdYuuBG3r35k59zT1xFFJRbAs4+HlIu7Mav8SnLxfUXmK5Av3KEI/njmtIi6o8faxhd4h8mEpqzEbOpJwKubNF+sGtA7/s3bvDDTOBKO4qlzqqgRzuiqgKUw=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:18.909435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-60b7c014-5ab7-4e97-b9af-dbf42c55fea4 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-60b7c014-5ab7-4e97-b9af-dbf42c55fea4 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 257 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrjJSDMNrzdYuuBG3r35k59zT1xFFJRbAs4+HlIu7Mav8SnLxfUXmK5Av3KEI/njmtIi6o8faxhd4h8mEpqzEbOpJwKubNF+sGtA7/s3bvDDTOBKO4qlzqqgRzuiqgKUw=="}} Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrjJSDMNrzdYuuBG3r35k59zT1xFFJRbAs4+HlIu7Mav8SnLxfUXmK5Av3KEI/njmtIi6o8faxhd4h8mEpqzEbOpJwKubNF+sGtA7/s3bvDDTOBKO4qlzqqgRzuiqgKUw=='}}} Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:18.928835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 16:24:18.938083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:18.949984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:24:18.950893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-60b7c014-5ab7-4e97-b9af-dbf42c55fea4 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:18.951353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:24:18.952202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:24:18.953265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:24:18.954437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:24:18.961703 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-60b7c014-5ab7-4e97-b9af-dbf42c55fea4 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 1.113643 Jul 25 16:24:18.965981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1903/3734] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:17 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 1129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:24:18.985661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:18.999387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:19.005354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.006205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.007889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.008467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.013626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.014406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.015954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.017236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.096377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Getting quotas for project eeb296addf4b46fda315d22fca210662. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:19.105075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Getting quotas for user be5761637f9b43c3bc4d0008579ed6b3 and project eeb296addf4b46fda315d22fca210662. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:19.146624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:24:19.148849 n-d-846219-13 devstack@n-api.service[119598]: WARNING nova.utils [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-302449533-access_point-696011045 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-302449533-acc Jul 25 16:24:19.149653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:24:19.264118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:19.272547 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b54f2ee-2fb4-45e9-a6f9-27440d71c049 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.092999 Jul 25 16:24:19.273998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1832/3735] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:24:17 2022] POST /compute/v2.1/servers => generated 458 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:24:19.287371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:19.298740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:19.313372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.314536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.315813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.316813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.319324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:19.328432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:19.333391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26f7f9a8-e9b3-40db-afa8-645102c98b18 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.365508 Jul 25 16:24:19.338044 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1904/3736] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:18 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:19.362295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9d928344c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-405818842", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:19.381795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lazy-loading 'flavor' on Instance uuid 49458875-c2e2-478b-8b53-82e8674dd042 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:24:19.413331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:19.421848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for user b0646cbc8a07440dbba4d98e572bdb91 and project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:19.472297 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 2166 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-405818842", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:24:19.490307 n-d-846219-13 devstack@n-api.service[119599]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-405818842', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:19.492544 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0dca5613-274d-469d-af7a-b7ebb7f025aa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.152191 Jul 25 16:24:19.494867 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1905/3737] 10.222.0.105 () {60 vars in 1165 bytes} [Mon Jul 25 16:24:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:19.497459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-654a1b69-75a2-4fda-b703-da33bf6ba516 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:19.498078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-654a1b69-75a2-4fda-b703-da33bf6ba516 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:19.613343 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98f4aa5d-70b2-438e-b4d2-9595a5560121 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042/action" status: 202 len: 0 microversion: 2.1 time: 0.337398 Jul 25 16:24:19.631148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1833/3738] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:24:19 2022] POST /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:24:19.658453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2b726a9-232a-4f05-a96f-44bba6ee38d6 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9da00469d0>, body: {"keypair": {"name": "tempest-keypair-21331880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1g2SV0zNHpUgXZMbTWnUQSuIbikonrBaEd7p3Qa9kvTatmKX5XsftPVx+JJzkeIzf36nlTrDFweFNB/ip0kj39yEAeKVRQD3unI/eJgjam2kKEGE8ri3h2ECj2leQ34Q=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:19.709265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d2b726a9-232a-4f05-a96f-44bba6ee38d6 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:19.754718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d2b726a9-232a-4f05-a96f-44bba6ee38d6 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for user b0646cbc8a07440dbba4d98e572bdb91 and project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:19.852240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2b726a9-232a-4f05-a96f-44bba6ee38d6 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.214726 Jul 25 16:24:19.854156 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1834/3739] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:19.863918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:19.867799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:19.899241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.900004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.907810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:19.908709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:19.985337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:20.607024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-654a1b69-75a2-4fda-b703-da33bf6ba516 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:20.633913 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-654a1b69-75a2-4fda-b703-da33bf6ba516 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1296 microversion: 2.1 time: 1.139891 Jul 25 16:24:20.659672 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1906/3740] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:19 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1296 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:20.680200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9d92834550>, body: {"keypair": {"name": "tempest-keypair-21331880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd06kSdB2kGQrYEBkhE4A78Oy8FAwYRto4RjkzdJxDWw/nHq0EvK584wguyn3Ekuul2aKtuFt9WvOfuSWQWLjzE/RGgQvKfjD2bR8osXo5Zg0OZf1QjduRvcPXQ9QzIDQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:20.774030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:20.792864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for user b0646cbc8a07440dbba4d98e572bdb91 and project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:20.906548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:20.919725 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-15cc5e11-d674-4f89-b53c-947880533046 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1500 microversion: 2.1 time: 1.062595 Jul 25 16:24:20.920791 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1835/3741] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:19 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1500 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:20.934956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:20.936580 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] HTTP exception thrown: Key pair 'tempest-keypair-21331880' already exists. Jul 25 16:24:20.938409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 271 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: {"keypair": {"name": "tempest-keypair-21331880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd06kSdB2kGQrYEBkhE4A78Oy8FAwYRto4RjkzdJxDWw/nHq0EvK584wguyn3Ekuul2aKtuFt9WvOfuSWQWLjzE/RGgQvKfjD2bR8osXo5Zg0OZf1QjduRvcPXQ9QzIDQ=="}} Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: exception: Key pair 'tempest-keypair-21331880' already exists. Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-21331880', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd06kSdB2kGQrYEBkhE4A78Oy8FAwYRto4RjkzdJxDWw/nHq0EvK584wguyn3Ekuul2aKtuFt9WvOfuSWQWLjzE/RGgQvKfjD2bR8osXo5Zg0OZf1QjduRvcPXQ9QzIDQ=='}}} Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result.read() Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b0646cbc8a07440dbba4d98e572bdb91-tempest-keypair-21331880' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 16:24:20.949836 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result.read() Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 16:24:20.959548 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b0646cbc8a07440dbba4d98e572bdb91-tempest-keypair-21331880' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 16, 24, 20, 921365), 'updated_at': None, 'name': 'tempest-keypair-21331880', 'user_id': 'b0646cbc8a07440dbba4d98e572bdb91', 'fingerprint': '61:b0:70:21:68:2a:41:c9:4c:62:2d:50:81:de:09:cb', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd06kSdB2kGQrYEBkhE4A78Oy8FAwYRto4RjkzdJxDWw/nHq0EvK584wguyn3Ekuul2aKtuFt9WvOfuSWQWLjzE/RGgQvKfjD2bR8osXo5Zg0OZf1QjduRvcPXQ9QzIDQ==', 'type': 'ssh'}] Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi keypair.create() Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._create() Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-21331880' already exists. Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 25 16:24:20.974311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-21331880' already exists. Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-21331880' already exists. Jul 25 16:24:20.986227 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:20.987853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:20.987853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:20.987853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:20.987853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:20.990088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 409 to user: Key pair 'tempest-keypair-21331880' already exists. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:20.990088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8dc9c54-8560-4826-8be0-1253ea18da91 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.316936 Jul 25 16:24:20.990088 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1907/3742] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:20 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 319 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:24:21.042183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e5b7033-1689-4c0f-9785-d3f5adb81b15 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Calling method '.version_select at 0x7f9da49481f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:21.084043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:21.103274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:21.106828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:21.109479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6648cf7a-6953-4933-8686-1e85b7faa110 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.186547 Jul 25 16:24:21.111565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1836/3743] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:20 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:21.149019 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e5b7033-1689-4c0f-9785-d3f5adb81b15 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21331880" status: 202 len: 0 microversion: 2.1 time: 0.146440 Jul 25 16:24:21.150266 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1908/3744] 10.222.0.105 () {58 vars in 1220 bytes} [Mon Jul 25 16:24:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21331880 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:24:21.172166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65e42659-d52e-4e4d-8ff5-76d4c20a8cfa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9d92dfa820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiUwmYbT3hUodiL0uLDipbz8Dw+0H3LFI3AoonIoG+dYVkDzbe8lWzWS8TLEeUlgSyxi1gKd7qvTnpr3SN/H6A/FNexsyj9k7+jjIjSH8z2bB8GH+95QFAJ9uPGWyjqxg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65e42659-d52e-4e4d-8ff5-76d4c20a8cfa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 247 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiUwmYbT3hUodiL0uLDipbz8Dw+0H3LFI3AoonIoG+dYVkDzbe8lWzWS8TLEeUlgSyxi1gKd7qvTnpr3SN/H6A/FNexsyj9k7+jjIjSH8z2bB8GH+95QFAJ9uPGWyjqxg=="}} Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiUwmYbT3hUodiL0uLDipbz8Dw+0H3LFI3AoonIoG+dYVkDzbe8lWzWS8TLEeUlgSyxi1gKd7qvTnpr3SN/H6A/FNexsyj9k7+jjIjSH8z2bB8GH+95QFAJ9uPGWyjqxg=='}}} Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi '' Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:24:21.181337 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 16:24:21.188577 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.192426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65e42659-d52e-4e4d-8ff5-76d4c20a8cfa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:21.194415 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65e42659-d52e-4e4d-8ff5-76d4c20a8cfa tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030017 Jul 25 16:24:21.196287 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1837/3745] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:21 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:24:21.216518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9d927bd040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1625416045", "public_key": " "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:21.268508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:21.276789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for user b0646cbc8a07440dbba4d98e572bdb91 and project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:21.316141 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 95 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1625416045", "public_key": " "}} Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1625416045', 'public_key': ' '}}} Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.319817 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.323457 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.327819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:21.329581 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-20928531-c365-4da9-9e35-739d2ea1e3ea tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.125412 Jul 25 16:24:21.330478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1909/3746] 10.222.0.105 () {60 vars in 1163 bytes} [Mon Jul 25 16:24:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:21.344712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9f19f3f-cb2c-4f1b-82d3-aef7e4d96000 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9da49a2e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKclsvdCD3wWFXBdE96rzXUVP+ywarGOsK5j7/e9sA7agKGSJyMpE2m7q4WFBx5fOfHUWVqogp0NiqcT7Y08vNIfzYQ/13QheWtK8IbZCK+zb6J7lhNQ7hOnH9qInG0jOg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9f19f3f-cb2c-4f1b-82d3-aef7e4d96000 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 507 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKclsvdCD3wWFXBdE96rzXUVP+ywarGOsK5j7/e9sA7agKGSJyMpE2m7q4WFBx5fOfHUWVqogp0NiqcT7Y08vNIfzYQ/13QheWtK8IbZCK+zb6J7lhNQ7hOnH9qInG0jOg=="}} Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKclsvdCD3wWFXBdE96rzXUVP+ywarGOsK5j7/e9sA7agKGSJyMpE2m7q4WFBx5fOfHUWVqogp0NiqcT7Y08vNIfzYQ/13QheWtK8IbZCK+zb6J7lhNQ7hOnH9qInG0jOg=='}}} Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 16:24:21.351492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 16:24:21.354417 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.358531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9f19f3f-cb2c-4f1b-82d3-aef7e4d96000 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:21.366109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9f19f3f-cb2c-4f1b-82d3-aef7e4d96000 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026576 Jul 25 16:24:21.366815 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1838/3747] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:21 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:24:21.380119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Action: 'create', calling method: .version_select at 0x7f9d927bce50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-959024346", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:21.413019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:21.421210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Getting quotas for user b0646cbc8a07440dbba4d98e572bdb91 and project 21badfa0d16e4b4f972c3af1600efb07. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:21.444023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 117 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-959024346", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-959024346', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 16:24:21.447290 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 16:24:21.450913 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.455487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:21.456833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e0b67144-34b6-4630-8615-1b275ccab751 tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.082812 Jul 25 16:24:21.463216 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1910/3748] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:21.473422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f157248f-e723-4d3f-91f3-f46406ccd8cc tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Calling method '.version_select at 0x7f9d92dfa430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:21.515779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f157248f-e723-4d3f-91f3-f46406ccd8cc tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1851147108 not found for user b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f157248f-e723-4d3f-91f3-f46406ccd8cc tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Request method failure captured: Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1851147108 HTTP/1.1 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sOxvNN63lu3sPKeYZ64KGJRJAHoz0fW13zRR7HPZnYwvuWpp9caq1rBUMqS-yvfMdlqgqukNWKwXpFT_aw6xg-AhJ6L7VLFwzHZPnVF_89etCtj9FhniMbq4yrPSclDZGIgJuLSX6RRIvtWJrccn2uktWsF3qoVstBwaw0aiT0WpNM Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21badfa0d16e4b4f972c3af1600efb07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21badfa0d16e4b4f972c3af1600efb07"}]}] Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21badfa0d16e4b4f972c3af1600efb07 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1946920736 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1946920736-project Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: exception: Keypair tempest-keypair-non-existent-1851147108 not found for user b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'tempest-keypair-non-existent-1851147108'} Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1851147108 not found for user b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.524978 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1851147108 not found for user b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1851147108 not found for user b0646cbc8a07440dbba4d98e572bdb91 Jul 25 16:24:21.531521 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:21.538375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f157248f-e723-4d3f-91f3-f46406ccd8cc tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1851147108 not found for user b0646cbc8a07440dbba4d98e572bdb91 {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:21.540348 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f157248f-e723-4d3f-91f3-f46406ccd8cc tempest-KeyPairsNegativeTestJSON-1946920736 tempest-KeyPairsNegativeTestJSON-1946920736-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1851147108" status: 404 len: 145 microversion: 2.1 time: 0.075178 Jul 25 16:24:21.542276 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1839/3749] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1851147108 => generated 145 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:24:21.684212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:21.685234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:21.699016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:21.699467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:21.702091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:21.704180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:22.009960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:22.028641 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-175f16af-5a6d-4423-83f6-1803d0bbbc86 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1348 microversion: 2.1 time: 0.349286 Jul 25 16:24:22.034352 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1911/3750] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:21 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1348 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:22.061618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:22.063321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:22.083571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:22.085856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:22.087174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:22.089377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:22.477272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:22.490563 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65be6b6a-61fd-4062-980a-07bbbaf84d38 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 200 len: 1483 microversion: 2.1 time: 0.454395 Jul 25 16:24:22.491187 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1912/3751] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:22 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 1483 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:22.520109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:22.524968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:22.541879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:22.542336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:22.548239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:22.550327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:22.696340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3991fd62-3b75-4fb0-a689-b93d2c91609e tempest-ComputeTenantNetworksTest-228089522 tempest-ComputeTenantNetworksTest-228089522-project] Calling method '.version_select at 0x7f9d92de0b80>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:22.772260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:22.802346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:22.816968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:22.819056 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-74cc8254-cb2a-45a5-aa81-a211d658c74a tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.319305 Jul 25 16:24:22.820588 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1913/3752] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:22 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:22.840687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1818165892"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:22.844939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:22.864332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:22.865178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:22.875109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:22.878900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:23.269926 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3991fd62-3b75-4fb0-a689-b93d2c91609e tempest-ComputeTenantNetworksTest-228089522 tempest-ComputeTenantNetworksTest-228089522-project] 10.222.0.105 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.347890 Jul 25 16:24:23.271002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1840/3753] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 16:24:21 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:23.286781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:23.288123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:23.299656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:23.300398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:23.301409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:23.302127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:23.318868 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d955bf63-0365-40e7-9daa-2bc96fa20605 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042/action" status: 202 len: 0 microversion: 2.1 time: 0.496474 Jul 25 16:24:23.324862 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1914/3754] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:24:22 2022] POST /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:24:23.335676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94ad46c9-d003-464f-b99e-cf1d0f9f3e3d tempest-ComputeTenantNetworksTest-228089522 tempest-ComputeTenantNetworksTest-228089522-project] Calling method '.version_select at 0x7f9d927c3af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:23.593746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:23.613794 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08749905-4d63-42cd-b800-3c12cd0d3134 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1354 microversion: 2.1 time: 0.339201 Jul 25 16:24:23.616990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1841/3755] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:23 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1354 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:23.640132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98aced28-3deb-46f2-a33a-72d6b6db04b2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d938070d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:23.702072 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94ad46c9-d003-464f-b99e-cf1d0f9f3e3d tempest-ComputeTenantNetworksTest-228089522 tempest-ComputeTenantNetworksTest-228089522-project] 10.222.0.105 "GET /compute/v2.1/os-tenant-networks/50da8ecb-e72a-4b2b-b1c6-9eb42d3f2571" status: 200 len: 140 microversion: 2.1 time: 0.375324 Jul 25 16:24:23.713646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1915/3756] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:24:23 2022] GET /compute/v2.1/os-tenant-networks/50da8ecb-e72a-4b2b-b1c6-9eb42d3f2571 => generated 140 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:23.770210 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98aced28-3deb-46f2-a33a-72d6b6db04b2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.149888 Jul 25 16:24:23.773560 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1842/3757] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:23 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:23.846047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:23.846898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:23.864851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:23.865974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:23.868697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:23.873268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:24.138418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:24.151290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:24.154137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:24.156794 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee93309a-a916-49b2-95cf-72afadbf6b86 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.315611 Jul 25 16:24:24.167916 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1916/3758] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:23 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:24.647879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:24.648840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:24.687870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:24.688547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:24.690643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:24.704803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:24.796081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d987358-c349-4008-b903-9cfab5fafe6f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927424c0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:24.915757 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d987358-c349-4008-b903-9cfab5fafe6f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.127024 Jul 25 16:24:24.942969 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1917/3759] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:24 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:25.129385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:25.147413 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b39cb1b-7036-4cf5-873b-a81bd763ad9b tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 0.506739 Jul 25 16:24:25.155379 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1843/3760] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:24 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:25.189152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:25.190124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:25.207947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:25.208892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:25.209921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:25.221785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:25.335073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:25.569508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:25.590449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:25.603625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:25.607782 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-204f1455-f27a-4141-9497-0446b69df436 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.427379 Jul 25 16:24:25.613202 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1918/3761] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:25 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:25.843151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8a9b06a1-fae5-4426-9acd-0390bfe3469c req-8c3eab0f-34ad-4262-86ae-dbfc0a503ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4e4fc4-3364-4545-a924-527ba65cd638", "tag": "e5b4de22-258e-4a4d-91fc-bbe7c87b59c2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:25.898103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8a9b06a1-fae5-4426-9acd-0390bfe3469c req-8c3eab0f-34ad-4262-86ae-dbfc0a503ac8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:25.898897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8a9b06a1-fae5-4426-9acd-0390bfe3469c req-8c3eab0f-34ad-4262-86ae-dbfc0a503ac8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:25.931718 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8a9b06a1-fae5-4426-9acd-0390bfe3469c req-8c3eab0f-34ad-4262-86ae-dbfc0a503ac8 service nova] Creating event network-changed:e5b4de22-258e-4a4d-91fc-bbe7c87b59c2 for instance 4e4e4fc4-3364-4545-a924-527ba65cd638 on n-h1-846219-13 Jul 25 16:24:25.935831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f85c84d9-937b-4b3d-997c-218f80ccd57c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927bc310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:25.956761 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8a9b06a1-fae5-4426-9acd-0390bfe3469c req-8c3eab0f-34ad-4262-86ae-dbfc0a503ac8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118278 Jul 25 16:24:25.961190 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1844/3762] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:26.130742 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f85c84d9-937b-4b3d-997c-218f80ccd57c tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.200299 Jul 25 16:24:26.133203 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1919/3763] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:25 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:26.194563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:26.195942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:26.241260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:26.242201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:26.247367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:26.248144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:26.641363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:26.642301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:26.654781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:26.660040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:26.661296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:26.661963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:26.820663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:26.839102 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee93ddfb-b5ab-4b45-870e-cd1af3869691 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 0.660422 Jul 25 16:24:26.842238 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1845/3764] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:26 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:26.866330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:26.879284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:26.884271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:26.887345 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-86b021bc-d736-4a81-b8a5-17b0fc1bd1ea tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.250000 Jul 25 16:24:26.903512 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1920/3765] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:26 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:27.155304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a804552c-aa0c-441b-a822-d84a480c6334 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d46280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:27.261825 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a804552c-aa0c-441b-a822-d84a480c6334 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.113729 Jul 25 16:24:27.269569 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1846/3766] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:27 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:27.869778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:27.869778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:27.900570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:27.901019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:27.916073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:27.917265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:27.917403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:27.920534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:27.949665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:27.950199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:27.951083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:27.951528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:28.218919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:28.237663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:28.242974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:28.245840 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0163405-f5a6-4137-8f62-f0f3d93e22cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.335316 Jul 25 16:24:28.265788 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1847/3767] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:27 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:28.281478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d289f53-3e3a-46c5-b4bd-6712c93f559a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da49a2e50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:28.392549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d289f53-3e3a-46c5-b4bd-6712c93f559a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.119401 Jul 25 16:24:28.394457 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1848/3768] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:28 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:28.661059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:28.699042 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c214ed67-c0f3-4be4-bff2-fb9f20ea5710 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 0.834099 Jul 25 16:24:28.714656 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1921/3769] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:27 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:29.215478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:29.224266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-18d639b4-1929-4bfb-8928-ec6c05b8d512 req-71d69c7c-9aab-4c44-9a4f-db14f1507475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49458875-c2e2-478b-8b53-82e8674dd042", "name": "network-vif-plugged", "status": "completed", "tag": "bf899014-1c65-47ce-bcdc-0d18a8fcc213"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:29.253922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-18d639b4-1929-4bfb-8928-ec6c05b8d512 req-71d69c7c-9aab-4c44-9a4f-db14f1507475 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:29.254831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-18d639b4-1929-4bfb-8928-ec6c05b8d512 req-71d69c7c-9aab-4c44-9a4f-db14f1507475 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:29.275718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:29.278153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:29.306903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:29.317290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:29.319208 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-18d639b4-1929-4bfb-8928-ec6c05b8d512 req-71d69c7c-9aab-4c44-9a4f-db14f1507475 service nova] Creating event network-vif-plugged:bf899014-1c65-47ce-bcdc-0d18a8fcc213 for instance 49458875-c2e2-478b-8b53-82e8674dd042 on n-h2-846219-13 Jul 25 16:24:29.322313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:29.328115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:29.344216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-18d639b4-1929-4bfb-8928-ec6c05b8d512 req-71d69c7c-9aab-4c44-9a4f-db14f1507475 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124734 Jul 25 16:24:29.347248 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1849/3770] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:29.416246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-169fdaa2-8123-4955-b5a6-f8cf768cecda tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92dae790>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:29.570698 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-169fdaa2-8123-4955-b5a6-f8cf768cecda tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.155398 Jul 25 16:24:29.580081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:29.586514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1850/3771] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:29 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:29.624839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:29.635831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:29.638824 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db2f6fc1-db86-4e97-a830-6593829972ef tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.368279 Jul 25 16:24:29.640639 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1922/3772] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:29 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:24:29.757726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:29.760548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:29.798619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:29.800349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:29.803066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:29.806354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:29.807754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:30.466918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:30.492006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0feb15d-9069-450b-b8e5-a614bb3bdf45 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 0.745981 Jul 25 16:24:30.495300 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1851/3773] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:29 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:30.596615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-95a77295-f3b9-4937-a8f7-39b40d288db0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92834160>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.671012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.671812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:30.702321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:30.704247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:30.707507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:30.707977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:30.812526 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-95a77295-f3b9-4937-a8f7-39b40d288db0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.227447 Jul 25 16:24:30.816833 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1923/3774] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:31.094702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:31.123275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:31.126749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:31.136808 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67036117-ce04-4aa3-8042-0442218a12ff tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.472155 Jul 25 16:24:31.141794 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1852/3775] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:31.519101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:31.526967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:31.541505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:31.589343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:31.602503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:31.605309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:31.606324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:31.839112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59e4137a-d627-471d-b470-211afbac0fdd tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92df5ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:32.015529 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59e4137a-d627-471d-b470-211afbac0fdd tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.183189 Jul 25 16:24:32.016681 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1853/3776] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:31 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:32.170959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:32.183139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:32.231569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:32.238103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:32.243134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:32.256702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:32.768704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:32.778126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:32.793193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:32.793193 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0b902adb-b411-491e-a104-86096cd975cf tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1368 microversion: 2.57 time: 0.630048 Jul 25 16:24:32.819726 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1854/3777] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:32 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1368 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:32.873792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:32.901609 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a27aebbc-ab0c-4cd7-a61d-466b3e4684b7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 1.382582 Jul 25 16:24:32.925406 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1924/3778] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:31 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:33.061205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-27f65365-3b6d-471d-81ee-dc26ed6610bb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d46f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.133352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:33.154941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:33.197337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.198396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.202646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.209322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.260195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-27f65365-3b6d-471d-81ee-dc26ed6610bb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.202759 Jul 25 16:24:33.274534 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1855/3779] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:33 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:33.458296 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7dccf5ef-8814-477e-9af8-15c1c290b7db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.332157 Jul 25 16:24:33.460606 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1925/3780] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:24:33 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:24:33.480591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.493084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:33.542244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.543442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.546312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.548843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.830335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.831544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:33.880251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.884236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.887621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.892457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:34.468430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:34.525529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:34.528983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:34.580476 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4a9024c7-ed9e-4051-9ec6-cbbdfc3c0575 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1386 microversion: 2.57 time: 0.757692 Jul 25 16:24:34.593041 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1926/3781] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:33 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1386 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:24:34.616660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:34.617432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:34.665834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:34.666616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:34.674365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:34.674824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:36.642784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:36.694308 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c213bd49-bbaa-47d2-af58-c92ed09726bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1675 microversion: 2.1 time: 3.228974 Jul 25 16:24:36.700437 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1856/3782] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:33 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1675 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:36.715496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e502933f-9957-4838-a884-2d053b667ac9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92df50d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:36.893621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:36.956100 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8dd86d52-3607-4ace-ab26-2d61d2f121a7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 2.359436 Jul 25 16:24:36.962225 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1927/3783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:34 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 2368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:36.983012 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e502933f-9957-4838-a884-2d053b667ac9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.280354 Jul 25 16:24:36.996139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:36.997002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1857/3784] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:36 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:36.998568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:37.015259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:37.016407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:37.018199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:37.019267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:37.299013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:37.328516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:37.344456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:37.347143 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cb1fbb91-f480-4923-ad11-a192cd689b0f tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1374 microversion: 2.57 time: 0.382574 Jul 25 16:24:37.348128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1928/3785] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:36 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1374 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:37.734043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:37.736579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:37.768157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:37.768788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:37.774685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:37.776789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:37.987851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:37.989947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:38.024655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:38.036990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:38.038645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:38.039588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:38.330890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:38.348431 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-738bb20c-12fb-452f-a482-4e13e0d9aaf7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1675 microversion: 2.1 time: 0.616853 Jul 25 16:24:38.350439 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1858/3786] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:37 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1675 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:38.372262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1cd1513-051d-4c72-993e-0698616cdf1f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d938073a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:38.528446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1cd1513-051d-4c72-993e-0698616cdf1f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.170313 Jul 25 16:24:38.531790 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1859/3787] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:38 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:38.547663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:38.557747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:38.588916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:38.589393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:38.590201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:38.590659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.006476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:39.036274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:39.044544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:39.050199 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-42ba8c7c-8d68-4057-88e1-c1d9f0aef481 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1359 microversion: 2.57 time: 0.516142 Jul 25 16:24:39.107693 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1860/3788] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:38 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1359 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:39.134188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:39.138119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:39.152904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:39.173046 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f3fd474-b4dc-46bf-be42-c288279b25e7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 1.186283 Jul 25 16:24:39.196281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1929/3789] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:37 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:39.199165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.202921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.204117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.204818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.248059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:24:39.366767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fdb0f77b-e06c-455a-b215-8f801a81b829 req-3fb3a90a-2dfb-484d-a91f-a0b67c57a6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4e4fc4-3364-4545-a924-527ba65cd638", "name": "network-vif-plugged", "status": "completed", "tag": "e5b4de22-258e-4a4d-91fc-bbe7c87b59c2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:39.411582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fdb0f77b-e06c-455a-b215-8f801a81b829 req-3fb3a90a-2dfb-484d-a91f-a0b67c57a6d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.424444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fdb0f77b-e06c-455a-b215-8f801a81b829 req-3fb3a90a-2dfb-484d-a91f-a0b67c57a6d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.497020 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fdb0f77b-e06c-455a-b215-8f801a81b829 req-3fb3a90a-2dfb-484d-a91f-a0b67c57a6d4 service nova] Creating event network-vif-plugged:e5b4de22-258e-4a4d-91fc-bbe7c87b59c2 for instance 4e4e4fc4-3364-4545-a924-527ba65cd638 on n-h1-846219-13 Jul 25 16:24:39.506775 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fdb0f77b-e06c-455a-b215-8f801a81b829 req-3fb3a90a-2dfb-484d-a91f-a0b67c57a6d4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145098 Jul 25 16:24:39.508256 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1930/3790] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:39.516404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:39.517643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:39.525975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.527860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.529010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.530787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.540480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-42833717-ee49-440d-b1ee-080df78b1a13 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 204 len: 0 microversion: 2.57 time: 0.423075 Jul 25 16:24:39.542626 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1861/3791] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:24:39 2022] DELETE /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:24:39.569427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:39.577367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:39.598466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.599542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.617302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.619548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.996295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:40.011442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:40.020736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:40.022582 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91916907-469a-4f59-afc1-3d88ef9439ae tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1365 microversion: 2.57 time: 0.465148 Jul 25 16:24:40.038191 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1862/3792] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:39 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1365 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:40.059975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f51d7595-4fb6-4764-975b-7cad4a07ef59 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92daee50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:40.177883 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f51d7595-4fb6-4764-975b-7cad4a07ef59 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.138019 Jul 25 16:24:40.179382 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1863/3793] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:40 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:40.204908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:40.206214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:40.221953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:40.222666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:40.223518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:40.223965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:40.435107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:40.453719 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d9d011f9-5d3c-47af-9b3a-df18c2c955bd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.942545 Jul 25 16:24:40.455559 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1931/3794] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:39 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:40.639601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:40.644138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:40.661597 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cf5caf8e-2313-4633-a611-6c967c884548 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 0.460176 Jul 25 16:24:40.662470 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1864/3795] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:40 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:41.053709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:41.054873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:41.083271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:41.086118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:41.089518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:41.093345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:41.208068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14b1116e-4632-429c-a712-0eaaa4d8007e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e1ac10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:41.352667 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14b1116e-4632-429c-a712-0eaaa4d8007e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.151216 Jul 25 16:24:41.353600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1865/3796] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:41 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:41.376074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:41.401330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:41.403466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:41.405080 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c31e3e11-ce39-4fc1-a237-2cbbc600f7a3 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1365 microversion: 2.57 time: 0.356638 Jul 25 16:24:41.407898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1932/3797] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:41 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:41.688155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:41.689277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:41.751948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:41.766099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:41.767269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:41.769516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:42.380282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e470c66-7777-40b4-8516-bc6a8b10f49a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92742f70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:42.579137 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e470c66-7777-40b4-8516-bc6a8b10f49a tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.198643 Jul 25 16:24:42.580923 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1933/3798] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:42 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:42.596648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:42.606348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:42.616114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:42.638290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:42.646549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:42.648407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:42.649354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:42.831482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:42.837686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:42.838789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lazy-loading 'fault' on Instance uuid 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:24:43.216559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:43.255435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:43.270622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49917a9d00824e7f8cc2edc8c2852ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3d826209694e65a624a80dbeca34b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:43.275481 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7254c5ca-3016-4699-9cd5-b4d26844270e tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 200 len: 1370 microversion: 2.57 time: 0.691542 Jul 25 16:24:43.279695 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1934/3799] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:42 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 1370 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:24:43.312904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:43.340155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4c5cdd2a-ea49-4cb8-a86e-90ddaa759f49 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1472 microversion: 2.1 time: 1.656040 Jul 25 16:24:43.344306 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1866/3800] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:41 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1472 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:43.629137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6d5e89f-75c2-44d6-a9f4-a090ec6662e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927425e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:43.807584 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6d5e89f-75c2-44d6-a9f4-a090ec6662e9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.207405 Jul 25 16:24:43.817725 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1935/3801] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:43 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:44.332421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:44.344292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] [instance: 2236cac5-7eae-4ad8-be09-f76d62d3a2a2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:44.378397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:44.392581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:44.394663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:44.403965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:44.404796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:44.406489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:44.407275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:44.420964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:44.421451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:44.422275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:44.422716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:44.468300 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] HTTP exception thrown: Instance 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 could not be found. Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Request method failure captured: Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 HTTP/1.1 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sOR1BVS98y7g8R6aD2PIGn9hPxAPjT_tCjh_iRiWAeXPDBfIc5vbyTfp3VWmQVJumD4cDPKQMp6S8f9T97jE0FceqI7L5gUyFO7g8NYYoP9_WrMf68iqKFcPY0uV1kQW94vOgrYYUWh6jB3k2zB-HhfgA_NwWl1AXCyGJgc94ScCVg Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.57 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: dc3d826209694e65a624a80dbeca34b7 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerShowV257Test-1402494689 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/dc3d826209694e65a624a80dbeca34b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/dc3d826209694e65a624a80dbeca34b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/dc3d826209694e65a624a80dbeca34b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_dc3d826209694e65a624a80dbeca34b7"}]}] Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerShowV257Test-1402494689 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: dc3d826209694e65a624a80dbeca34b7 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerShowV257Test-1402494689 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerShowV257Test-1402494689-project Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 49917a9d00824e7f8cc2edc8c2852ba1 Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerShowV257Test-1402494689-project Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 could not be found. Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '2236cac5-7eae-4ad8-be09-f76d62d3a2a2'} Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 could not be found. Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 could not be found. Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:44.484809 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 could not be found. Jul 25 16:24:44.492735 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:24:44.495039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] Returning 404 to user: Instance 2236cac5-7eae-4ad8-be09-f76d62d3a2a2 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:44.496824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71e29527-c6b7-4247-89a0-08324bdd56f1 tempest-ServerShowV257Test-1402494689 tempest-ServerShowV257Test-1402494689-project] 10.222.0.105 "GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2" status: 404 len: 111 microversion: 2.57 time: 0.175065 Jul 25 16:24:44.505616 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1867/3802] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:24:44 2022] GET /compute/v2.1/servers/2236cac5-7eae-4ad8-be09-f76d62d3a2a2 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:24:44.830191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0d1c78d-e8a7-41ad-9546-8bca76c2f809 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e1a8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:45.068622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:45.085547 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fcf5566e-ffd9-4b03-b3bf-e617bb25b3f9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1644 microversion: 2.1 time: 0.706990 Jul 25 16:24:45.089388 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1936/3803] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:44 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1644 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:45.121301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:45.122926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:45.152498 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0d1c78d-e8a7-41ad-9546-8bca76c2f809 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.331414 Jul 25 16:24:45.153134 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1868/3804] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:44 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:45.154770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.159865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:45.171167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.178766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:45.675888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:45.696819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-672af76e-a1d7-4d0a-89ee-c1bd48301b03 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1644 microversion: 2.1 time: 0.581847 Jul 25 16:24:45.701139 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1937/3805] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:45 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1644 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:45.729182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:45.729865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:45.745547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.774085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:45.775365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.776035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:46.178209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cfd4e0fc-ff95-46ca-9b8f-b23e3a3a4657 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927bb700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:46.472234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cfd4e0fc-ff95-46ca-9b8f-b23e3a3a4657 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.298251 Jul 25 16:24:46.493621 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1938/3806] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:46 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:46.804660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-081ef475-b354-4101-b4d9-457b9c7875be tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1797 microversion: 2.1 time: 1.077798 Jul 25 16:24:46.809551 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1869/3807] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:45 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1797 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:46.953739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:46.993008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:47.006005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Searching by: {'deleted': False, 'project_id': 'b13a4c5edb33497ba0348afda935754d'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:24:47.067571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:47.081541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:47.091202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:47.092148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:47.259324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:24:47.296643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:47.519027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c9f7dc4-73cb-47e1-a0c9-059729516687 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d4ce50>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:47.550738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f68cb6c1-e22b-463e-86a0-95d85316a923 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 346 microversion: 2.1 time: 0.609740 Jul 25 16:24:47.565522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1939/3808] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:24:46 2022] GET /compute/v2.1/servers => generated 346 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:47.675066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:47.688552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:47.690774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Searching by: {'deleted': False, 'project_id': 'b13a4c5edb33497ba0348afda935754d'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:24:47.708195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:47.708901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:47.709997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:47.712568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:47.827524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:24:47.883175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c9f7dc4-73cb-47e1-a0c9-059729516687 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.368243 Jul 25 16:24:47.888729 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1870/3809] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:47 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:47.995828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:48.016156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:48.016614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:48.611590 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c93864b0-8972-413f-8806-1fbdb3082caa tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 1609 microversion: 2.1 time: 0.983174 Jul 25 16:24:48.621131 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1940/3810] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:24:47 2022] GET /compute/v2.1/servers/detail => generated 1609 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:48.656765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b6ec588-508d-4dfa-8a52-9aa8dcb504e7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:48.710652 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b6ec588-508d-4dfa-8a52-9aa8dcb504e7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.064881 Jul 25 16:24:48.733749 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1871/3811] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:24:48 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:48.914576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a50da72-9e1a-4366-a515-a8517f272a2d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d9275c1f0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:49.098080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:49.098867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:49.123836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:49.134583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:49.135439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:49.135878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:49.160644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a50da72-9e1a-4366-a515-a8517f272a2d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.251647 Jul 25 16:24:49.172392 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1941/3812] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:48 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:49.521345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:24:49.828009 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-00a711ad-256b-4de1-bcd9-f83bf0252a5d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "DELETE /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 204 len: 0 microversion: 2.1 time: 0.733838 Jul 25 16:24:49.854496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:49.855420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:49.858044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1872/3813] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:24:49 2022] DELETE /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:24:49.865460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:49.867141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:49.868574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:49.869339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:50.179946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91982634-c027-40e2-8e8c-b7ff646293f1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d4c8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:50.411182 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91982634-c027-40e2-8e8c-b7ff646293f1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.238221 Jul 25 16:24:50.429660 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1873/3814] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:50 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:50.591131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:50.623427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6e5dc45-f467-407c-bed6-e92e2e491cd5 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1612 microversion: 2.1 time: 0.786136 Jul 25 16:24:50.636032 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1942/3815] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:49 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1612 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:51.458498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cdd1a2a8-3332-4b91-b8ae-b178b57f4447 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d93807b80>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:51.586912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cdd1a2a8-3332-4b91-b8ae-b178b57f4447 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.146469 Jul 25 16:24:51.590664 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1874/3816] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:51 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:51.664248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:51.665829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:51.684207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:51.694029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:51.696976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:51.703903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:52.451771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:52.480487 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d196f797-963b-437d-9e5e-2bce7939a7a9 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1612 microversion: 2.1 time: 0.820591 Jul 25 16:24:52.533074 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1943/3817] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:51 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1612 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:52.616401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec992084-c752-410a-9536-57706e189228 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d66040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:52.871447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec992084-c752-410a-9536-57706e189228 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.260398 Jul 25 16:24:52.874313 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1875/3818] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:52 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:53.476741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-738784b5-3385-4517-a2f3-5769c8c12a3a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: .version_select at 0x7f9d9274c3a0>, body: {"keypair": {"name": "tempest-keypair-400121653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx3iph8MLFPpQW5XLDUatfBkGrHeTIDN+BmwhKbjZC+oddankOvuu5g5cwHbkYd6x3HOa7MjKjwOe9vZYGxN/b8WSvXMTm4K5LtD5xMgjcqPaEiWYZd07TWExhVp4dVpg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:53.535742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-738784b5-3385-4517-a2f3-5769c8c12a3a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:53.577938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-738784b5-3385-4517-a2f3-5769c8c12a3a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:53.664678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-738784b5-3385-4517-a2f3-5769c8c12a3a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.642529 Jul 25 16:24:53.666460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1944/3819] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:53.673003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:53.674576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:53.701273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:53.702045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:53.703220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:53.704103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:53.856268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-147d26e5-b07a-4b88-b146-8edc94efb447 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Action: 'create', calling method: .version_select at 0x7f9d93807b80>, body: {"keypair": {"name": "tempest-keypair-980109408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEM0yACUTCAjNSNtUuCBCtGzRERkzwjq+sHPVl03VkTaZtypD5pQcGOdw6u9QHJlSc05RMfJfQMZ7ZoLYCHJAx36Ioe0ChJph8JffODcO2QVoO0//y3E9GX+ry96ZDCpQ=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:53.935769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-147d26e5-b07a-4b88-b146-8edc94efb447 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Getting quotas for project aa44b01f7747404da4ab3cbbee3d7c0f. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:53.950476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-147d26e5-b07a-4b88-b146-8edc94efb447 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Getting quotas for user dd6a710bce5a4467adff77afed6da5a3 and project aa44b01f7747404da4ab3cbbee3d7c0f. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:54.017622 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-147d26e5-b07a-4b88-b146-8edc94efb447 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.879065 Jul 25 16:24:54.023073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1876/3820] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:24:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:54.035600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5406965c-fac7-49b3-a454-b17bf0accf46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d66f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:54.110641 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5406965c-fac7-49b3-a454-b17bf0accf46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.085150 Jul 25 16:24:54.112878 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1877/3821] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:54 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:55.142762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9e9640e5-dc59-43ec-b02d-717dbd28daf2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d6d8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:55.310892 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9e9640e5-dc59-43ec-b02d-717dbd28daf2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.184282 Jul 25 16:24:55.313572 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1878/3822] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:55 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:55.504949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:55.524821 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ce297eb-1204-4e10-a37b-bbb9cd1815e1 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1612 microversion: 2.1 time: 1.856610 Jul 25 16:24:55.525833 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1945/3823] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:53 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1612 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:56.338941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-deef4230-35be-4c6e-b857-3f12c1ee2661 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92dc7940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:56.551511 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-deef4230-35be-4c6e-b857-3f12c1ee2661 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.226748 Jul 25 16:24:56.554020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:56.556194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:56.583447 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1879/3824] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:56 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:56.601952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:56.606751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:56.613209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:56.616549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:56.946462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:56.989666 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-070ecf80-ffd7-4095-905f-951438736a03 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1544 microversion: 2.1 time: 0.444000 Jul 25 16:24:56.993425 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1946/3825] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:56 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1544 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:57.584833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3845d385-8219-46b0-8e01-5b53235dab12 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d46160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:57.797284 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3845d385-8219-46b0-8e01-5b53235dab12 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.217624 Jul 25 16:24:57.805562 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1880/3826] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:57 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:58.030395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:58.032495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:58.035617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:58.071692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:58.084039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:58.085068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:58.091984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:58.495657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-38d47911-4638-4d5b-87a1-cf8e8b046e89 req-af55eda4-fb0d-4495-997e-0af0bc4d864c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc212827-9380-4526-8c8a-ec4a67bf3b6a", "name": "network-vif-deleted", "tag": "97fe1faf-df0e-473e-9146-1d9129e7bd6e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:58.517150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:58.530032 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4e56198-136b-4b20-b79e-7c66310e1173 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1544 microversion: 2.1 time: 0.505271 Jul 25 16:24:58.530770 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1947/3827] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:58 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1544 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:58.532913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-38d47911-4638-4d5b-87a1-cf8e8b046e89 req-af55eda4-fb0d-4495-997e-0af0bc4d864c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:58.533447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-38d47911-4638-4d5b-87a1-cf8e8b046e89 req-af55eda4-fb0d-4495-997e-0af0bc4d864c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:58.639975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-38d47911-4638-4d5b-87a1-cf8e8b046e89 req-af55eda4-fb0d-4495-997e-0af0bc4d864c service nova] Creating event network-vif-deleted:97fe1faf-df0e-473e-9146-1d9129e7bd6e for instance dc212827-9380-4526-8c8a-ec4a67bf3b6a on n-h1-846219-13 Jul 25 16:24:58.673990 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-38d47911-4638-4d5b-87a1-cf8e8b046e89 req-af55eda4-fb0d-4495-997e-0af0bc4d864c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193825 Jul 25 16:24:58.677649 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1881/3828] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:58.818297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99194b3e-8e6b-4fb0-ace0-8a735d98d1d0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927625e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:58.968062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99194b3e-8e6b-4fb0-ace0-8a735d98d1d0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.157206 Jul 25 16:24:58.984832 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1948/3829] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:58 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:59.568577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:59.570178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:59.592055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:59.596434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:59.598443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:59.602688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:59.997742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-413a72cc-953a-4dfa-8b8d-eda9ed040eb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927bc310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:00.223318 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-413a72cc-953a-4dfa-8b8d-eda9ed040eb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.229446 Jul 25 16:25:00.234775 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1949/3830] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:24:59 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:00.549921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:00.588197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-413966e2-3b09-4984-aea2-cbf110402da2 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 1.019144 Jul 25 16:25:00.592555 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1882/3831] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:24:59 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:01.261607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81efb578-6499-471f-a77f-4578a10aff87 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92762790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:01.451062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81efb578-6499-471f-a77f-4578a10aff87 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.199330 Jul 25 16:25:01.468402 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1950/3832] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:01 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:01.645735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:01.650909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:01.651680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9852faa6-8f43-48bf-b432-d0d7748ec0ab req-7f474ec6-bbd1-4570-82de-5ffe2159a419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4e4fc4-3364-4545-a924-527ba65cd638", "tag": "e5b4de22-258e-4a4d-91fc-bbe7c87b59c2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:01.695451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:01.704667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:01.705895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:01.709230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:01.716556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9852faa6-8f43-48bf-b432-d0d7748ec0ab req-7f474ec6-bbd1-4570-82de-5ffe2159a419 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:01.721477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9852faa6-8f43-48bf-b432-d0d7748ec0ab req-7f474ec6-bbd1-4570-82de-5ffe2159a419 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:01.789315 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9852faa6-8f43-48bf-b432-d0d7748ec0ab req-7f474ec6-bbd1-4570-82de-5ffe2159a419 service nova] Creating event network-changed:e5b4de22-258e-4a4d-91fc-bbe7c87b59c2 for instance 4e4e4fc4-3364-4545-a924-527ba65cd638 on n-h1-846219-13 Jul 25 16:25:01.819452 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9852faa6-8f43-48bf-b432-d0d7748ec0ab req-7f474ec6-bbd1-4570-82de-5ffe2159a419 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.385890 Jul 25 16:25:01.825308 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1883/3833] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:25:02.256641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:02.271026 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecf51d62-69a4-4b2e-b3e2-58b804558b47 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.643470 Jul 25 16:25:02.275906 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1951/3834] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:01 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:02.486254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55d4767f-1eed-4902-a79c-91bb9a50f43f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d4c160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:02.696702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55d4767f-1eed-4902-a79c-91bb9a50f43f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.226523 Jul 25 16:25:02.716707 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1884/3835] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:02 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:03.316958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:03.325939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:03.407560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:03.414123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:03.419842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:03.426947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:03.624180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:03.742877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-412f56eb-161b-47d7-9ca7-01225475a15d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92e2f160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:03.976026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:04.038908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-412f56eb-161b-47d7-9ca7-01225475a15d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.305859 Jul 25 16:25:04.056875 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1885/3836] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:03 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:05.012466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:05.071445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b17dfe43-fb77-4890-9860-ddc091eca602 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d4c310>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:05.091636 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-130c691a-f4c1-4f30-90b8-4be149eff30d tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 1.752465 Jul 25 16:25:05.093280 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1952/3837] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:03 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:05.276760 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b17dfe43-fb77-4890-9860-ddc091eca602 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.214660 Jul 25 16:25:05.293288 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1886/3838] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:05 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:06.135474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:06.137804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:06.201960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:06.206489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:06.212321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:06.214978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:06.310387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc0fe736-2a3f-4254-8c7a-ac36efe05d43 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d719d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:06.438575 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc0fe736-2a3f-4254-8c7a-ac36efe05d43 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.142707 Jul 25 16:25:06.439292 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1887/3839] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:06 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:06.602760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:06.652186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-54025a82-67b8-4631-92f3-9bc67883b995 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.522094 Jul 25 16:25:06.674759 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1953/3840] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:06 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:07.463961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-491d3eaa-587f-4c77-83dc-d8a9e3114da7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da49a2ee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:07.603619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-491d3eaa-587f-4c77-83dc-d8a9e3114da7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.147123 Jul 25 16:25:07.608110 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1888/3841] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:07 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:07.697550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:07.704228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:07.737510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:07.738302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:07.742745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:07.743866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.169954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:08.200964 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3e89d5a-08cd-4190-9977-d86300622c14 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.513668 Jul 25 16:25:08.202207 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1954/3842] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:07 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:08.634832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee7ecc6a-62b7-414c-9d1b-76b1652993b2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d71a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:08.723170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "9dc891cf-809e-46e3-8202-96b42b86ece1"}], "security_groups": [{"name": "tempest-securitygroup--625397059"}], "key_name": "tempest-keypair-980109408", "user_data": "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:08.764344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee7ecc6a-62b7-414c-9d1b-76b1652993b2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.138656 Jul 25 16:25:08.781649 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1889/3843] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:08 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:09.266819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:09.313731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:09.343395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:09.344063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:09.345132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:09.345590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:09.741568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:09.786053 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8bcadbb8-9055-440b-b4c2-7c0192bf8c62 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.536747 Jul 25 16:25:09.789942 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1890/3844] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:09 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:09.799319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f89a9470-c606-4f01-aeea-dda6899d20ed tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d71b80>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:09.890224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] validate_networks() for [('9dc891cf-809e-46e3-8202-96b42b86ece1', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:09.946048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f89a9470-c606-4f01-aeea-dda6899d20ed tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.154822 Jul 25 16:25:09.946659 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1891/3845] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:09 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:10.816265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:10.819415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:10.841363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:10.845334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:10.850147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:10.853916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:11.481904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:11.487075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:11.521143 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41c0c0d8-f5e5-47ee-a0dc-d715c14c7eb7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.711643 Jul 25 16:25:11.572402 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1892/3846] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:10 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:11.609648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-642b950d-0b62-4be3-8078-fd8f4d593869 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d47d30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:11.810232 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-642b950d-0b62-4be3-8078-fd8f4d593869 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1443 microversion: 2.1 time: 0.235507 Jul 25 16:25:11.811382 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1893/3847] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:11 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1443 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:11.842343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-581527718", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e812fb40-fcc6-40c5-a453-70ce5887f1c5"}], "security_groups": [{"name": "tempest-securitygroup--339393344"}], "key_name": "tempest-keypair-400121653", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:12.765771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] validate_networks() for [('e812fb40-fcc6-40c5-a453-70ce5887f1c5', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:13.368128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:13.369361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:13.370046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:13.370659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:13.371257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:13.376750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:13.397397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.400074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.401264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.403452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.463609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Getting quotas for project aa44b01f7747404da4ab3cbbee3d7c0f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:13.479984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Getting quotas for user dd6a710bce5a4467adff77afed6da5a3 and project aa44b01f7747404da4ab3cbbee3d7c0f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:13.514908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:13.517745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:13.609788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a41bf137-1667-46d2-8b4e-d106a3ba3444 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 4.904288 Jul 25 16:25:13.611447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1955/3848] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:25:08 2022] POST /compute/v2.1/servers => generated 410 bytes in 4907 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:25:13.617300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:13.618279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:13.630395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.631505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.632558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.633283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.784188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:13.806793 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4b9c0d3-be28-46e4-8442-6126fd143b76 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.193794 Jul 25 16:25:13.825837 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1956/3849] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:13 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:13.843296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cac20ddb-f526-42d9-9693-ba3292c40e5d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927c9790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:13.941204 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cac20ddb-f526-42d9-9693-ba3292c40e5d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1452 microversion: 2.1 time: 0.113369 Jul 25 16:25:13.951601 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1957/3850] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:13 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:13.956708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-efe59227-c797-4b01-a620-f07735ab89ac tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:13.957369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-efe59227-c797-4b01-a620-f07735ab89ac tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:14.555573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:14.558602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:14.559407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:14.560035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:14.560753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:14.586995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:14.590105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:14.593259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:14.594101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:14.675429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-efe59227-c797-4b01-a620-f07735ab89ac tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:14.691600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:14.694736 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-efe59227-c797-4b01-a620-f07735ab89ac tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1229 microversion: 2.1 time: 0.742219 Jul 25 16:25:14.726263 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1958/3851] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:13 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1229 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:14.736504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:14.746595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-332fd9b7-8abd-4bb4-ac64-c7a5dd48fd6d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927475e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:14.781812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:14.787489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:14.855832 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3389c5ab-1176-4a72-a617-ada140db876f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 3.024464 Jul 25 16:25:14.864999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1894/3852] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:25:11 2022] POST /compute/v2.1/servers => generated 403 bytes in 3035 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:25:14.872304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:14.873935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:14.882846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:14.883742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:14.885675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:14.886765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:14.943704 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-332fd9b7-8abd-4bb4-ac64-c7a5dd48fd6d tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 200 len: 1452 microversion: 2.1 time: 0.215309 Jul 25 16:25:14.953460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1959/3853] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:14 2022] GET /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 1452 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:14.969687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28e508c3-0b4f-4365-a299-8c232fc7fade tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:15.029745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-28e508c3-0b4f-4365-a299-8c232fc7fade tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:15.256206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:15.296138 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d5c952b-02e2-4510-ae7d-3aec8d44fe6e tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1256 microversion: 2.1 time: 0.429432 Jul 25 16:25:15.301598 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1895/3854] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:14 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1256 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:15.320751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e48e0d90-3c6d-4971-baad-062c2d565fcf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92d69940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:15.455018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-28e508c3-0b4f-4365-a299-8c232fc7fade tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:15.486808 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-28e508c3-0b4f-4365-a299-8c232fc7fade tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1244 microversion: 2.1 time: 0.530826 Jul 25 16:25:15.502935 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1960/3855] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:14 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1244 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:15.735814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:15.741669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:15.768585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:15.769822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:15.771637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:15.774220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:15.987921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:16.028585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e72b54a7-54d7-4de0-8f28-6c20e084617c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1281 microversion: 2.1 time: 0.284749 Jul 25 16:25:16.030415 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1961/3856] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:15 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1281 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:16.342848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:16.347441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:16.388334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.389330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.390773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.391559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.693017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.695892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.698079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lazy-loading 'fault' on Instance uuid dc212827-9380-4526-8c8a-ec4a67bf3b6a {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:25:16.926329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51387870067647ea81d15530cf0296cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13a4c5edb33497ba0348afda935754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:16.966287 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-adbfc9ea-d86e-47ea-b219-576606dfc6d7 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 200 len: 1215 microversion: 2.1 time: 0.622452 Jul 25 16:25:16.967456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1962/3857] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:16 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 1215 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:17.009402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:17.019646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:17.093613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.098031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.100008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.104590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.386941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:17.408837 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38fc9bfb-3056-48d2-a40e-91e89953bfc8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1248 microversion: 2.1 time: 0.432650 Jul 25 16:25:17.424756 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1963/3858] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:16 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1248 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:17.464254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:17.465529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:17.477805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.478984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.480500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.481262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.515177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:17.574551 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e48e0d90-3c6d-4971-baad-062c2d565fcf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 204 len: 0 microversion: 2.1 time: 2.271072 Jul 25 16:25:17.576337 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1896/3859] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:15 2022] DELETE /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 0 bytes in 2274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:25:17.610928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:17.612378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:17.631165 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2b3ab24-90a0-40a2-adac-459e59ada988 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1287 microversion: 2.1 time: 0.209442 Jul 25 16:25:17.633273 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1964/3860] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:17 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1287 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:17.670472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:17.686922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:17.742075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.745308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.754385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.759321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.836806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:25:17.994026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:17.994869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] [instance: dc212827-9380-4526-8c8a-ec4a67bf3b6a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:18.023195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.026267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.030363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.031505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.131186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] HTTP exception thrown: Instance dc212827-9380-4526-8c8a-ec4a67bf3b6a could not be found. Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Request method failure captured: Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a HTTP/1.1 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sNGTMehbaFFm6T1jxFzzvKD2Uiq2dErmA_6ivYTukrAHnHi--DWDylk74zLiIzmlAh3iuzKJCGOdFr73nvsOsTjxFv0uuof5qkAhTpWT8b65jvX1ByRv294cIq96KJOe7y2DLhD59xW3vlYYUQnv-znW5wQGQFBhGVQoigInTCR4vc Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: b13a4c5edb33497ba0348afda935754d Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestBootFromVolume-2007671125 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b13a4c5edb33497ba0348afda935754d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/b13a4c5edb33497ba0348afda935754d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/b13a4c5edb33497ba0348afda935754d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_b13a4c5edb33497ba0348afda935754d"}]}] Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestBootFromVolume-2007671125 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: b13a4c5edb33497ba0348afda935754d Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2007671125 Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestBootFromVolume-2007671125-project Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 51387870067647ea81d15530cf0296cf Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestBootFromVolume-2007671125-project Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance dc212827-9380-4526-8c8a-ec4a67bf3b6a could not be found. Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'dc212827-9380-4526-8c8a-ec4a67bf3b6a'} Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc212827-9380-4526-8c8a-ec4a67bf3b6a could not be found. Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc212827-9380-4526-8c8a-ec4a67bf3b6a could not be found. Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:18.139399 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc212827-9380-4526-8c8a-ec4a67bf3b6a could not be found. Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Returning 404 to user: Instance dc212827-9380-4526-8c8a-ec4a67bf3b6a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:25:18.146486 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-145be03f-2907-475f-9461-4c41aaf8c71c tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a" status: 404 len: 111 microversion: 2.1 time: 0.152777 Jul 25 16:25:18.147450 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1c2d546-9ef1-48c4-9dd2-4f8f8285ebde tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 204 len: 0 microversion: 2.1 time: 0.558508 Jul 25 16:25:18.149289 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1965/3862] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:17 2022] GET /compute/v2.1/servers/dc212827-9380-4526-8c8a-ec4a67bf3b6a => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:25:18.160701 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1897/3862] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:25:17 2022] DELETE /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:25:18.165194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dca4b7ca-8734-4efa-9186-86d8b4d7bb20 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] Calling method '.version_select at 0x7f9d92762700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:18.187353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0215c5d0-c950-43d4-8ca9-eaacc40ad693 req-fccccc5b-50a0-4ace-bd32-925ee9dc4c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49458875-c2e2-478b-8b53-82e8674dd042", "name": "network-vif-unplugged", "status": "completed", "tag": "bf899014-1c65-47ce-bcdc-0d18a8fcc213"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:18.223067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0215c5d0-c950-43d4-8ca9-eaacc40ad693 req-fccccc5b-50a0-4ace-bd32-925ee9dc4c13 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.226367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0215c5d0-c950-43d4-8ca9-eaacc40ad693 req-fccccc5b-50a0-4ace-bd32-925ee9dc4c13 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.262292 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dca4b7ca-8734-4efa-9186-86d8b4d7bb20 tempest-ServersTestBootFromVolume-2007671125 tempest-ServersTestBootFromVolume-2007671125-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487779037" status: 202 len: 0 microversion: 2.1 time: 0.108699 Jul 25 16:25:18.263036 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1966/3863] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:25:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487779037 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:25:18.263823 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0215c5d0-c950-43d4-8ca9-eaacc40ad693 req-fccccc5b-50a0-4ace-bd32-925ee9dc4c13 service nova] Creating event network-vif-unplugged:bf899014-1c65-47ce-bcdc-0d18a8fcc213 for instance 49458875-c2e2-478b-8b53-82e8674dd042 on n-h2-846219-13 Jul 25 16:25:18.293017 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0215c5d0-c950-43d4-8ca9-eaacc40ad693 req-fccccc5b-50a0-4ace-bd32-925ee9dc4c13 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119596 Jul 25 16:25:18.294536 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1898/3864] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:18.450234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:18.450958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:18.474208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.476754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.496773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.497456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.638367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1440306879", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2d092cd9-2c7a-465d-800a-441e40e4458e"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:18.789749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:18.817711 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00aff2ec-5a60-4aff-81b8-ad7082ba203b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1304 microversion: 2.1 time: 0.366910 Jul 25 16:25:18.819708 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1967/3865] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:18 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1304 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:18.841224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:18.861802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:18.942806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.951051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.952855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.960397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.998520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] validate_networks() for [('2d092cd9-2c7a-465d-800a-441e40e4458e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:19.434558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:19.468520 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c41d8fe8-9777-4e78-b293-4188bae50796 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1287 microversion: 2.1 time: 0.643572 Jul 25 16:25:19.472502 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1968/3866] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:18 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1287 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:19.864569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:19.870009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:19.896520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.903518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:19.904914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.909714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:20.401109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:20.415283 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d0048943-b51d-4c91-9222-662d19dd247f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1302 microversion: 2.1 time: 0.554695 Jul 25 16:25:20.422764 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1969/3867] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:19 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1302 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:20.506015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:20.507536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:20.529454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:20.537803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:20.550232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:20.554260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:21.842833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:21.865426 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-780cf33e-cf28-432f-b49d-4a9bbcd350e1 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 1.367492 Jul 25 16:25:21.870071 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1970/3868] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:20 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:21.883837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:21.884876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:21.902689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:21.904787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:21.906815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:21.908935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.149222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:22.179814 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51454e54-ce60-4f79-8a0a-1e7477429b43 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1302 microversion: 2.1 time: 0.307783 Jul 25 16:25:22.180669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1971/3869] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:21 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1302 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:22.358359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:22.358871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:22.359384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:22.364411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:22.364930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:22.397299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.398099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.399383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.400159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.521859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:22.552829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Getting quotas for user ccbaed5ca4f5414b9e06fa95dbbac29c and project f00e2ef7f7ba4d089f0d1acafd5d559e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:22.568561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-541b6003-b43d-4aa0-a9e6-1300ffacb544 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'create', calling method: .version_select at 0x7f9d927d68b0>, body: {"keypair": {"name": "tempest-keypair-1808878095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBftOFH5FkFvH68//5hPzdyRJ4yB+9fX/qfKifCc7PUGmQXLbyuFsTNLmU6/Kc1SsjXdmqkFfSp0cgaqyTBoZrJRxb665Llvb5RxrphHbp6WC0wZVYMmEEZ1lGAnCehPxg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:22.637949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:22.643882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:22.668282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-541b6003-b43d-4aa0-a9e6-1300ffacb544 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for project d5bb17bf33f845cd988f685ee08af589. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:22.691540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-541b6003-b43d-4aa0-a9e6-1300ffacb544 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for user 18df729ef0034f6a88f6acbc7054db92 and project d5bb17bf33f845cd988f685ee08af589. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:22.832411 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-541b6003-b43d-4aa0-a9e6-1300ffacb544 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.623877 Jul 25 16:25:22.834841 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1972/3870] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:25:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 637 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:25:22.880157 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e7cc5eca-6c33-4bb2-b565-a7b0acb8c35b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.247075 Jul 25 16:25:22.883647 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1899/3871] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:25:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 4252 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:25:22.908084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:22.924992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45d48002-fb6e-4b74-a5dd-5e3a93a49512 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:22.927821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:22.930019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45d48002-fb6e-4b74-a5dd-5e3a93a49512 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:22.981460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.984858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.989449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.992696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:23.427167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:23.900442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-45d48002-fb6e-4b74-a5dd-5e3a93a49512 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:23.918995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45d48002-fb6e-4b74-a5dd-5e3a93a49512 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1212 microversion: 2.1 time: 1.023501 Jul 25 16:25:23.920211 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1900/3872] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:22 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1212 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:23.958266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:23.959111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:23.981328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:23.981792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:23.982678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:23.983147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.203964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:25.219937 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bb0282a9-2ab0-475a-8169-1dfda9df8cb9 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 2.331418 Jul 25 16:25:25.232164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1973/3873] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:22 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:25.251151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-31794c2e-b903-418e-8574-4ac065b46d83 req-c1a892e2-3b46-4332-8dd6-b57dabc530ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49458875-c2e2-478b-8b53-82e8674dd042", "name": "network-vif-deleted", "tag": "bf899014-1c65-47ce-bcdc-0d18a8fcc213"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:25.327354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-31794c2e-b903-418e-8574-4ac065b46d83 req-c1a892e2-3b46-4332-8dd6-b57dabc530ed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.328042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-31794c2e-b903-418e-8574-4ac065b46d83 req-c1a892e2-3b46-4332-8dd6-b57dabc530ed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.407189 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-31794c2e-b903-418e-8574-4ac065b46d83 req-c1a892e2-3b46-4332-8dd6-b57dabc530ed service nova] Creating event network-vif-deleted:bf899014-1c65-47ce-bcdc-0d18a8fcc213 for instance 49458875-c2e2-478b-8b53-82e8674dd042 on n-h2-846219-13 Jul 25 16:25:25.432454 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-31794c2e-b903-418e-8574-4ac065b46d83 req-c1a892e2-3b46-4332-8dd6-b57dabc530ed service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194007 Jul 25 16:25:25.433535 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1974/3874] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:25.487215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:25.494219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:25.548147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.552532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.559094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.562413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.821074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:25.847522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc8b4e1f-e1e8-4394-b77c-a2ec803554f7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 1.911387 Jul 25 16:25:25.852080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1901/3875] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:23 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:26.171782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:26.211941 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0de639c7-13eb-4faa-953f-ca456f68fd1e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1208 microversion: 2.1 time: 0.768328 Jul 25 16:25:26.222479 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1975/3876] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:25 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1208 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:26.265928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:26.266889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:26.319925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:26.320637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:26.341318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:26.342289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:26.895716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:26.896409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:26.917145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:26.922876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:26.932744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:26.935430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:28.796372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:28.822370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3bd32d0-d06b-41d3-8e88-015e72b17f3c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 2.562225 Jul 25 16:25:28.830757 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1902/3877] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:26 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:28.839951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:28.844309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:28.887331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:28.887854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:28.892569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:28.896630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.370117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:29.384659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d6b829e-9529-4376-8244-27a932cd5134 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1270 microversion: 2.1 time: 0.552303 Jul 25 16:25:29.391346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:29.405855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1903/3878] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:28 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1270 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:29.418061 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2eb9fc8a-7004-4389-aa06-1b5ccc2411db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 2.522084 Jul 25 16:25:29.420353 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1976/3879] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:26 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:29.424169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2afe51d0-3992-478b-b0f1-6097641099d9 req-a0596942-4104-4666-b34d-81daae91ed11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c1d060-9021-42bb-b787-1c1a101e441a", "tag": "4d7f522b-9a02-4f11-bedd-7d195b51145f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:29.445750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2afe51d0-3992-478b-b0f1-6097641099d9 req-a0596942-4104-4666-b34d-81daae91ed11 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.446861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2afe51d0-3992-478b-b0f1-6097641099d9 req-a0596942-4104-4666-b34d-81daae91ed11 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.477720 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2afe51d0-3992-478b-b0f1-6097641099d9 req-a0596942-4104-4666-b34d-81daae91ed11 service nova] Creating event network-changed:4d7f522b-9a02-4f11-bedd-7d195b51145f for instance 16c1d060-9021-42bb-b787-1c1a101e441a on n-h1-846219-13 Jul 25 16:25:29.497298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2afe51d0-3992-478b-b0f1-6097641099d9 req-a0596942-4104-4666-b34d-81daae91ed11 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089239 Jul 25 16:25:29.505064 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1904/3880] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:29.873424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:29.874333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:29.907608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.914192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.918229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.920908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.439916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:30.440788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:30.461320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:30.463042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.464123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:30.464695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.819777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:30.842443 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9008151a-3529-488d-a31a-15ccb6356e30 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1270 microversion: 2.1 time: 0.408639 Jul 25 16:25:30.847721 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1905/3881] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:30 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1270 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:30.862675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:30.863932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:30.880750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:30.881660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.884223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:30.885073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.319564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:31.363949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-443a4e98-502a-4e66-9e00-2f3f737ac02f tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 1.496218 Jul 25 16:25:31.365559 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1977/3882] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:29 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:31.703326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:31.762309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7dd76da5-c3a2-4939-9c72-e2564aad67f9 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 0.901700 Jul 25 16:25:31.769385 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1906/3883] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:30 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:31.884589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:31.886044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:31.934103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bfeec24b-cc76-4f72-97a9-dc9b9e43cd55 req-ea0debf3-5cd8-41e4-9bfe-efbdfa5d7f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4e924c-5cee-4432-8388-aa9faa67c2f3", "tag": "56f7716c-53e5-41b9-99b2-38ed93aa7e9e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:31.940887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.944543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.947172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.954134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.979244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bfeec24b-cc76-4f72-97a9-dc9b9e43cd55 req-ea0debf3-5cd8-41e4-9bfe-efbdfa5d7f0b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.986805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bfeec24b-cc76-4f72-97a9-dc9b9e43cd55 req-ea0debf3-5cd8-41e4-9bfe-efbdfa5d7f0b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:32.045849 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bfeec24b-cc76-4f72-97a9-dc9b9e43cd55 req-ea0debf3-5cd8-41e4-9bfe-efbdfa5d7f0b service nova] Creating event network-changed:56f7716c-53e5-41b9-99b2-38ed93aa7e9e for instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 on n-h1-846219-13 Jul 25 16:25:32.082282 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bfeec24b-cc76-4f72-97a9-dc9b9e43cd55 req-ea0debf3-5cd8-41e4-9bfe-efbdfa5d7f0b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156052 Jul 25 16:25:32.087798 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1907/3884] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:32.431226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:32.463946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:32.470210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:32.520919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:32.543027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:32.545336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:32.547131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:32.731556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:33.171894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:33.192736 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea1a0a22-85ea-4fd5-a90e-7f8961ab9bc5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 1.313316 Jul 25 16:25:33.194657 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1978/3885] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:31 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:33.230084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:33.233879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:33.264887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:33.266537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:33.268479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:33.271431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:33.587739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:33.618151 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97cedf77-7838-4bf9-a252-abd43544b8cb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 1.217819 Jul 25 16:25:33.619502 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1908/3886] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:32 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:34.151679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:34.187818 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bcb55ecc-3bad-41b7-a259-3d416f5fde06 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 0.990147 Jul 25 16:25:34.214340 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1979/3887] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:33 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:34.238490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:34.241525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:34.264393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=14 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:34.271295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.277875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:34.281257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.283910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:34.663406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:34.664862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:34.707071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.710814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:34.712336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.726757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:35.157301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:35.202075 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5d578014-98d4-4d2b-b195-eb94c7adfcb9 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 0.972023 Jul 25 16:25:35.205774 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1909/3888] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:34 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:35.236405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:35.258253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:35.272700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:35.282560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:35.284607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:35.285802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:35.499527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:35.537662 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-823a55e5-61d2-4618-adc5-3772ebfdfc2a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 0.870627 Jul 25 16:25:35.539784 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1980/3889] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:34 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:35.794379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-584147465", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b1b0602-8b2b-402c-b734-1a415e2686d1"}], "security_groups": [{"name": "tempest-securitygroup--404792508"}], "key_name": "tempest-keypair-1808878095", "user_data": "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:35.882209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:35.901961 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fcde17ee-ade9-4c04-9021-1ab778e9c63a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 0.675534 Jul 25 16:25:35.903165 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1910/3890] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:35 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:36.273027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:36.283567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:36.310721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:36.311878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.314711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:36.315855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.587002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] validate_networks() for [('2b1b0602-8b2b-402c-b734-1a415e2686d1', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:37.091866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:37.117016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e44bbe04-0b29-4ef1-b8a9-a67400ce4d1b tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 0.867332 Jul 25 16:25:37.135542 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1911/3891] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:36 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:37.185922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:37.187393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:37.200410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.202583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:37.204481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.205550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:37.910044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:37.927410 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ffa5340b-05cc-4f78-810d-b112c8b58732 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 0.752903 Jul 25 16:25:37.927925 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1912/3892] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:37 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:37.941491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e8b193fe-fc6a-4e4f-bc52-21ad52930135 req-b50cca9d-f7a8-4ddf-8325-57571ef399fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "654e39ff-8f92-4810-806a-4f62b3ffba22", "tag": "db04ca46-b184-4785-b18f-997d2dff3ca2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:37.970404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e8b193fe-fc6a-4e4f-bc52-21ad52930135 req-b50cca9d-f7a8-4ddf-8325-57571ef399fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.971243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e8b193fe-fc6a-4e4f-bc52-21ad52930135 req-b50cca9d-f7a8-4ddf-8325-57571ef399fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.021321 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e8b193fe-fc6a-4e4f-bc52-21ad52930135 req-b50cca9d-f7a8-4ddf-8325-57571ef399fd service nova] Creating event network-changed:db04ca46-b184-4785-b18f-997d2dff3ca2 for instance 654e39ff-8f92-4810-806a-4f62b3ffba22 on n-h2-846219-13 Jul 25 16:25:38.055386 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e8b193fe-fc6a-4e4f-bc52-21ad52930135 req-b50cca9d-f7a8-4ddf-8325-57571ef399fd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122723 Jul 25 16:25:38.056508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1913/3893] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:38.086261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:38.087072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:38.120242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.121952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.123693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.124778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.786289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:38.788430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:38.790111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:38.791747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:38.793002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:38.815925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.817385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.820509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.821572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.855025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:38.866948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:38.871456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for project d5bb17bf33f845cd988f685ee08af589. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:38.885197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07e2572f-45e8-433f-b0a0-ec517c259469 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 0.818593 Jul 25 16:25:38.885888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for user 18df729ef0034f6a88f6acbc7054db92 and project d5bb17bf33f845cd988f685ee08af589. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:38.903072 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1914/3894] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:38 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:38.924863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:38.926668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-14eed8a1-f813-438a-9b89-4bb7a884c531 req-ee4a343b-5215-47db-8d18-2fdfefb13c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c1d060-9021-42bb-b787-1c1a101e441a", "name": "network-vif-plugged", "status": "completed", "tag": "4d7f522b-9a02-4f11-bedd-7d195b51145f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:38.937183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:38.946450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-14eed8a1-f813-438a-9b89-4bb7a884c531 req-ee4a343b-5215-47db-8d18-2fdfefb13c72 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.947408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-14eed8a1-f813-438a-9b89-4bb7a884c531 req-ee4a343b-5215-47db-8d18-2fdfefb13c72 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.979459 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-14eed8a1-f813-438a-9b89-4bb7a884c531 req-ee4a343b-5215-47db-8d18-2fdfefb13c72 service nova] Creating event network-vif-plugged:4d7f522b-9a02-4f11-bedd-7d195b51145f for instance 16c1d060-9021-42bb-b787-1c1a101e441a on n-h1-846219-13 Jul 25 16:25:38.992820 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-14eed8a1-f813-438a-9b89-4bb7a884c531 req-ee4a343b-5215-47db-8d18-2fdfefb13c72 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086709 Jul 25 16:25:38.994594 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1915/3895] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:39.006038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:39.007489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:39.021521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:39.023205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:39.025416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:39.026366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:39.082492 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e04843b3-71ae-432e-930d-27c10c66694c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 3.309975 Jul 25 16:25:39.085420 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1981/3896] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:25:35 2022] POST /compute/v2.1/servers => generated 403 bytes in 3315 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 25 16:25:39.109539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:39.110899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:39.131960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:39.133334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:39.136202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:39.138178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:39.656632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:39.679179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:39.692050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-62035958-b261-47bc-b9aa-2e01d4ab913a tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 0.603074 Jul 25 16:25:39.693526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1982/3897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:39 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:39.704698 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bf6dbf25-f36b-4a80-bf4e-edb07a34eec1 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 0.707963 Jul 25 16:25:39.708512 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1916/3898] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:38 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:39.719198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7176c85d-cbe5-4fc2-934a-181e6fdfda4d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:39.720262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7176c85d-cbe5-4fc2-934a-181e6fdfda4d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:39.751134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:39.952526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:39.955342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:39.981203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:39.986060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:39.988649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:39.989742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.029746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7176c85d-cbe5-4fc2-934a-181e6fdfda4d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:40.065388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7176c85d-cbe5-4fc2-934a-181e6fdfda4d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:40.068614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7176c85d-cbe5-4fc2-934a-181e6fdfda4d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:40.072025 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7176c85d-cbe5-4fc2-934a-181e6fdfda4d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1285 microversion: 2.20 time: 0.372008 Jul 25 16:25:40.073034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1983/3899] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:39 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:40.742827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:40.759021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:40.762576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:40.786462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-836e1ca7-f88b-4c22-989f-a52dde7c401f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 0.854917 Jul 25 16:25:40.787843 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1917/3900] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:39 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:40.806066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.807705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.810283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.811792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.815034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:40.817778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:40.878026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.880424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.882565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.883908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:41.732910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:41.787235 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-afbe7801-1a16-43c9-8b3f-f6d7eee1909c tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1354 microversion: 2.1 time: 1.054203 Jul 25 16:25:41.793599 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1984/3901] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:40 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1354 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:41.812366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:41.817000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:41.846238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:41.854695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:41.860166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:41.865002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.026047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:42.071002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55a374b7-a2cc-4514-8e5c-92efa12f70ba tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 1.273663 Jul 25 16:25:42.076436 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1918/3902] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:40 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:42.104400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:42.107977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:42.155622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.162821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.172433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.175437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.264335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:42.314442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:42.324488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:42.330812 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85124fd0-becd-4981-be42-5f506dc749ed tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1337 microversion: 2.20 time: 0.534474 Jul 25 16:25:42.343222 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1985/3903] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:41 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1337 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:42.829319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:42.830679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:42.890238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.891202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.893547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.895768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:43.028132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:43.365579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:43.414203 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2293d532-a4e4-4b34-8dd7-a04f1c7c4b03 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 1.330856 Jul 25 16:25:43.417418 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1919/3904] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:42 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:43.447906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:43.452654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:43.495007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:43.496631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:43.510368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:43.511657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:43.745156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:43.775890 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5425a648-9b9e-4bfd-b3a9-96f9f8f203f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1544 microversion: 2.1 time: 0.955069 Jul 25 16:25:43.777607 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1986/3905] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:42 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1544 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:43.847709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:43.848896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:43.872471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:43.873910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:43.875822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:43.882998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.308989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:44.334560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:44.340603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:44.343620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ee7d857-aeb8-405f-b76d-d61cea3bbaba tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1343 microversion: 2.20 time: 0.535316 Jul 25 16:25:44.345677 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1987/3906] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:43 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1343 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:44.356690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:44.358359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:44.380394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.384024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.386280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.388815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.547818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:44.583886 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ca5ffc5-25ef-42fe-9141-6cd8dc143fc3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 1.155267 Jul 25 16:25:44.585971 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1920/3907] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:43 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:44.596345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:44.597594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:44.607071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.608101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.609503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.610343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.868822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57e9b7bb-20d8-4264-bebd-6692e6b56efb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.519393 Jul 25 16:25:44.872393 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1988/3908] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:25:44 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a/os-interface => generated 284 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:44.883267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:44.884234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:44.899779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.901033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.903032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.904778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:45.650275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:45.709304 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41ecd8b4-c061-467c-815c-52bd66ea4cf4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.118391 Jul 25 16:25:45.715582 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1921/3909] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:44 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:45.754542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:45.756892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:45.779037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:45.784678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:45.790536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:45.793020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.029140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.082252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.086698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.089488 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e7a72e6-96f7-4462-8bf6-b9d929b59531 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1343 microversion: 2.20 time: 0.370736 Jul 25 16:25:46.091554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1922/3910] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:45 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1343 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:46.103981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:46.106268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:46.126623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.132225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.133235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.134345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.136111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.170108 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bfeffccf-7fb7-477d-964e-78213643b17f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 1.287121 Jul 25 16:25:46.171440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1989/3911] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:44 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:46.188240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:46.190034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:46.218178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.218960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.220381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.221169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.207191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:47.251417 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1de47e3a-de7e-4e03-8b21-f8e209813e83 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.077688 Jul 25 16:25:47.252542 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1990/3912] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:46 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:47.267324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-939458a0-9344-4120-820c-5abf94e0c4df req-1b46a9fb-10ee-4e1d-996f-bd49cbd9687b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654e39ff-8f92-4810-806a-4f62b3ffba22", "name": "network-vif-plugged", "status": "completed", "tag": "db04ca46-b184-4785-b18f-997d2dff3ca2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:47.312077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-939458a0-9344-4120-820c-5abf94e0c4df req-1b46a9fb-10ee-4e1d-996f-bd49cbd9687b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.313861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-939458a0-9344-4120-820c-5abf94e0c4df req-1b46a9fb-10ee-4e1d-996f-bd49cbd9687b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.366442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-939458a0-9344-4120-820c-5abf94e0c4df req-1b46a9fb-10ee-4e1d-996f-bd49cbd9687b service nova] Creating event network-vif-plugged:db04ca46-b184-4785-b18f-997d2dff3ca2 for instance 654e39ff-8f92-4810-806a-4f62b3ffba22 on n-h2-846219-13 Jul 25 16:25:47.392005 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-939458a0-9344-4120-820c-5abf94e0c4df req-1b46a9fb-10ee-4e1d-996f-bd49cbd9687b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134465 Jul 25 16:25:47.396554 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1991/3913] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:47.413204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:47.416723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:47.435021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.436553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.438674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.439584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.474844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:47.494762 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d78908e-0b6d-46b5-a841-39a5cb514525 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 1.399865 Jul 25 16:25:47.498363 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1923/3914] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:46 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:47.508629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:47.513658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:47.535292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.535292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.536242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.536795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.579993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:48.608671 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1fa7178f-5c58-4348-ba0f-826c2ad6183f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 1.108660 Jul 25 16:25:48.627169 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1924/3915] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:47 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:48.649807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:48.652003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:48.678272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:48.701641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:48.703994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.708494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:48.711602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.768371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:48.787465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:48.789209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:48.793322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b697a42a-7d84-463e-9f1c-b0cc8e7b3dd9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 1.392722 Jul 25 16:25:48.798172 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1992/3916] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:47 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:48.814199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:48.814844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:48.834877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:48.835451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.837245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:48.838743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.883107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:50.061123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:50.279905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:50.300263 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c213891-a66d-45f1-9126-3761a6bb06e5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1312 microversion: 2.1 time: 1.500715 Jul 25 16:25:50.321132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1993/3917] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:48 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1312 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:50.321643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:50.336559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-12ffdee3-f5f8-437c-b4d5-b640b86eb2a1 req-87fc5fce-ceec-4642-8dd3-8027ee56b3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4e924c-5cee-4432-8388-aa9faa67c2f3", "name": "network-vif-plugged", "status": "completed", "tag": "56f7716c-53e5-41b9-99b2-38ed93aa7e9e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:50.358349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-12ffdee3-f5f8-437c-b4d5-b640b86eb2a1 req-87fc5fce-ceec-4642-8dd3-8027ee56b3cd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.358821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-12ffdee3-f5f8-437c-b4d5-b640b86eb2a1 req-87fc5fce-ceec-4642-8dd3-8027ee56b3cd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.360804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed40e862-52eb-441c-baff-0ca8d7591369 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.730039 Jul 25 16:25:50.362080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1925/3918] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:48 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:50.379032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:50.389724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:50.417145 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-12ffdee3-f5f8-437c-b4d5-b640b86eb2a1 req-87fc5fce-ceec-4642-8dd3-8027ee56b3cd service nova] Creating event network-vif-plugged:56f7716c-53e5-41b9-99b2-38ed93aa7e9e for instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 on n-h1-846219-13 Jul 25 16:25:50.419940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-12ffdee3-f5f8-437c-b4d5-b640b86eb2a1 req-87fc5fce-ceec-4642-8dd3-8027ee56b3cd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109464 Jul 25 16:25:50.420582 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1994/3919] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:50.430318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.431503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.437830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.438638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.441607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:50.443026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:50.471936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.472844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.489998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.491000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.430361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:51.464615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da7e2437-7ca1-4590-bbfd-f493e712ab2c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 1.095818 Jul 25 16:25:51.477166 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1926/3920] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:50 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:51.495751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:51.497305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:51.517769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:51.518589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.520029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:51.532959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.649783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:51.679575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:51.692673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:51.695452 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97a05313-966d-475a-82e9-f01785652c00 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 1.273187 Jul 25 16:25:51.703083 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1995/3921] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:50 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:51.714120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:51.715253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:51.741275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:51.745732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.750845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:51.756677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.418675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:52.436309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ccfb743-e52b-4cb9-97c2-646bc51c13d1 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.957274 Jul 25 16:25:52.437464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1927/3922] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:51 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:52.450843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e1699bd8-18c0-45b2-9582-ac62058c616b req-4f8b2b1c-d5a7-40e2-8e47-96fc55f4617c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c1d060-9021-42bb-b787-1c1a101e441a", "tag": "4d7f522b-9a02-4f11-bedd-7d195b51145f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:52.499894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e1699bd8-18c0-45b2-9582-ac62058c616b req-4f8b2b1c-d5a7-40e2-8e47-96fc55f4617c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.500703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e1699bd8-18c0-45b2-9582-ac62058c616b req-4f8b2b1c-d5a7-40e2-8e47-96fc55f4617c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.595045 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e1699bd8-18c0-45b2-9582-ac62058c616b req-4f8b2b1c-d5a7-40e2-8e47-96fc55f4617c service nova] Creating event network-changed:4d7f522b-9a02-4f11-bedd-7d195b51145f for instance 16c1d060-9021-42bb-b787-1c1a101e441a on n-h1-846219-13 Jul 25 16:25:52.648921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:52.678074 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e1699bd8-18c0-45b2-9582-ac62058c616b req-4f8b2b1c-d5a7-40e2-8e47-96fc55f4617c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235808 Jul 25 16:25:52.679561 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1928/3923] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:52.714281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:52.720939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:52.753484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.754386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.755684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.756428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.773549 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11fca01f-bcf0-48b4-a742-6c09a6356a80 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1492 microversion: 2.1 time: 1.059894 Jul 25 16:25:52.782025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1996/3924] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:51 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1492 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:52.846199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-496657607", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "6caa10b5-bb0b-47f3-bbd9-62b23141517a"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:53.046785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] validate_networks() for [('6caa10b5-bb0b-47f3-bbd9-62b23141517a', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:53.071415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:53.087791 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dd511ea7-1991-4107-bcc1-b4f11d3c23a6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1369 microversion: 2.1 time: 0.400007 Jul 25 16:25:53.088650 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1929/3925] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:52 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1369 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:53.094011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:53.100913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:53.113081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.113940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.114989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.115723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.776246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:53.804849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:53.810766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:53.814397 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a856f5e-1f38-4f24-8977-825e0eae80a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 0.723386 Jul 25 16:25:53.816537 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1930/3926] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:53 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:53.830532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-341685149"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:53.836587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:53.858288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.861171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.863517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.865057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.186888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:54.241647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83e8d195-35c1-4210-a365-1cc5f0d245b5 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "POST /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22/action" status: 202 len: 0 microversion: 2.1 time: 0.420123 Jul 25 16:25:54.245349 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1931/3927] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:25:53 2022] POST /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:25:54.261740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:54.265777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:54.284504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.285692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.288659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.290397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:55.804859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:55.820314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc546930-966a-4209-8c05-cb6ff00953f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1558 microversion: 2.1 time: 1.571879 Jul 25 16:25:55.820968 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1932/3928] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:54 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1558 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:55.836864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bfb6f133-31b7-4356-b138-a3ba69464358 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92dc5c10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:56.093151 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bfb6f133-31b7-4356-b138-a3ba69464358 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d" status: 200 len: 1416 microversion: 2.1 time: 0.270560 Jul 25 16:25:56.098248 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1933/3929] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:55 2022] GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d => generated 1416 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:56.129517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:56.131422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:56.164724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.169704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.171452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.186403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.436828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:56.438706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:56.443823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:56.445055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:56.447841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:56.499899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.501264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.504064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.505308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.579386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:56.591087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for user ed4735185f84421f92bc1404d62f26e3 and project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:56.624548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:56.633181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:56.734250 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64bc82ca-f52c-4aa9-8332-7d428c006ea9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.924845 Jul 25 16:25:56.735573 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1997/3930] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:25:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 3952 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:25:56.758742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-52accfbd-0d07-4786-b05f-0b87caf8f901 req-7fd8f925-8421-4f8b-934a-6547f9f9741e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:56.793294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:56.805835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-52accfbd-0d07-4786-b05f-0b87caf8f901 req-7fd8f925-8421-4f8b-934a-6547f9f9741e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.806323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-52accfbd-0d07-4786-b05f-0b87caf8f901 req-7fd8f925-8421-4f8b-934a-6547f9f9741e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.823956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:56.828461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:56.831875 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-52accfbd-0d07-4786-b05f-0b87caf8f901 req-7fd8f925-8421-4f8b-934a-6547f9f9741e service nova] Creating event network-changed:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:25:56.835342 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4db901dc-06d7-456d-8ab1-ff414b339c12 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 0.734209 Jul 25 16:25:56.841369 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1934/3931] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:56 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:56.855181 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-52accfbd-0d07-4786-b05f-0b87caf8f901 req-7fd8f925-8421-4f8b-934a-6547f9f9741e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115310 Jul 25 16:25:56.861878 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1998/3932] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:56.863882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:56.877252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:56.881956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1190a3ef-bd74-4789-936b-3b06e4b9c49f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d927d65e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:56.913543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.914532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.916388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.927782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.979609 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1190a3ef-bd74-4789-936b-3b06e4b9c49f tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d" status: 200 len: 1416 microversion: 2.1 time: 0.113204 Jul 25 16:25:56.980221 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 1999/3933] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:56 2022] GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d => generated 1416 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:57.009176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2fee1c8f-1882-4eab-ba8e-b11545852d9c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:57.010957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2fee1c8f-1882-4eab-ba8e-b11545852d9c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:57.156513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2fee1c8f-1882-4eab-ba8e-b11545852d9c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:57.176234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2fee1c8f-1882-4eab-ba8e-b11545852d9c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1218 microversion: 2.1 time: 0.181176 Jul 25 16:25:57.176952 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2000/3934] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:56 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1218 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:57.182469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15c95b49-ed51-4fca-9598-bf1b7e6c68d0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da4a1f3a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:57.241627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9de95de6-2b1d-4987-8471-90a680dec7a8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.396411 Jul 25 16:25:57.243206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1935/3935] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:25:56 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-interface => generated 284 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:57.767052 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15c95b49-ed51-4fca-9598-bf1b7e6c68d0 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d" status: 204 len: 0 microversion: 2.1 time: 0.588462 Jul 25 16:25:57.769239 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2001/3936] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:57 2022] DELETE /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:25:57.786883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-953eed8a-011e-4d31-a370-55b654363209 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d939dd160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:57.875594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:57.877143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:57.929754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:57.930530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:57.936862 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-953eed8a-011e-4d31-a370-55b654363209 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Image not found. Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-953eed8a-011e-4d31-a370-55b654363209 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d HTTP/1.1 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '55189531-f6a3-41cb-a146-ec491c7b669d'} Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 55189531-f6a3-41cb-a146-ec491c7b669d Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 16:25:57.942478 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55189531-f6a3-41cb-a146-ec491c7b669d could not be found. Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-953eed8a-011e-4d31-a370-55b654363209 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:25:57.948030 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-953eed8a-011e-4d31-a370-55b654363209 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d" status: 404 len: 62 microversion: 2.1 time: 0.169214 Jul 25 16:25:57.956994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:57.958507 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1936/3937] 10.222.0.105 () {58 vars in 1238 bytes} [Mon Jul 25 16:25:57 2022] GET /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d => generated 62 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:25:57.959597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:57.980333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:57.989884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:58.014653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:58.017820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:58.019289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:58.024390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:58.855873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:58.866774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c511ff08-cade-4044-9497-c02bb6dcf09e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1505 microversion: 2.1 time: 0.908878 Jul 25 16:25:58.867425 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1937/3938] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:57 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1505 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:58.873447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:58.874614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:58.883599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:58.884728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:58.885960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:58.886660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:59.089716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:59.090554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:59.101226 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1716d01a-0466-46db-9ef3-1339e2c31137 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1270 microversion: 2.1 time: 0.232011 Jul 25 16:25:59.101951 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1938/3939] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:58 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:59.133961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:59.137797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:59.139749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d95b6bec-8d6b-44ea-ab82-d9622e6b1373 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 1.272418 Jul 25 16:25:59.140873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2002/3940] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:25:57 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:25:59.721767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7ef3b05f-7a23-4ca1-b07b-347e69b1e383 req-fc86d000-9188-433e-b2b1-2f0846e12763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654e39ff-8f92-4810-806a-4f62b3ffba22", "name": "network-vif-plugged", "status": "completed", "tag": "db04ca46-b184-4785-b18f-997d2dff3ca2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:59.790817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7ef3b05f-7a23-4ca1-b07b-347e69b1e383 req-fc86d000-9188-433e-b2b1-2f0846e12763 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:59.791646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7ef3b05f-7a23-4ca1-b07b-347e69b1e383 req-fc86d000-9188-433e-b2b1-2f0846e12763 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:59.821870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7ef3b05f-7a23-4ca1-b07b-347e69b1e383 req-fc86d000-9188-433e-b2b1-2f0846e12763 service nova] Creating event network-vif-plugged:db04ca46-b184-4785-b18f-997d2dff3ca2 for instance 654e39ff-8f92-4810-806a-4f62b3ffba22 on n-h2-846219-13 Jul 25 16:25:59.845777 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7ef3b05f-7a23-4ca1-b07b-347e69b1e383 req-fc86d000-9188-433e-b2b1-2f0846e12763 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132904 Jul 25 16:25:59.849989 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1939/3941] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:00.138629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:00.139526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:00.149268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.149991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.151259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.151887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.376792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:00.378616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:00.398148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.401755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.403361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.404115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.445256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:00.464217 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec76ac49-76bf-41ad-8378-e8d6237629c9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1276 microversion: 2.1 time: 0.330944 Jul 25 16:26:00.479077 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1940/3942] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:00 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:00.517656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:00.518812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:00.533931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.534885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.536407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.537203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.541069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:01.584482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3450c9d-17fe-42b2-9d69-516ac16858a8 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1492 microversion: 2.1 time: 1.678325 Jul 25 16:26:01.586347 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2003/3943] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:25:59 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1492 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:01.603781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:01.611581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:01.632049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:01.632822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.634299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:01.635057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.703374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:01.722794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:01.735535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:01.737819 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c12450e-6ff3-4e94-bcd2-e8f9a9d7fd63 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 1.241809 Jul 25 16:26:01.739165 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1941/3944] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:26:00 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:26:01.760416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:01.761242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:01.793086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:01.796529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.810022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:01.812181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.902136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:26:02.103217 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39456d3a-8a13-4c7a-bdf5-98fc7b76c6b7 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 204 len: 0 microversion: 2.1 time: 0.356231 Jul 25 16:26:02.104417 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1942/3945] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:01 2022] DELETE /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:26:02.139377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07436522-ddcd-488d-b86a-b6ca4042ed15 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da00313a0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:02.199520 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-07436522-ddcd-488d-b86a-b6ca4042ed15 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Image not found. Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07436522-ddcd-488d-b86a-b6ca4042ed15 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d HTTP/1.1 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '55189531-f6a3-41cb-a146-ec491c7b669d'} Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 55189531-f6a3-41cb-a146-ec491c7b669d to delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55189531-f6a3-41cb-a146-ec491c7b669d could not be found. Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.201942 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07436522-ddcd-488d-b86a-b6ca4042ed15 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07436522-ddcd-488d-b86a-b6ca4042ed15 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d" status: 404 len: 62 microversion: 2.1 time: 0.089181 Jul 25 16:26:02.208973 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1943/3946] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:02 2022] DELETE /compute/v2.1/images/55189531-f6a3-41cb-a146-ec491c7b669d => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:26:02.224832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:02.224832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:02.243901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.244358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.249565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.250059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.317907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:26:02.443710 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Instance is already in deleting state, ignoring this request Jul 25 16:26:02.445411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-409ff65a-d2e6-47cf-8ca7-1bda63adf588 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 204 len: 0 microversion: 2.1 time: 0.235603 Jul 25 16:26:02.458470 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1944/3947] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:02 2022] DELETE /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:26:02.467725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:02.469156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:02.485586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.486865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.488354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.489279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.978374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:03.030599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea232024-2085-42c6-bb44-f3446d85b3a6 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1318 microversion: 2.1 time: 1.427818 Jul 25 16:26:03.036105 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2004/3948] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:01 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1318 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:03.045809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6827019f-840d-4d9c-826e-3ce1dfef17f9 req-739d19e6-7edd-49bc-8600-a9c71f0d6800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe6d8ab-98da-490e-9477-c72bfe3c0265", "tag": "c726d239-aff4-4971-8f69-118d560c1aeb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:03.071755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6827019f-840d-4d9c-826e-3ce1dfef17f9 req-739d19e6-7edd-49bc-8600-a9c71f0d6800 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:03.072885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6827019f-840d-4d9c-826e-3ce1dfef17f9 req-739d19e6-7edd-49bc-8600-a9c71f0d6800 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:03.116206 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6827019f-840d-4d9c-826e-3ce1dfef17f9 req-739d19e6-7edd-49bc-8600-a9c71f0d6800 service nova] Creating event network-changed:c726d239-aff4-4971-8f69-118d560c1aeb for instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 on n-h1-846219-13 Jul 25 16:26:03.164942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6827019f-840d-4d9c-826e-3ce1dfef17f9 req-739d19e6-7edd-49bc-8600-a9c71f0d6800 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125968 Jul 25 16:26:03.173876 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2005/3949] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:03.195291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:03.203257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:03.241125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:03.243353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:03.247784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:03.248964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:03.395396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:03.418992 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f056244b-180b-4225-a32b-f0ac7457e178 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1498 microversion: 2.1 time: 0.958373 Jul 25 16:26:03.420188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1945/3950] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:02 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1498 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:03.585131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-08183761-38b9-44b0-97a6-6f5f16db893c req-883a2fe6-ad0e-414b-a5b5-9a4632258985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd4e924c-5cee-4432-8388-aa9faa67c2f3", "tag": "56f7716c-53e5-41b9-99b2-38ed93aa7e9e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:03.614204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-08183761-38b9-44b0-97a6-6f5f16db893c req-883a2fe6-ad0e-414b-a5b5-9a4632258985 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:03.614723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-08183761-38b9-44b0-97a6-6f5f16db893c req-883a2fe6-ad0e-414b-a5b5-9a4632258985 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:03.636858 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-08183761-38b9-44b0-97a6-6f5f16db893c req-883a2fe6-ad0e-414b-a5b5-9a4632258985 service nova] Creating event network-changed:56f7716c-53e5-41b9-99b2-38ed93aa7e9e for instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 on n-h1-846219-13 Jul 25 16:26:03.644878 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-08183761-38b9-44b0-97a6-6f5f16db893c req-883a2fe6-ad0e-414b-a5b5-9a4632258985 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064521 Jul 25 16:26:03.646450 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1946/3951] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:26:03.756232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:03.769876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:03.771839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:03.773278 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ae4088fd-50d1-4254-9df6-6492c61c1b89 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 0.597160 Jul 25 16:26:03.773859 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2006/3952] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:26:03 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:26:04.087088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:04.088387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:04.110412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:04.111220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:04.117565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:04.119359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:04.291485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-42510345", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "d5bec1f7-ecda-4b5d-8007-ec7344e84e8d"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:04.365383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] validate_networks() for [('d5bec1f7-ecda-4b5d-8007-ec7344e84e8d', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:26:05.054113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:05.107576 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ecddf120-070b-451b-850e-1a8b6a672634 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1318 microversion: 2.1 time: 1.050779 Jul 25 16:26:05.138112 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1947/3953] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:04 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1318 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:05.151769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:05.153448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:05.169499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:05.171923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:05.174980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:05.176361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.200110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:26:06.201058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:26:06.201058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:26:06.201430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:26:06.202141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:26:06.245008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.245865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.248020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.248893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.367859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Getting quotas for project 271bd1febe4f40179397124bb2323cb7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:06.400177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Getting quotas for user da7bf59dd936435ca5192d2096628a56 and project 271bd1febe4f40179397124bb2323cb7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:06.437885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:06.462296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:26:06.476193 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d16c7fbb-6b4c-41b2-8f94-f32cd6e37a49 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1498 microversion: 2.1 time: 1.335722 Jul 25 16:26:06.476450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:26:06.477192 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1948/3954] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:05 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1498 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:06.502159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d3637231-73ba-4f08-a4a1-f104156a072e req-02bcae3c-f17d-4c7d-bfaa-1e8b0cc53102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654e39ff-8f92-4810-806a-4f62b3ffba22", "name": "network-vif-unplugged", "status": "completed", "tag": "db04ca46-b184-4785-b18f-997d2dff3ca2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:06.569517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d3637231-73ba-4f08-a4a1-f104156a072e req-02bcae3c-f17d-4c7d-bfaa-1e8b0cc53102 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.572544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d3637231-73ba-4f08-a4a1-f104156a072e req-02bcae3c-f17d-4c7d-bfaa-1e8b0cc53102 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.603472 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.411078 Jul 25 16:26:06.605686 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2007/3955] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:26:04 2022] POST /compute/v2.1/servers => generated 382 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:26:06.611407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:06.612084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:06.627596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d3637231-73ba-4f08-a4a1-f104156a072e req-02bcae3c-f17d-4c7d-bfaa-1e8b0cc53102 service nova] Creating event network-vif-unplugged:db04ca46-b184-4785-b18f-997d2dff3ca2 for instance 654e39ff-8f92-4810-806a-4f62b3ffba22 on n-h2-846219-13 Jul 25 16:26:06.639641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.640109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.641051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.641567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.647855 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d3637231-73ba-4f08-a4a1-f104156a072e req-02bcae3c-f17d-4c7d-bfaa-1e8b0cc53102 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156569 Jul 25 16:26:06.657778 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1949/3956] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:06.681482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:06.683308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:06.715416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.720219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.730557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.733838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.897874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:08.721832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:08.750273 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba7029ee-d44e-45c2-98f0-38abfe7680e9 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1318 microversion: 2.1 time: 2.089497 Jul 25 16:26:08.758772 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1950/3957] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:06 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1318 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:08.776943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:08.784988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:08.821307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:08.827124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:08.829533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:08.833696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.029206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:09.079716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:09.096984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:09.103620 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99209b9e-2224-472a-a250-769d68c6161a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 2.496070 Jul 25 16:26:09.140015 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2008/3958] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:26:06 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:26:09.162445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:09.163562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:09.186008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.188032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.190574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.191833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.317543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:09.356381 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-73e123df-dea5-45d1-902e-ae51bb608662 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1215 microversion: 2.1 time: 0.595411 Jul 25 16:26:09.369568 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1951/3959] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:08 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1215 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:09.385538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-698e4fce-c82d-4fe7-b203-84108008e7ec req-e31d9b59-4683-4da6-94d4-282083070aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "name": "network-vif-plugged", "status": "completed", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:09.444438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-698e4fce-c82d-4fe7-b203-84108008e7ec req-e31d9b59-4683-4da6-94d4-282083070aac service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.445256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-698e4fce-c82d-4fe7-b203-84108008e7ec req-e31d9b59-4683-4da6-94d4-282083070aac service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.457945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbaed5ca4f5414b9e06fa95dbbac29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00e2ef7f7ba4d089f0d1acafd5d559e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:09.488777 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f24b014-57b2-4b04-9393-607d30f370bf tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 200 len: 1297 microversion: 2.1 time: 0.344348 Jul 25 16:26:09.492598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-698e4fce-c82d-4fe7-b203-84108008e7ec req-e31d9b59-4683-4da6-94d4-282083070aac service nova] Creating event network-vif-plugged:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:26:09.502745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2009/3960] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:09 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 1297 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:09.522634 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-698e4fce-c82d-4fe7-b203-84108008e7ec req-e31d9b59-4683-4da6-94d4-282083070aac service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142798 Jul 25 16:26:09.524594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7dd980ce-5b34-48c8-92ba-6b0e8ee06277 req-39b888dd-300d-409f-8d9c-4e480cc7d265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "654e39ff-8f92-4810-806a-4f62b3ffba22", "name": "network-vif-deleted", "tag": "db04ca46-b184-4785-b18f-997d2dff3ca2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:09.529363 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1952/3961] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:09.556502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7dd980ce-5b34-48c8-92ba-6b0e8ee06277 req-39b888dd-300d-409f-8d9c-4e480cc7d265 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.562118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7dd980ce-5b34-48c8-92ba-6b0e8ee06277 req-39b888dd-300d-409f-8d9c-4e480cc7d265 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.581808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:09.611787 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7dd980ce-5b34-48c8-92ba-6b0e8ee06277 req-39b888dd-300d-409f-8d9c-4e480cc7d265 service nova] Creating event network-vif-deleted:db04ca46-b184-4785-b18f-997d2dff3ca2 for instance 654e39ff-8f92-4810-806a-4f62b3ffba22 on n-h2-846219-13 Jul 25 16:26:09.640984 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7dd980ce-5b34-48c8-92ba-6b0e8ee06277 req-39b888dd-300d-409f-8d9c-4e480cc7d265 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143597 Jul 25 16:26:09.643158 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2010/3962] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:09.815775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:09.816647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:09.860735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.862897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.866711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.867180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:10.152960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:10.156715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:10.165305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:10.179477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:10.180679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:10.182509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:10.183692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:10.933455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:10.952661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:10.957558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:10.963801 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cd2673e1-370d-4f51-b6ee-8dae492db497 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1410 microversion: 2.20 time: 0.823102 Jul 25 16:26:10.973381 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2011/3963] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:26:10 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1410 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:26:10.990802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:10.992085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.000744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.001721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.002977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.004236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.205749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:11.233198 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e04dbf5-a591-40a7-a67f-2d1423a2eb6f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1277 microversion: 2.1 time: 0.252934 Jul 25 16:26:11.236489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2012/3964] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:10 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:11.255212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.256307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 654e39ff-8f92-4810-806a-4f62b3ffba22] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.276073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.280179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.282197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.283018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.286751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:11.307741 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49b68212-da3a-4aea-9ca8-95751181c376 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1318 microversion: 2.1 time: 1.505753 Jul 25 16:26:11.311264 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1953/3965] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:09 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1318 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:11.318223 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 654e39ff-8f92-4810-806a-4f62b3ffba22 could not be found. Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 HTTP/1.1 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 654e39ff-8f92-4810-806a-4f62b3ffba22 could not be found. Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '654e39ff-8f92-4810-806a-4f62b3ffba22'} Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 654e39ff-8f92-4810-806a-4f62b3ffba22 could not be found. Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 654e39ff-8f92-4810-806a-4f62b3ffba22 could not be found. Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.320555 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 654e39ff-8f92-4810-806a-4f62b3ffba22 could not be found. Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 654e39ff-8f92-4810-806a-4f62b3ffba22 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.328940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ed568688-9ec4-4eea-a4bb-e3f78c371d46 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22" status: 404 len: 111 microversion: 2.1 time: 0.071681 Jul 25 16:26:11.333208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b232e4f2-ab28-4bfc-8a8b-2e00b9a28972 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da4a92160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.340541 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2013/3966] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] GET /compute/v2.1/servers/654e39ff-8f92-4810-806a-4f62b3ffba22 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:11.368214 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b232e4f2-ab28-4bfc-8a8b-2e00b9a28972 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Image not found. Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b232e4f2-ab28-4bfc-8a8b-2e00b9a28972 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 HTTP/1.1 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7920c5e6-cd88-4c30-bf80-97744964dee0'} Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7920c5e6-cd88-4c30-bf80-97744964dee0 to delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7920c5e6-cd88-4c30-bf80-97744964dee0 could not be found. Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.370539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b232e4f2-ab28-4bfc-8a8b-2e00b9a28972 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b232e4f2-ab28-4bfc-8a8b-2e00b9a28972 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0" status: 404 len: 62 microversion: 2.1 time: 0.043807 Jul 25 16:26:11.375894 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1954/3967] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] DELETE /compute/v2.1/images/7920c5e6-cd88-4c30-bf80-97744964dee0 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:26:11.387224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.388356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.397767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.398677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.399996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.401939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.449937 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 HTTP/1.1 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '49458875-c2e2-478b-8b53-82e8674dd042'} Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:11.453780 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.462659 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.466035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.467212 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-76c71234-b6b8-4288-bbf7-da5d411ee00e tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 404 len: 111 microversion: 2.1 time: 0.086780 Jul 25 16:26:11.468864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2014/3968] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:11 2022] DELETE /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:11.481953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.483356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 49458875-c2e2-478b-8b53-82e8674dd042] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.496887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.497915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.499527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.500903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.534268 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 HTTP/1.1 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '49458875-c2e2-478b-8b53-82e8674dd042'} Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.537645 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.545584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.545584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.545584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.545584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.545584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. Jul 25 16:26:11.545584 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.555567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 49458875-c2e2-478b-8b53-82e8674dd042 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.563143 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cd0b354e-649c-4a70-8b92-ec618cb69ad3 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042" status: 404 len: 111 microversion: 2.1 time: 0.089005 Jul 25 16:26:11.565179 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1955/3969] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] GET /compute/v2.1/servers/49458875-c2e2-478b-8b53-82e8674dd042 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:11.574823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7cc94d62-85b0-446a-93c5-b82c8abbfcb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9d92870430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.641477 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7cc94d62-85b0-446a-93c5-b82c8abbfcb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Image not found. Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7cc94d62-85b0-446a-93c5-b82c8abbfcb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 HTTP/1.1 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: exception: Image not found. Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '12e090fd-4225-4ddb-ae68-8f55aa3a6cf1'} Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 to delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 could not be found. Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.643407 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7cc94d62-85b0-446a-93c5-b82c8abbfcb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Image not found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7cc94d62-85b0-446a-93c5-b82c8abbfcb2 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1" status: 404 len: 62 microversion: 2.1 time: 0.074808 Jul 25 16:26:11.651305 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2015/3970] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] DELETE /compute/v2.1/images/12e090fd-4225-4ddb-ae68-8f55aa3a6cf1 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:26:11.655950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.656462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.674254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.675006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.675999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.676504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.730982 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf HTTP/1.1 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '2a03699d-344b-418e-b91f-4b56f275b9cf'} Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:11.740664 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.744840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.746147 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-647ae8ab-7817-4370-8299-abd12b2ca472 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 404 len: 111 microversion: 2.1 time: 0.093514 Jul 25 16:26:11.746996 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1956/3971] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:11 2022] DELETE /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:11.757990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.758625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 2a03699d-344b-418e-b91f-4b56f275b9cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.778264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.778749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.779912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.780565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.828233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf HTTP/1.1 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '2a03699d-344b-418e-b91f-4b56f275b9cf'} Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.830858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.835080 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.835080 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.835080 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.835080 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.835080 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. Jul 25 16:26:11.835080 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.837636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 2a03699d-344b-418e-b91f-4b56f275b9cf could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.838977 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7eee760f-bf24-4efa-917a-2e5e62f41162 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf" status: 404 len: 111 microversion: 2.1 time: 0.085927 Jul 25 16:26:11.840474 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2016/3972] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] GET /compute/v2.1/servers/2a03699d-344b-418e-b91f-4b56f275b9cf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:11.850278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc0c5dc9-47c6-44d5-8a1d-d4abec8cd1cb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '.version_select at 0x7f9da051f280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.889329 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-bc0c5dc9-47c6-44d5-8a1d-d4abec8cd1cb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Image not found. Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc0c5dc9-47c6-44d5-8a1d-d4abec8cd1cb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 HTTP/1.1 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: exception: Image not found. Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'cedb3ae8-4424-4f36-ba0f-55340635bf26'} Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cedb3ae8-4424-4f36-ba0f-55340635bf26 to delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cedb3ae8-4424-4f36-ba0f-55340635bf26 could not be found. Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.891292 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc0c5dc9-47c6-44d5-8a1d-d4abec8cd1cb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Image not found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc0c5dc9-47c6-44d5-8a1d-d4abec8cd1cb tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26" status: 404 len: 62 microversion: 2.1 time: 0.048020 Jul 25 16:26:11.895847 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1957/3973] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] DELETE /compute/v2.1/images/cedb3ae8-4424-4f36-ba0f-55340635bf26 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:26:11.911275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.911855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.936543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.937058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.938197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.940420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.979329 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb HTTP/1.1 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '619749d4-64ec-4540-bbdb-e5de46fcaceb'} Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:11.986348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:11.990632 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a064138d-aa20-463b-8a64-7d6d00c63d63 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "DELETE /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 404 len: 111 microversion: 2.1 time: 0.084718 Jul 25 16:26:11.991629 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2017/3974] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:11 2022] DELETE /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:11.998424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.999065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] [instance: 619749d4-64ec-4540-bbdb-e5de46fcaceb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:12.025542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:12.028417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:12.032098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.034315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.038416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.040561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.057524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.058468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.060252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.066650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.113145 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] HTTP exception thrown: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Request method failure captured: Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb HTTP/1.1 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sLrle8vhkShRApyqbgaWibu5WmmnJ11mrqMA1YtsCrWuOY1qCgpISYUDE9Q5fUEy1PqvNtgCKmdjUQe5jfciFu6hr-BvXBgLyw-O9MBNMJslGaJv0-uMx6Ey8F9Utr95RP2M8ZiutrRXXI18iGKIwwPK7t_fpykrR1JaZdsem0dtCM Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f00e2ef7f7ba4d089f0d1acafd5d559e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f00e2ef7f7ba4d089f0d1acafd5d559e"}]}] Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesTestJSON-590925518 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: f00e2ef7f7ba4d089f0d1acafd5d559e Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesTestJSON-590925518 Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ccbaed5ca4f5414b9e06fa95dbbac29c Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesTestJSON-590925518-project Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '619749d4-64ec-4540-bbdb-e5de46fcaceb'} Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:12.115882 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:12.122488 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:12.122488 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:12.122488 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:12.122488 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:12.122488 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. Jul 25 16:26:12.122488 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:12.125643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] Returning 404 to user: Instance 619749d4-64ec-4540-bbdb-e5de46fcaceb could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:12.126920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b878174-2cc6-4337-97d4-cce1e0a02af6 tempest-ImagesTestJSON-590925518 tempest-ImagesTestJSON-590925518-project] 10.222.0.105 "GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb" status: 404 len: 111 microversion: 2.1 time: 0.134035 Jul 25 16:26:12.128478 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1958/3975] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:11 2022] GET /compute/v2.1/servers/619749d4-64ec-4540-bbdb-e5de46fcaceb => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:12.136294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d8953dd6-fe3e-4887-bc5a-24a1f83925ca req-a9aa72dd-49b4-4488-ad4e-4d0f5ed0c2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe6d8ab-98da-490e-9477-c72bfe3c0265", "name": "network-vif-plugged", "status": "completed", "tag": "c726d239-aff4-4971-8f69-118d560c1aeb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:12.169325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d8953dd6-fe3e-4887-bc5a-24a1f83925ca req-a9aa72dd-49b4-4488-ad4e-4d0f5ed0c2d7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.170854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d8953dd6-fe3e-4887-bc5a-24a1f83925ca req-a9aa72dd-49b4-4488-ad4e-4d0f5ed0c2d7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.205619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d8953dd6-fe3e-4887-bc5a-24a1f83925ca req-a9aa72dd-49b4-4488-ad4e-4d0f5ed0c2d7 service nova] Creating event network-vif-plugged:c726d239-aff4-4971-8f69-118d560c1aeb for instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 on n-h1-846219-13 Jul 25 16:26:12.222810 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d8953dd6-fe3e-4887-bc5a-24a1f83925ca req-a9aa72dd-49b4-4488-ad4e-4d0f5ed0c2d7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091497 Jul 25 16:26:12.224830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1959/3976] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:12.296597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:12.297452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:12.327712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.330448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.332674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.336221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.742085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:12.760086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:12.770597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:12.782408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93b2c42f-a856-43c8-96a8-951e65011e55 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1602 microversion: 2.20 time: 0.753751 Jul 25 16:26:12.783201 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2018/3977] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:26:12 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1602 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:26:12.792081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:12.795138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:12.808285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.809691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.811621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.812526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.821871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:12.840257 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce6b037a-1a1f-415b-8c1f-d8437bb32184 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 0.550755 Jul 25 16:26:12.841541 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1960/3978] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:12 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:12.851617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:12.855355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:12.876879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.877942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.879182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:12.879973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.205504 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1666126e-7bcc-46ce-997a-d3714b6abb03 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.362103 Jul 25 16:26:13.206896 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1961/3979] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:26:12 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:26:13.364839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:13.383553 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38fecba4-9ef1-4530-af2e-e8f4a48ae9fc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1318 microversion: 2.1 time: 0.598236 Jul 25 16:26:13.385009 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2019/3980] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:12 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:13.884380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:13.889224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:13.919376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.920354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.921739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.922278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:14.420798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:14.421714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:14.437066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:14.438758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:14.439915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:14.440391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:14.569819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:14.589709 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-662ff834-370d-4784-9fe7-679e74aeed8d tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 0.709480 Jul 25 16:26:14.591885 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1962/3981] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:13 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:14.850710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:14.871586 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4755ccf-204f-4d92-adc3-8e459e4ed0fd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1318 microversion: 2.1 time: 0.455002 Jul 25 16:26:14.881479 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2020/3982] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:14 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:15.628969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:15.634310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:15.664119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:15.673645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:15.679257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:15.680677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:15.910282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:15.911060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:15.929560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:15.929560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:15.929560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:15.930026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:16.327718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:16.446822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:16.507621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:16.545446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec6e8f21-8a31-491c-9c9c-ffabb9efcc66 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 0.924951 Jul 25 16:26:16.550882 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1963/3983] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:15 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:16.574036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-678702c6-aa85-406e-aaee-c0eb39f1bafb req-b7da6284-82f5-43da-a412-5f909dec3dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c9bf9f-a6e7-46d3-9eaf-b70e17859aee", "tag": "5f2fe21c-5149-4c95-8cf3-9e1fddb45f0e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:16.630259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-678702c6-aa85-406e-aaee-c0eb39f1bafb req-b7da6284-82f5-43da-a412-5f909dec3dc4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:16.642080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-678702c6-aa85-406e-aaee-c0eb39f1bafb req-b7da6284-82f5-43da-a412-5f909dec3dc4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:16.696426 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-678702c6-aa85-406e-aaee-c0eb39f1bafb req-b7da6284-82f5-43da-a412-5f909dec3dc4 service nova] Creating event network-changed:5f2fe21c-5149-4c95-8cf3-9e1fddb45f0e for instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee on n-h1-846219-13 Jul 25 16:26:16.711625 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-678702c6-aa85-406e-aaee-c0eb39f1bafb req-b7da6284-82f5-43da-a412-5f909dec3dc4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158418 Jul 25 16:26:16.721466 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1964/3984] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:16.774744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:16.801628 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-98fac495-7c41-4ac5-978d-a39004c8a135 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1506 microversion: 2.1 time: 0.895924 Jul 25 16:26:16.833658 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2021/3985] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:15 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1506 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:16.849234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:16.850302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:16.876718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:16.885488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:16.887318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:16.888095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.287017 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Removing security group 79a7240f-b084-4e15-9868-f3901482691c from port c726d239-aff4-4971-8f69-118d560c1aeb Jul 25 16:26:17.589974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:17.593699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:17.615478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.617010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.619510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.621451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.462533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:18.505033 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2739c066-a1a6-439e-890d-61399753f357 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 0.925369 Jul 25 16:26:18.520555 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2022/3986] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:17 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:18.661854 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16db9134-fbf1-419b-bfba-94b073d101f5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265/action" status: 202 len: 0 microversion: 2.1 time: 1.821608 Jul 25 16:26:18.671222 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1965/3987] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:26:16 2022] POST /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265/action => generated 0 bytes in 1833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:26:18.681034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:18.687725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:18.716670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b37ff3cc-ab72-4908-9d34-ce8fdec9a646 req-63f7d3f3-5308-4dd1-90f8-a4a103653b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe6d8ab-98da-490e-9477-c72bfe3c0265", "tag": "c726d239-aff4-4971-8f69-118d560c1aeb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:18.724482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.725404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.731040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.734621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.746054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b37ff3cc-ab72-4908-9d34-ce8fdec9a646 req-63f7d3f3-5308-4dd1-90f8-a4a103653b07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.747831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b37ff3cc-ab72-4908-9d34-ce8fdec9a646 req-63f7d3f3-5308-4dd1-90f8-a4a103653b07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.798682 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b37ff3cc-ab72-4908-9d34-ce8fdec9a646 req-63f7d3f3-5308-4dd1-90f8-a4a103653b07 service nova] Creating event network-changed:c726d239-aff4-4971-8f69-118d560c1aeb for instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 on n-h1-846219-13 Jul 25 16:26:18.816604 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b37ff3cc-ab72-4908-9d34-ce8fdec9a646 req-63f7d3f3-5308-4dd1-90f8-a4a103653b07 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105356 Jul 25 16:26:18.831854 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1966/3988] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:18.877830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e0b574ea-bc52-4fac-90ad-a0457b45a163 req-4fb5c99b-9803-42d1-9b8e-a2f1eb4d75f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:18.896942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:18.927330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e0b574ea-bc52-4fac-90ad-a0457b45a163 req-4fb5c99b-9803-42d1-9b8e-a2f1eb4d75f6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.927825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e0b574ea-bc52-4fac-90ad-a0457b45a163 req-4fb5c99b-9803-42d1-9b8e-a2f1eb4d75f6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.980042 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e0b574ea-bc52-4fac-90ad-a0457b45a163 req-4fb5c99b-9803-42d1-9b8e-a2f1eb4d75f6 service nova] Creating event network-changed:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:26:18.989507 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e0b574ea-bc52-4fac-90ad-a0457b45a163 req-4fb5c99b-9803-42d1-9b8e-a2f1eb4d75f6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139002 Jul 25 16:26:18.990325 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1967/3989] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:19.256882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:19.284135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-72502385-a42b-4048-8156-340412fc0e89 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1464 microversion: 2.1 time: 0.599506 Jul 25 16:26:19.286689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2023/3990] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:18 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1464 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:19.317240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:19.319400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:19.340073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:19.340960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:19.342083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:19.342795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:19.547876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:19.549369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:19.585928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:19.586937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:19.588110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:19.588857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:20.815228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:20.842821 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0a7d41b6-e790-47d3-af4e-dd87a0041179 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.537469 Jul 25 16:26:20.867778 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1968/3991] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:19 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:20.895476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:20.899295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:20.930123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:20.934656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:20.939777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:20.944576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:22.349493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:22.376724 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93b735a4-24ef-45a9-8187-22ad3099840f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 2.847005 Jul 25 16:26:22.394577 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2024/3992] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:19 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:22.740073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:22.797000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d23b950-29e4-4525-aef4-1018e5a4fe2f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.926989 Jul 25 16:26:22.837282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1969/3993] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:20 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:22.864778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:22.882170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:22.969602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:22.976010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:22.982818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:22.987150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:23.458173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:23.458676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:23.468873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:23.469695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:23.474036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:23.475025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:23.856670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:23.889615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9511d66f-0974-4262-9422-6d66b5b141e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.033438 Jul 25 16:26:23.914198 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2025/3994] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:22 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:23.932376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:23.946149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:23.973218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:23.974357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:23.975838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:23.976648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:24.401855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:24.450109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bfb645d9-f29a-429c-80e0-9d98fb1f93c3 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 1.009079 Jul 25 16:26:24.460882 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1970/3995] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:23 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:24.683232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:24.764806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8136c052-11fa-46a3-97aa-db9f2aae65a5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.841444 Jul 25 16:26:24.769179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2026/3996] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:23 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:25.045842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-468424726", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "6caa10b5-bb0b-47f3-bbd9-62b23141517a"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:25.260903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] validate_networks() for [('6caa10b5-bb0b-47f3-bbd9-62b23141517a', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:26:25.503935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:25.518416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:25.535167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:25.541178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:25.565847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:25.565847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:26.593412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:26.638378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49caeaea-3d2c-4388-b8d3-8a6671e15d12 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 1.141414 Jul 25 16:26:26.646046 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2027/3997] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:25 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:27.679408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:27.680445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:27.694317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.699313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.700858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.703652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.751760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:26:27.752712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:26:27.753609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:26:27.754295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:26:27.755224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:26:27.788622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.789311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.790768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.791639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.900218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:27.930951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Getting quotas for user ed4735185f84421f92bc1404d62f26e3 and project 72a5bf05a4f64e0d84a353f0743d8bf0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:27.993237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:26:28.007000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:26:28.214151 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-abd338bf-6be1-4305-823e-9b43a61d46c8 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.172299 Jul 25 16:26:28.215761 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1971/3998] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:26:25 2022] POST /compute/v2.1/servers => generated 382 bytes in 3180 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:26:28.232393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eb39fc16-3dcd-4e1a-a495-a087074332af tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:28.233471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eb39fc16-3dcd-4e1a-a495-a087074332af tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:28.616083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eb39fc16-3dcd-4e1a-a495-a087074332af tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:28.636054 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eb39fc16-3dcd-4e1a-a495-a087074332af tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1218 microversion: 2.1 time: 0.408655 Jul 25 16:26:28.637673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1972/3999] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:28 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:28.659681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:28.746181 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e645163-2d0c-40c1-8426-039791bf0b9f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 1.058405 Jul 25 16:26:28.751694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2028/4000] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:27 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:29.668431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:29.674336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:29.708956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.711345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.715564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.718718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.809471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:29.823401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:29.914663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.919161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.928170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.936477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:30.271945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:30.325677 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-744942c0-5d72-4627-91f4-41f83cc501c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1214 microversion: 2.1 time: 0.664669 Jul 25 16:26:30.355702 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1973/4001] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:29 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1214 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:30.615846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:30.624990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-453838991", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "e2eaf870-86ea-4e57-bca9-ea71da108713"}], "key_name": "tempest-TestSecurityGroupsBasicOps-912625498", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4e4e4fc4-3364-4545-a924-527ba65cd638"]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:30.637445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6e8f94b-075c-442a-93a2-6717ff2cc9a6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 0.860936 Jul 25 16:26:30.669511 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2029/4002] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:29 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:30.745453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] validate_networks() for [('e2eaf870-86ea-4e57-bca9-ea71da108713', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:26:31.332688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-167bae44-3547-4d50-9a08-b89262cd7f5c req-e514425c-0b7a-4708-867a-8cdb5414e362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c9bf9f-a6e7-46d3-9eaf-b70e17859aee", "name": "network-vif-plugged", "status": "completed", "tag": "5f2fe21c-5149-4c95-8cf3-9e1fddb45f0e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:31.383505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-167bae44-3547-4d50-9a08-b89262cd7f5c req-e514425c-0b7a-4708-867a-8cdb5414e362 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.391367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-167bae44-3547-4d50-9a08-b89262cd7f5c req-e514425c-0b7a-4708-867a-8cdb5414e362 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:31.464950 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-167bae44-3547-4d50-9a08-b89262cd7f5c req-e514425c-0b7a-4708-867a-8cdb5414e362 service nova] Creating event network-vif-plugged:5f2fe21c-5149-4c95-8cf3-9e1fddb45f0e for instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee on n-h1-846219-13 Jul 25 16:26:31.514218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-167bae44-3547-4d50-9a08-b89262cd7f5c req-e514425c-0b7a-4708-867a-8cdb5414e362 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183133 Jul 25 16:26:31.515487 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2030/4003] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:26:31.592332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:31.607998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:31.654899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.656279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:31.659722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.662782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:32.179786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:32.184468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:32.205302 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-871a4b5d-7079-439a-943f-29efb9eda434 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1276 microversion: 2.1 time: 0.682171 Jul 25 16:26:32.208787 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2031/4004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:31 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1276 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:32.224564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:32.247003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:32.275577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:32.276473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:32.278468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:32.279452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:33.410776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:33.419978 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9ce1c21-a195-4216-87ac-9e55a85c7318 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1319 microversion: 2.1 time: 1.209558 Jul 25 16:26:33.434183 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2032/4005] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:32 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1319 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:33.444422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:33.452708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:33.463213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:33.464415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:33.466100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:33.466835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:33.692895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:33.707780 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69b9bd47-2065-422b-8d15-1bbf82c6f28a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1276 microversion: 2.1 time: 0.272090 Jul 25 16:26:33.716976 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2033/4006] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:33 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:33.825572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:26:33.828759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:26:33.829832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:26:33.830933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:26:33.832998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:26:33.857182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:33.858098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:33.862509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:33.863442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:33.946011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Getting quotas for project eeb296addf4b46fda315d22fca210662. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:33.968319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Getting quotas for user be5761637f9b43c3bc4d0008579ed6b3 and project eeb296addf4b46fda315d22fca210662. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:33.999313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:26:34.005267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:26:34.161013 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-137f2e41-2a1d-4d01-91cc-0661a7d06ed5 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 363 microversion: 2.1 time: 3.540059 Jul 25 16:26:34.165518 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1974/4007] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:26:30 2022] POST /compute/v2.1/servers => generated 363 bytes in 3545 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:26:34.182776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35513f9e-2ce0-443e-a6bc-55e75d6b1361 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:34.183883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-35513f9e-2ce0-443e-a6bc-55e75d6b1361 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:34.451141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:34.452194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:34.466556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:34.467006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:34.467834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:34.481923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:34.764261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35513f9e-2ce0-443e-a6bc-55e75d6b1361 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:34.788183 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35513f9e-2ce0-443e-a6bc-55e75d6b1361 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1244 microversion: 2.1 time: 0.614740 Jul 25 16:26:34.790214 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2034/4008] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:34 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1244 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:34.801822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:34.803644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:34.823916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:34.825741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:34.827754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:34.828853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.057562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:35.104390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9af68716-0e71-4edf-8fd0-516f0cdc80a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1276 microversion: 2.1 time: 0.310844 Jul 25 16:26:35.112831 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2035/4009] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:34 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:35.167352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:35.195861 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dfbb6a4d-4d28-4713-91a4-961fedd674b7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1508 microversion: 2.1 time: 0.751089 Jul 25 16:26:35.196783 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1975/4010] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:34 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1508 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:35.239048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:35.240330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:35.272745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.274822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.280600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.289705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.391379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:35.393725 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d39cbafd-c0c6-44e1-9d67-b0c4e799d4a7 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee/os-instance-actions/req-3a7c7e63-930e-43b4-b505-95e5d14c21c8" status: 200 len: 313 microversion: 2.1 time: 0.173879 Jul 25 16:26:35.394731 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2036/4011] 10.222.0.105 () {58 vars in 1424 bytes} [Mon Jul 25 16:26:35 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee/os-instance-actions/req-3a7c7e63-930e-43b4-b505-95e5d14c21c8 => generated 313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:35.418759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:35.433846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:35.466079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.470375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.478559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.486939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.818329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:35.819173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:35.846579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:35.853992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.854697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.862163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.862770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.895941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38b31e0a-a0b1-4311-bb6e-b6261b8ea7b4 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "POST /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee/action" status: 202 len: 0 microversion: 2.1 time: 0.488603 Jul 25 16:26:35.919918 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1976/4012] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:26:35 2022] POST /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:26:35.948702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:35.952448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:35.987217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.988073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.008379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.010481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.247009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:36.341212 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-683c0211-2ee8-4384-9424-e6a3458d09de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1240 microversion: 2.1 time: 0.514418 Jul 25 16:26:36.349458 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2037/4013] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:35 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1240 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:36.370868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:36.378055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:36.428841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.432064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.439897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.441476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:37.002672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:37.018699 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a8f12eb-6e7d-45e7-8a17-dea637402ca0 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1510 microversion: 2.1 time: 1.092561 Jul 25 16:26:37.019964 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1977/4014] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:35 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1510 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:37.399926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:37.400556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:37.418019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:37.418771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:37.420150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:37.421009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:37.631392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:37.668371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-03515c60-dd8b-4da7-9e21-c3573b7c94a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 1.314673 Jul 25 16:26:37.670544 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2038/4015] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:36 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:37.824456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:37.836392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a65b2a82-35e4-4fb3-992f-d239c1e8a4de tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.445534 Jul 25 16:26:37.837278 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1978/4016] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:37 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:38.071515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:38.072411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:38.087672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.088444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.089541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.090058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.615477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:38.631498 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78ebfa6c-2fa7-443c-b451-94089640d239 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1510 microversion: 2.1 time: 0.565001 Jul 25 16:26:38.633592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2039/4017] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:38 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:38.696875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:38.697701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:38.713882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.714292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.715425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.722365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.877039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:38.877506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:38.891391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.891901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.899439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.900499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:39.257193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:39.273271 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0984027f-28d6-4b5c-ab42-fe8684e497e6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.401352 Jul 25 16:26:39.280072 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2040/4018] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:38 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:39.421125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:39.434539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7aac8acf-09d0-448f-88a1-a2503ecf9c6a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 0.746400 Jul 25 16:26:39.441319 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1979/4019] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:38 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:39.602983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1d34d228-5b2a-4b38-963f-7a8fa336669b req-fa91fc03-cae7-4e06-aa58-f5a10309c5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08a773e-d2bc-44ef-94d4-4e0dea64af33", "tag": "c70c5a54-cd77-45d9-bd12-a3026466e57e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:39.644986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1d34d228-5b2a-4b38-963f-7a8fa336669b req-fa91fc03-cae7-4e06-aa58-f5a10309c5fc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:39.645963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1d34d228-5b2a-4b38-963f-7a8fa336669b req-fa91fc03-cae7-4e06-aa58-f5a10309c5fc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:39.655389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:39.656712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:39.676323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:39.678017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:39.679207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:39.686909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:39.705570 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1d34d228-5b2a-4b38-963f-7a8fa336669b req-fa91fc03-cae7-4e06-aa58-f5a10309c5fc service nova] Creating event network-changed:c70c5a54-cd77-45d9-bd12-a3026466e57e for instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 on n-h2-846219-13 Jul 25 16:26:39.725474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1d34d228-5b2a-4b38-963f-7a8fa336669b req-fa91fc03-cae7-4e06-aa58-f5a10309c5fc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123577 Jul 25 16:26:39.731730 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2041/4020] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:40.308729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:40.309983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:40.313537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:40.317785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=62 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:40.332035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bafc0228-4401-4e94-bf71-e8e09dafd857 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1515 microversion: 2.1 time: 0.680798 Jul 25 16:26:40.335144 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1980/4021] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:39 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1515 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:40.342160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.342766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.343897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.344485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.456915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:40.458110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:40.470145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.474527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.476042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.476730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.975647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:40.989973 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7a84c2b9-cb9d-4b96-87c8-575e4c226899 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.687363 Jul 25 16:26:40.991244 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2042/4022] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:40 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:41.374736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:41.375863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:41.383190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:41.391816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:41.393561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:41.396687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12a963cb-565c-41c9-b2c1-dc55371fdffe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 0.943955 Jul 25 16:26:41.398766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:41.399680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:41.411854 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1981/4023] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:40 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:42.050577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:42.071839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:42.094077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.094559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.095586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.096043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.100322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:42.135647 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6c74b5f-f0d5-4ecd-87dc-6ba9d4488471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1508 microversion: 2.1 time: 0.766677 Jul 25 16:26:42.136320 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2043/4024] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:41 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1508 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:42.187301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '.version_select at 0x7f9d9272fca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:42.192664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:42.219967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.232324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.234227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.235337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.356048 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e77b528a-b1a3-4821-8d1c-ea3077f8866f tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.176741 Jul 25 16:26:42.368277 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2044/4025] 10.222.0.105 () {58 vars in 1301 bytes} [Mon Jul 25 16:26:42 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee/os-instance-actions => generated 611 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:26:42.379644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:42.380169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:42.393938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.394443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.395362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.395910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.461776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:26:42.529743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:42.549311 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eee803bf-5dd9-45fd-a0ec-4011459b3b16 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.525961 Jul 25 16:26:42.553376 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1982/4026] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:42 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:42.558887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:42.559897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:42.583690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.584473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.585635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.586477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.659582 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5d46578-d12f-4876-b5d2-f6b5db1a85b6 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "DELETE /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 204 len: 0 microversion: 2.1 time: 0.284076 Jul 25 16:26:42.665014 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2045/4027] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:42 2022] DELETE /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:26:42.671450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:42.678533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:42.695861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.697487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.702194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.703169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.172496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:43.197716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a6efd23-7780-4b39-964b-faecbcc40905 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 0.646121 Jul 25 16:26:43.201673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1983/4028] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:42 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:43.215805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-82f8da96-1aab-43a3-b2ad-8df11103c14f req-a4cd15ff-6e8e-40a1-8329-893bc413425c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68205026-85f3-4422-b253-496ac11797f7", "tag": "13e35165-9f8a-4892-860a-dbc3c1a06b62"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:43.238353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-82f8da96-1aab-43a3-b2ad-8df11103c14f req-a4cd15ff-6e8e-40a1-8329-893bc413425c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:43.245245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-82f8da96-1aab-43a3-b2ad-8df11103c14f req-a4cd15ff-6e8e-40a1-8329-893bc413425c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.265038 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-82f8da96-1aab-43a3-b2ad-8df11103c14f req-a4cd15ff-6e8e-40a1-8329-893bc413425c service nova] Creating event network-changed:13e35165-9f8a-4892-860a-dbc3c1a06b62 for instance 68205026-85f3-4422-b253-496ac11797f7 on n-h2-846219-13 Jul 25 16:26:43.274854 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-82f8da96-1aab-43a3-b2ad-8df11103c14f req-a4cd15ff-6e8e-40a1-8329-893bc413425c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067183 Jul 25 16:26:43.276587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1984/4029] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:43.555500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:43.582171 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-22aa1bbd-292a-459b-b6a0-228c0286bea2 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1514 microversion: 2.1 time: 0.914299 Jul 25 16:26:43.584115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:43.585868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:43.596591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:43.597057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.598073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:43.598846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.633146 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2046/4030] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:42 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1514 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:43.912020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:43.989892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=14 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:44.202329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:44.213802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-376c083e-ffa7-4dcd-9f7a-658957e6d191 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.627709 Jul 25 16:26:44.215019 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1985/4031] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:43 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:44.244632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:44.246113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:44.269572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.278533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.280367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.281421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.646394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:44.647220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:44.656140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.656363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.657205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.657757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.777654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:44.824116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:44.838589 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2a9e113-a7ad-4d20-9f81-44aa6277d25e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 0.600394 Jul 25 16:26:44.842514 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2047/4032] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:44 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:45.166204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:45.177994 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3cefddf7-2c6b-449a-a434-fce2a14fb471 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1514 microversion: 2.1 time: 0.535790 Jul 25 16:26:45.179247 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1986/4033] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:44 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1514 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:45.242619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:45.242619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:45.257323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:45.257909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:45.259146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:45.260444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:45.301587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:45.456093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:45.466386 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7d12ab2e-fbe0-4401-8df1-74d13c27aa13 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.233310 Jul 25 16:26:45.468296 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2048/4034] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:45 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:46.229484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:46.231437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:46.261796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.275009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.276325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.276965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.570073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7bf59dd936435ca5192d2096628a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271bd1febe4f40179397124bb2323cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:46.610979 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93e44fcf-5f52-46e9-8a3c-0b0aa7c75708 tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 200 len: 1472 microversion: 2.1 time: 0.397876 Jul 25 16:26:46.618185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2049/4035] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:46 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:46.660426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f2a6da25-e336-4df5-902e-52477213274a req-c95120ad-3b06-461c-b00c-08bc57396068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c9bf9f-a6e7-46d3-9eaf-b70e17859aee", "name": "network-vif-deleted", "tag": "5f2fe21c-5149-4c95-8cf3-9e1fddb45f0e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:46.702987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:46.705901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:46.712996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f2a6da25-e336-4df5-902e-52477213274a req-c95120ad-3b06-461c-b00c-08bc57396068 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.717370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f2a6da25-e336-4df5-902e-52477213274a req-c95120ad-3b06-461c-b00c-08bc57396068 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.719122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.720335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.722288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.723770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.742781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f2a6da25-e336-4df5-902e-52477213274a req-c95120ad-3b06-461c-b00c-08bc57396068 service nova] Creating event network-vif-deleted:5f2fe21c-5149-4c95-8cf3-9e1fddb45f0e for instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee on n-h1-846219-13 Jul 25 16:26:46.759091 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f2a6da25-e336-4df5-902e-52477213274a req-c95120ad-3b06-461c-b00c-08bc57396068 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139082 Jul 25 16:26:46.764525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2050/4036] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:46.776225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:46.777343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:46.799209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.799684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.800545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.801181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.013817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:47.059595 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fefe2fa7-7389-4c14-8527-5f45662dd334 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.292999 Jul 25 16:26:47.072000 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2051/4037] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:46 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:47.266812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-295455448", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "e469dfae-c331-4f39-b8d2-bbe06b1c6408"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:47.384534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:47.399247 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d7538cd-6c2a-474c-9c52-d468e8d040ae tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 1.524892 Jul 25 16:26:47.413784 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1987/4038] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:45 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:47.480024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] validate_networks() for [('e469dfae-c331-4f39-b8d2-bbe06b1c6408', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:26:47.698178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:47.699654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] [instance: 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:47.722415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.725639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.728259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.729348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.755679 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] HTTP exception thrown: Instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee could not be found. Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Request method failure captured: Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee HTTP/1.1 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sQbPTmj7MWD7fZWR9k9sSunupl9EpTMFUmBdd3zdU2nRziOUTcBy5Q9LuN_oK6m3mjhxDN52O0DRNgqUEtPU0hzlFrNdycZUdwKDu1ldd71jqEeJL-_rPSxNYeI5IdYK36elIiN-z1PQs4ZeISCxsOymtQEWbGRKN84Ctw5PMY3n_U Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 271bd1febe4f40179397124bb2323cb7 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-InstanceActionsTestJSON-224231202 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/271bd1febe4f40179397124bb2323cb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/271bd1febe4f40179397124bb2323cb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/271bd1febe4f40179397124bb2323cb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_271bd1febe4f40179397124bb2323cb7"}]}] Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-InstanceActionsTestJSON-224231202 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 271bd1febe4f40179397124bb2323cb7 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-InstanceActionsTestJSON-224231202 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-InstanceActionsTestJSON-224231202-project Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: da7bf59dd936435ca5192d2096628a56 Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-InstanceActionsTestJSON-224231202-project Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee could not be found. Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '15c9bf9f-a6e7-46d3-9eaf-b70e17859aee'} Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee could not be found. Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee could not be found. Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:47.760669 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee could not be found. Jul 25 16:26:47.765794 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:26:47.768190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] Returning 404 to user: Instance 15c9bf9f-a6e7-46d3-9eaf-b70e17859aee could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:47.769473 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2024074a-46ed-40a4-8ad2-6ee1f4c2b09a tempest-InstanceActionsTestJSON-224231202 tempest-InstanceActionsTestJSON-224231202-project] 10.222.0.105 "GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee" status: 404 len: 111 microversion: 2.1 time: 0.080046 Jul 25 16:26:47.785936 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1988/4039] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:47 2022] GET /compute/v2.1/servers/15c9bf9f-a6e7-46d3-9eaf-b70e17859aee => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:48.101172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:48.103573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:48.126180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:48.128628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:48.129933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:48.131070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:48.280804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:48.297916 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-18a35248-7c99-418e-a023-4047b76a6593 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.203393 Jul 25 16:26:48.298800 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1989/4040] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:48 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:48.442719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:48.443991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:48.468142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:48.471336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:48.480255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:48.484405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:48.974118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:48.996134 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd0a4eb4-7302-498c-82f6-43085b708c00 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 0.564955 Jul 25 16:26:48.997836 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1990/4041] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:48 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:48.999367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:26:49.000125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:26:49.001036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:26:49.002223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:26:49.003298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:26:49.047744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.051467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.055561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.059896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.137181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Getting quotas for project a8dd1238bb404448803f7e05924180fe. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:49.150400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Getting quotas for user 2258ff14334d404ea8b2900b66076444 and project a8dd1238bb404448803f7e05924180fe. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:49.187175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:26:49.194604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:26:49.321307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:49.321944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:49.326564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0f84b4f-fa8c-41aa-8493-8b514fd6c6fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.249017 Jul 25 16:26:49.329939 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2052/4042] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:26:47 2022] POST /compute/v2.1/servers => generated 382 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:26:49.358771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.359179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d64ea34-b038-4152-8ff5-beaccdfebca5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:49.360179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d64ea34-b038-4152-8ff5-beaccdfebca5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:49.361027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.362838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.364989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.689051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d64ea34-b038-4152-8ff5-beaccdfebca5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:49.724552 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d64ea34-b038-4152-8ff5-beaccdfebca5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1219 microversion: 2.1 time: 0.379647 Jul 25 16:26:49.727893 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2053/4043] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:49 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1219 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:49.781964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:49.817306 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9a9cfba-44d6-4778-a04f-f7218de70f00 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.500304 Jul 25 16:26:49.819294 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1991/4044] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:49 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:50.090058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:50.093398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:50.139037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:50.145330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:50.150038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:50.150537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:50.682484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:50.693810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d5518c8f-e19e-4138-9276-606f402efd66 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 0.668852 Jul 25 16:26:50.721641 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2054/4045] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:50 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:50.730531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-de0636ae-ae2a-4930-8344-40e09a8d027d req-1a6d490b-f26c-435f-b451-c624641a741a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a773e-d2bc-44ef-94d4-4e0dea64af33", "name": "network-vif-plugged", "status": "completed", "tag": "c70c5a54-cd77-45d9-bd12-a3026466e57e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:50.748036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-074603b3-b640-4a42-b385-2946c85e5f94 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:50.748680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-074603b3-b640-4a42-b385-2946c85e5f94 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:50.792692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:50.803474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-de0636ae-ae2a-4930-8344-40e09a8d027d req-1a6d490b-f26c-435f-b451-c624641a741a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:50.804340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-de0636ae-ae2a-4930-8344-40e09a8d027d req-1a6d490b-f26c-435f-b451-c624641a741a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:50.870801 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-de0636ae-ae2a-4930-8344-40e09a8d027d req-1a6d490b-f26c-435f-b451-c624641a741a service nova] Creating event network-vif-plugged:c70c5a54-cd77-45d9-bd12-a3026466e57e for instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 on n-h2-846219-13 Jul 25 16:26:50.893188 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-de0636ae-ae2a-4930-8344-40e09a8d027d req-1a6d490b-f26c-435f-b451-c624641a741a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174139 Jul 25 16:26:50.897265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-074603b3-b640-4a42-b385-2946c85e5f94 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:50.902749 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1992/4046] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:50.905164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-074603b3-b640-4a42-b385-2946c85e5f94 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1219 microversion: 2.1 time: 0.161691 Jul 25 16:26:50.908325 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2055/4047] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:50 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:50.917541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:50.925325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:50.973984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:50.976318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:50.982226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:50.983329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.115442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:51.116251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:51.144083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.144926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.146128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.152473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.247831 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a48ee40f-f018-4b76-9264-637e95e94b2b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/ips" status: 200 len: 152 microversion: 2.20 time: 0.137433 Jul 25 16:26:51.250021 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2056/4048] 10.222.0.105 () {60 vars in 1294 bytes} [Mon Jul 25 16:26:51 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:26:51.469712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:51.516407 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b30b24e-0e72-49a4-bea7-39f555751f74 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.604082 Jul 25 16:26:51.520799 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1993/4049] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:50 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:51.736790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:51.737963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:51.750496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.751123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.764188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.765579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.935055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:51.936546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:51.955849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.956633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.959960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.961393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:52.427555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:52.437880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3bf5c63d-1500-4aa4-aa6c-7aadf6e49ce5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1271 microversion: 2.1 time: 0.508885 Jul 25 16:26:52.461197 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1994/4050] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:51 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1271 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:52.553665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:52.554362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:52.566617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:52.569444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:52.573939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:52.574645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:52.592625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:52.807250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:52.832512 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0bae0ccf-a7f7-45c9-a1d1-79a486f7b364 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1318 microversion: 2.1 time: 1.099591 Jul 25 16:26:52.879169 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2057/4051] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:51 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1318 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:53.003157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e973b88a-69a4-4017-b883-ee6fea44e60b req-4f9e1bd3-cbff-4caa-a5ee-f0b2ff761e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68205026-85f3-4422-b253-496ac11797f7", "name": "network-vif-plugged", "status": "completed", "tag": "13e35165-9f8a-4892-860a-dbc3c1a06b62"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:53.049548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:53.059296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e973b88a-69a4-4017-b883-ee6fea44e60b req-4f9e1bd3-cbff-4caa-a5ee-f0b2ff761e78 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:53.063270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e973b88a-69a4-4017-b883-ee6fea44e60b req-4f9e1bd3-cbff-4caa-a5ee-f0b2ff761e78 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:53.083710 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-381994a6-1b68-4ad1-9814-19ed403f67a9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.534405 Jul 25 16:26:53.096554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1995/4052] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:52 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:53.147264 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e973b88a-69a4-4017-b883-ee6fea44e60b req-4f9e1bd3-cbff-4caa-a5ee-f0b2ff761e78 service nova] Creating event network-vif-plugged:13e35165-9f8a-4892-860a-dbc3c1a06b62 for instance 68205026-85f3-4422-b253-496ac11797f7 on n-h2-846219-13 Jul 25 16:26:53.164322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e973b88a-69a4-4017-b883-ee6fea44e60b req-4f9e1bd3-cbff-4caa-a5ee-f0b2ff761e78 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173016 Jul 25 16:26:53.172526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2058/4053] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 16:26:53.500212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:53.502263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:53.577497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:53.582687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:53.594093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:53.602514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:53.889962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:53.911327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:53.960392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:53.991560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:53.997048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.010386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:54.066423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:54.124268 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b0d012d-7690-4c38-b2ba-13dea5e30050 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1279 microversion: 2.1 time: 0.639634 Jul 25 16:26:54.128014 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1996/4054] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:53 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1279 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:54.158535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:54.166643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:54.208615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.210286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:54.218474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.219934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:54.473050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:54.487856 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4074edf-6e14-40f6-9820-ce44f82e17c9 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1302 microversion: 2.1 time: 0.350818 Jul 25 16:26:54.492856 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1997/4055] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:54 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1302 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:54.512484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:54.525261 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9d867aa-c5fd-41a3-8292-6a697a2aa66b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1505 microversion: 2.1 time: 0.640043 Jul 25 16:26:54.546132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2059/4056] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:53 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:54.554086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:54.554946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:54.580763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.593502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:54.599084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.599899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.004257 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bca29e3d-9612-4063-9403-949f431d9c51 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33/action" status: 202 len: 0 microversion: 2.1 time: 0.454405 Jul 25 16:26:55.013983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:55.015343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:55.020147 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1998/4057] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:26:54 2022] POST /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:26:55.029260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:55.030426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.031594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:55.032259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.222168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:55.224031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:55.250300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:55.251347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.255673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:55.256642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.655658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:55.696248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:55.709822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-925f5b07-fdcf-4f9a-af8e-9521973b7859 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1510 microversion: 2.1 time: 0.700023 Jul 25 16:26:55.711572 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2060/4058] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:55 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1510 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:55.726241 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61ee6151-fde5-4009-8de5-f6fd0d565048 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1277 microversion: 2.1 time: 0.502279 Jul 25 16:26:55.751706 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 1999/4059] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:55 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1277 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:55.781298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:55.784917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:55.808700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:55.810925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.813825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:55.814893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.165683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:56.214330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-01fedd0b-ea58-4d64-9133-7546545a6fbc tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1475 microversion: 2.1 time: 0.495312 Jul 25 16:26:56.219473 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2061/4060] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:55 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1475 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:56.258102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:56.259219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:56.272268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.273466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.275142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.276212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.539299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:56.552302 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8aebb9b1-1ffa-4196-a70b-77fa9ad3d484 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1475 microversion: 2.1 time: 0.311528 Jul 25 16:26:56.570182 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2000/4061] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:56 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:56.590182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:56.593673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:56.607054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.607986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.610692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.611661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.758541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:56.760189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:56.783338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.783803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.786806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.788037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.846457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e5b44bc-9b26-495c-93a7-2e2a83ddf17f tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1628 microversion: 2.1 time: 0.263480 Jul 25 16:26:56.859813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2062/4062] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:56 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1628 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:56.883089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:56.891279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:56.904730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.906191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.907905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.908611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.263956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:57.302318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2522ac56-e07c-48a7-88c2-2fd732c282b2 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1490 microversion: 2.1 time: 0.548363 Jul 25 16:26:57.305181 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2001/4063] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:56 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1490 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:57.314058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:57.315001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:57.339356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:57.340042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.341379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:57.342173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.369374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:57.403529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26815d3f-8d47-475f-a210-f1857859ecc0 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 0.541624 Jul 25 16:26:57.405864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2063/4064] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:56 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:57.447349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:57.450389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:57.478731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:57.480092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.482246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:57.482976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.599029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lazy-loading 'flavor' on Instance uuid 937a6da3-2ec6-40fa-9f39-6f02632f3e82 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:26:57.768219 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-767cd84e-9751-467e-9d73-ae7457193588 tempest-TestSecurityGroupsBasicOps-65016631 tempest-TestSecurityGroupsBasicOps-65016631-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1916 microversion: 2.1 time: 0.460483 Jul 25 16:26:57.770077 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2002/4065] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:57 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1916 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:57.790999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:57.791775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:57.847898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:57.849602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.851483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:57.853269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:57.959952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lazy-loading 'flavor' on Instance uuid e08a773e-d2bc-44ef-94d4-4e0dea64af33 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:26:58.162151 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6a73900-3bd5-4e34-9f09-b0d28da068c2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/action" status: 202 len: 0 microversion: 2.20 time: 0.730005 Jul 25 16:26:58.164268 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2064/4066] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:26:57 2022] POST /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:26:58.183411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:58.185129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:58.206363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.207548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.209240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.211109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.300932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:26:58.452309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:58.524233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-10af89e0-a856-41cf-9dff-111f049d9a10 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "DELETE /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 204 len: 0 microversion: 2.1 time: 0.351756 Jul 25 16:26:58.525934 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2065/4067] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:26:58 2022] DELETE /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:26:58.548736 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7da322d6-0a65-4ace-aa0c-63b09182eb9a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33/action" status: 202 len: 0 microversion: 2.1 time: 0.776544 Jul 25 16:26:58.549699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:58.549869 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2003/4068] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:26:57 2022] POST /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:26:58.555562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:58.559960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:58.561841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:58.563618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.564559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.566281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.567901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.578676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.579737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.582800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.583559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.114753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:59.155984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:59.186048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:59.189844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:59.192132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e435e30c-a86b-476a-b80e-0c70336ffae6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 0.663681 Jul 25 16:26:59.193405 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2066/4069] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:26:58 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:26:59.205005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:59.206312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:59.220920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:59.221392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.222802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:59.223530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:59.223844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.240933 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72d1501e-8b83-4e60-9583-535571e388fc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 0.689386 Jul 25 16:26:59.246464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2004/4070] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:58 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:59.262782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:59.264122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:59.276703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:59.283580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.286449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:59.286449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.565845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:59.586035 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af6c34e9-6471-426f-b902-687dd9fedb6d tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1481 microversion: 2.1 time: 0.390383 Jul 25 16:26:59.587544 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2067/4071] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:59 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1481 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:59.981964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:00.003670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49767b4e-8d6e-4540-bf39-e460d8682f41 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1496 microversion: 2.1 time: 0.756113 Jul 25 16:27:00.015479 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2005/4072] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:26:59 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1496 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:00.289390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:00.291855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:00.299777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:00.300269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:00.336713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:00.337338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:00.338195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:00.338635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:00.342103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:00.346906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:00.350691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:00.354091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:00.910355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:01.474226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:01.493136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:01.497205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:01.500070 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ef1561f-bcb6-4a98-8061-dad2b27d22f7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 1.239821 Jul 25 16:27:01.502182 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2068/4073] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:00 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:01.511165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a5c921c9-9650-490c-9f9a-630a64c07a6e req-2c636349-51ea-4ac4-80f0-885ca78f3ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c29d078-a4a1-4237-a4ec-2175eb39b444", "tag": "20167a92-fcf7-4a3b-8f8b-09b533f1d309"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:01.531043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a5c921c9-9650-490c-9f9a-630a64c07a6e req-2c636349-51ea-4ac4-80f0-885ca78f3ed6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.532016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:01.533362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a5c921c9-9650-490c-9f9a-630a64c07a6e req-2c636349-51ea-4ac4-80f0-885ca78f3ed6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.560615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a5c921c9-9650-490c-9f9a-630a64c07a6e req-2c636349-51ea-4ac4-80f0-885ca78f3ed6 service nova] Creating event network-changed:20167a92-fcf7-4a3b-8f8b-09b533f1d309 for instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 on n-h1-846219-13 Jul 25 16:27:01.565530 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-50e948d6-51d9-48f9-b8a1-fc5adf7d6453 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 1.270855 Jul 25 16:27:01.568514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2006/4074] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:00 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:01.571498 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a5c921c9-9650-490c-9f9a-630a64c07a6e req-2c636349-51ea-4ac4-80f0-885ca78f3ed6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066709 Jul 25 16:27:01.573062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2069/4075] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:01.583019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:01.584832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:01.587197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:01.588426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:01.598920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.600443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.603051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.604289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.624674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.625509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.626974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.627763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.978616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:02.001884 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-215c460b-07cc-4dd9-a022-e25e88fa5fdd tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 200 len: 1481 microversion: 2.1 time: 0.428321 Jul 25 16:27:02.002995 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2007/4076] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:01 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 1481 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:02.118762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:02.148114 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-763b0415-e767-4cdc-918a-71621a091228 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1517 microversion: 2.1 time: 0.572100 Jul 25 16:27:02.149192 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2070/4077] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:01 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1517 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:02.389843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4af681b8-3088-4caa-ad88-1c08d934d3fc req-103d76b0-e0de-497a-af31-60f9b200ce06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68205026-85f3-4422-b253-496ac11797f7", "name": "network-vif-deleted", "tag": "13e35165-9f8a-4892-860a-dbc3c1a06b62"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:02.411677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4af681b8-3088-4caa-ad88-1c08d934d3fc req-103d76b0-e0de-497a-af31-60f9b200ce06 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.412712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4af681b8-3088-4caa-ad88-1c08d934d3fc req-103d76b0-e0de-497a-af31-60f9b200ce06 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.450954 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4af681b8-3088-4caa-ad88-1c08d934d3fc req-103d76b0-e0de-497a-af31-60f9b200ce06 service nova] Creating event network-vif-deleted:13e35165-9f8a-4892-860a-dbc3c1a06b62 for instance 68205026-85f3-4422-b253-496ac11797f7 on n-h2-846219-13 Jul 25 16:27:02.457900 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4af681b8-3088-4caa-ad88-1c08d934d3fc req-103d76b0-e0de-497a-af31-60f9b200ce06 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071935 Jul 25 16:27:02.459120 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2008/4078] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:27:02.528966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:02.530753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:02.544160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.545496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.547348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.548548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.590922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:02.592541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:02.615536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.616032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.617144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.617586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.646929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:03.324277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.336270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-280ebc37-66fe-490d-bcd4-c6dbd930fe36 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 0.751549 Jul 25 16:27:03.337826 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2009/4079] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:02 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:03.344022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:03.344661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 68205026-85f3-4422-b253-496ac11797f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:03.352159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:03.352600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:03.353630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:03.354108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:03.362004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.375043 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] HTTP exception thrown: Instance 68205026-85f3-4422-b253-496ac11797f7 could not be found. Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Request method failure captured: Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 HTTP/1.1 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sOjTFnhi2mUfDwq0D9B64wEoQB60JOpATW6qYy7cBgYFkBtt_Qg1zobgU-UoH7kZNZNM_1yYnW-L1SZ8Yg9dzcyXXyXNCK07jPtCuNYZRzy862-YOjfJtjpQFZCyyYs3p4qB7oz88K8AhztoxL1rt6OhHK7eBEwiFBd0oNxF87mnu8 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: eeb296addf4b46fda315d22fca210662 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-302449533 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/eeb296addf4b46fda315d22fca210662"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/eeb296addf4b46fda315d22fca210662"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/eeb296addf4b46fda315d22fca210662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_eeb296addf4b46fda315d22fca210662"}]}] Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestSecurityGroupsBasicOps-302449533 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: eeb296addf4b46fda315d22fca210662 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-302449533 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestSecurityGroupsBasicOps-302449533-project Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: be5761637f9b43c3bc4d0008579ed6b3 Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestSecurityGroupsBasicOps-302449533-project Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 68205026-85f3-4422-b253-496ac11797f7 could not be found. Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '68205026-85f3-4422-b253-496ac11797f7'} Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68205026-85f3-4422-b253-496ac11797f7 could not be found. Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68205026-85f3-4422-b253-496ac11797f7 could not be found. Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:03.378409 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68205026-85f3-4422-b253-496ac11797f7 could not be found. Jul 25 16:27:03.382230 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:03.382626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.385133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Returning 404 to user: Instance 68205026-85f3-4422-b253-496ac11797f7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:03.386557 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-96e9c044-4de1-49eb-a9e3-adf11c36ebef tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7" status: 404 len: 111 microversion: 2.1 time: 0.047402 Jul 25 16:27:03.387453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.387884 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2010/4080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:03 2022] GET /compute/v2.1/servers/68205026-85f3-4422-b253-496ac11797f7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:03.392059 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5da3abc2-8696-479c-a7f8-714d2387e85d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 0.870592 Jul 25 16:27:03.396351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:03.397560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2071/4081] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:02 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:03.398338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:03.423016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:03.429611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:03.440068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:03.441469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:03.951310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.961643 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7454df4a-2f29-473f-b51c-a9fc6a7cd6cc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1517 microversion: 2.1 time: 0.572282 Jul 25 16:27:03.972100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2011/4082] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:03 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1517 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:04.379417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:04.386673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:04.423542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.425249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:04.427246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.428567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:04.448708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:04.451909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:04.466739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.467539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:04.468896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.469667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:05.345388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:05.374912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:05.380211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:05.388857 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4388ca26-7abd-4026-972a-7f121170a812 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 0.960809 Jul 25 16:27:05.393350 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2012/4083] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:04 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:05.402291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:05.416695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:05.434534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:05.441677 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a084d36a-6357-4e99-adab-b5382e5befc6 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 1.066076 Jul 25 16:27:05.452560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2072/4084] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:04 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:05.463700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:05.469827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:05.475752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:05.476641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.209993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6ccbd2eb-7676-4b4f-96a4-8f10e29a54c8 req-b0404c67-3791-4440-a6cd-1b243e3e33d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a773e-d2bc-44ef-94d4-4e0dea64af33", "name": "network-vif-plugged", "status": "completed", "tag": "c70c5a54-cd77-45d9-bd12-a3026466e57e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:06.280180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6ccbd2eb-7676-4b4f-96a4-8f10e29a54c8 req-b0404c67-3791-4440-a6cd-1b243e3e33d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.280928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6ccbd2eb-7676-4b4f-96a4-8f10e29a54c8 req-b0404c67-3791-4440-a6cd-1b243e3e33d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.317062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6ccbd2eb-7676-4b4f-96a4-8f10e29a54c8 req-b0404c67-3791-4440-a6cd-1b243e3e33d4 service nova] Creating event network-vif-plugged:c70c5a54-cd77-45d9-bd12-a3026466e57e for instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 on n-h2-846219-13 Jul 25 16:27:06.339956 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6ccbd2eb-7676-4b4f-96a4-8f10e29a54c8 req-b0404c67-3791-4440-a6cd-1b243e3e33d4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138449 Jul 25 16:27:06.349441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2073/4085] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:27:06.439990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:06.440971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:06.453986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.454932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.456348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.457148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.715913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:06.725425 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68d102b9-0aec-48e7-8fa6-925510313d7d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 1.330053 Jul 25 16:27:06.726039 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2013/4086] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:05 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:06.747548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:06.748560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:06.759969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.760822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.762843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.764022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:07.080491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:07.095971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:07.100372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:07.102390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2588db12-3d34-4927-9ac1-9a9a056e28d8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 0.669003 Jul 25 16:27:07.103688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2074/4087] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:06 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:27:07.481962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:07.492542 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc43dc29-1941-477c-a6dc-f95168ca0c62 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 0.756932 Jul 25 16:27:07.509210 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2014/4088] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:06 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:07.773430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:07.780828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:07.805188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:07.806807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:07.808632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:07.810003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.150131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:08.150872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:08.159207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.159702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.160731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.161477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.331216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:08.366007 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-498d05db-44fc-49ae-9c6a-b78145270623 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 0.607899 Jul 25 16:27:08.368035 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2075/4089] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:07 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:08.543756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:08.546444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:08.572458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.578145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.580349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.581695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:09.039439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:09.058070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:09.063412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:09.066687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4b06e24-4ee7-44f5-a237-1359f2d73e0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 0.922967 Jul 25 16:27:09.090794 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2015/4090] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:08 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:09.230881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-049b6dbf-461e-4889-bac0-2e27c11bc729 req-9e61fd7c-45ea-4e8b-ba88-2b226dc7191a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c29d078-a4a1-4237-a4ec-2175eb39b444", "name": "network-vif-plugged", "status": "completed", "tag": "20167a92-fcf7-4a3b-8f8b-09b533f1d309"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:09.258946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-049b6dbf-461e-4889-bac0-2e27c11bc729 req-9e61fd7c-45ea-4e8b-ba88-2b226dc7191a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:09.259849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-049b6dbf-461e-4889-bac0-2e27c11bc729 req-9e61fd7c-45ea-4e8b-ba88-2b226dc7191a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:09.266332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:09.298794 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-049b6dbf-461e-4889-bac0-2e27c11bc729 req-9e61fd7c-45ea-4e8b-ba88-2b226dc7191a service nova] Creating event network-vif-plugged:20167a92-fcf7-4a3b-8f8b-09b533f1d309 for instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 on n-h1-846219-13 Jul 25 16:27:09.301651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85b605ef-f294-446a-aef8-42e81039a221 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 0.765391 Jul 25 16:27:09.310361 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2076/4091] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:08 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:09.327908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-049b6dbf-461e-4889-bac0-2e27c11bc729 req-9e61fd7c-45ea-4e8b-ba88-2b226dc7191a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108227 Jul 25 16:27:09.332581 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2016/4092] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:09.418641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:09.426932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:09.451715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:09.463328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:09.464783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:09.470990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:09.472395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:09.885556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:09.928234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-071668a4-1db7-42da-a806-9ccd8ebd8aaa tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 0.519744 Jul 25 16:27:09.957401 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2077/4093] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:09 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:10.112640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:10.118776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:10.138041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:10.139330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:10.141406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:10.143072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:10.338346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:10.343077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:10.379370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:10.380557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:10.387002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:10.388365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:11.274252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:11.317230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:11.320438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:11.345070 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-141340ac-e7af-4fcd-a600-0b9d196c495a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 1.235415 Jul 25 16:27:11.346662 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2017/4094] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:10 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:11.527845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:11.579595 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e2f0708-9490-426c-b1f0-c681879f3bb2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1319 microversion: 2.1 time: 1.243546 Jul 25 16:27:11.580546 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2078/4095] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:10 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1319 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:11.646732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:11.653991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:11.751528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:11.752548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:11.765444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:11.778267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:11.858643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-887242965", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "36a64c20-c397-41cd-b990-56c72a4cae49"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:12.091341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] validate_networks() for [('36a64c20-c397-41cd-b990-56c72a4cae49', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:27:12.650579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:12.693178 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49ed9956-4128-4f72-b735-4f68c69e79e4 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 1.081290 Jul 25 16:27:12.694581 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2079/4096] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:11 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:12.708723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:12.723660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:12.752025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:12.753924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:12.758338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:12.763525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.509624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:14.538573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:14.540296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:14.547407 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f99c7a1-8290-492e-a803-62e41d148755 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 1.850862 Jul 25 16:27:14.557152 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2080/4097] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:12 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:14.557152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:14.557152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:14.580186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:14.581014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.582619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:14.583422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.753533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:27:14.754145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:27:14.754429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:27:14.754845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:27:14.755283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:27:14.780807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:14.781769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.783499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:14.783995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.884460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Getting quotas for project 0e9696a9a67b4e3cbff42aa7065a2b5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:14.916395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Getting quotas for user e38e8ef5233b4f6285d0d19f809b1715 and project 0e9696a9a67b4e3cbff42aa7065a2b5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:14.979852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:27:14.985068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:27:15.147551 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1008371c-f3ae-4126-804c-adf4873678ca tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.799019 Jul 25 16:27:15.154331 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2018/4098] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:27:11 2022] POST /compute/v2.1/servers => generated 382 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:27:15.206716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:15.228745 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b58bc2a-93de-4566-a88e-2a39bee5f3fd tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1508 microversion: 2.1 time: 0.678639 Jul 25 16:27:15.231425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:15.231744 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2081/4099] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:14 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1508 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:15.233785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:15.265811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:15.270178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:15.275527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:15.276422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:15.289212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:15.289212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:15.325190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:15.328815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:15.331450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:15.332704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:15.413718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:27:15.612806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:15.803553 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e75d183c-1b60-4dbd-8dae-287bef075967 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 204 len: 0 microversion: 2.1 time: 0.531729 Jul 25 16:27:15.814776 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2082/4100] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:27:15 2022] DELETE /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:27:15.876514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1263748048", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "36a64c20-c397-41cd-b990-56c72a4cae49"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:15.969201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:16.006279 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8f1894c-5f32-49e2-b138-a5f1f778f216 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 0.800232 Jul 25 16:27:16.009122 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2019/4101] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:15 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:16.040067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:16.041488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:16.072626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:16.076155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:16.081806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:16.082760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:16.181445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] validate_networks() for [('36a64c20-c397-41cd-b990-56c72a4cae49', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:27:17.235288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:17.292312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:17.307982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:17.314917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86e86a68-854d-41e1-a37b-0101d909a2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1748 microversion: 2.20 time: 1.281562 Jul 25 16:27:17.347194 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2020/4102] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:16 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1748 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:17.363223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:17.367153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:17.380317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:17.381527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:17.383449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:17.384548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:17.959737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:17.988405 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-71a8a50a-19eb-4bb4-9b0a-1bbb1e9424e5 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1514 microversion: 2.1 time: 0.636581 Jul 25 16:27:17.990768 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2021/4103] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:17 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1514 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:18.015012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:18.015850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:18.027618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:18.028179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:18.029259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:18.029805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.259128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:27:19.260653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:27:19.263616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:27:19.264685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:27:19.265702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:27:19.317346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:19.319915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.337515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:19.338564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.446880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Getting quotas for project 0e9696a9a67b4e3cbff42aa7065a2b5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:19.504004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Getting quotas for user e38e8ef5233b4f6285d0d19f809b1715 and project 0e9696a9a67b4e3cbff42aa7065a2b5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:19.612285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:27:19.625288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:27:19.844561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-56c3eaf0-8ac7-46bf-9c63-72901ba45ea3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.024200 Jul 25 16:27:19.864444 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2083/4104] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:27:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 4049 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:27:19.888760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:19.890383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:19.919676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:19.935978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.951763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:19.955514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:20.125978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:20.140716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c7ebf3c6-071b-4e81-9460-bf92c75239ee tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 2.133321 Jul 25 16:27:20.164102 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2022/4105] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:17 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:20.198161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:20.209356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:20.259786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:20.266055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:20.267094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:20.267684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:20.668961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:20.679616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:20.682974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:20.686699 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4a40bb2-b712-411e-b288-1f2740d1b1b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 0.820126 Jul 25 16:27:20.694615 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2084/4106] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:19 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:20.716305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:20.735310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:20.795594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:20.805201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:20.809151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:20.810707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:20.947720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:27:21.336466 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ade59bd6-6fe3-4dcf-8fc8-06b2d4c10bdb tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "DELETE /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 204 len: 0 microversion: 2.1 time: 0.639781 Jul 25 16:27:21.338824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2085/4107] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:27:20 2022] DELETE /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:27:21.380953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1389537672", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "451", "networks": [{"uuid": "36a64c20-c397-41cd-b990-56c72a4cae49"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:21.837568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2258ff14334d404ea8b2900b66076444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8dd1238bb404448803f7e05924180fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:21.926780 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc45147c-61b6-464c-892a-aaddab600cc2 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 200 len: 1514 microversion: 2.1 time: 1.760895 Jul 25 16:27:21.941385 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2023/4108] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:20 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 1514 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:21.961075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:21.986512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:22.054914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:22.068509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:22.073726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:22.082298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:22.083346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:23.813009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:23.838392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec231e2e-2323-4053-9d5e-2a0333008220 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 1.894603 Jul 25 16:27:23.840908 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2024/4109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:21 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:23.859657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:23.865155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:23.893343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:23.894184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:23.895239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:23.899791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:24.818193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:24.958412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:25.475688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:25.490972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-50970988-e75a-45a7-bec6-3ca782b89c9d tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1669 microversion: 2.1 time: 1.647888 Jul 25 16:27:25.491858 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2025/4110] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:23 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1669 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:25.506387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:25.507793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:25.520472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:25.521620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:25.527133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:25.528485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:26.720095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:26.761456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:26.777669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:26.783974 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ccf06386-f2ff-48a3-9611-5114ca7fe48f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 1.283053 Jul 25 16:27:26.785608 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2026/4111] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:25 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:26.861077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4b0df24e-c9af-48e4-b17a-d4d9a997ad7e req-831fd5fa-770e-4fe0-a157-7108a6504c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c29d078-a4a1-4237-a4ec-2175eb39b444", "name": "network-vif-deleted", "tag": "20167a92-fcf7-4a3b-8f8b-09b533f1d309"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:26.927007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4b0df24e-c9af-48e4-b17a-d4d9a997ad7e req-831fd5fa-770e-4fe0-a157-7108a6504c51 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:26.927556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4b0df24e-c9af-48e4-b17a-d4d9a997ad7e req-831fd5fa-770e-4fe0-a157-7108a6504c51 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:26.965020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4b0df24e-c9af-48e4-b17a-d4d9a997ad7e req-831fd5fa-770e-4fe0-a157-7108a6504c51 service nova] Creating event network-vif-deleted:20167a92-fcf7-4a3b-8f8b-09b533f1d309 for instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 on n-h1-846219-13 Jul 25 16:27:26.976714 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4b0df24e-c9af-48e4-b17a-d4d9a997ad7e req-831fd5fa-770e-4fe0-a157-7108a6504c51 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176105 Jul 25 16:27:26.978508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2027/4112] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:27.024562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b7fb9b77-e69c-451c-a70d-be7af01322df req-de0315be-347f-4e3b-810f-f82e6295608e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "name": "network-vif-plugged", "status": "completed", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:27.046867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b7fb9b77-e69c-451c-a70d-be7af01322df req-de0315be-347f-4e3b-810f-f82e6295608e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:27.048454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b7fb9b77-e69c-451c-a70d-be7af01322df req-de0315be-347f-4e3b-810f-f82e6295608e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:27.094720 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b7fb9b77-e69c-451c-a70d-be7af01322df req-de0315be-347f-4e3b-810f-f82e6295608e service nova] Creating event network-vif-plugged:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:27:27.105078 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b7fb9b77-e69c-451c-a70d-be7af01322df req-de0315be-347f-4e3b-810f-f82e6295608e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111388 Jul 25 16:27:27.106839 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2028/4113] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:27.120883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:27.122244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:27.161927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:27.162991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:27.168336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:27.169893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:27.257895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 HTTP/1.1 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7c29d078-a4a1-4237-a4ec-2175eb39b444'} Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:27.264058 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:27.273046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:27.278093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:27.284778 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59c1c374-d458-4a13-ac26-4bfc1d55ae41 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 404 len: 111 microversion: 2.1 time: 0.173867 Jul 25 16:27:27.297370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2029/4114] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:27 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:27.348358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:27.357651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:27.384736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:27.389953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:27.395737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:27.398936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:27.496191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:27.523002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:27:28.074530 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5610b4f6-1ac9-474a-8250-0792e3119510 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 204 len: 0 microversion: 2.1 time: 0.774486 Jul 25 16:27:28.080326 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2030/4115] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:27:27 2022] DELETE /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:27:28.089587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:28.098017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:28.124271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:28.124885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:28.126041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:28.126689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:28.764731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:28.799618 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4cb3cf2-61c8-4b51-babd-a16303972a1e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 0.716328 Jul 25 16:27:28.810136 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2031/4116] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:28 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:28.838047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:28.839649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:28.874405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:28.886299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:28.888383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:28.889715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.068201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6a710bce5a4467adff77afed6da5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44b01f7747404da4ab3cbbee3d7c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:29.089340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0052d2f1-5687-43e8-b397-78e6ae0841f6 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 200 len: 1602 microversion: 2.1 time: 0.277312 Jul 25 16:27:29.100182 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2032/4117] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:28 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 1602 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:29.105690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-24d266a9-4e49-4a1e-a078-d279e6c6933b req-bf85cce7-a468-4ef2-ae7d-a7efe8dec7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0195c6f1-af14-4b4a-9715-ab0d1bbfc51a", "tag": "dcf7eecb-1be9-4f4a-927c-18e8568f1cdb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:29.162823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-24d266a9-4e49-4a1e-a078-d279e6c6933b req-bf85cce7-a468-4ef2-ae7d-a7efe8dec7b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.163329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-24d266a9-4e49-4a1e-a078-d279e6c6933b req-bf85cce7-a468-4ef2-ae7d-a7efe8dec7b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.232364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-24d266a9-4e49-4a1e-a078-d279e6c6933b req-bf85cce7-a468-4ef2-ae7d-a7efe8dec7b6 service nova] Creating event network-changed:dcf7eecb-1be9-4f4a-927c-18e8568f1cdb for instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a on n-h2-846219-13 Jul 25 16:27:29.341138 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-24d266a9-4e49-4a1e-a078-d279e6c6933b req-bf85cce7-a468-4ef2-ae7d-a7efe8dec7b6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239003 Jul 25 16:27:29.381234 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2033/4118] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:29.381234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:29.381234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:29.410072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.410611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.411005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:29.411601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.411907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.444674 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b7c42bd8-a696-4c08-93fb-02a99b87976a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/ips" status: 200 len: 149 microversion: 2.1 time: 0.097664 Jul 25 16:27:29.452472 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2034/4119] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:27:29 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/ips => generated 149 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:29.452472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-262724387", "metadata": {"image_type": "test"}}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:29.455427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:29.464049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.464636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.465632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.466318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.486337 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444/action HTTP/1.1 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 111 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-262724387", "metadata": {"image_type": "test"}}} Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7c29d078-a4a1-4237-a4ec-2175eb39b444', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-262724387', 'metadata': {'image_type': 'test'}}}} Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 16:27:29.488216 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14d0a502-66a3-4526-8e35-1f734dd5e563 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "POST /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444/action" status: 404 len: 111 microversion: 2.1 time: 0.043337 Jul 25 16:27:29.491998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2035/4120] 10.222.0.105 () {60 vars in 1284 bytes} [Mon Jul 25 16:27:29 2022] POST /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:29.508557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:29.509258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:29.517415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.517876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.519686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.520137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.552837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:30.171834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:30.258600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:30.266648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:30.288728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5146ae72-517d-43de-855a-c330a458e31a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 0.781485 Jul 25 16:27:30.308818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2036/4121] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:29 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:30.342088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:30.343690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:30.365681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:30.367881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:30.369174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:30.372174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:31.224996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:31.408971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:31.484917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:31.496324 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-66f30305-efd7-4186-a7d8-6ec1dcb3458f tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1769 microversion: 2.1 time: 1.173911 Jul 25 16:27:31.513673 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2037/4122] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:30 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1769 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:31.519469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff52aff5-ebb8-4d01-a690-9146ee36fa64 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-191563952", "metadata": {"image_type": "test"}}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:31.531735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ff52aff5-ebb8-4d01-a690-9146ee36fa64 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Failed to fetch instance by id tempest-invalid-1595546346 {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:27:31.532386 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ff52aff5-ebb8-4d01-a690-9146ee36fa64 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance tempest-invalid-1595546346 could not be found. Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff52aff5-ebb8-4d01-a690-9146ee36fa64 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/tempest-invalid-1595546346/action HTTP/1.1 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 111 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-191563952", "metadata": {"image_type": "test"}}} Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance tempest-invalid-1595546346 could not be found. Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'tempest-invalid-1595546346', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-191563952', 'metadata': {'image_type': 'test'}}}} Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1595546346 could not be found. Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:31.535208 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1595546346 could not be found. Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1595546346 could not be found. Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff52aff5-ebb8-4d01-a690-9146ee36fa64 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance tempest-invalid-1595546346 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff52aff5-ebb8-4d01-a690-9146ee36fa64 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "POST /compute/v2.1/servers/tempest-invalid-1595546346/action" status: 404 len: 101 microversion: 2.1 time: 0.021121 Jul 25 16:27:31.547841 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2038/4123] 10.222.0.105 () {60 vars in 1254 bytes} [Mon Jul 25 16:27:31 2022] POST /compute/v2.1/servers/tempest-invalid-1595546346/action => generated 101 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:31.587492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-47e91c4a-5fc7-4b4f-ab66-4095d873f904 req-47be9396-75a9-439c-9c2e-11896be04342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4e4fc4-3364-4545-a924-527ba65cd638", "tag": "e5b4de22-258e-4a4d-91fc-bbe7c87b59c2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:31.671141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-47e91c4a-5fc7-4b4f-ab66-4095d873f904 req-47be9396-75a9-439c-9c2e-11896be04342 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:31.671937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-47e91c4a-5fc7-4b4f-ab66-4095d873f904 req-47be9396-75a9-439c-9c2e-11896be04342 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:31.729387 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-47e91c4a-5fc7-4b4f-ab66-4095d873f904 req-47be9396-75a9-439c-9c2e-11896be04342 service nova] Creating event network-changed:e5b4de22-258e-4a4d-91fc-bbe7c87b59c2 for instance 4e4e4fc4-3364-4545-a924-527ba65cd638 on n-h1-846219-13 Jul 25 16:27:31.821566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-47e91c4a-5fc7-4b4f-ab66-4095d873f904 req-47be9396-75a9-439c-9c2e-11896be04342 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256882 Jul 25 16:27:31.826332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2039/4124] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:31.866289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:31.885418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:31.934975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:31.938662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:31.949419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:31.957928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.397412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:33.409688 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3ba858fb-88bd-4889-b298-47a9b18cb46e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 1.577771 Jul 25 16:27:33.413916 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2040/4125] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:31 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:33.423932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:33.424960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] [instance: 16c1d060-9021-42bb-b787-1c1a101e441a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:33.477197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.477710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.478579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.479093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.567550 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] HTTP exception thrown: Instance 16c1d060-9021-42bb-b787-1c1a101e441a could not be found. Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Request method failure captured: Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a HTTP/1.1 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUkh62XfjJpKdIVvHbVjLgGasiQH2T6g66sQIkGfMczlKydWIFxJ9MW1opDQUxmf4XFyUzF08eNJyGGZYc3Q-65zf9IuApOXGIqjsxWLBIhFrN6HScV6nAjSGsqUpjWo6LdtJT8UfAMY5PCh0WoJqxkYY3YHPOxWw6jDp_0WyOmfM Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: aa44b01f7747404da4ab3cbbee3d7c0f Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestFqdnHostnames-515435665 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/aa44b01f7747404da4ab3cbbee3d7c0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/aa44b01f7747404da4ab3cbbee3d7c0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/aa44b01f7747404da4ab3cbbee3d7c0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_aa44b01f7747404da4ab3cbbee3d7c0f"}]}] Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestFqdnHostnames-515435665 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: aa44b01f7747404da4ab3cbbee3d7c0f Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-515435665 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestFqdnHostnames-515435665-project Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: dd6a710bce5a4467adff77afed6da5a3 Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestFqdnHostnames-515435665-project Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 16c1d060-9021-42bb-b787-1c1a101e441a could not be found. Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '16c1d060-9021-42bb-b787-1c1a101e441a'} Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c1d060-9021-42bb-b787-1c1a101e441a could not be found. Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c1d060-9021-42bb-b787-1c1a101e441a could not be found. Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:33.585715 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c1d060-9021-42bb-b787-1c1a101e441a could not be found. Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:33.590960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Returning 404 to user: Instance 16c1d060-9021-42bb-b787-1c1a101e441a could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:33.608222 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4553fb7-f37c-43cd-bb19-236770498e20 tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a" status: 404 len: 111 microversion: 2.1 time: 0.172769 Jul 25 16:27:33.612428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2041/4126] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:33 2022] GET /compute/v2.1/servers/16c1d060-9021-42bb-b787-1c1a101e441a => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:33.635733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:33.643857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:33.690796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.693280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.700187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.700655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.528381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:34.541449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:34.546758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:34.551229 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-baa1ea4b-61f7-42a9-bdbe-b210bbcb0db3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 0.935579 Jul 25 16:27:34.553714 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2042/4127] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:33 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:34.569562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c79c558b-b0ef-46d2-bb63-818a646ea05e tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-173376810"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:34.577369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c79c558b-b0ef-46d2-bb63-818a646ea05e tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:27:34.578066 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c79c558b-b0ef-46d2-bb63-818a646ea05e tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c79c558b-b0ef-46d2-bb63-818a646ea05e tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 56 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: {"createImage": {"name": "tempest-test-snap-173376810"}} Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-173376810'}}} Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:34.585599 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c79c558b-b0ef-46d2-bb63-818a646ea05e tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:34.591539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c79c558b-b0ef-46d2-bb63-818a646ea05e tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.033519 Jul 25 16:27:34.593231 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2043/4128] 10.222.0.105 () {60 vars in 1280 bytes} [Mon Jul 25 16:27:34 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:34.607039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:34.607670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:34.619463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:34.619925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.620815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:34.621586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.895579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5761637f9b43c3bc4d0008579ed6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb296addf4b46fda315d22fca210662', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:34.909071 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e82469cf-fcba-4369-bb70-bf54ac4774c6 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 200 len: 1381 microversion: 2.1 time: 0.313505 Jul 25 16:27:34.910629 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2044/4129] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:34 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 1381 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:34.928778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78c3bcb5-e6eb-4bb3-870e-e64d92ea3e3b tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] Calling method '.version_select at 0x7f9d93e4c310>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:34.999615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78c3bcb5-e6eb-4bb3-870e-e64d92ea3e3b tempest-ServersTestFqdnHostnames-515435665 tempest-ServersTestFqdnHostnames-515435665-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980109408" status: 202 len: 0 microversion: 2.1 time: 0.086115 Jul 25 16:27:35.000867 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2045/4130] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:27:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980109408 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:27:35.053478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:35.065341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:35.083159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.090808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:35.091858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.092412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:35.676934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:35.688860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4409e411-d2a4-4f51-90c6-eb8a3c0055db tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 0.666935 Jul 25 16:27:35.690675 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2046/4131] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:35 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:35.738671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99f248e7-4eaf-4da1-be10-695d02eb72dc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-997431509"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:35.742496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99f248e7-4eaf-4da1-be10-695d02eb72dc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:27:35.743585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-99f248e7-4eaf-4da1-be10-695d02eb72dc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99f248e7-4eaf-4da1-be10-695d02eb72dc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 56 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: {"createImage": {"name": "tempest-test-snap-997431509"}} Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-997431509'}}} Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:35.746968 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 16:27:35.750908 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:35.751526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99f248e7-4eaf-4da1-be10-695d02eb72dc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:35.752103 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99f248e7-4eaf-4da1-be10-695d02eb72dc tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.040766 Jul 25 16:27:35.752694 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2047/4132] 10.222.0.105 () {60 vars in 1286 bytes} [Mon Jul 25 16:27:35 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:35.765951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-12d8e799-d0e4-4481-9bc5-19942da463bd req-611c2462-8219-43a8-a8de-512bb91cd8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c1d060-9021-42bb-b787-1c1a101e441a", "name": "network-vif-deleted", "tag": "4d7f522b-9a02-4f11-bedd-7d195b51145f"}, {"server_uuid": "4e4e4fc4-3364-4545-a924-527ba65cd638", "name": "network-vif-deleted", "tag": "e5b4de22-258e-4a4d-91fc-bbe7c87b59c2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:35.781762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-12d8e799-d0e4-4481-9bc5-19942da463bd req-611c2462-8219-43a8-a8de-512bb91cd8d9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.782639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-12d8e799-d0e4-4481-9bc5-19942da463bd req-611c2462-8219-43a8-a8de-512bb91cd8d9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:35.850524 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-12d8e799-d0e4-4481-9bc5-19942da463bd req-611c2462-8219-43a8-a8de-512bb91cd8d9 service nova] Creating event network-vif-deleted:4d7f522b-9a02-4f11-bedd-7d195b51145f for instance 16c1d060-9021-42bb-b787-1c1a101e441a on n-h1-846219-13 Jul 25 16:27:35.852895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-12d8e799-d0e4-4481-9bc5-19942da463bd req-611c2462-8219-43a8-a8de-512bb91cd8d9 service nova] Creating event network-vif-deleted:e5b4de22-258e-4a4d-91fc-bbe7c87b59c2 for instance 4e4e4fc4-3364-4545-a924-527ba65cd638 on n-h1-846219-13 Jul 25 16:27:35.881816 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-12d8e799-d0e4-4481-9bc5-19942da463bd req-611c2462-8219-43a8-a8de-512bb91cd8d9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.127332 Jul 25 16:27:35.884124 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2048/4133] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:35.910232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:35.912917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:35.951011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.953079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:35.962203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.965403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.684647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:36.694108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:36.706528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:36.708437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f873abd-af99-4889-ae29-3a1af030b00a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 0.821468 Jul 25 16:27:36.710226 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2049/4134] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:35 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:36.726399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:36.729888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:36.754491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.759593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.761760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.766126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.813523 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 HTTP/1.1 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7c29d078-a4a1-4237-a4ec-2175eb39b444'} Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:36.821873 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:36.825743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:36.833042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:36.834354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c97a08e9-6105-461f-baa9-5e6bad2db417 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 404 len: 111 microversion: 2.1 time: 0.120637 Jul 25 16:27:36.838442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2050/4135] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:27:36 2022] DELETE /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:36.843931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bfe7f77e-41ce-4c8f-9561-f221e166d036 req-1d023075-b393-4763-b495-57919826cc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0195c6f1-af14-4b4a-9715-ab0d1bbfc51a", "name": "network-vif-plugged", "status": "completed", "tag": "dcf7eecb-1be9-4f4a-927c-18e8568f1cdb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:36.863175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bfe7f77e-41ce-4c8f-9561-f221e166d036 req-1d023075-b393-4763-b495-57919826cc18 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.863577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bfe7f77e-41ce-4c8f-9561-f221e166d036 req-1d023075-b393-4763-b495-57919826cc18 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.889077 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bfe7f77e-41ce-4c8f-9561-f221e166d036 req-1d023075-b393-4763-b495-57919826cc18 service nova] Creating event network-vif-plugged:dcf7eecb-1be9-4f4a-927c-18e8568f1cdb for instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a on n-h2-846219-13 Jul 25 16:27:36.913766 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bfe7f77e-41ce-4c8f-9561-f221e166d036 req-1d023075-b393-4763-b495-57919826cc18 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071476 Jul 25 16:27:36.916243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2051/4136] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:36.943148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:36.943987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] [instance: 4e4e4fc4-3364-4545-a924-527ba65cd638] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:36.973738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.975608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.979561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.980645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.012191 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] HTTP exception thrown: Instance 4e4e4fc4-3364-4545-a924-527ba65cd638 could not be found. Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Request method failure captured: Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 HTTP/1.1 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sOjTFnhi2mUfDwq0D9B64wEoQB60JOpATW6qYy7cBgYFkBtt_Qg1zobgU-UoH7kZNZNM_1yYnW-L1SZ8Yg9dzcyXXyXNCK07jPtCuNYZRzy862-YOjfJtjpQFZCyyYs3p4qB7oz88K8AhztoxL1rt6OhHK7eBEwiFBd0oNxF87mnu8 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: eeb296addf4b46fda315d22fca210662 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-302449533 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/eeb296addf4b46fda315d22fca210662"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/eeb296addf4b46fda315d22fca210662"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/eeb296addf4b46fda315d22fca210662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_eeb296addf4b46fda315d22fca210662"}]}] Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestSecurityGroupsBasicOps-302449533 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: eeb296addf4b46fda315d22fca210662 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-302449533 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestSecurityGroupsBasicOps-302449533-project Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: be5761637f9b43c3bc4d0008579ed6b3 Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestSecurityGroupsBasicOps-302449533-project Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 4e4e4fc4-3364-4545-a924-527ba65cd638 could not be found. Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4e4e4fc4-3364-4545-a924-527ba65cd638'} Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4e4fc4-3364-4545-a924-527ba65cd638 could not be found. Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4e4fc4-3364-4545-a924-527ba65cd638 could not be found. Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:37.025022 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4e4fc4-3364-4545-a924-527ba65cd638 could not be found. Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:37.028727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Returning 404 to user: Instance 4e4e4fc4-3364-4545-a924-527ba65cd638 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:37.033434 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2465a8ad-8fd1-42f0-8ed2-10705da4dbc7 tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638" status: 404 len: 111 microversion: 2.1 time: 0.110959 Jul 25 16:27:37.038014 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2052/4137] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:36 2022] GET /compute/v2.1/servers/4e4e4fc4-3364-4545-a924-527ba65cd638 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:37.057404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] validate_networks() for [('36a64c20-c397-41cd-b990-56c72a4cae49', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:27:37.081965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f54fa9ca-46af-4ee8-8701-8d11feecc156"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:37.092467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:37.123838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:37.125989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.127744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:37.128442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.863398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:37.908774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e72a4531-516f-4593-81d9-8febc0147179 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871518 Jul 25 16:27:37.911580 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2053/4138] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:27:37 2022] POST /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 194 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:37.968932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:37.975631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:38.028148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:38.031135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:38.055411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:38.065525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.559528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:39.581053 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d742a996-3434-4c0c-b94b-a39c1bf17f28 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1509 microversion: 2.1 time: 1.665140 Jul 25 16:27:39.588411 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2054/4139] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:37 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1509 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:39.606162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:39.607888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] [instance: 7c29d078-a4a1-4237-a4ec-2175eb39b444] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:39.628289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.634669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.636039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.640103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.696319 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] HTTP exception thrown: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Request method failure captured: Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 HTTP/1.1 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRGCWzbzeLbokWsldueWr4qso9E-RsYhlM72T5pQdO6uXJyAveHznGRN_juvNQ1Cv6KfZTj1lnmKEPr3LUkP7k64k6NszqGujvcON7vkSayVf11M7O7QaQcRZ4g48-tzs44P3o2ezUcLGD_MVO2JcnhHkE5mwDmdMrnhdkSG1y2vR0 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a8dd1238bb404448803f7e05924180fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a8dd1238bb404448803f7e05924180fe"}]}] Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a8dd1238bb404448803f7e05924180fe Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1036878931 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2258ff14334d404ea8b2900b66076444 Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ImagesNegativeTestJSON-1036878931-project Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '7c29d078-a4a1-4237-a4ec-2175eb39b444'} Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:27:39.699852 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. Jul 25 16:27:39.707617 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:27:39.722957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] Returning 404 to user: Instance 7c29d078-a4a1-4237-a4ec-2175eb39b444 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:27:39.725078 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0112954c-ec77-4d58-9c11-c6d0a85adc79 tempest-ImagesNegativeTestJSON-1036878931 tempest-ImagesNegativeTestJSON-1036878931-project] 10.222.0.105 "GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444" status: 404 len: 111 microversion: 2.1 time: 0.134384 Jul 25 16:27:39.726408 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2055/4140] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:39 2022] GET /compute/v2.1/servers/7c29d078-a4a1-4237-a4ec-2175eb39b444 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:27:39.735370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:39.742575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:39.765200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.768639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.772361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.774257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.111396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:41.131054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:41.133642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:41.137789 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e5ac7c8d-0355-44cc-ab80-eebcb5683bc0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 1.409539 Jul 25 16:27:41.144010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:27:41.145083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:27:41.146817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:27:41.147266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:27:41.147683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:27:41.160069 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2056/4141] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:39 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:41.173824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0c1bdbc9-b450-4472-94d0-2b777650d2ee req-d8beca2d-a303-488d-8f3b-ca8939e07e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3afea4-645e-4b47-8f31-45b8eb2d0207", "tag": "7a49b1c0-e7ca-4706-bd62-9344cf2d0efc"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:41.189794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.197506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.198782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.199304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.236371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0c1bdbc9-b450-4472-94d0-2b777650d2ee req-d8beca2d-a303-488d-8f3b-ca8939e07e9f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.249239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0c1bdbc9-b450-4472-94d0-2b777650d2ee req-d8beca2d-a303-488d-8f3b-ca8939e07e9f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.262495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Getting quotas for project 0e9696a9a67b4e3cbff42aa7065a2b5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:41.270768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Getting quotas for user e38e8ef5233b4f6285d0d19f809b1715 and project 0e9696a9a67b4e3cbff42aa7065a2b5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:41.288176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:27:41.292364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:27:41.295581 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0c1bdbc9-b450-4472-94d0-2b777650d2ee req-d8beca2d-a303-488d-8f3b-ca8939e07e9f service nova] Creating event network-changed:7a49b1c0-e7ca-4706-bd62-9344cf2d0efc for instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 on n-h1-846219-13 Jul 25 16:27:41.319162 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0c1bdbc9-b450-4472-94d0-2b777650d2ee req-d8beca2d-a303-488d-8f3b-ca8939e07e9f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153153 Jul 25 16:27:41.322972 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2057/4142] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:41.358354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:41.359415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:41.388562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.390164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc070258-6e08-4bb8-8769-2f41795ae4c7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 20.047691 Jul 25 16:27:41.391055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2086/4143] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:27:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 20050 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:27:41.397310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.398478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.398966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.419206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1bf01bc6-9bc6-4773-b72a-2aea364569c5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:41.420292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1bf01bc6-9bc6-4773-b72a-2aea364569c5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:42.065007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1bf01bc6-9bc6-4773-b72a-2aea364569c5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:42.079147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1bf01bc6-9bc6-4773-b72a-2aea364569c5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1225 microversion: 2.1 time: 0.674309 Jul 25 16:27:42.093128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2087/4144] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:41 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1225 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:42.104667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-be58ae7f-2b0e-4dbc-aa0e-d5324d5bf435 req-84f9b4a4-a14b-46c6-98b7-83832f2a2885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a773e-d2bc-44ef-94d4-4e0dea64af33", "name": "network-vif-unplugged", "status": "completed", "tag": "c70c5a54-cd77-45d9-bd12-a3026466e57e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:42.156395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-be58ae7f-2b0e-4dbc-aa0e-d5324d5bf435 req-84f9b4a4-a14b-46c6-98b7-83832f2a2885 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:42.160200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-be58ae7f-2b0e-4dbc-aa0e-d5324d5bf435 req-84f9b4a4-a14b-46c6-98b7-83832f2a2885 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:42.195723 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-be58ae7f-2b0e-4dbc-aa0e-d5324d5bf435 req-84f9b4a4-a14b-46c6-98b7-83832f2a2885 service nova] Creating event network-vif-unplugged:c70c5a54-cd77-45d9-bd12-a3026466e57e for instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 on n-h2-846219-13 Jul 25 16:27:42.208121 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-be58ae7f-2b0e-4dbc-aa0e-d5324d5bf435 req-84f9b4a4-a14b-46c6-98b7-83832f2a2885 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119837 Jul 25 16:27:42.211895 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2088/4145] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:42.227880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:42.229437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:42.244598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:42.245645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:42.247202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:42.248320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:42.885793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:42.942744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:42.961617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:42.980371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67ce7e58-49a3-4649-9bfd-f26b429acdf4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 0.757050 Jul 25 16:27:42.982362 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2089/4146] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:42 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:42.995999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:43.052813 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e02b91c-56a4-458d-9604-4829a469bfb5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1509 microversion: 2.1 time: 1.727993 Jul 25 16:27:43.062096 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2058/4147] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:41 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1509 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:43.113819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:43.114433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:43.135681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:43.136143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:43.137273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:43.138141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:43.325007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:43.378989 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a772911-5a9a-4978-8244-ecdbdd873e90 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1277 microversion: 2.1 time: 0.276160 Jul 25 16:27:43.384666 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2090/4148] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:43 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:43.691612 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:27:43.692085 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:27:44.013728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:44.014429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:44.052808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.053300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.075450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.079397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.087332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:44.088844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:44.126731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.126731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.139810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.140513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:45.043742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.068866 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e971824b-fde0-49c5-9138-87aab1e453a0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 200 len: 1512 microversion: 2.1 time: 0.988265 Jul 25 16:27:45.070391 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2091/4149] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:44 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 1512 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:45.088106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:45.090716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:45.124029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:45.124311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.126951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:45.146167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:45.147143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:45.150451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.156311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.180601 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c09bfc5b-7519-40ad-b491-80f6bb77bc4b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 1.172334 Jul 25 16:27:45.191092 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2059/4150] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:44 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:27:45.210170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:45.228009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:45.270631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:45.271370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:45.272457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:45.273968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:45.552199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.578603 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-320743f3-b714-4797-b505-ae762d930a6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1283 microversion: 2.1 time: 0.506053 Jul 25 16:27:45.593132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2092/4151] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:45 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1283 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:46.221776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:46.226864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:46.263797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.268984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.271453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.275689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.810722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:46.825079 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-435188ed-a2c4-4b52-a8a2-f85bcb38584d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.632242 Jul 25 16:27:46.837676 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2060/4152] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:45 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:46.876573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a1d6f399-ff53-4040-a42b-bdc3f8375cde req-2ea54163-be2b-4f38-9d66-8c42440d21a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3afea4-645e-4b47-8f31-45b8eb2d0207", "name": "network-vif-plugged", "status": "completed", "tag": "7a49b1c0-e7ca-4706-bd62-9344cf2d0efc"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:46.915884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a1d6f399-ff53-4040-a42b-bdc3f8375cde req-2ea54163-be2b-4f38-9d66-8c42440d21a6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.916342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a1d6f399-ff53-4040-a42b-bdc3f8375cde req-2ea54163-be2b-4f38-9d66-8c42440d21a6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.944173 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a1d6f399-ff53-4040-a42b-bdc3f8375cde req-2ea54163-be2b-4f38-9d66-8c42440d21a6 service nova] Creating event network-vif-plugged:7a49b1c0-e7ca-4706-bd62-9344cf2d0efc for instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 on n-h1-846219-13 Jul 25 16:27:46.960041 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a1d6f399-ff53-4040-a42b-bdc3f8375cde req-2ea54163-be2b-4f38-9d66-8c42440d21a6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120220 Jul 25 16:27:46.961563 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2061/4153] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:46.967418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:46.968177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:46.991507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.992068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.994124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.994611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:47.331824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:47.342603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:47.349790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:47.356630 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ebe6737-d84b-40fa-bad1-4014dd622ed3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 1.143681 Jul 25 16:27:47.359870 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2093/4154] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:46 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:27:47.377297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:47.378215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:47.400210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:47.401816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:47.403144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:47.404267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:47.432765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:47.442798 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80cb5e4a-774c-4d0b-86f9-0d05bf378007 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.479939 Jul 25 16:27:47.445839 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2062/4155] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:46 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:48.340202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:48.350618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0569b3c7-3106-40c8-b749-fffbbfc735de tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.989253 Jul 25 16:27:48.366553 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2094/4156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:47 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:48.384786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:48.385636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:48.407652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.408222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.409060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.409521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.410982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:48.411720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:48.439880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.440323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.453745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.456888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.392512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.417376 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a5cb4b6e-a199-4c23-8278-a788836e56c7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 2.023210 Jul 25 16:27:50.423209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2095/4157] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:48 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:50.447723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:50.448759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:50.479399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.479904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.480840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.481534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.866163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.877875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.888795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.890577 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4046d2da-d748-4ff3-9485-6530e32ebca3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 2.510489 Jul 25 16:27:50.892725 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2063/4158] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:48 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:27:50.910686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:50.919872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:50.944111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.945432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.946445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.950363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.251088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:51.292253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:51.300874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5387c23b-8ca3-4040-bf96-c403188fb297 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.874726 Jul 25 16:27:51.308740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2096/4159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:50 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:51.560385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:51.569527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-42b0c5ed-943a-46d1-9048-748af5854b8a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.673584 Jul 25 16:27:51.570830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2064/4160] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:50 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:51.601492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-857852dd-f87d-4dd8-8a29-d9bff299a39b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:51.626497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-857852dd-f87d-4dd8-8a29-d9bff299a39b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.627328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-857852dd-f87d-4dd8-8a29-d9bff299a39b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.675367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-857852dd-f87d-4dd8-8a29-d9bff299a39b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:27:51.725311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a97fda25-3c44-4433-b646-0f80e0dbbb5b req-da01ed12-15a6-42ed-a583-8f1960d12160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13af6d6-7394-4650-a121-e2dbbcf5e5a0", "tag": "db08aae4-0c20-4efd-9945-7f1274c7c777"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:51.738451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a97fda25-3c44-4433-b646-0f80e0dbbb5b req-da01ed12-15a6-42ed-a583-8f1960d12160 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.739336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a97fda25-3c44-4433-b646-0f80e0dbbb5b req-da01ed12-15a6-42ed-a583-8f1960d12160 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.794860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a97fda25-3c44-4433-b646-0f80e0dbbb5b req-da01ed12-15a6-42ed-a583-8f1960d12160 service nova] Creating event network-changed:db08aae4-0c20-4efd-9945-7f1274c7c777 for instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 on n-h1-846219-13 Jul 25 16:27:51.820999 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a97fda25-3c44-4433-b646-0f80e0dbbb5b req-da01ed12-15a6-42ed-a583-8f1960d12160 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097752 Jul 25 16:27:51.823698 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2065/4161] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:27:51.894227 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-857852dd-f87d-4dd8-8a29-d9bff299a39b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.301043 Jul 25 16:27:51.910133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2097/4162] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:27:51 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:27:51.920596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:51.922138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:51.932341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:51.936876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:51.940265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.941065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.942888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.949113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.955584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.958044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.960618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.962690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.070944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:52.462844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:52.495048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:52.500568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:52.504281 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38663016-8f49-4ed6-9377-e68e8716ffac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1743 microversion: 2.20 time: 0.579118 Jul 25 16:27:52.517508 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2098/4163] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:51 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1743 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:27:52.526321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:52.527040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:52.539672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:52.540562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.543218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:52.544688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.696183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:52.711730 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20bf97a6-c796-475f-ab4f-c21aa9eb37cb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.800422 Jul 25 16:27:52.713175 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2066/4164] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:51 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:53.137499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:53.174027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-068c0c9b-c7d4-46c6-8fbb-c318f6d066f0 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.654885 Jul 25 16:27:53.174662 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2099/4165] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:52 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:53.532349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:53.532970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:53.536349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:53.556457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.557018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.558605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.559431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.747039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:53.748842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:53.777925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.779247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.782205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.783485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.049840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.092788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.099151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.107140 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9b0ce83c-6d88-4a55-8bd5-6239cacc3b3b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1725 microversion: 2.20 time: 0.578272 Jul 25 16:27:54.122773 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2067/4166] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:53 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1725 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:54.213674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:54.221322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:54.251697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:54.253624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.257737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:54.259094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.352065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.381196 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb2e2ed5-5371-47b1-9bad-3ead1a5ae133 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.646611 Jul 25 16:27:54.384163 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2100/4167] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:53 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:54.899950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.916522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2386938a-888b-4065-8bd8-e08fefbdab65 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.720572 Jul 25 16:27:54.930574 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2068/4168] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:54 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:55.152749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:55.153723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:55.169716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.170422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.173415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.174387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.437504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:55.440281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:55.461283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.462654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.464927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.468924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.966461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:55.988028 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5814a506-8da4-4aed-8f17-232b6118460c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.565603 Jul 25 16:27:55.990766 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2069/4169] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:55 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:56.002499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2662d536-0f63-4920-a7e9-712892d88fad req-36a7883e-687c-44d6-8b0e-b9095afc2483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "name": "network-vif-unplugged", "status": "completed", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:56.038606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2662d536-0f63-4920-a7e9-712892d88fad req-36a7883e-687c-44d6-8b0e-b9095afc2483 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.046333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2662d536-0f63-4920-a7e9-712892d88fad req-36a7883e-687c-44d6-8b0e-b9095afc2483 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.056761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.076548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.078149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.079404 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b166735e-c123-44ff-986a-8389bbee267f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1725 microversion: 2.20 time: 0.932597 Jul 25 16:27:56.079982 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2101/4170] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:55 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1725 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:56.085295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:56.089153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:56.098786 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2662d536-0f63-4920-a7e9-712892d88fad req-36a7883e-687c-44d6-8b0e-b9095afc2483 service nova] Creating event network-vif-unplugged:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:27:56.105984 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2662d536-0f63-4920-a7e9-712892d88fad req-36a7883e-687c-44d6-8b0e-b9095afc2483 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113551 Jul 25 16:27:56.107345 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2070/4171] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:56.111729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.112494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.113692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.114311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.419286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.432611 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6dc22a02-619b-4b32-883b-3f978b79daa1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.351076 Jul 25 16:27:56.449140 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2102/4172] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:56 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:57.014318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:57.015034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.044482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.046305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.049385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.050440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.109295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:57.110658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.132408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.132928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.140363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.141624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.907626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.914767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:57.925718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.929417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.931947 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5b779030-83ec-428a-b837-6561cfe4a080 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1668 microversion: 2.20 time: 0.831982 Jul 25 16:27:57.933249 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2103/4173] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:57 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1668 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:27:57.949578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.959997 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82e3d6f7-27b6-420a-a8d4-eafc0ec3a5f3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.953552 Jul 25 16:27:57.961501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:57.963569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.972556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2071/4174] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:57 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:57.985804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf42e97-01f7-4a50-a95a-787a019025cb"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:57.987275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.988435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.989808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.990380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.995811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.997963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.998689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.999902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.000575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.336601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:58.465939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:58.491740 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-776ec4b0-0ae8-4c61-a91d-9adb641237d4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.543213 Jul 25 16:27:58.495358 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2104/4175] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:57 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:58.517666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4cac6018-95e6-41ed-ac1d-3267b211b09b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: .version_select at 0x7f9d927fc1f0>, body: {"keypair": {"name": "tempest-keypair-87813857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0RnA/m8ftzC7b1QW4wW9zWGsDncE7RzvHzPK+9SWfNTKhdgAyZK7f0yaqueF7rH41HAyWIscAqCa3Z/6XwfTlgbGos5vFuuB3OBcd8bK1/kwUjrzxM+gFVVpI1lGAuCA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:58.527938 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bbe65738-74b2-48d2-a9c2-777c6c2716f2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.553665 Jul 25 16:27:58.534657 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2072/4176] 10.222.0.105 () {62 vars in 1369 bytes} [Mon Jul 25 16:27:57 2022] POST /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 188 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:27:58.573708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4cac6018-95e6-41ed-ac1d-3267b211b09b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:58.588201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-13141aed-fbe4-46e7-828c-034bb68fa0ab tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] Calling method '.version_select at 0x7f9d93fba0d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:58.617257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4cac6018-95e6-41ed-ac1d-3267b211b09b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:58.659652 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-13141aed-fbe4-46e7-828c-034bb68fa0ab tempest-TestSecurityGroupsBasicOps-302449533 tempest-TestSecurityGroupsBasicOps-302449533-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-912625498" status: 202 len: 0 microversion: 2.1 time: 0.075181 Jul 25 16:27:58.662086 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2073/4177] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-912625498 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:27:58.714498 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4cac6018-95e6-41ed-ac1d-3267b211b09b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.207238 Jul 25 16:27:58.724556 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2105/4178] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:27:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:58.865000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:58.868102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:58.879727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.880764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.885414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.886272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.993946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:58.995567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:59.009746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.010480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.012682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.016444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.186595 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ad47398e-ff39-4906-b75f-d6db8bb5698a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/action" status: 202 len: 0 microversion: 2.20 time: 0.329487 Jul 25 16:27:59.195340 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2074/4179] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:27:58 2022] POST /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:27:59.203190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:59.204072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:59.212787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.213528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.214471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.215860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.861640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.881435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a7311ec-0031-4991-9287-86945e27fcbc tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.885697 Jul 25 16:27:59.881435 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2106/4180] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:58 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:59.886717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:59.892209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:59.905491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.906299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.907342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.909280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.956103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.970579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.973038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.983265 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65207d48-1c6d-461a-9de7-0b2ce639b22d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1754 microversion: 2.20 time: 0.779994 Jul 25 16:27:59.984163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2075/4181] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:27:59 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1754 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:00.489767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-94835428-b04d-475c-915e-c617a32347fe req-0bec420a-ec4a-4cdf-a8c5-1cde76499b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13af6d6-7394-4650-a121-e2dbbcf5e5a0", "name": "network-vif-plugged", "status": "completed", "tag": "db08aae4-0c20-4efd-9945-7f1274c7c777"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:00.538857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-94835428-b04d-475c-915e-c617a32347fe req-0bec420a-ec4a-4cdf-a8c5-1cde76499b12 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.539568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-94835428-b04d-475c-915e-c617a32347fe req-0bec420a-ec4a-4cdf-a8c5-1cde76499b12 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.616290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-94835428-b04d-475c-915e-c617a32347fe req-0bec420a-ec4a-4cdf-a8c5-1cde76499b12 service nova] Creating event network-vif-plugged:db08aae4-0c20-4efd-9945-7f1274c7c777 for instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 on n-h1-846219-13 Jul 25 16:28:00.636115 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-94835428-b04d-475c-915e-c617a32347fe req-0bec420a-ec4a-4cdf-a8c5-1cde76499b12 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152731 Jul 25 16:28:00.648402 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2076/4182] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:00.892453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:00.903709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:00.904975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:00.925755 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dcc38d78-a559-4854-8d71-271052b426ff tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 1.042551 Jul 25 16:28:00.928572 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2107/4183] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:27:59 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:00.932333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.934534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.937789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.939935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.018205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:01.025060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:01.055315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.060092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.061827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.064741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.374576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.391895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80bb7944-6aaf-4c4a-a2fd-003bd48be6b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 0.495528 Jul 25 16:28:01.394346 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2077/4184] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:00 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:01.463827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.481275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.483256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.484652 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b7e1342-414c-499a-b9a7-9b2fb5ff3e08 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1754 microversion: 2.20 time: 0.475018 Jul 25 16:28:01.504988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2108/4185] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:01 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1754 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:01.954683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:01.955566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:01.959024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:01.979108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.980138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.984787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.987813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.749425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:02.750447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-072c4f73-ac01-4371-b830-1c0c08167e4d tempest-ExtensionsTest-599787165 tempest-ExtensionsTest-599787165-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:02.761334 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-072c4f73-ac01-4371-b830-1c0c08167e4d tempest-ExtensionsTest-599787165 tempest-ExtensionsTest-599787165-project] 10.222.0.105 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.856786 Jul 25 16:28:02.763097 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2078/4186] 10.222.0.105 () {58 vars in 1175 bytes} [Mon Jul 25 16:28:01 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:02.780506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-11b26eb2-acfa-4aa1-b74b-718e8033ea63 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1325 microversion: 2.1 time: 0.827760 Jul 25 16:28:02.785030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2109/4187] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:01 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1325 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:02.811367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:02.815134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:02.820242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:02.820994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:02.840050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.841056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.842876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.843328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.873648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.880266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.889703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.892519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.254012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.260175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.273756 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9273bd09-e51a-4bfe-a99c-3ab13f87d8f7 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1683 microversion: 2.1 time: 1.501468 Jul 25 16:28:04.284528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.291169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.294790 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57e71e94-c89a-4a65-847f-165401f23270 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1756 microversion: 2.20 time: 1.507561 Jul 25 16:28:04.296303 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2110/4188] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:02 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1756 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:04.297502 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2079/4189] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:02 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1683 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:04.303058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:04.305233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94ed75ca-cbc8-447f-985e-c6915a25e2a3 tempest-ExtensionsTest-599787165 tempest-ExtensionsTest-599787165-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:04.309973 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94ed75ca-cbc8-447f-985e-c6915a25e2a3 tempest-ExtensionsTest-599787165 tempest-ExtensionsTest-599787165-project] 10.222.0.105 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012067 Jul 25 16:28:04.310292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:04.311202 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2111/4190] 10.222.0.105 () {58 vars in 1139 bytes} [Mon Jul 25 16:28:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:28:04.318141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.318843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.319842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.320422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.141002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:05.155428 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eec2ddc1-7d34-47ab-bc55-3c45279edf6e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1516 microversion: 2.1 time: 0.856721 Jul 25 16:28:05.156141 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2080/4191] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:04 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1516 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:05.187776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:05.188500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:05.202840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.205693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.206652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.208121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.315427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:05.316207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:05.328721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.330270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.331182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.331694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.059191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:06.122380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53797c09-34a3-47f7-9e1d-2d2404a0628a tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1515 microversion: 2.1 time: 0.945399 Jul 25 16:28:06.128614 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2112/4192] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:05 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1515 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:06.137270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:06.137270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:06.191111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.191998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.193316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.194060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.353343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:06.375822 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-675ae273-f841-4c43-b20f-71c4bff11712 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1660 microversion: 2.1 time: 1.081477 Jul 25 16:28:06.376890 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2081/4193] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:05 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1660 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:06.408525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-86032623", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e812fb40-fcc6-40c5-a453-70ce5887f1c5"}], "security_groups": [{"name": "tempest-securitygroup--937647981"}], "key_name": "tempest-keypair-87813857", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:06.894117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] validate_networks() for [('e812fb40-fcc6-40c5-a453-70ce5887f1c5', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:28:07.093633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:07.121869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:07.129315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:07.137199 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-245f458a-4f79-445e-bb12-3e27aa77bcf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1756 microversion: 2.20 time: 1.006941 Jul 25 16:28:07.138831 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2113/4194] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:06 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1756 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:07.145181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:07.146248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:07.155899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.156811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:07.157878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.159825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:07.777377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:07.792666 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bacbe2bd-3a4c-4c72-8f5e-b2724fcb492e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 200 len: 1516 microversion: 2.1 time: 0.652363 Jul 25 16:28:07.793302 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2114/4195] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:07 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 1516 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:07.813785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a998e3a-3a9b-4217-9ad3-b5370bf78c63 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:07.852617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a998e3a-3a9b-4217-9ad3-b5370bf78c63 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.856109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a998e3a-3a9b-4217-9ad3-b5370bf78c63 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:07.945208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a998e3a-3a9b-4217-9ad3-b5370bf78c63 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Going to try to start instance {{(pid=119599) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:28:08.046343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a998e3a-3a9b-4217-9ad3-b5370bf78c63 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.240525 Jul 25 16:28:08.065836 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2115/4196] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:28:07 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:08.099310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:08.125867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:08.132574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:08.204336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.209825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.211924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.229205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.456791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:08.548942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:28:08.549518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:28:08.550033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:28:08.550648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:28:08.551124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:28:08.580604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.581232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.582232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.587615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.659647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:08.666936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:08.675332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:08.690505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.691260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.719438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:28:08.722482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:28:08.870918 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f08a57a9-1e9d-4db6-a70b-e6b20bf598b6 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.480689 Jul 25 16:28:08.871612 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2082/4197] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:28:06 2022] POST /compute/v2.1/servers => generated 403 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:28:08.894592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:08.895395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:08.916672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.916897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.929226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.932533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:09.652555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ad837f68-4a46-49e3-b859-d6ebe5a86537 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1519 microversion: 2.1 time: 1.580389 Jul 25 16:28:09.665126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2116/4198] 10.222.0.105 () {58 vars in 1172 bytes} [Mon Jul 25 16:28:08 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1519 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:09.665126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:09.665126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:09.694364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:09.694851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:09.695685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:09.696112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.090792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.129363 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc135869-f4e9-46af-b88d-0ac47b58e442 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 1.242853 Jul 25 16:28:10.130323 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2083/4199] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:08 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:10.146581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:10.149643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:10.185812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.190612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.192006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.193695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.516388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.532049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.554685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.558559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7e63bf8a-76ee-49d1-871e-64430db0d28e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1756 microversion: 2.20 time: 0.901666 Jul 25 16:28:10.578831 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2117/4200] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:09 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1756 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:10.589044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.598733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:10.603911 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ee255a4-e5ed-4ce6-a175-01fd7107114f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1246 microversion: 2.1 time: 0.472446 Jul 25 16:28:10.613421 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2084/4201] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:10 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1246 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:10.619470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.622013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-887242965', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:10.647996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.648875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.650080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.650809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.895056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:11.109854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:11.118098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.118948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.163264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:11.172090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:11.232599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.235734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.242684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.251032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.628586 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-262626f8-9078-4a51-ab7a-896b12fb323e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-887242965" status: 200 len: 1518 microversion: 2.1 time: 2.047760 Jul 25 16:28:12.630944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2118/4202] 10.222.0.105 () {58 vars in 1266 bytes} [Mon Jul 25 16:28:10 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-887242965 => generated 1518 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:12.639168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:12.640675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:12.662631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.664319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.666836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.686781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:13.593348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.641218 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7417262b-75ea-4f6f-8b0f-6bb005dea603 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1669 microversion: 2.1 time: 2.486262 Jul 25 16:28:13.648513 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2085/4203] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:11 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1669 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:13.676066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:13.681528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:13.709018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:13.713398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:13.714405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:13.714864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:13.902838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.906681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.914453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.922196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.923895 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e35ba44-e29a-422e-95b0-0b98859acc7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1756 microversion: 2.20 time: 1.291359 Jul 25 16:28:13.928314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4525491-355f-4806-8a90-88ea4daab541 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1300 microversion: 2.1 time: 0.273568 Jul 25 16:28:13.941859 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2119/4204] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:12 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1756 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:13.946385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:13.949556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2086/4205] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:13 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:13.952458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.958412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:13.958886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-127e4ac4-cba8-4718-ad89-05d22680d07f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'create', calling method: .version_select at 0x7f9d93d21ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1930356707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJL7dGerlaj59acf5qdCEvloSMRvOgHfRCcfTo2Y3ya+A6guiPcfB70otanBEXcXj+oWmU/K9BsSHYLjcM4+u6CzZlrCCNuMQeJ5IGT0GqMT4DBSeuedse4qQz20jHLEA=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:13.973978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:13.975019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:13.976118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:13.976843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:14.038761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-127e4ac4-cba8-4718-ad89-05d22680d07f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:14.059055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-127e4ac4-cba8-4718-ad89-05d22680d07f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for user 0333f8e4e1e54bcda08bce44f79fbc9c and project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:14.132641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:14.169660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:14.175679 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-127e4ac4-cba8-4718-ad89-05d22680d07f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.218346 Jul 25 16:28:14.192920 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2087/4206] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:28:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:14.212880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-591b9608-5a3c-4a1d-8046-11a90eaac23d tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d93a76160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:14.329000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:14.340364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:14.341110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:14.366733 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-591b9608-5a3c-4a1d-8046-11a90eaac23d tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/20dc5997-9463-43fc-9cfd-1e0d2eea0bdc" status: 200 len: 351 microversion: 2.1 time: 0.172053 Jul 25 16:28:14.368312 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2088/4207] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:28:14 2022] GET /compute/v2.1/os-volumes/20dc5997-9463-43fc-9cfd-1e0d2eea0bdc => generated 351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:14.690944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:14.691907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:14.700898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:14.701394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:14.702341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:14.703264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.894352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:15.910466 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-606e0a91-258c-4de1-ae29-34872bcbb0d5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.223560 Jul 25 16:28:15.911933 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2089/4208] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:14 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:15.923768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:15.924505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:15.934691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:15.935303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.936227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:15.943933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.998452 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-969aa061-71fc-4216-91f1-c599edd4f1ae tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4530 microversion: 2.1 time: 2.066650 Jul 25 16:28:16.013147 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2120/4209] 10.222.0.105 () {58 vars in 1178 bytes} [Mon Jul 25 16:28:13 2022] GET /compute/v2.1/servers/detail?status=active => generated 4530 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:16.013147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:16.013147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:16.038187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.039190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.040583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.041859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.918769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:16.932216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0843faf2-49e3-43af-a099-fc5abc61d629 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 1.015103 Jul 25 16:28:16.933571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2090/4210] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:15 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:16.949580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:16.950221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:16.963273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.963773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.964786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.965254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:17.237783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:17.247608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:17.249254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:17.254940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fb61f99-466c-4968-b5a6-699c26721e66 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.254350 Jul 25 16:28:17.260029 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2121/4211] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:15 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:17.274058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:17.295454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:17.296495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.servers [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Removing options 'limit' from query {{(pid=119599) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 16:28:17.300411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:17.315870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.319903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:17.320984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.323963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:17.403950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:17.422797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.426195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.210126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:18.213325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:18.235728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-492f6484-bf35-4f04-b889-bae31a67d21e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.299870 Jul 25 16:28:18.236372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2091/4212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:16 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:18.266029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92e1a091-fa7e-4d97-96f5-ea26592a7cd1 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9da00444c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:18.437422 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92e1a091-fa7e-4d97-96f5-ea26592a7cd1 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/09d74423-e1f3-4c5b-b15b-09001a9f5139" status: 200 len: 350 microversion: 2.1 time: 0.199487 Jul 25 16:28:18.438385 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2092/4213] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:28:18 2022] GET /compute/v2.1/os-volumes/09d74423-e1f3-4c5b-b15b-09001a9f5139 => generated 350 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:18.444047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:18.444747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:18.467088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.467817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.473722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.474876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.641356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:18.783726 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-102dfcef-7c36-4944-a1f8-a49bd89bd076 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1666 microversion: 2.1 time: 1.516744 Jul 25 16:28:18.807960 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2122/4214] 10.222.0.105 () {58 vars in 1166 bytes} [Mon Jul 25 16:28:17 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1666 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:18.814102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:18.814741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:18.838757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.839684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.844655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.846309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.162494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:20.214163 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e82fcf7f-ac69-4ef7-b2eb-dcd42b7b78db tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 1.761562 Jul 25 16:28:20.225815 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2093/4215] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:18 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:20.279716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:20.283085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:20.317893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:20.320975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.323138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:20.337699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.953982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:20.963792 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6b3c59d-29ae-4e83-91bf-423e2b247731 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 2.154396 Jul 25 16:28:20.965279 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2123/4216] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:18 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:20.982817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:20.988771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:20.990400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:20.997030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:20.997990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.999066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:20.999695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:21.036822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:21.075413 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f832099-df2d-4255-a81f-a364231d450e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?status=active" status: 200 len: 1017 microversion: 2.1 time: 0.108474 Jul 25 16:28:21.076970 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2124/4217] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:28:20 2022] GET /compute/v2.1/servers?status=active => generated 1017 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:21.086465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-772393929", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "21ec2ff7-fdb7-4217-b929-c5006bce316f"}], "key_name": "tempest-TestNetworkBasicOps-1930356707", "security_groups": [{"name": "tempest-secgroup-smoke-1076764224"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:21.584144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:21.598127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] validate_networks() for [('21ec2ff7-fdb7-4217-b929-c5006bce316f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:28:21.624224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:21.627650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:21.637880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c60143bc-fe24-4686-89b3-c9b4d820dd0e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.396904 Jul 25 16:28:21.643771 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2094/4218] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:20 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:21.678958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:21.680345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:21.712649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:21.713598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:21.717148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:21.720249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:22.686775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:22.711867 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f27ccc11-9f88-4ad7-8710-d7d3de2e7490 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 1.064141 Jul 25 16:28:22.714752 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2095/4219] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:21 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:22.737162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:22.761592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:22.762420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.servers [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Removing options 'limit' from query {{(pid=119598) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 16:28:22.764702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:22.783643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:22.785612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:22.789792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:22.791454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:22.885612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:23.078899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34363471-13e2-49fd-9f10-7562f8eececa tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1017 microversion: 2.1 time: 0.360051 Jul 25 16:28:23.094678 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2096/4220] 10.222.0.105 () {58 vars in 1155 bytes} [Mon Jul 25 16:28:22 2022] GET /compute/v2.1/servers?limit=100000 => generated 1017 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:23.118017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52cea167-5f2b-42c1-aff4-0c9071479174 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9da01614c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:23.359774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52cea167-5f2b-42c1-aff4-0c9071479174 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/7a2f1ebc-7528-4b26-b69b-42e009693619" status: 200 len: 351 microversion: 2.1 time: 0.263358 Jul 25 16:28:23.361041 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2097/4221] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:28:23 2022] GET /compute/v2.1/os-volumes/7a2f1ebc-7528-4b26-b69b-42e009693619 => generated 351 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:23.366768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:23.367733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:23.377209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:23.377871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:23.378828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:23.379440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:23.559004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:28:23.559535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:28:23.561073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:28:23.561897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:28:23.563780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:28:23.602636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=13 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:23.612803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:23.614520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:23.616199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:23.620697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:23.718124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:23.753079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for user 0333f8e4e1e54bcda08bce44f79fbc9c and project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:23.816606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:28:23.830433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:28:24.029767 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b2f55d7-62e9-470b-81f8-4698c80d7608 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.949708 Jul 25 16:28:24.031769 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2125/4222] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:28:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:28:24.038075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:24.039371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:24.059805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.061513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.064945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.066112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.095683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:24.169881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:24.243601 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-111c6809-f5c3-471e-92ff-baefff5497f1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 0.881183 Jul 25 16:28:24.246796 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2098/4223] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:23 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:24.274823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:24.275923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:24.290236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:24.300627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.304295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.306379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.307362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.853185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:24.878771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:24.889751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:24.895901 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e208f409-acaf-41d5-809e-b792020ef966 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 0.862711 Jul 25 16:28:24.902436 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2126/4224] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:24 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:24.916585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:24.946451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:24.959200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:24.981707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.982218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.989625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.995128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:25.091414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:25.110077 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-06cb1d02-ca65-40a4-8b8b-12aacf3f621b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.860744 Jul 25 16:28:25.136903 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2099/4225] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:24 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:25.150786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fbbaa32e-fcc9-4e71-8dda-4b148bc83269 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9da4aaac10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:25.194838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:25.479960 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff726d89-fcea-4414-b7c3-b00c4adefde5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 1017 microversion: 2.1 time: 0.560463 Jul 25 16:28:25.495422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2127/4226] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:28:24 2022] GET /compute/v2.1/servers => generated 1017 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:25.863723 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fbbaa32e-fcc9-4e71-8dda-4b148bc83269 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.724692 Jul 25 16:28:25.878156 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2100/4227] 10.222.0.105 () {58 vars in 1139 bytes} [Mon Jul 25 16:28:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:25.894566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6303b145-5015-4bcf-ae92-be9d5e2f1eb4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:25.901750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6303b145-5015-4bcf-ae92-be9d5e2f1eb4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:26.104362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c553b929-f192-4c3b-bdc7-3cb839b0dcb7 req-60e9d2a4-f2af-4f4d-bb5e-e87ce954ebc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b4d249-05a5-4cf2-87e1-bd2446fab3ec", "tag": "f56e7b5f-d955-461d-a900-09a0116a77f2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:26.137910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c553b929-f192-4c3b-bdc7-3cb839b0dcb7 req-60e9d2a4-f2af-4f4d-bb5e-e87ce954ebc6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.138754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c553b929-f192-4c3b-bdc7-3cb839b0dcb7 req-60e9d2a4-f2af-4f4d-bb5e-e87ce954ebc6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.144681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6303b145-5015-4bcf-ae92-be9d5e2f1eb4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:26.154772 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6303b145-5015-4bcf-ae92-be9d5e2f1eb4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1252 microversion: 2.1 time: 0.274940 Jul 25 16:28:26.159215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2101/4228] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:25 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1252 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:26.171444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:26.177405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:26.188782 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c553b929-f192-4c3b-bdc7-3cb839b0dcb7 req-60e9d2a4-f2af-4f4d-bb5e-e87ce954ebc6 service nova] Creating event network-changed:f56e7b5f-d955-461d-a900-09a0116a77f2 for instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec on n-h2-846219-13 Jul 25 16:28:26.218654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c553b929-f192-4c3b-bdc7-3cb839b0dcb7 req-60e9d2a4-f2af-4f4d-bb5e-e87ce954ebc6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.712171 Jul 25 16:28:26.224047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2128/4229] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:26.247241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.250770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:26.251564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:26.258656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.269777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.270598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.283346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.283811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.284607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.285044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.490497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lazy-loading 'flavor' on Instance uuid dd0bdba4-a87a-432c-ae9d-63290c249010 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:28:26.832327 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac2d2d9f-a399-443e-93dc-93ab8dd94d53 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.670515 Jul 25 16:28:26.889643 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2102/4230] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:28:26 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:26.921379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:26.948174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:26.949726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:27.005765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:27.010569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:27.011696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:27.012162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:27.078114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:27.093040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc833448-db72-4d9f-8ab7-1205d53bbc4e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 0.866731 Jul 25 16:28:27.093723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2129/4231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:26 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:27.109148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2e5ba45-175a-4e34-a304-bf7d6bb0ef17 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d93aedc10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:27.266272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:27.392341 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2e5ba45-175a-4e34-a304-bf7d6bb0ef17 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.289871 Jul 25 16:28:27.393620 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2130/4232] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:28:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:27.428181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:27.431866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:27.491370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:27.494795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:27.497032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:27.499284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:27.560941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24f724e7-9ccd-493a-99e0-6ac9bb9c4adc tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 348 microversion: 2.1 time: 0.652291 Jul 25 16:28:27.563626 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2103/4233] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:28:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 348 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:27.588457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:27.591915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:27.612910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:27.614564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:27.617144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:27.617907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:28.428120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:28.492654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:28.507915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:28.513999 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b8ff5cf-814b-472a-b4e7-1753d8fd3001 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.118759 Jul 25 16:28:28.533764 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2131/4234] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:27 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:28.562446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:28.564833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:28.614061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:28.617866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:28.623048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:28.626698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:28.741823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:28.777442 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c960493-a654-4720-bffe-fe3192eb8e98 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1681 microversion: 2.1 time: 1.205860 Jul 25 16:28:28.780971 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2104/4235] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:27 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1681 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:28.829169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f29be63d-e50d-4f8a-aabd-d99125051067 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d93a571f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:29.290937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:29.340875 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f29be63d-e50d-4f8a-aabd-d99125051067 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.548898 Jul 25 16:28:29.342005 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2105/4236] 10.222.0.105 () {58 vars in 1139 bytes} [Mon Jul 25 16:28:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:29.360016 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-608a750e-9d5c-422d-9a06-03bcafbd6383 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1310 microversion: 2.1 time: 0.821377 Jul 25 16:28:29.361043 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2132/4237] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:28 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1310 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:29.382179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:29.425547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:29.430780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:29.436527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:29.444303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.servers [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Removing options 'limit' from query {{(pid=119598) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 16:28:29.445814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:29.477674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:29.478174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:29.479007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:29.480272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:29.486534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:29.488611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:29.498795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:29.502577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:29.692425 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-957e558b-66ab-4e80-a368-c0b347ac18d7 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?limit=1" status: 200 len: 488 microversion: 2.1 time: 0.333172 Jul 25 16:28:29.710069 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2106/4238] 10.222.0.105 () {58 vars in 1145 bytes} [Mon Jul 25 16:28:29 2022] GET /compute/v2.1/servers?limit=1 => generated 488 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:29.726887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-624a6681-6b79-4390-ac8e-8edc8cceccf5 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d93903ca0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:29.964164 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-624a6681-6b79-4390-ac8e-8edc8cceccf5 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.250454 Jul 25 16:28:29.964991 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2107/4239] 10.222.0.105 () {58 vars in 1172 bytes} [Mon Jul 25 16:28:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:30.004473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:30.009510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:30.046715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:30.051950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:30.055274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:30.056984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:31.279057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:31.307004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:31.314334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:31.319892 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7afe1243-fc0e-4636-9e6c-2e1b66ece463 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.340020 Jul 25 16:28:31.326956 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2108/4240] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:29 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:31.338398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:31.373195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:31.374575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-887242965', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:31.408231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:31.409540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:31.410961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:31.413843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:31.930419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:31.981166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:32.070382 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-21cfa894-1016-42e8-80a5-68ff458c61e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 2.707236 Jul 25 16:28:32.075304 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2133/4241] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:29 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 2714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:32.139915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:32.145847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:32.171774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:32.201816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:32.206358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:32.208280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:32.209191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:32.218429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f890a6a-4736-4012-881d-a80864d00831 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-887242965" status: 200 len: 347 microversion: 2.1 time: 0.889297 Jul 25 16:28:32.220614 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2109/4242] 10.222.0.105 () {58 vars in 1245 bytes} [Mon Jul 25 16:28:31 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-887242965 => generated 347 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:32.233379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2e96f07-a108-47a1-8f36-b93be969ecf8 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d9399b280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:32.591748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f2e96f07-a108-47a1-8f36-b93be969ecf8 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.367162 Jul 25 16:28:32.593280 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2110/4243] 10.222.0.105 () {58 vars in 1175 bytes} [Mon Jul 25 16:28:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:32.632864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:32.637324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:32.691997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:32.692807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:32.699045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:32.703190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:32.961671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:33.004355 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2a2188e-fe80-4311-b75c-6f0b60b0f93f tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1664 microversion: 2.1 time: 0.920694 Jul 25 16:28:33.009534 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2134/4244] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:32 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1664 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:33.053256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:33.082717 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9a8d12f-0fdf-4404-9078-7f96c6a6a54e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1310 microversion: 2.1 time: 0.475204 Jul 25 16:28:33.088215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2111/4245] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:32 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1310 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:33.100096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f72f89b9-ddc6-4831-8fae-e93a608e090b tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:33.116295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f72f89b9-ddc6-4831-8fae-e93a608e090b tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.118084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f72f89b9-ddc6-4831-8fae-e93a608e090b tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.194662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f72f89b9-ddc6-4831-8fae-e93a608e090b tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Going to try to stop instance {{(pid=119598) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:28:33.274862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:33.337759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f72f89b9-ddc6-4831-8fae-e93a608e090b tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "POST /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a/action" status: 202 len: 0 microversion: 2.1 time: 0.246045 Jul 25 16:28:33.357788 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2112/4246] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:28:33 2022] POST /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:33.402662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:33.405024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:33.421128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.422350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.425551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.427033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.430592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-565b7276-d868-4337-8a64-e46a1abba967 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Action: 'create', calling method: .version_select at 0x7f9d92eb3ca0>, body: {"keypair": {"name": "tempest-keypair-203217089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0SAs8nGqQys5MMNl6AiOIJUDR64+YSiyOxB5Qnx6CyrIpWDpWIyryPKnf7miIzLUPmnUWSBBdslyV80mEhYDKrgRjjQPAdlCaw+hURPbEURuqz0825ymSDxcnLOduFPw=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:33.468062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-565b7276-d868-4337-8a64-e46a1abba967 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Getting quotas for project f27380e2a0f8453291be96f8f4172508. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:33.498343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-565b7276-d868-4337-8a64-e46a1abba967 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Getting quotas for user 382d0aa047e24da7b76ccfaf2a0fbcae and project f27380e2a0f8453291be96f8f4172508. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:33.544146 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-565b7276-d868-4337-8a64-e46a1abba967 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.532185 Jul 25 16:28:33.555518 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2135/4247] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:28:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:33.574642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b3e7df95-061c-4b1b-a0f0-96b6fbeac7ad tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d92f99040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:33.795320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:33.811064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:33.815528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:33.821555 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9408fd9-39a3-47c1-9da3-ec4bf38d3529 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 0.457731 Jul 25 16:28:33.822744 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2113/4248] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:33 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:33.848078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:33.848914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:33.867962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.869413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.870320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.870763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.971523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b3e7df95-061c-4b1b-a0f0-96b6fbeac7ad tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.423960 Jul 25 16:28:33.972224 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2136/4249] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:28:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:33.987852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:33.993527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:34.017446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.024319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:34.026315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.026975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:34.162469 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ab33da6-39ac-4274-bbc4-f5bdfe60ad8d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action" status: 202 len: 0 microversion: 2.1 time: 0.332758 Jul 25 16:28:34.169588 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2114/4250] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:28:33 2022] POST /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:34.188367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:34.189240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:34.214923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.216406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:34.217525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.217766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:34.550948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:34.612138 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0b3f622-98ca-44c7-b8ab-fbc14328e905 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 0.625996 Jul 25 16:28:34.613221 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2137/4251] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:33 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:34.655908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e973fe14-68ae-4107-bc4c-648bd292ef48 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9da4a2d0d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:34.873287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:34.889867 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81f632f6-3c28-4c90-bcb0-286d87af8b84 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1525 microversion: 2.1 time: 0.711790 Jul 25 16:28:34.911932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2115/4252] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:34 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1525 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:34.911932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:34.911932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:34.911932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.911932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:34.911932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.912814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:35.046942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:35.196691 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e973fe14-68ae-4107-bc4c-648bd292ef48 tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.581659 Jul 25 16:28:35.197672 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2138/4253] 10.222.0.105 () {58 vars in 1193 bytes} [Mon Jul 25 16:28:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:35.219105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:35.219674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:35.247998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:35.248821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:35.260699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:35.262058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:36.152035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:36.440276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:36.472833 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a655878-903c-466b-ab33-dbe0edeb4c41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 1.578273 Jul 25 16:28:36.483729 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2116/4254] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:34 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:36.506431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:36.507546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:36.519278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:36.520190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:36.521952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:36.522744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:36.986758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:37.030429 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9474b2ed-b100-4faf-9527-4cfceccbfdfb tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1670 microversion: 2.1 time: 1.821290 Jul 25 16:28:37.032254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2139/4255] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:35 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1670 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:37.054697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9bd5ee2f-a854-4eaa-b3c1-dea4816fd63a tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] Calling method '.version_select at 0x7f9d938e3d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:37.478402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:37.481644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9bd5ee2f-a854-4eaa-b3c1-dea4816fd63a tempest-VolumesTestJSON-278332678 tempest-VolumesTestJSON-278332678-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.444576 Jul 25 16:28:37.510812 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2140/4256] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:28:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:37.523163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:37.544374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:37.545297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:37.546518 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-36852cda-632a-4e62-a146-16adfe1ec6c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.060984 Jul 25 16:28:37.547396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:37.567414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:37.568808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:37.572357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:37.573616 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2117/4257] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:36 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:37.574315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:37.618192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:37.619538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:37.654924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:37.655675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:37.657087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:37.687846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:39.668957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:39.690809 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3bdc960f-d7e7-45b1-bbb1-12f13fa76e71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 2.176936 Jul 25 16:28:39.692322 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2141/4258] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:37 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:39.706829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:39.710458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:39.731320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:39.732649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:39.736946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:39.738440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:39.750136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:39.994656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:40.008566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f38487e-30a6-456e-a95f-9b23ec7e3271 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1525 microversion: 2.1 time: 2.433332 Jul 25 16:28:40.009225 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2118/4259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:37 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1525 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:40.033585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:40.034365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:40.060030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:40.065957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:40.067156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:40.070567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:41.678671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:41.850391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:41.882718 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6524b1c7-0d0a-4628-827f-079ca4fc6312 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1670 microversion: 2.1 time: 1.871851 Jul 25 16:28:41.898289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2119/4260] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:40 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1670 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:41.908117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:41.921958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:41.936060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:41.950429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:41.952821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:41.955324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:41.980947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:42.028954 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91aa7523-be69-4bba-8c96-77982d331029 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 2.334291 Jul 25 16:28:42.049424 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2142/4261] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:39 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:42.093080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-bd83c0ae-8a09-40d6-b620-50fdcce9d338 req-4b83ff48-a696-49dd-b9ce-7ce975191885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b289405c-2b33-4e47-b3f9-ed6883c30d5e", "tag": "612834dd-cb88-46cd-9773-769962d64ff4"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:42.182717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bd83c0ae-8a09-40d6-b620-50fdcce9d338 req-4b83ff48-a696-49dd-b9ce-7ce975191885 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:42.184721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bd83c0ae-8a09-40d6-b620-50fdcce9d338 req-4b83ff48-a696-49dd-b9ce-7ce975191885 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:42.251993 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-bd83c0ae-8a09-40d6-b620-50fdcce9d338 req-4b83ff48-a696-49dd-b9ce-7ce975191885 service nova] Creating event network-changed:612834dd-cb88-46cd-9773-769962d64ff4 for instance b289405c-2b33-4e47-b3f9-ed6883c30d5e on n-h1-846219-13 Jul 25 16:28:42.283678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-bd83c0ae-8a09-40d6-b620-50fdcce9d338 req-4b83ff48-a696-49dd-b9ce-7ce975191885 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216275 Jul 25 16:28:42.284827 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2143/4262] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:42.323516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-baccef2d-fcbc-44f4-b08b-fae66b0ad333 req-0e66a492-b6d1-48a5-9f7e-cf2f04397532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b4d249-05a5-4cf2-87e1-bd2446fab3ec", "name": "network-vif-plugged", "status": "completed", "tag": "f56e7b5f-d955-461d-a900-09a0116a77f2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:42.386295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-baccef2d-fcbc-44f4-b08b-fae66b0ad333 req-0e66a492-b6d1-48a5-9f7e-cf2f04397532 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:42.387271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-baccef2d-fcbc-44f4-b08b-fae66b0ad333 req-0e66a492-b6d1-48a5-9f7e-cf2f04397532 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:42.438453 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-baccef2d-fcbc-44f4-b08b-fae66b0ad333 req-0e66a492-b6d1-48a5-9f7e-cf2f04397532 service nova] Creating event network-vif-plugged:f56e7b5f-d955-461d-a900-09a0116a77f2 for instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec on n-h2-846219-13 Jul 25 16:28:42.464848 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-baccef2d-fcbc-44f4-b08b-fae66b0ad333 req-0e66a492-b6d1-48a5-9f7e-cf2f04397532 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170289 Jul 25 16:28:42.473405 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2144/4263] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:42.499200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:42.500989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:42.538254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:42.541068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:42.546557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:42.550231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:43.226887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:43.260139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:43.275944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:43.278537 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c12ee1b-6daf-4f9a-9931-64598f8ce706 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.378610 Jul 25 16:28:43.292706 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2120/4264] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:41 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:43.325367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:43.326610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:43.353505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:43.354216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:43.355695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:43.356463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:43.512785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=9 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:43.892219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:43.918832 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-095714e2-3772-46b0-ad92-a89abba56eee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 1.442706 Jul 25 16:28:43.924234 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2145/4265] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:42 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:43.944577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:43.946312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:43.972928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:43.976749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:43.978705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:43.979685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:44.548324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:44.569661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83a4cef3-91f7-4a15-befb-0e8bcc9d3868 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1525 microversion: 2.1 time: 1.274685 Jul 25 16:28:44.570765 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2121/4266] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:43 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1525 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:44.576331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:44.579424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:44.592829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:44.593520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:44.594703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:44.595341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:44.999104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:45.018431 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12bb75a6-c58d-4580-832d-a78f4b2e767e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1670 microversion: 2.1 time: 1.091787 Jul 25 16:28:45.057337 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2146/4267] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:43 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1670 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:45.070726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:45.083287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:45.108962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:45.117352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:45.120911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:45.124770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:45.309653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:45.326872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e3c575d3-4e99-4008-b22b-b58e5e0ad896 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 0.746260 Jul 25 16:28:45.327555 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2122/4268] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:44 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:45.351746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:45.363792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:45.414343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:45.415443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:45.417242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:45.418372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:45.935005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:45.949709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:45.953964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:45.955233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9445c1e7-84a8-4340-93c2-5e1e6bfed007 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 0.896382 Jul 25 16:28:45.955818 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2147/4269] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:45 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:45.969959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:45.975194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:45.999813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:46.001248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:46.002438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:46.003061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:47.955107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:47.971136 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c22c0379-ac1a-4760-ae06-7e3527591173 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1525 microversion: 2.1 time: 2.008816 Jul 25 16:28:47.976804 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2148/4270] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:45 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1525 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:47.987255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:48.002653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:48.020776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.021598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:48.022936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.023955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:48.045915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:48.062341 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c25ef91e-d134-4d84-b05e-84c72179bc71 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1367 microversion: 2.1 time: 2.731088 Jul 25 16:28:48.076374 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2123/4271] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:45 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1367 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:48.081512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:48.082121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:48.105403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.106007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:48.106637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.107070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:48.593262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:48.647732 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecffecc5-531e-4926-bd03-118eb0859a3c tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.662087 Jul 25 16:28:48.657644 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2149/4272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:47 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:48.673442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:48.675949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:48.689560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.691822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:48.694224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.695374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.326301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.335198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.336647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aca792ac-507e-4449-91cf-3ea53e98c7c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 1.258985 Jul 25 16:28:49.349156 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2124/4273] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:48 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:49.355190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:49.356235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:49.363443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:49.364347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.367072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:49.367929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.376871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.378520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.379886 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17cd8a4b-4046-4573-ad0a-bff8257ce841 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 0.720570 Jul 25 16:28:49.380490 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2150/4274] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:48 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:49.404874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:49.414991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:49.429787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:49.434001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.435145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:49.436038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.648517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.662324 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c2bb8bb2-aeba-4c56-9809-932ecabb6109 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1673 microversion: 2.1 time: 0.323778 Jul 25 16:28:49.663831 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2125/4275] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:49 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1673 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:49.682654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:49.685389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:49.693610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:49.694779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.695863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:49.696551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.814772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.834008 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a19f7614-c4f5-487c-833b-49db228fde66 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1525 microversion: 2.1 time: 0.431208 Jul 25 16:28:49.849262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2151/4276] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:49 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1525 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:49.857811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-8140569", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0f49b445-a1c1-412f-ba7f-92b3125e9983"}], "security_groups": [{"name": "tempest-securitygroup--1117394682"}], "key_name": "tempest-keypair-203217089", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:49.942604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.953718 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f0abf56-efaf-41ea-b8f2-4b12391b285a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1556 microversion: 2.1 time: 0.287835 Jul 25 16:28:49.955080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2126/4277] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:49 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1556 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:50.139528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fcdf6f84-c792-478b-b7d2-4065d2d06866 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:50.145569 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:28:50.145569 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:28:50.146610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcdf6f84-c792-478b-b7d2-4065d2d06866 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:50.147065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcdf6f84-c792-478b-b7d2-4065d2d06866 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:50.149714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcdf6f84-c792-478b-b7d2-4065d2d06866 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:50.153654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcdf6f84-c792-478b-b7d2-4065d2d06866 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:50.178670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] validate_networks() for [('0f49b445-a1c1-412f-ba7f-92b3125e9983', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:28:50.214394 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fcdf6f84-c792-478b-b7d2-4065d2d06866 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.257139 Jul 25 16:28:50.222646 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2127/4278] 10.222.0.105 () {58 vars in 1190 bytes} [Mon Jul 25 16:28:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:50.236114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:50.236945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:50.272934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:50.274535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:50.279201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:50.281398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:50.388873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:50.413207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:28:50.449970 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Working on deleting snapshot 5ff3a0e5-8362-4072-bd20-1f4a15af5f63 from shelved instance... Jul 25 16:28:51.276339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Getting quotas for project f27380e2a0f8453291be96f8f4172508. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:51.308054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Getting quotas for user 382d0aa047e24da7b76ccfaf2a0fbcae and project f27380e2a0f8453291be96f8f4172508. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:51.343334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:28:51.343802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:28:51.344519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:28:51.345147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:28:51.346682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:28:51.376364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.377460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.378775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.379638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.404022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Getting quotas for project f27380e2a0f8453291be96f8f4172508. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:51.413268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Getting quotas for user 382d0aa047e24da7b76ccfaf2a0fbcae and project f27380e2a0f8453291be96f8f4172508. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:51.446458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:28:51.452327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:28:51.530516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6e3c9e8-445f-4d2c-ac17-e4fd102e6483 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.679676 Jul 25 16:28:51.532010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2152/4279] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:28:49 2022] POST /compute/v2.1/servers => generated 411 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:28:51.547374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:51.554827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:51.574604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.575383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.576399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.577365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.865135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-053a987b-94c5-425f-b920-60cc9eecbc55 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.331553 Jul 25 16:28:51.868146 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2153/4280] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:28:51 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/os-interface => generated 284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:51.879417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:51.881196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:51.899314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.901359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.903761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.905246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:52.189271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Doing local delete in cell ead5885e-2d03-43f4-b304-6ac8e514b7e3(cell1) {{(pid=119598) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 16:28:52.190169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:52.190616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:52.194998 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 16:28:52.202458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] deallocate_for_instance() {{(pid=119598) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 16:28:52.539499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:52.562496 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a641a8f-4335-4b71-a76d-0f61eb40ac57 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 0.687204 Jul 25 16:28:52.564429 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2154/4281] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:51 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:52.570506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:52.571692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:52.579986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:52.580899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:52.582047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:52.582768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.494771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:53.514702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:53.517274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:53.522926 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6dd9f4a2-23d8-4259-a107-cebc314d20ee tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 0.956576 Jul 25 16:28:53.538364 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2155/4282] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:52 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:53.559561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-378981468", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "availability_zone": "nova:n-h2-846219-13", "networks": [{"uuid": "84d9222e-ef5e-43ff-8d79-7b2075928b30"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:53.799689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] validate_networks() for [('84d9222e-ef5e-43ff-8d79-7b2075928b30', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:28:54.553064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Updating instance_info_cache with network_info: [] {{(pid=119598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:28:55.030994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=60 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:55.314653 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78550c97-7025-4df4-b167-c1e8b79413b5 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 204 len: 0 microversion: 2.1 time: 5.089092 Jul 25 16:28:55.315957 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2128/4283] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:28:50 2022] DELETE /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 0 bytes in 5092 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:28:55.329992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:55.331446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:55.344469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.345846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.347452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.348227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.148037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:56.157352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f64d531-1261-4185-8cab-4928f2e6ce07 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1502 microversion: 2.1 time: 0.839220 Jul 25 16:28:56.158265 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2129/4284] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:55 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1502 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:56.163649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:56.164527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:56.172382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.173369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.174436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.175109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.338063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:56.352777 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9575e3be-3d9a-411d-b0b6-60de999e0443 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1336 microversion: 2.1 time: 0.189479 Jul 25 16:28:56.367671 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2130/4285] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:56 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1336 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:56.370047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-12e12d37-4d26-4eb4-bae3-b4f2a5629ac7 req-a5f012be-ccab-42ad-9182-399482b5f663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b289405c-2b33-4e47-b3f9-ed6883c30d5e", "name": "network-vif-plugged", "status": "completed", "tag": "612834dd-cb88-46cd-9773-769962d64ff4"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:56.397363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-12e12d37-4d26-4eb4-bae3-b4f2a5629ac7 req-a5f012be-ccab-42ad-9182-399482b5f663 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.401782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-12e12d37-4d26-4eb4-bae3-b4f2a5629ac7 req-a5f012be-ccab-42ad-9182-399482b5f663 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.427137 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-12e12d37-4d26-4eb4-bae3-b4f2a5629ac7 req-a5f012be-ccab-42ad-9182-399482b5f663 service nova] Creating event network-vif-plugged:612834dd-cb88-46cd-9773-769962d64ff4 for instance b289405c-2b33-4e47-b3f9-ed6883c30d5e on n-h1-846219-13 Jul 25 16:28:56.434020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-12e12d37-4d26-4eb4-bae3-b4f2a5629ac7 req-a5f012be-ccab-42ad-9182-399482b5f663 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075247 Jul 25 16:28:56.435265 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2131/4286] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:56.441623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:56.442493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:56.463428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.465883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.470344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.473259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.491961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:28:56.492467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:28:56.493074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:28:56.495221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:28:56.495941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:28:56.532459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.535401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.540285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.542041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.621212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Getting quotas for project 1082acabdd794db4a56c08cb3467f7b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:56.642172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Getting quotas for user 16bf2a0111b740459d36374e2ba3761d and project 1082acabdd794db4a56c08cb3467f7b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:56.707581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:28:56.712962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:28:56.854135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-96c207ff-8992-472e-b3c5-0a20260390be tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.308384 Jul 25 16:28:56.856149 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2156/4287] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:28:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 3317 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:28:56.871365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:56.880498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:56.898299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.908050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.910000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.916998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.532142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:57.543897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:57.545466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:57.546714 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41586509-504a-4881-ab20-6c31e5e4fbdf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 0.689485 Jul 25 16:28:57.569392 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2157/4288] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:56 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:57.575136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4f4427a2-7caf-481d-aead-1c7eff1cc5d3 req-754213fc-6709-4f9b-9350-3b3a5d02a42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a773e-d2bc-44ef-94d4-4e0dea64af33", "name": "network-vif-deleted", "tag": "c70c5a54-cd77-45d9-bd12-a3026466e57e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:57.600948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4f4427a2-7caf-481d-aead-1c7eff1cc5d3 req-754213fc-6709-4f9b-9350-3b3a5d02a42c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.601522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4f4427a2-7caf-481d-aead-1c7eff1cc5d3 req-754213fc-6709-4f9b-9350-3b3a5d02a42c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.661184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.compute.server_external_events [req-4f4427a2-7caf-481d-aead-1c7eff1cc5d3 req-754213fc-6709-4f9b-9350-3b3a5d02a42c service nova] Unable to find a host for instance e08a773e-d2bc-44ef-94d4-4e0dea64af33. Dropping event network-vif-deleted {{(pid=119599) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 16:28:57.663895 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4f4427a2-7caf-481d-aead-1c7eff1cc5d3 req-754213fc-6709-4f9b-9350-3b3a5d02a42c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104800 Jul 25 16:28:57.666564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2158/4289] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 16:28:57.683125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:57.683739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: e08a773e-d2bc-44ef-94d4-4e0dea64af33] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:57.684784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:57.695551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.696069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.696732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-50157bc6-a156-4246-9b49-afc432db7caa tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 1.260046 Jul 25 16:28:57.696885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.697878 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2132/4290] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:56 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:57.709731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:57.718116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.728442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:57.730544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:57.745280 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] HTTP exception thrown: Instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 could not be found. Jul 25 16:28:57.745575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.745916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.747324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.748031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Request method failure captured: Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 HTTP/1.1 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sHrKL098P7kngsgV8LPhRU79kKW31ZdDdD0Pt25wpgPTXNNClnv_xPsRjPvG-4r5kGwQF2Q7mAH2LERbSZyJUtLDB5tDR_vBo7rkZsPVEDU9xy3HaiyXHpJzLW8AYxwAtY1IRumjGA_k1gydIXPTDba57THZur0RQAcfsBM8ccGfi0 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_72a5bf05a4f64e0d84a353f0743d8bf0"}]}] Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-274194738 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ed4735185f84421f92bc1404d62f26e3 Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 could not be found. Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'e08a773e-d2bc-44ef-94d4-4e0dea64af33'} Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 could not be found. Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 could not be found. Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:28:57.748720 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 could not be found. Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:28:57.753083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Returning 404 to user: Instance e08a773e-d2bc-44ef-94d4-4e0dea64af33 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:28:57.753643 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb99267b-c049-4de9-b6e6-8e3009d90293 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33" status: 404 len: 111 microversion: 2.1 time: 0.083596 Jul 25 16:28:57.754555 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2159/4291] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:57 2022] GET /compute/v2.1/servers/e08a773e-d2bc-44ef-94d4-4e0dea64af33 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:28:57.760626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57987259-dea5-44c1-94e7-38873fce2a18 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:57.762757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57987259-dea5-44c1-94e7-38873fce2a18 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:57.889964 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57987259-dea5-44c1-94e7-38873fce2a18 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1332 microversion: 2.1 time: 0.134138 Jul 25 16:28:57.890583 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2160/4292] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:57 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:57.902016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:57.908173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:57.913487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:57.952111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.958594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.960456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.962236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.129564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:58.247243 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8d88c4a-a13f-4006-9b00-9d944ed7d1b9 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 347 microversion: 2.1 time: 0.547692 Jul 25 16:28:58.248278 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2133/4293] 10.222.0.105 () {58 vars in 1159 bytes} [Mon Jul 25 16:28:57 2022] GET /compute/v2.1/servers?status=shutoff => generated 347 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:58.254988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:58.256206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:58.265754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.266343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.267433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.268328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.341793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:28:58.498269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45ec4d37-2923-42b2-b4fa-ed532d064654 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "DELETE /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 204 len: 0 microversion: 2.1 time: 0.248043 Jul 25 16:28:58.504878 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2134/4294] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:28:58 2022] DELETE /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:28:58.523664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c51b09a-2bd6-45ab-9f54-b4ccde70f660 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:58.535838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c51b09a-2bd6-45ab-9f54-b4ccde70f660 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.537203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c51b09a-2bd6-45ab-9f54-b4ccde70f660 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.591994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c51b09a-2bd6-45ab-9f54-b4ccde70f660 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Going to try to start instance {{(pid=119598) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:28:58.669534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:58.690931 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a374bd7-de42-42a0-9777-06c3cb2d32ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.794781 Jul 25 16:28:58.691529 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2161/4295] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:57 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:58.692687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c51b09a-2bd6-45ab-9f54-b4ccde70f660 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "POST /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a/action" status: 202 len: 0 microversion: 2.1 time: 0.172255 Jul 25 16:28:58.694090 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2135/4296] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:28:58 2022] POST /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:58.732890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-212d6a96-d60b-46f2-bb01-e4171a1b5604 req-1a65b512-74c8-4148-8c8c-dfcd57d9e8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "name": "network-vif-plugged", "status": "completed", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:58.742757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:58.748149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:58.777588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.778958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-212d6a96-d60b-46f2-bb01-e4171a1b5604 req-1a65b512-74c8-4148-8c8c-dfcd57d9e8a9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.779442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-212d6a96-d60b-46f2-bb01-e4171a1b5604 req-1a65b512-74c8-4148-8c8c-dfcd57d9e8a9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.781838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.783247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.784867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.823352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-212d6a96-d60b-46f2-bb01-e4171a1b5604 req-1a65b512-74c8-4148-8c8c-dfcd57d9e8a9 service nova] Creating event network-vif-plugged:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:28:58.831665 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-212d6a96-d60b-46f2-bb01-e4171a1b5604 req-1a65b512-74c8-4148-8c8c-dfcd57d9e8a9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135174 Jul 25 16:28:58.833864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2136/4297] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:58.871314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:58.872146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:58.887790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.888622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.889664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.891183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.929086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:59.110652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.132241 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9d953877-f893-4b4e-bea1-0a8840a6acb3 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1470 microversion: 2.1 time: 0.430966 Jul 25 16:28:59.134408 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2162/4298] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:58 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1470 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:59.151268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:59.153187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:59.167156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.167948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.174877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.175922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.813728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.834232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.837285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.839055 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f353449-c1a6-406b-a70c-937869db750e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.003608 Jul 25 16:28:59.842549 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2137/4299] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:28:58 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:28:59.853533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:59.857698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:59.880917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.882793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.884336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.885177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.900067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.920542 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18dbc570-b672-44a4-b50f-ec07f7083a75 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1511 microversion: 2.1 time: 0.783118 Jul 25 16:28:59.922908 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2163/4300] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:59 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1511 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:59.933387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:59.946916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:59.989927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.990788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.992135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.992993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.002033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:00.195190 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e17cab4d-5546-447d-ad76-8933082e76d5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1421 microversion: 2.1 time: 0.266171 Jul 25 16:29:00.199990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2164/4301] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:59 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1421 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:00.209520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:00.214389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:00.227703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.228716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.231515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.235346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.312964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:00.339405 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-02b4a8a3-f7bd-4888-a63f-8743e944f305 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1378 microversion: 2.1 time: 0.494860 Jul 25 16:29:00.340914 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2138/4302] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:28:59 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1378 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:00.352211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b191440f-acfd-467c-ab0e-4cef5d3c0831 req-56b2b43c-fb95-4387-bdf0-e2fc452f2810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b4d249-05a5-4cf2-87e1-bd2446fab3ec", "tag": "f56e7b5f-d955-461d-a900-09a0116a77f2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:00.370417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b191440f-acfd-467c-ab0e-4cef5d3c0831 req-56b2b43c-fb95-4387-bdf0-e2fc452f2810 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.370933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b191440f-acfd-467c-ab0e-4cef5d3c0831 req-56b2b43c-fb95-4387-bdf0-e2fc452f2810 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.398199 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b191440f-acfd-467c-ab0e-4cef5d3c0831 req-56b2b43c-fb95-4387-bdf0-e2fc452f2810 service nova] Creating event network-changed:f56e7b5f-d955-461d-a900-09a0116a77f2 for instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec on n-h2-846219-13 Jul 25 16:29:00.406468 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b191440f-acfd-467c-ab0e-4cef5d3c0831 req-56b2b43c-fb95-4387-bdf0-e2fc452f2810 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063647 Jul 25 16:29:00.412844 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2139/4303] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:00.427304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:00.428797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:00.442933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.443708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.445384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.446260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.957555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:00.985470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8100ed5-300f-4cb8-9908-86c016f431bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1470 microversion: 2.1 time: 0.570564 Jul 25 16:29:00.987327 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2140/4304] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:00 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1470 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:00.993771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:00.994767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:01.003252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:01.004234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:01.005287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:01.005797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:01.946550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:01.965690 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f1758a7f-bda7-484a-9a69-b2e2c33ae051 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 1.763381 Jul 25 16:29:01.975838 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2165/4305] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:00 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:01.981828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:01.984562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:02.001272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.002587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.005376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.006497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.231434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:02.247683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:02.251412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:02.253802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4433a7f3-ed8a-4e2c-9b01-48cf368d2cb8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1812 microversion: 2.20 time: 1.264735 Jul 25 16:29:02.267516 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2141/4306] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:00 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1812 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:02.292475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:02.294840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:02.308435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.309233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.310901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.312024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.596939 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b3124e24-593f-47b5-ad33-6eccadce2626 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1427 microversion: 2.1 time: 0.318375 Jul 25 16:29:02.598511 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2142/4307] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:02 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1427 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:02.603918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:02.604904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:02.612148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.613528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.615658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.616411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.849001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:02.861833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b730e17f-0339-4087-9ca9-6ec14c4f8c22 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1511 microversion: 2.1 time: 0.893312 Jul 25 16:29:02.875442 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2166/4308] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:01 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1511 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:02.882607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:02.883504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:02.890825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.891258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:02.892048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:02.892490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.213990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:03.225065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-80095b53-58bd-44fb-a2d1-8287b0a0e074 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1470 microversion: 2.1 time: 0.347597 Jul 25 16:29:03.238510 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2167/4309] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:02 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:03.249184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-de42c348-f9db-47a9-ba6d-d942f37e7944 req-8b1e4fe7-4aaf-4819-9a31-5925cb743524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6687e9a-5a54-490c-bbe9-63d306daf7bb", "tag": "6c700cce-f5e2-4d89-9d29-31db007ed96e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:03.261559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-de42c348-f9db-47a9-ba6d-d942f37e7944 req-8b1e4fe7-4aaf-4819-9a31-5925cb743524 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.262277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-de42c348-f9db-47a9-ba6d-d942f37e7944 req-8b1e4fe7-4aaf-4819-9a31-5925cb743524 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.286486 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-de42c348-f9db-47a9-ba6d-d942f37e7944 req-8b1e4fe7-4aaf-4819-9a31-5925cb743524 service nova] Creating event network-changed:6c700cce-f5e2-4d89-9d29-31db007ed96e for instance a6687e9a-5a54-490c-bbe9-63d306daf7bb on n-h2-846219-13 Jul 25 16:29:03.296833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-de42c348-f9db-47a9-ba6d-d942f37e7944 req-8b1e4fe7-4aaf-4819-9a31-5925cb743524 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055943 Jul 25 16:29:03.298250 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2168/4310] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:03.319012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:03.319820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:03.330551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.331180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.332150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.332666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.339506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:03.362053 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a54817e2-95be-4336-80d0-ef0c2d73de7b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1549 microversion: 2.1 time: 0.762240 Jul 25 16:29:03.362727 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2143/4311] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:02 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1549 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:03.369305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:03.370170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:03.376644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.379705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.384904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.387732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.831866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:03.842135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d599b60-4306-484f-b1c6-7bb7cbf300de tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.541580 Jul 25 16:29:03.843234 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2169/4312] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:03 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:03.849342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:03.850887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:03.859649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.860042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.861231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.861743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.888587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:03.913861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:03.916947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:03.922972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-376daa43-9fd9-47be-ae2c-561796bfa03f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1799 microversion: 2.20 time: 0.558003 Jul 25 16:29:03.923710 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2144/4313] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:03 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1799 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:03.930102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:03.930714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:03.938831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.939554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.940615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.941345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.122693 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7de929b8-2347-4243-92d0-3e19766c164c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1427 microversion: 2.1 time: 0.197318 Jul 25 16:29:04.123818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2145/4314] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:03 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1427 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:04.133506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:04.135151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:04.147239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.150184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.151459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.153522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.496783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:04.506600 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7a5d2063-83e1-498a-ad67-60e004513171 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1549 microversion: 2.1 time: 0.661999 Jul 25 16:29:04.507349 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2170/4315] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:03 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1549 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:04.525807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:04.526955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:04.534615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.535314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.536638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.537550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.611211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.621335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.625753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lazy-loading 'fault' on Instance uuid bbe6d8ab-98da-490e-9477-c72bfe3c0265 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:04.688120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:04.710876 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ddb9e1d8-f3ab-4b43-9584-16010f61f9ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1515 microversion: 2.1 time: 0.583822 Jul 25 16:29:04.714719 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2146/4316] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:04 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1515 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:04.744692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:04.759648 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cceef254-9deb-4c9f-9c32-68669c3b6512 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 200 len: 1308 microversion: 2.1 time: 0.250972 Jul 25 16:29:04.760763 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2171/4317] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:04 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:04.765415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:04.795262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:04.804394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.servers [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Removing options 'limit' from query {{(pid=119598) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 16:29:04.807432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:04.811325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.813490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.816259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.817681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.821905 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-df9f09a5-2f52-47ef-a497-41c4d3853cb5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.084733 Jul 25 16:29:04.824335 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2147/4318] 10.222.0.105 () {58 vars in 1145 bytes} [Mon Jul 25 16:29:04 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:29:04.848700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:04.851605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:04.876874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.877417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.881002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:04.882752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.882752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.884718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:04.928802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.931812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:04.936159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:04.938462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:05.270673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:05.282327 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9cddd6a9-548b-4a0c-a018-ce52e41c0473 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1515 microversion: 2.1 time: 0.448706 Jul 25 16:29:05.299092 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2172/4319] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:04 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:05.308417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:05.310926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:05.317721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:05.318234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:05.319044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:05.319477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:05.804725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:05.825456 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d88ff48-1264-4000-935b-162a473c21e6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.962026 Jul 25 16:29:05.826805 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2148/4320] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:04 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:05.832260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:05.833335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:05.843283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:05.847194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:05.848898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:05.849885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.119597 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f602c7c-30e7-4b06-b43c-a06fb3ec9c5b tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.818049 Jul 25 16:29:06.121543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2173/4321] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:05 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:06.134594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ada0f734-cfb6-41c9-acf1-626577c019bc req-6e3323b8-8f57-4f50-a5ae-28b0ee2daf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe6d8ab-98da-490e-9477-c72bfe3c0265", "name": "network-vif-deleted", "tag": "c726d239-aff4-4971-8f69-118d560c1aeb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:06.163231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ada0f734-cfb6-41c9-acf1-626577c019bc req-6e3323b8-8f57-4f50-a5ae-28b0ee2daf33 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.164051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ada0f734-cfb6-41c9-acf1-626577c019bc req-6e3323b8-8f57-4f50-a5ae-28b0ee2daf33 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.186721 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ada0f734-cfb6-41c9-acf1-626577c019bc req-6e3323b8-8f57-4f50-a5ae-28b0ee2daf33 service nova] Creating event network-vif-deleted:c726d239-aff4-4971-8f69-118d560c1aeb for instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 on n-h1-846219-13 Jul 25 16:29:06.194621 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ada0f734-cfb6-41c9-acf1-626577c019bc req-6e3323b8-8f57-4f50-a5ae-28b0ee2daf33 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070469 Jul 25 16:29:06.196207 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2174/4322] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:06.206039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:06.207490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: bbe6d8ab-98da-490e-9477-c72bfe3c0265] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.216619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.217713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.219021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.219829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.246838 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] HTTP exception thrown: Instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 could not be found. Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Request method failure captured: Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 HTTP/1.1 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sHrKL098P7kngsgV8LPhRU79kKW31ZdDdD0Pt25wpgPTXNNClnv_xPsRjPvG-4r5kGwQF2Q7mAH2LERbSZyJUtLDB5tDR_vBo7rkZsPVEDU9xy3HaiyXHpJzLW8AYxwAtY1IRumjGA_k1gydIXPTDba57THZur0RQAcfsBM8ccGfi0 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_72a5bf05a4f64e0d84a353f0743d8bf0"}]}] Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ed4735185f84421f92bc1404d62f26e3 Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 could not be found. Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'bbe6d8ab-98da-490e-9477-c72bfe3c0265'} Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 could not be found. Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 could not be found. Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:06.253569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 could not be found. Jul 25 16:29:06.258626 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:06.261599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Returning 404 to user: Instance bbe6d8ab-98da-490e-9477-c72bfe3c0265 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:06.263788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7675606-9938-473f-b96e-44865c907279 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265" status: 404 len: 111 microversion: 2.1 time: 0.065134 Jul 25 16:29:06.265622 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2175/4323] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:06 2022] GET /compute/v2.1/servers/bbe6d8ab-98da-490e-9477-c72bfe3c0265 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:06.277424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:06.279139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.289919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.290916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.291975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.292719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.342054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:06.367091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:06.381941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a597f1c5-d92b-4718-953b-02791ff60263 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 200 len: 1516 microversion: 2.1 time: 0.552251 Jul 25 16:29:06.382620 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2149/4324] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:05 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 1516 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:06.408926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:06.421594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.430545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.431458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.432514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.440061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.565144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b680a503-eebc-40e5-b020-662c1a62826d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "DELETE /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 204 len: 0 microversion: 2.1 time: 0.292175 Jul 25 16:29:06.568599 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2176/4325] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:06 2022] DELETE /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:06.583975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:06.585255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.594684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:06.598082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.598812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.599927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.601503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.898795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:06.914953 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3a304bbb-75a8-4691-83b6-60714fe0f3d2 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1516 microversion: 2.1 time: 0.509978 Jul 25 16:29:06.916423 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2150/4326] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:06 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1516 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:06.928112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:06.929233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.945496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.946219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.947232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.947879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.394948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:07.414059 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bba224aa-384a-4f19-872a-7694cba48cdd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1512 microversion: 2.1 time: 0.835315 Jul 25 16:29:07.414059 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2177/4327] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:06 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1512 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:07.453609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:07.462716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:07.463564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:07.613516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:07.628230 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-734a2491-0911-4734-930d-60e3407fd56c tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.709269 Jul 25 16:29:07.629975 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2151/4328] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:06 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:07.638989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:07.640798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:07.654856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:07.656030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.657864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:07.659569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.833808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:07.834724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.836217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:07.836914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.913254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:07.927979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:08.076152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:08.186802 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f5f6063-0ed6-4821-90f9-273a96c27d19 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 347 microversion: 2.1 time: 0.758455 Jul 25 16:29:08.188616 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2178/4329] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:29:07 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 347 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:08.209410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:08.217171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:08.235796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.236858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:08.238597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.267800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:08.296472 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26f54786-b8c3-4c50-a04c-083be13bd4ad tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.664437 Jul 25 16:29:08.312997 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2152/4330] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:07 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:08.360110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7e432880-f5d7-48f5-b292-2177221fe5e8 req-6cf99c96-6b6b-4fac-b090-8ded0790961f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b7320c-940d-4dd8-967c-89f6ceb37ef8", "tag": "74254698-2645-4f37-a8e6-328a218f3b65"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:08.380618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7e432880-f5d7-48f5-b292-2177221fe5e8 req-6cf99c96-6b6b-4fac-b090-8ded0790961f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.381385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7e432880-f5d7-48f5-b292-2177221fe5e8 req-6cf99c96-6b6b-4fac-b090-8ded0790961f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:08.404851 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7e432880-f5d7-48f5-b292-2177221fe5e8 req-6cf99c96-6b6b-4fac-b090-8ded0790961f service nova] Creating event network-changed:74254698-2645-4f37-a8e6-328a218f3b65 for instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 on n-h2-846219-13 Jul 25 16:29:08.425700 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7e432880-f5d7-48f5-b292-2177221fe5e8 req-6cf99c96-6b6b-4fac-b090-8ded0790961f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073945 Jul 25 16:29:08.428338 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2153/4331] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:08.448873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:08.450208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:08.477401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.477858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:08.480081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.480530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.318949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:09.341680 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10ca00f3-8bfa-4df8-a0ee-d564d668443b tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1512 microversion: 2.1 time: 0.898267 Jul 25 16:29:09.346395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:09.347334 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2154/4332] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:08 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1512 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:09.360512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8e16c00d-b1ec-4a43-b1aa-13ea0d28a016 req-e1fe91be-0e27-4493-bae7-98aa72321c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b289405c-2b33-4e47-b3f9-ed6883c30d5e", "tag": "612834dd-cb88-46cd-9773-769962d64ff4"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:09.362173 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e610bcba-37e9-4a6f-8a71-a48785c1eaa4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1515 microversion: 2.1 time: 1.161774 Jul 25 16:29:09.377758 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2179/4333] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:08 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1515 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:09.383735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:09.384608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:09.385111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8e16c00d-b1ec-4a43-b1aa-13ea0d28a016 req-e1fe91be-0e27-4493-bae7-98aa72321c05 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.385653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8e16c00d-b1ec-4a43-b1aa-13ea0d28a016 req-e1fe91be-0e27-4493-bae7-98aa72321c05 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.394996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.395895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.397174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.398050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.428065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:09.438494 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8e16c00d-b1ec-4a43-b1aa-13ea0d28a016 req-e1fe91be-0e27-4493-bae7-98aa72321c05 service nova] Creating event network-changed:612834dd-cb88-46cd-9773-769962d64ff4 for instance b289405c-2b33-4e47-b3f9-ed6883c30d5e on n-h1-846219-13 Jul 25 16:29:09.453265 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8e16c00d-b1ec-4a43-b1aa-13ea0d28a016 req-e1fe91be-0e27-4493-bae7-98aa72321c05 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103324 Jul 25 16:29:09.455186 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2155/4334] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:09.468532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:09.470889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:09.486506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.487667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.489749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.491048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.444767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:10.456294 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48e46303-2690-4475-b2b6-f4809cd5f5ea tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 1.076932 Jul 25 16:29:10.470611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2180/4335] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:09 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:10.483023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:10.487036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:10.488577 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7611727f-fc8a-4152-827a-c63716d9b6a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 1.031029 Jul 25 16:29:10.488781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:10.491707 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2156/4336] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:09 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:10.509482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.510078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.511778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.512630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.520270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:10.521867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:10.533195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.533994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.535530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.536372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.655829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.659291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.660847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lazy-loading 'fault' on Instance uuid dfa3abea-d747-4c7a-a439-831f1775cda3 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:11.437916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:11.451697 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-874045ec-dd58-4651-88c5-0038662c375d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 200 len: 1308 microversion: 2.1 time: 0.957480 Jul 25 16:29:11.453343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2157/4337] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:10 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 1308 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:11.462544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a11c407f-2225-452e-92b8-17d84cbeb4bd req-d6bade66-82ed-4377-8013-d1809e4902d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa3abea-d747-4c7a-a439-831f1775cda3", "name": "network-vif-deleted", "tag": "7c7c3e73-089a-4eca-b9b7-3b7bcc209e04"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:11.486004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a11c407f-2225-452e-92b8-17d84cbeb4bd req-d6bade66-82ed-4377-8013-d1809e4902d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.493665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a11c407f-2225-452e-92b8-17d84cbeb4bd req-d6bade66-82ed-4377-8013-d1809e4902d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.510558 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a11c407f-2225-452e-92b8-17d84cbeb4bd req-d6bade66-82ed-4377-8013-d1809e4902d4 service nova] Creating event network-vif-deleted:7c7c3e73-089a-4eca-b9b7-3b7bcc209e04 for instance dfa3abea-d747-4c7a-a439-831f1775cda3 on n-h2-846219-13 Jul 25 16:29:11.519737 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a11c407f-2225-452e-92b8-17d84cbeb4bd req-d6bade66-82ed-4377-8013-d1809e4902d4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064001 Jul 25 16:29:11.521282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2158/4338] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:11.701035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:11.718721 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-09a67c61-1248-484c-9da6-de3a2b18d79e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 200 len: 1516 microversion: 2.1 time: 1.246907 Jul 25 16:29:11.720968 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2181/4339] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:10 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 1516 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:11.728140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:11.729423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:11.746745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.747873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.749764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.751056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.821598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a83127ef-8ef5-4f0b-935d-67e78905309a req-b25322d2-43e8-46ad-8660-a770c2360f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6687e9a-5a54-490c-bbe9-63d306daf7bb", "name": "network-vif-plugged", "status": "completed", "tag": "6c700cce-f5e2-4d89-9d29-31db007ed96e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:11.840597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a83127ef-8ef5-4f0b-935d-67e78905309a req-b25322d2-43e8-46ad-8660-a770c2360f25 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.841543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a83127ef-8ef5-4f0b-935d-67e78905309a req-b25322d2-43e8-46ad-8660-a770c2360f25 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.865086 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a83127ef-8ef5-4f0b-935d-67e78905309a req-b25322d2-43e8-46ad-8660-a770c2360f25 service nova] Creating event network-vif-plugged:6c700cce-f5e2-4d89-9d29-31db007ed96e for instance a6687e9a-5a54-490c-bbe9-63d306daf7bb on n-h2-846219-13 Jul 25 16:29:11.873809 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a83127ef-8ef5-4f0b-935d-67e78905309a req-b25322d2-43e8-46ad-8660-a770c2360f25 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350178 Jul 25 16:29:11.875218 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2159/4340] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:11.886414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:11.888340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:11.899892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.901141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.902446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.903262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.369154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.385282 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3df59c99-47c7-4d77-b0c5-7649e6fd2f94 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.662070 Jul 25 16:29:12.386766 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2182/4341] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:11 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:12.396470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.398460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:12.425057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.426082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.427321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.428899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.490906 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-62ffa20f-01b0-4b84-94a4-2d5a850e5edc tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.612576 Jul 25 16:29:12.497757 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2160/4342] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:11 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:12.510530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.511869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dfa3abea-d747-4c7a-a439-831f1775cda3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:12.529678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.530742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.532273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.533062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.568715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] HTTP exception thrown: Instance dfa3abea-d747-4c7a-a439-831f1775cda3 could not be found. Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Request method failure captured: Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 HTTP/1.1 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sHrKL098P7kngsgV8LPhRU79kKW31ZdDdD0Pt25wpgPTXNNClnv_xPsRjPvG-4r5kGwQF2Q7mAH2LERbSZyJUtLDB5tDR_vBo7rkZsPVEDU9xy3HaiyXHpJzLW8AYxwAtY1IRumjGA_k1gydIXPTDba57THZur0RQAcfsBM8ccGfi0 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_72a5bf05a4f64e0d84a353f0743d8bf0"}]}] Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ed4735185f84421f92bc1404d62f26e3 Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance dfa3abea-d747-4c7a-a439-831f1775cda3 could not be found. Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'dfa3abea-d747-4c7a-a439-831f1775cda3'} Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa3abea-d747-4c7a-a439-831f1775cda3 could not be found. Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa3abea-d747-4c7a-a439-831f1775cda3 could not be found. Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:12.572912 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa3abea-d747-4c7a-a439-831f1775cda3 could not be found. Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Returning 404 to user: Instance dfa3abea-d747-4c7a-a439-831f1775cda3 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09f238d8-2d59-4570-873d-4551bcfdcbbd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3" status: 404 len: 111 microversion: 2.1 time: 0.075893 Jul 25 16:29:12.586690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2161/4343] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:12 2022] GET /compute/v2.1/servers/dfa3abea-d747-4c7a-a439-831f1775cda3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:12.605559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.606443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:12.615047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.615527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.616339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.616836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.679582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:12.725975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.748614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1db03b4-ce4f-42d0-a81d-6cee31b06ff4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1516 microversion: 2.1 time: 0.359619 Jul 25 16:29:12.750357 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2183/4344] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:12 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:12.775677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.781753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.783242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:12.792091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.793070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.794536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.795454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.849416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:12.850783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7660c127-eced-42d4-90fc-9a82b9722acd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 204 len: 0 microversion: 2.1 time: 0.264632 Jul 25 16:29:12.851469 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2162/4345] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:12 2022] DELETE /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:12.868237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.870197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:12.883180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.883651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.886808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.887624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.938811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.948934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.949831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.268918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:13.281331 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1eb826cf-f8c4-497b-a4c2-14738538c7d3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 4530 microversion: 2.1 time: 0.510875 Jul 25 16:29:13.283757 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2184/4346] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:29:12 2022] GET /compute/v2.1/servers/detail => generated 4530 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:13.285165 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3526a028-66b9-4018-a2cb-e9deefbed5fe tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1500 microversion: 2.1 time: 0.426902 Jul 25 16:29:13.286198 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2163/4347] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:12 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1500 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:13.319684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:13.331652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:13.333518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:13.433745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:13.435014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:13.447870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.448700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.450573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.451386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.624859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.625758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.627737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.629075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.699545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:13.779371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9de2a766-f773-45f5-88b6-eb179be76d9e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1017 microversion: 2.1 time: 0.467541 Jul 25 16:29:13.794530 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2185/4348] 10.222.0.105 () {58 vars in 1155 bytes} [Mon Jul 25 16:29:13 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1017 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:13.794530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:13.794530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:13.794957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.795406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.796859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.797998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.232711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.244535 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12119522-ab97-48e4-88a5-34cd299f5612 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.816278 Jul 25 16:29:14.247463 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2164/4349] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:13 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:14.265875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:14.276842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.277849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:14.286491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.286933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.287768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.288200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.370880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7123797d-92cc-4752-91a9-b838d040e7a0 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.589251 Jul 25 16:29:14.379279 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2186/4350] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:13 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:14.404305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:14.405157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:14.413698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.414144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.415113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.416105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.439046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:14.579215 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4396fc00-4837-45cf-8295-a4ea368811c4 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1017 microversion: 2.1 time: 0.328160 Jul 25 16:29:14.587154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2165/4351] 10.222.0.105 () {58 vars in 1217 bytes} [Mon Jul 25 16:29:14 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1017 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:14.616471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:14.629389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.631370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:14.641347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.642703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.644493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.645415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.837155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:14.909263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.922743 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d628063-7f25-407e-a256-cb4c7dda49d0 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1500 microversion: 2.1 time: 0.539533 Jul 25 16:29:14.923478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2187/4352] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:14 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1500 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:14.968062 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dd38044c-b14a-4b6c-aae6-632816d8b548 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1017 microversion: 2.1 time: 0.360920 Jul 25 16:29:14.969393 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2166/4353] 10.222.0.105 () {58 vars in 1201 bytes} [Mon Jul 25 16:29:14 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1017 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:14.989675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:14.998638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.999724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': '-887242965', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:15.007683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.008428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.009964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.011959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.208028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:15.287781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:15.288577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:15.338877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.342340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.344114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.346320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.436947 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67c63cdf-6c7b-454a-bea6-5c33fd381739 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?name=-887242965" status: 200 len: 347 microversion: 2.1 time: 0.454241 Jul 25 16:29:15.439080 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2188/4354] 10.222.0.105 () {58 vars in 1161 bytes} [Mon Jul 25 16:29:14 2022] GET /compute/v2.1/servers?name=-887242965 => generated 347 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:15.452303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:15.454165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:15.475991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.477429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.479349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.480481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.960344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:15.975870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e02d2d1-03ae-41b0-b451-582f2d42189e tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1404 microversion: 2.1 time: 0.693678 Jul 25 16:29:15.986031 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2167/4355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:15 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:15.996023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69eb6762-0465-48fe-bfbb-702424721c19 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.554792 Jul 25 16:29:15.998163 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2189/4356] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:15 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:16.013261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.015625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e4c0e04f-1366-4322-891a-6787feca4c5d req-71410bf6-9823-4849-b247-83bb66b6dc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f43cc78-3ee1-43d2-a010-c844af4d767a", "name": "network-vif-deleted", "tag": "7e82df10-1f35-4f42-8607-171ec06fb049"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:16.031599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:16.045776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:16.062781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e4c0e04f-1366-4322-891a-6787feca4c5d req-71410bf6-9823-4849-b247-83bb66b6dc65 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.064040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e4c0e04f-1366-4322-891a-6787feca4c5d req-71410bf6-9823-4849-b247-83bb66b6dc65 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.073648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.074511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.076472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.077270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.086389 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e4c0e04f-1366-4322-891a-6787feca4c5d req-71410bf6-9823-4849-b247-83bb66b6dc65 service nova] Creating event network-vif-deleted:7e82df10-1f35-4f42-8607-171ec06fb049 for instance 5f43cc78-3ee1-43d2-a010-c844af4d767a on n-h2-846219-13 Jul 25 16:29:16.097504 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e4c0e04f-1366-4322-891a-6787feca4c5d req-71410bf6-9823-4849-b247-83bb66b6dc65 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096993 Jul 25 16:29:16.099100 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2190/4357] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:16.107187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.108909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:16.117728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.118511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.119797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.120431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.197199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.197772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.199180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lazy-loading 'fault' on Instance uuid 5f43cc78-3ee1-43d2-a010-c844af4d767a {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:16.210525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:16.271282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:16.283149 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18c6073a-1c5b-4c42-a1f5-ea77aa0e3b79 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 200 len: 1309 microversion: 2.1 time: 0.182131 Jul 25 16:29:16.284022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2191/4358] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:16 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 1309 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:16.303615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7dcad4f1-9312-49a2-a05c-7899b57c75c1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1017 microversion: 2.1 time: 0.314309 Jul 25 16:29:16.305698 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2168/4359] 10.222.0.105 () {58 vars in 1159 bytes} [Mon Jul 25 16:29:15 2022] GET /compute/v2.1/servers?name=-instance => generated 1017 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:16.327637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.337752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:16.339287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-88724296', 'deleted': False, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:29:16.349497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.350113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.351423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.355653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.527126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:29:16.699427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4a965c3-e3e3-4ec5-905e-a87bb0c31cd1 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-88724296" status: 200 len: 347 microversion: 2.1 time: 0.378042 Jul 25 16:29:16.700372 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2192/4360] 10.222.0.105 () {58 vars in 1231 bytes} [Mon Jul 25 16:29:16 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-88724296 => generated 347 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:16.723155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.724477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:16.739270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.740469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.742002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.742772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.802107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:16.820673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2ecbee90-d764-4bf3-b32f-cb59955e3a5e req-86930696-c132-49e3-b4be-91141537473e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b7320c-940d-4dd8-967c-89f6ceb37ef8", "name": "network-vif-plugged", "status": "completed", "tag": "74254698-2645-4f37-a8e6-328a218f3b65"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:16.871671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2ecbee90-d764-4bf3-b32f-cb59955e3a5e req-86930696-c132-49e3-b4be-91141537473e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.872851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2ecbee90-d764-4bf3-b32f-cb59955e3a5e req-86930696-c132-49e3-b4be-91141537473e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.912157 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2ecbee90-d764-4bf3-b32f-cb59955e3a5e req-86930696-c132-49e3-b4be-91141537473e service nova] Creating event network-vif-plugged:74254698-2645-4f37-a8e6-328a218f3b65 for instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 on n-h2-846219-13 Jul 25 16:29:16.925831 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2ecbee90-d764-4bf3-b32f-cb59955e3a5e req-86930696-c132-49e3-b4be-91141537473e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115673 Jul 25 16:29:16.927495 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2193/4361] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:16.927999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:16.964426 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f27365b5-0d37-4038-a6ec-a83a56c69387 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 204 len: 0 microversion: 2.1 time: 0.248560 Jul 25 16:29:16.965855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2169/4362] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:16 2022] DELETE /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:16.981003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.982379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:16.990486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.991109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.991745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.992336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.013403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.015631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.026590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.027195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.028222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.029128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.352630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:17.362380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2d7dde4-e538-4058-86c1-3a3ed246b2d5 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1522 microversion: 2.1 time: 0.389531 Jul 25 16:29:17.363216 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2194/4363] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:16 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:17.369861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.370957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.379502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.380232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.381845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.382440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.431261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:17.437701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:17.447913 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-50439978-4985-4d05-84f9-11c1fdaf136d tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1590 microversion: 2.1 time: 0.441370 Jul 25 16:29:17.461230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2170/4364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1590 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:17.461839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.463781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: 5f43cc78-3ee1-43d2-a010-c844af4d767a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.481658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.483414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.484381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.484879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.508301 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] HTTP exception thrown: Instance 5f43cc78-3ee1-43d2-a010-c844af4d767a could not be found. Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Request method failure captured: Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a HTTP/1.1 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sHrKL098P7kngsgV8LPhRU79kKW31ZdDdD0Pt25wpgPTXNNClnv_xPsRjPvG-4r5kGwQF2Q7mAH2LERbSZyJUtLDB5tDR_vBo7rkZsPVEDU9xy3HaiyXHpJzLW8AYxwAtY1IRumjGA_k1gydIXPTDba57THZur0RQAcfsBM8ccGfi0 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_72a5bf05a4f64e0d84a353f0743d8bf0"}]}] Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ed4735185f84421f92bc1404d62f26e3 Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 5f43cc78-3ee1-43d2-a010-c844af4d767a could not be found. Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '5f43cc78-3ee1-43d2-a010-c844af4d767a'} Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f43cc78-3ee1-43d2-a010-c844af4d767a could not be found. Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f43cc78-3ee1-43d2-a010-c844af4d767a could not be found. Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:17.511241 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f43cc78-3ee1-43d2-a010-c844af4d767a could not be found. Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Returning 404 to user: Instance 5f43cc78-3ee1-43d2-a010-c844af4d767a could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-87601671-927f-4b1e-b454-f29ab5ad4a9e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a" status: 404 len: 111 microversion: 2.1 time: 0.060687 Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2171/4365] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/5f43cc78-3ee1-43d2-a010-c844af4d767a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.530661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.534277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.535154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.535630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.536101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.664235 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a81e788f-7a48-4d2d-8427-d84bb8535e87 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147455 Jul 25 16:29:17.678818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2172/4366] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:17.684071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75330f83-c666-40b2-84b1-4908486fb69e tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.316982 Jul 25 16:29:17.684400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.684816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.685281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2195/4367] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:17.694672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.695426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.696389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.699069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.729149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:17.847410 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1ceb75a-fe51-4a4e-9c0e-e423228b4027 tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "DELETE /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 204 len: 0 microversion: 2.1 time: 0.166416 Jul 25 16:29:17.848552 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2173/4368] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:17 2022] DELETE /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:17.862492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.863535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.874959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.875952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.877511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.878044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.908242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:18.117377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:18.127429 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a230f76a-8359-4449-a37f-6fa1ed5890bf tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1679 microversion: 2.1 time: 0.271602 Jul 25 16:29:18.128395 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2196/4369] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:18.387017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:18.387550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:18.404646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.405116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.405901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.406344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.619084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:18.628771 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0ef315d-a9a7-4668-b949-bb2b3d8842a3 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1522 microversion: 2.1 time: 0.247090 Jul 25 16:29:18.629726 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2174/4370] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:18 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:18.714768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:18.716177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:18.726278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.727043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.728239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.728874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.953677 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-882e6330-4de2-4689-ba2c-a31d8cf4bb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1469 microversion: 2.1 time: 0.245249 Jul 25 16:29:18.954531 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2197/4371] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:18 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:19.030868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.033417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-073c224f-8aff-427e-abec-6604c4832d6c req-9f24ba04-37d9-48a1-9994-d09981bccf55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6687e9a-5a54-490c-bbe9-63d306daf7bb", "tag": "6c700cce-f5e2-4d89-9d29-31db007ed96e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:19.045630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.050675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-073c224f-8aff-427e-abec-6604c4832d6c req-9f24ba04-37d9-48a1-9994-d09981bccf55 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.051418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-073c224f-8aff-427e-abec-6604c4832d6c req-9f24ba04-37d9-48a1-9994-d09981bccf55 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.072646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.075410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.076205 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-073c224f-8aff-427e-abec-6604c4832d6c req-9f24ba04-37d9-48a1-9994-d09981bccf55 service nova] Creating event network-changed:6c700cce-f5e2-4d89-9d29-31db007ed96e for instance a6687e9a-5a54-490c-bbe9-63d306daf7bb on n-h2-846219-13 Jul 25 16:29:19.078985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.079806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.084484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-073c224f-8aff-427e-abec-6604c4832d6c req-9f24ba04-37d9-48a1-9994-d09981bccf55 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057098 Jul 25 16:29:19.086526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2198/4372] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:19.163691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.164976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.175539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.177133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.178292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.182945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.528919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:19.530312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:19.538197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4726d5ab-029f-47ac-9ed3-ffa1930a8cd0 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1590 microversion: 2.1 time: 0.515280 Jul 25 16:29:19.553737 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f8f5e6f-5cab-4ec7-b7a1-f42b626172dd tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1679 microversion: 2.1 time: 0.380281 Jul 25 16:29:19.553737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2199/4373] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1679 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:19.554288 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2175/4374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1590 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:19.651724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.652526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.660827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.661404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.662444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.662965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.956029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:19.975000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-823c5c0a-ca63-4bf5-8d66-b96badd9376e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1522 microversion: 2.1 time: 0.324811 Jul 25 16:29:19.977416 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2200/4375] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:19.977588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.978207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.986971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.987791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.988798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.989421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:20.567574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:20.574356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:20.589444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:20.591115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:20.592885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:20.593972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.153910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:21.160125 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3285413-1950-41c4-aaf5-51bf76245f4a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1654 microversion: 2.1 time: 1.188176 Jul 25 16:29:21.167855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2176/4376] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1654 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:21.174584 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-00fb016d-777c-4335-9ab5-b5f9b779600e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1679 microversion: 2.1 time: 0.614837 Jul 25 16:29:21.176950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:21.177792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:21.184868 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2201/4377] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:20 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1679 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:21.199677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:21.200353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:21.203588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.204030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.204795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.205267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.208319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.209546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.210690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.211348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.531319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:21.541835 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c41b513b-6b2f-476c-9c21-761e04f74ca2 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1654 microversion: 2.1 time: 0.347846 Jul 25 16:29:21.542751 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2202/4378] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:21 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1654 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:21.560489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1721143a-7509-4201-a615-9db4e1001b0f req-97a2b87d-6215-4e6d-b47d-ecada82aa8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0bdba4-a87a-432c-ae9d-63290c249010", "name": "network-vif-deleted", "tag": "db44d82e-e89e-4e1b-8bb3-7071ec8fb317"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:21.568815 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca4c71d2-ee08-475d-ae6c-fcd4afceba8c tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1522 microversion: 2.1 time: 0.392889 Jul 25 16:29:21.582174 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2177/4379] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:21 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:21.590339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:21.591215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:21.599941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.606022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.607077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.607489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1721143a-7509-4201-a615-9db4e1001b0f req-97a2b87d-6215-4e6d-b47d-ecada82aa8b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.607843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.607959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1721143a-7509-4201-a615-9db4e1001b0f req-97a2b87d-6215-4e6d-b47d-ecada82aa8b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.636538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1721143a-7509-4201-a615-9db4e1001b0f req-97a2b87d-6215-4e6d-b47d-ecada82aa8b6 service nova] Creating event network-vif-deleted:db44d82e-e89e-4e1b-8bb3-7071ec8fb317 for instance dd0bdba4-a87a-432c-ae9d-63290c249010 on n-h1-846219-13 Jul 25 16:29:21.658358 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1721143a-7509-4201-a615-9db4e1001b0f req-97a2b87d-6215-4e6d-b47d-ecada82aa8b6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106616 Jul 25 16:29:21.660111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2203/4380] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:21.788358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-85ac1ee3-0ba3-4701-a7e1-a6ad8858fa5b req-9e8cfa69-9c87-4bac-bd92-d477c780294c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13af6d6-7394-4650-a121-e2dbbcf5e5a0", "name": "network-vif-deleted", "tag": "db08aae4-0c20-4efd-9945-7f1274c7c777"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:21.818499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-85ac1ee3-0ba3-4701-a7e1-a6ad8858fa5b req-9e8cfa69-9c87-4bac-bd92-d477c780294c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.819429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-85ac1ee3-0ba3-4701-a7e1-a6ad8858fa5b req-9e8cfa69-9c87-4bac-bd92-d477c780294c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.834124 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-85ac1ee3-0ba3-4701-a7e1-a6ad8858fa5b req-9e8cfa69-9c87-4bac-bd92-d477c780294c service nova] Creating event network-vif-deleted:db08aae4-0c20-4efd-9945-7f1274c7c777 for instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 on n-h1-846219-13 Jul 25 16:29:21.852186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-85ac1ee3-0ba3-4701-a7e1-a6ad8858fa5b req-9e8cfa69-9c87-4bac-bd92-d477c780294c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060682 Jul 25 16:29:21.854990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2204/4381] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:21.907870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30874632-c716-477c-8181-25ef777d67b4 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1654 microversion: 2.1 time: 0.324455 Jul 25 16:29:21.908776 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2178/4382] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:21 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1654 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:22.188316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1704163498", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "availability_zone": "nova:n-h1-846219-13", "networks": [{"uuid": "84d9222e-ef5e-43ff-8d79-7b2075928b30"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:22.199621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:22.202658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:22.219813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:22.226677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.229658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:22.230234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.327458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:22.328238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.329666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lazy-loading 'fault' on Instance uuid dd0bdba4-a87a-432c-ae9d-63290c249010 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:22.365079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] validate_networks() for [('84d9222e-ef5e-43ff-8d79-7b2075928b30', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:29:22.556021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4735185f84421f92bc1404d62f26e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a5bf05a4f64e0d84a353f0743d8bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:22.566114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7976b1b1-63fa-4012-bd3f-82d3f271758d tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 200 len: 1333 microversion: 2.1 time: 0.371042 Jul 25 16:29:22.567397 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2179/4383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:22 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 1333 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:22.600404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:22.601063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:22.618582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:22.619071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.619984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:22.632313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.707104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:22.707104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.708010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lazy-loading 'fault' on Instance uuid e13af6d6-7394-4650-a121-e2dbbcf5e5a0 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:22.836352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:22.861524 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33c93d0d-cd81-4c25-a466-1c5504e9a71d tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 200 len: 1315 microversion: 2.1 time: 0.269680 Jul 25 16:29:22.876725 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2180/4384] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:22 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:22.931423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:23.169284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:29:23.175571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:29:23.176139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:29:23.177000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:29:23.177964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:29:23.189057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:23.207395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.208567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.209764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.210506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.248435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Getting quotas for project 1082acabdd794db4a56c08cb3467f7b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:23.256773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Getting quotas for user 16bf2a0111b740459d36374e2ba3761d and project 1082acabdd794db4a56c08cb3467f7b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:23.276340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:29:23.280444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:29:23.341731 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3cec8ed5-b4a4-45a6-9858-6da32bd0eb9f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.159138 Jul 25 16:29:23.342988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2205/4385] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:29:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:29:23.358980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ffe13d5b-79d2-4224-aec7-c51e3cc1ca2c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.361156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ffe13d5b-79d2-4224-aec7-c51e3cc1ca2c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:23.491203 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ffe13d5b-79d2-4224-aec7-c51e3cc1ca2c tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1333 microversion: 2.1 time: 0.139169 Jul 25 16:29:23.491803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2181/4386] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:23 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1333 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:23.589319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.590273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] [instance: dd0bdba4-a87a-432c-ae9d-63290c249010] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:23.608051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.608784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.609816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.615581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.647735 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] HTTP exception thrown: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 could not be found. Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Request method failure captured: Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 HTTP/1.1 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sHrKL098P7kngsgV8LPhRU79kKW31ZdDdD0Pt25wpgPTXNNClnv_xPsRjPvG-4r5kGwQF2Q7mAH2LERbSZyJUtLDB5tDR_vBo7rkZsPVEDU9xy3HaiyXHpJzLW8AYxwAtY1IRumjGA_k1gydIXPTDba57THZur0RQAcfsBM8ccGfi0 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/72a5bf05a4f64e0d84a353f0743d8bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_72a5bf05a4f64e0d84a353f0743d8bf0"}]}] Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 72a5bf05a4f64e0d84a353f0743d8bf0 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-274194738 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: ed4735185f84421f92bc1404d62f26e3 Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-274194738-project Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 could not be found. Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'dd0bdba4-a87a-432c-ae9d-63290c249010'} Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 could not be found. Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 could not be found. Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:23.654521 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 could not be found. Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.659433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Returning 404 to user: Instance dd0bdba4-a87a-432c-ae9d-63290c249010 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:23.661168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d93b95e1-7bf5-45d6-85d1-c23f7892bb1a tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010" status: 404 len: 111 microversion: 2.1 time: 0.076319 Jul 25 16:29:23.663650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2206/4387] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:23 2022] GET /compute/v2.1/servers/dd0bdba4-a87a-432c-ae9d-63290c249010 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:23.676432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-198b3588-ab2a-4d47-9923-9d4f7a52e66e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] Calling method '.version_select at 0x7f9d929f64c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.734378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-198b3588-ab2a-4d47-9923-9d4f7a52e66e tempest-ServerActionsTestJSON-274194738 tempest-ServerActionsTestJSON-274194738-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164140981" status: 202 len: 0 microversion: 2.1 time: 0.063703 Jul 25 16:29:23.736470 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2182/4388] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164140981 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:23.884963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.885677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: e13af6d6-7394-4650-a121-e2dbbcf5e5a0] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:23.895407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.896250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.897304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.897991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.916530 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] HTTP exception thrown: Instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 could not be found. Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Request method failure captured: Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 HTTP/1.1 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sRekrBHEvoo9fkNLVoPcof8a7qhifg-xbpdXhQBxITon-7B9Ot_1UvkAA29FkBuk7j0DrPsKLbLFMWFYNWnlaB2k8roqFc23gCiEWoyt62aUXTNDaS6sZXbS1l3tRlgucjj7ayWtKxPWta1nAEzUd0xZKPGwj77muQSTpinbvWw4iA Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0e9696a9a67b4e3cbff42aa7065a2b5e Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e9696a9a67b4e3cbff42aa7065a2b5e"}]}] Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0e9696a9a67b4e3cbff42aa7065a2b5e Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServerFiltersTestJSON-209069177-project Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e38e8ef5233b4f6285d0d19f809b1715 Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServerFiltersTestJSON-209069177-project Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 could not be found. Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'e13af6d6-7394-4650-a121-e2dbbcf5e5a0'} Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 could not be found. Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 could not be found. Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:23.918442 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 could not be found. Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Returning 404 to user: Instance e13af6d6-7394-4650-a121-e2dbbcf5e5a0 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e62fd069-0d44-44d9-99e3-a594492fdd1e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0" status: 404 len: 111 microversion: 2.1 time: 0.040717 Jul 25 16:29:23.925690 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2207/4389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:23 2022] GET /compute/v2.1/servers/e13af6d6-7394-4650-a121-e2dbbcf5e5a0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:23.929697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.930195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:23.939659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.940302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.941493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.941927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.974925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:24.100735 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3c419b0-9f9f-4a9b-b1ab-a333acd6a398 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 204 len: 0 microversion: 2.1 time: 0.174864 Jul 25 16:29:24.101947 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2183/4390] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:23 2022] DELETE /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:24.111719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:24.112755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:24.121304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.122024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.122988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.123695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.292370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:24.307265 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d221711c-4d20-468a-90e0-fb2555f83a34 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 200 len: 1522 microversion: 2.1 time: 0.200938 Jul 25 16:29:24.307882 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2208/4391] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:24 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:24.518463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:24.522609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:24.538308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.538308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.538308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.538308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.657849 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e438fe9-ebb5-4ba2-b6cc-91325dd13db3 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1342 microversion: 2.1 time: 0.146254 Jul 25 16:29:24.658375 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2184/4392] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:24 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1342 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:25.331734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:25.331734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:25.341251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.341614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.342412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.342844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.530420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:25.539442 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-505b3769-5843-484a-894e-4aa5ee23d73e tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 200 len: 1522 microversion: 2.1 time: 0.214133 Jul 25 16:29:25.554908 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2209/4393] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:25 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:25.682673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:25.683954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:25.697388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.697971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.698910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.699415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.798899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c98d7496-1afc-4ce4-8735-f2081fb2ce70 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1422 microversion: 2.1 time: 0.122044 Jul 25 16:29:25.800195 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2185/4394] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:25 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:26.567276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:26.568097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:26.584552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.584998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.591636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.592612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.822441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:26.823404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:26.826364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:26.838809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.839616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.840925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.841623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.873979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:26.993861 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3ab9cc82-e81f-421f-90c5-33479476ef5f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1428 microversion: 2.1 time: 0.174598 Jul 25 16:29:26.995627 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2186/4395] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:26 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:27.067565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:27.098158 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2cdfafe-74b6-4905-a3c8-d2dba1d4d267 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 200 len: 1522 microversion: 2.1 time: 0.531808 Jul 25 16:29:27.101133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2210/4396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:26 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:27.291189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5fb8a709-0ea7-491a-8fd2-89e3d6987b78 req-bc2ec409-65bc-4757-a5d8-553eb6fbe53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3afea4-645e-4b47-8f31-45b8eb2d0207", "name": "network-vif-deleted", "tag": "7a49b1c0-e7ca-4706-bd62-9344cf2d0efc"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:27.309808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5fb8a709-0ea7-491a-8fd2-89e3d6987b78 req-bc2ec409-65bc-4757-a5d8-553eb6fbe53b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:27.310824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5fb8a709-0ea7-491a-8fd2-89e3d6987b78 req-bc2ec409-65bc-4757-a5d8-553eb6fbe53b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.346748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5fb8a709-0ea7-491a-8fd2-89e3d6987b78 req-bc2ec409-65bc-4757-a5d8-553eb6fbe53b service nova] Creating event network-vif-deleted:7a49b1c0-e7ca-4706-bd62-9344cf2d0efc for instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 on n-h1-846219-13 Jul 25 16:29:27.361350 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5fb8a709-0ea7-491a-8fd2-89e3d6987b78 req-bc2ec409-65bc-4757-a5d8-553eb6fbe53b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073449 Jul 25 16:29:27.363016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2187/4397] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:28.023154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.030675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.066388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.067120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.068196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.068877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.135769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.137047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 2f3afea4-645e-4b47-8f31-45b8eb2d0207] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.156091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.156546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.157594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.160178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.256597 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] HTTP exception thrown: Instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 could not be found. Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Request method failure captured: Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 HTTP/1.1 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sRekrBHEvoo9fkNLVoPcof8a7qhifg-xbpdXhQBxITon-7B9Ot_1UvkAA29FkBuk7j0DrPsKLbLFMWFYNWnlaB2k8roqFc23gCiEWoyt62aUXTNDaS6sZXbS1l3tRlgucjj7ayWtKxPWta1nAEzUd0xZKPGwj77muQSTpinbvWw4iA Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0e9696a9a67b4e3cbff42aa7065a2b5e Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e9696a9a67b4e3cbff42aa7065a2b5e"}]}] Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0e9696a9a67b4e3cbff42aa7065a2b5e Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ListServerFiltersTestJSON-209069177-project Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: e38e8ef5233b4f6285d0d19f809b1715 Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ListServerFiltersTestJSON-209069177-project Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 could not be found. Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '2f3afea4-645e-4b47-8f31-45b8eb2d0207'} Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 could not be found. Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 could not be found. Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:28.259778 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 could not be found. Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Returning 404 to user: Instance 2f3afea4-645e-4b47-8f31-45b8eb2d0207 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83e93738-f20f-477d-9899-c0a40b3a55ce tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207" status: 404 len: 111 microversion: 2.1 time: 0.142527 Jul 25 16:29:28.264095 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2188/4398] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:28 2022] GET /compute/v2.1/servers/2f3afea4-645e-4b47-8f31-45b8eb2d0207 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:28.293448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.298912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.364534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.367259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.368787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.374592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.485063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:28.708152 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-45035677-c2bd-4b05-a955-096e3bd423d9 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 0.693050 Jul 25 16:29:28.708771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2211/4399] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:28 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:28.819987 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24ee06a9-d231-41af-a06a-bfe703b5c432 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "DELETE /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 204 len: 0 microversion: 2.1 time: 0.542293 Jul 25 16:29:28.824998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2189/4400] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:28 2022] DELETE /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:28.831895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.833060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.857962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.861302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.862430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.865604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:29.246904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:29.260516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c7de2c09-c56c-44ee-bc40-e2e1bcd32658 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1521 microversion: 2.1 time: 0.433059 Jul 25 16:29:29.261938 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2212/4401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:28 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:29.579125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5112b032-ce24-44f8-949f-8e0ed32277a1 req-e591a094-e90b-4cf9-9051-6a43745d86a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e91322-74a5-461d-b281-6ef8a8a7119a", "tag": "914628da-4671-4ab0-a013-e9c73a64c0df"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:29.629866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5112b032-ce24-44f8-949f-8e0ed32277a1 req-e591a094-e90b-4cf9-9051-6a43745d86a6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:29.630481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5112b032-ce24-44f8-949f-8e0ed32277a1 req-e591a094-e90b-4cf9-9051-6a43745d86a6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:29.650444 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5112b032-ce24-44f8-949f-8e0ed32277a1 req-e591a094-e90b-4cf9-9051-6a43745d86a6 service nova] Creating event network-changed:914628da-4671-4ab0-a013-e9c73a64c0df for instance 22e91322-74a5-461d-b281-6ef8a8a7119a on n-h1-846219-13 Jul 25 16:29:29.658526 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5112b032-ce24-44f8-949f-8e0ed32277a1 req-e591a094-e90b-4cf9-9051-6a43745d86a6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084172 Jul 25 16:29:29.660832 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2190/4402] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:29.750047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:29.750841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:29.762113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:29.766656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:29.767684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:29.768278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.111844 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7c68acd-02ea-420c-8ae4-7b393a961673 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 0.370122 Jul 25 16:29:30.132330 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2213/4403] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:29 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:30.306353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:30.308430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:30.331324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:30.332087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.333052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:30.333987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.958661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:30.959911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:30.967000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:30.967992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.969449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:30.970493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.979051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:30.994991 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d595e452-675e-476e-9bb5-d1fc3a26edb6 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1521 microversion: 2.1 time: 0.712420 Jul 25 16:29:31.007987 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2191/4404] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:30 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:31.008219 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-14ee8331-3ddd-449e-a5b4-35fb1c7507e4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/ips" status: 200 len: 149 microversion: 2.1 time: 0.046885 Jul 25 16:29:31.009063 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2214/4405] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:29:30 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:31.014395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f54fa9ca-46af-4ee8-8701-8d11feecc156"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:31.017182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:31.025524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.026746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.027932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.028581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.143345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:31.144890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:31.161054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.163658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.165334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.166206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.182175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Invalid volume: volume f54fa9ca-46af-4ee8-8701-8d11feecc156 is already attached to instances: cd4e924c-5cee-4432-8388-aa9faa67c2f3 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/os-volume_attachments HTTP/1.1 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 74 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: {"volumeAttachment": {"volumeId": "f54fa9ca-46af-4ee8-8701-8d11feecc156"}} Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid volume: volume f54fa9ca-46af-4ee8-8701-8d11feecc156 is already attached to instances: cd4e924c-5cee-4432-8388-aa9faa67c2f3 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': 'b6b4d249-05a5-4cf2-87e1-bd2446fab3ec', 'body': {'volumeAttachment': {'volumeId': 'f54fa9ca-46af-4ee8-8701-8d11feecc156'}}} Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f54fa9ca-46af-4ee8-8701-8d11feecc156 is already attached to instances: cd4e924c-5cee-4432-8388-aa9faa67c2f3 Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:29:31.184761 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f54fa9ca-46af-4ee8-8701-8d11feecc156 is already attached to instances: cd4e924c-5cee-4432-8388-aa9faa67c2f3 Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f54fa9ca-46af-4ee8-8701-8d11feecc156 is already attached to instances: cd4e924c-5cee-4432-8388-aa9faa67c2f3 Jul 25 16:29:31.189878 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:31.194306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 400 to user: Invalid volume: volume f54fa9ca-46af-4ee8-8701-8d11feecc156 is already attached to instances: cd4e924c-5cee-4432-8388-aa9faa67c2f3 {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:31.195439 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-982620f4-a7c2-4a20-b013-20e31a71b669 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.185640 Jul 25 16:29:31.197822 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2192/4406] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:29:31 2022] POST /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:29:31.209528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:31.211352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:31.218567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.219318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.220710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.221392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.251917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:31.388633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f505956-c9f5-4fc3-9f52-28861a09ece1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 204 len: 0 microversion: 2.1 time: 0.183132 Jul 25 16:29:31.391302 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2193/4407] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:31 2022] DELETE /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:29:31.408046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:31.409228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:31.416793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.417474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.419567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.419567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.189914 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-accf54ed-d2cb-4674-ab1f-59053ca1b730 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 1.053631 Jul 25 16:29:32.190923 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2215/4408] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:31 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:32.218253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:32.225272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:32.238152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:32.249641 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3825c09-8542-454c-bbf4-2efdb9345fc3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1681 microversion: 2.1 time: 0.847873 Jul 25 16:29:32.251652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.252109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.252994 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2194/4409] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:31 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1681 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:32.253596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.254034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.599330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8ef5233b4f6285d0d19f809b1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9696a9a67b4e3cbff42aa7065a2b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:32.619742 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab830b6e-fb1d-4da1-ab7b-e4cfe1828425 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 200 len: 1521 microversion: 2.1 time: 0.411604 Jul 25 16:29:32.630143 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2216/4410] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:32 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:32.883889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ecfee8d4-1b7c-4266-8f30-fe3d08016575 req-c531dc12-acd5-4825-99d1-8fcab78d5cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0195c6f1-af14-4b4a-9715-ab0d1bbfc51a", "name": "network-vif-deleted", "tag": "dcf7eecb-1be9-4f4a-927c-18e8568f1cdb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:32.907064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ecfee8d4-1b7c-4266-8f30-fe3d08016575 req-c531dc12-acd5-4825-99d1-8fcab78d5cf1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.908431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ecfee8d4-1b7c-4266-8f30-fe3d08016575 req-c531dc12-acd5-4825-99d1-8fcab78d5cf1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.936429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ecfee8d4-1b7c-4266-8f30-fe3d08016575 req-c531dc12-acd5-4825-99d1-8fcab78d5cf1 service nova] Creating event network-vif-deleted:dcf7eecb-1be9-4f4a-927c-18e8568f1cdb for instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a on n-h2-846219-13 Jul 25 16:29:32.953711 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ecfee8d4-1b7c-4266-8f30-fe3d08016575 req-c531dc12-acd5-4825-99d1-8fcab78d5cf1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085695 Jul 25 16:29:32.956427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2195/4411] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:33.234490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:33.234490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:33.234490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:33.251327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.252274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.254007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.255841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.284946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:33.287121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:33.310224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.311418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.319855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.320040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.333376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:33.335321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:33.476933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:33.915280 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-edd48801-844b-4f6f-af91-28235ecaed1f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 0.696230 Jul 25 16:29:33.917071 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2217/4412] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:33 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:33.936769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:33.938379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] [instance: 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:33.953033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.953998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.955030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.955666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.978153 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] HTTP exception thrown: Instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a could not be found. Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Request method failure captured: Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a HTTP/1.1 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sRekrBHEvoo9fkNLVoPcof8a7qhifg-xbpdXhQBxITon-7B9Ot_1UvkAA29FkBuk7j0DrPsKLbLFMWFYNWnlaB2k8roqFc23gCiEWoyt62aUXTNDaS6sZXbS1l3tRlgucjj7ayWtKxPWta1nAEzUd0xZKPGwj77muQSTpinbvWw4iA Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0e9696a9a67b4e3cbff42aa7065a2b5e Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e9696a9a67b4e3cbff42aa7065a2b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e9696a9a67b4e3cbff42aa7065a2b5e"}]}] Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0e9696a9a67b4e3cbff42aa7065a2b5e Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-209069177 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ListServerFiltersTestJSON-209069177-project Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: e38e8ef5233b4f6285d0d19f809b1715 Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ListServerFiltersTestJSON-209069177-project Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a could not be found. Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '0195c6f1-af14-4b4a-9715-ab0d1bbfc51a'} Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a could not be found. Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a could not be found. Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:33.980619 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a could not be found. Jul 25 16:29:33.985294 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:33.987725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] Returning 404 to user: Instance 0195c6f1-af14-4b4a-9715-ab0d1bbfc51a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:33.989211 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92640c2a-01d6-487c-960c-a9292426cf76 tempest-ListServerFiltersTestJSON-209069177 tempest-ListServerFiltersTestJSON-209069177-project] 10.222.0.105 "GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a" status: 404 len: 111 microversion: 2.1 time: 0.070333 Jul 25 16:29:33.990031 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2218/4413] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:33 2022] GET /compute/v2.1/servers/0195c6f1-af14-4b4a-9715-ab0d1bbfc51a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:34.021739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:34.039159 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc5d1c5c-8bcb-4394-a0db-6bc9533d1b2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1681 microversion: 2.1 time: 0.757815 Jul 25 16:29:34.044621 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2196/4414] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:33 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1681 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:34.951835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:34.952544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:34.966795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:34.967394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:34.970061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:34.972396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:35.072188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:35.072797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:35.085533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:35.088779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:35.089921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:35.091007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:35.270701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:35.283922 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1dec358-99b3-4fb0-8135-97d89ed1cde8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1614 microversion: 2.1 time: 0.218415 Jul 25 16:29:35.285575 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2197/4415] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:35 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1614 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:35.342092 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7dd81370-fcba-481d-a6a0-b2b1d0f25266 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 0.394438 Jul 25 16:29:35.342703 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2219/4416] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:34 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:35.809805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3eefa6ca-4033-4f4a-88e2-d55b45382810 req-bb9b53f6-1f7c-4874-a2e1-81062c1c5b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b4d249-05a5-4cf2-87e1-bd2446fab3ec", "name": "network-vif-deleted", "tag": "f56e7b5f-d955-461d-a900-09a0116a77f2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:35.826156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3eefa6ca-4033-4f4a-88e2-d55b45382810 req-bb9b53f6-1f7c-4874-a2e1-81062c1c5b07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:35.828018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3eefa6ca-4033-4f4a-88e2-d55b45382810 req-bb9b53f6-1f7c-4874-a2e1-81062c1c5b07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:35.845459 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3eefa6ca-4033-4f4a-88e2-d55b45382810 req-bb9b53f6-1f7c-4874-a2e1-81062c1c5b07 service nova] Creating event network-vif-deleted:f56e7b5f-d955-461d-a900-09a0116a77f2 for instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec on n-h2-846219-13 Jul 25 16:29:35.854959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3eefa6ca-4033-4f4a-88e2-d55b45382810 req-bb9b53f6-1f7c-4874-a2e1-81062c1c5b07 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050072 Jul 25 16:29:35.863306 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2198/4417] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:36.316597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:36.317234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:36.332984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:36.334935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:36.336126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:36.338221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:36.378405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:36.379406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:36.401026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:36.401536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:36.404830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:36.407087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:36.410342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:36.422792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:36.427155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lazy-loading 'fault' on Instance uuid b6b4d249-05a5-4cf2-87e1-bd2446fab3ec {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:36.581012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:36.624604 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75922230-4a18-44da-8810-03ee1becc741 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 200 len: 1332 microversion: 2.1 time: 0.311616 Jul 25 16:29:36.639572 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2220/4418] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:36 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 1332 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:36.728985 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3583ff16-8c86-4496-9c46-36b950780810 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 0.355582 Jul 25 16:29:36.741351 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2199/4419] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:36 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:37.675017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:37.676180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:37.712665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:37.714105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:37.715923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:37.719379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:37.765178 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec HTTP/1.1 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b6b4d249-05a5-4cf2-87e1-bd2446fab3ec'} Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:37.767610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:29:37.772872 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:37.775113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:37.775701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:37.775947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:37.780652 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26b077de-d085-4ee3-9e14-2cf09babf19a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 404 len: 111 microversion: 2.1 time: 0.104921 Jul 25 16:29:37.790714 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2221/4420] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:37 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:37.806298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89dcecc0-414b-49ed-afa6-06269f7be76e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '.version_select at 0x7f9d92ffe550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:37.813009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:37.825019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:37.826378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:37.827107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:37.860977 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89dcecc0-414b-49ed-afa6-06269f7be76e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87813857" status: 202 len: 0 microversion: 2.1 time: 0.065590 Jul 25 16:29:37.863153 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2222/4421] 10.222.0.105 () {58 vars in 1220 bytes} [Mon Jul 25 16:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87813857 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:38.922568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-865368125", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": "none"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:39.052009 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a9df060-0b9d-4b3f-a32a-487277a1b3d7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 1.292229 Jul 25 16:29:39.052659 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2200/4422] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:37 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:39.054229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:29:39.056010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:29:39.059047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:29:39.059943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:29:39.061013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:29:39.074563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5ca50bb8-9b3e-411c-b914-f0014acfa810 req-a6a5425c-599b-403c-b805-65dacb378c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e91322-74a5-461d-b281-6ef8a8a7119a", "name": "network-vif-plugged", "status": "completed", "tag": "914628da-4671-4ab0-a013-e9c73a64c0df"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:39.097235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:39.102798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.104342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.109296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.110771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.127585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5ca50bb8-9b3e-411c-b914-f0014acfa810 req-a6a5425c-599b-403c-b805-65dacb378c6b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.128159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5ca50bb8-9b3e-411c-b914-f0014acfa810 req-a6a5425c-599b-403c-b805-65dacb378c6b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.158117 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5ca50bb8-9b3e-411c-b914-f0014acfa810 req-a6a5425c-599b-403c-b805-65dacb378c6b service nova] Creating event network-vif-plugged:914628da-4671-4ab0-a013-e9c73a64c0df for instance 22e91322-74a5-461d-b281-6ef8a8a7119a on n-h1-846219-13 Jul 25 16:29:39.168752 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5ca50bb8-9b3e-411c-b914-f0014acfa810 req-a6a5425c-599b-403c-b805-65dacb378c6b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111425 Jul 25 16:29:39.171093 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2201/4423] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:39.176293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Getting quotas for project 2c3214d2647e4f4b944435f325b2aaa0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:39.186755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Getting quotas for user f525e521f26d440eb26682f3ddbc68b0 and project 2c3214d2647e4f4b944435f325b2aaa0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:39.225553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:29:39.236229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:29:39.319893 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-09aad580-3a6f-4e53-b543-0e0791c7db3f tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.622471 Jul 25 16:29:39.329404 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2223/4424] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:29:38 2022] POST /compute/v2.1/servers => generated 382 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 25 16:29:39.334930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f360188b-d1bb-44f1-9a34-22e772803d91 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:39.335650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f360188b-d1bb-44f1-9a34-22e772803d91 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:39.546144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f360188b-d1bb-44f1-9a34-22e772803d91 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:39.560489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f360188b-d1bb-44f1-9a34-22e772803d91 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:39.569941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f360188b-d1bb-44f1-9a34-22e772803d91 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:39.584159 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f360188b-d1bb-44f1-9a34-22e772803d91 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1283 microversion: 2.47 time: 0.253921 Jul 25 16:29:39.585831 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2202/4425] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:39 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1283 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:40.001566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:40.002145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:40.010273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.011155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.012181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.012836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.086121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:40.087433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:40.116094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.116566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.117695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.118145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.146197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lazy-loading 'services' on Instance uuid cd4e924c-5cee-4432-8388-aa9faa67c2f3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:40.250373 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-372613be-1eb4-4878-bf29-fc66b48d1dac tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments/f54fa9ca-46af-4ee8-8701-8d11feecc156" status: 202 len: 0 microversion: 2.1 time: 0.254029 Jul 25 16:29:40.252128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2224/4426] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:29:39 2022] DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments/f54fa9ca-46af-4ee8-8701-8d11feecc156 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:40.264599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:40.268002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:40.280790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.281778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.283532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.284199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.332512 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67c56234-cbfd-4a24-9d40-d2d19507f430 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075942 Jul 25 16:29:40.334246 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2225/4427] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:40 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:40.622054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:40.624288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:40.653495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.653946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.676297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.678531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.837981 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8aee7069-39b4-4f5b-8330-f15c0a542c3a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1470 microversion: 2.1 time: 0.755902 Jul 25 16:29:40.839374 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2203/4428] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:40 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1470 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:40.882537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:40.900570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:40.904976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:40.906449 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1bddc49-1ad7-4e67-a7dd-f1d02cd0b84d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1335 microversion: 2.47 time: 0.290493 Jul 25 16:29:40.907062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2226/4429] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:40 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1335 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:41.347902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:41.352669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:41.361177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.362000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.363007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.363735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.398275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:41.403881 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-449733b7-fd3e-41a9-a4e9-c0948fd08013 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061662 Jul 25 16:29:41.405280 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2204/4430] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:41 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:41.863649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:41.863649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:41.884561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.887420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.888485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.890771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.942501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:41.943108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:41.962092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.962846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.963881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.967361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.203273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:42.213518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:42.215606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:42.217170 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6a1ff1e-3cb2-4aef-a1db-88e7b849baed tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1341 microversion: 2.47 time: 0.285139 Jul 25 16:29:42.235612 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2205/4431] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:41 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1341 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:42.416652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:42.420846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.434425 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ee0fb04-5bef-4bb8-998d-89b4f8911787 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1655 microversion: 2.1 time: 0.578014 Jul 25 16:29:42.438045 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2227/4432] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:41 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1655 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:42.438529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.439107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.441759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.442441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.463390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:42.464398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.482993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.483841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.485476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.488528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.532806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4cac0c33-5ba9-4286-ad7d-7740ca1c317e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120435 Jul 25 16:29:42.542714 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2206/4433] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:42 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:42.639787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:42.642962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.656811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.657306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.658615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.669188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.783689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7361df73-043c-43a5-98cb-e77b78c10d93 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e/action" status: 200 len: 24567 microversion: 2.1 time: 0.149833 Jul 25 16:29:42.791838 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2207/4434] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:29:42 2022] POST /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e/action => generated 24567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:29:42.921867 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-86870621-90ac-4aca-a041-5731d9e3d7c5 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1655 microversion: 2.1 time: 0.462501 Jul 25 16:29:42.923096 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2228/4435] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:42 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1655 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:42.949353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:42.950668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.976274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.977062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.978296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.979101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.249341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:43.251036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:43.259829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.260783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.262049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.269292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.379114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-deb5fb8a-a5f5-4bb0-beeb-ac6ed5e13e56 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1655 microversion: 2.1 time: 0.434885 Jul 25 16:29:43.383972 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2208/4436] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:42 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1655 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:43.410621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:43.411523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:43.425643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.428995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.432002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.434219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.442296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:43.462249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:43.463909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:43.465346 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1cf7c80-068b-4d8a-af20-4c9959924815 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1341 microversion: 2.47 time: 0.223866 Jul 25 16:29:43.465993 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2229/4437] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:43 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:43.505058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:43.550130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:43.552404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:43.560907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.561645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.562608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.563190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.624005 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f6ba6316-3c65-4db9-8bc3-a9275c2565ee tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076354 Jul 25 16:29:43.625236 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2230/4438] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:43 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:43.661796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26bb1179-4bf3-4e7a-860d-3cb91eb84bff tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "DELETE /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 204 len: 0 microversion: 2.1 time: 0.253355 Jul 25 16:29:43.663781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2209/4439] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:43 2022] DELETE /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:29:43.676114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:43.676972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:43.707845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.711373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.712539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.713168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.967389 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0657794a-fa70-4da3-9ea2-648b21a74add tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1661 microversion: 2.1 time: 0.296746 Jul 25 16:29:43.969074 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2231/4440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:43 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1661 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:44.495439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:44.496418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:44.535941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.537703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.539459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.540161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.638179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:44.640949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:44.652735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.653686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.654801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.655506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.678462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:44.706323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:44.711084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:44.712981 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-32d69113-9192-46ff-9a87-d65853fa68d2 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1341 microversion: 2.47 time: 0.225486 Jul 25 16:29:44.726001 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2210/4441] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:44 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1341 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:44.738370 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-098d730c-f2e8-4161-851b-605045b0653b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105236 Jul 25 16:29:44.739262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2232/4442] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:44 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:44.994926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:44.996439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:45.013372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.014018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.024572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.027177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.735432 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39417e5e-0eb0-433f-925e-2ef649504f64 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1661 microversion: 2.1 time: 0.741791 Jul 25 16:29:45.737691 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2211/4443] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:44 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1661 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:45.740014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:45.741258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:45.752696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.754914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.755181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:45.755315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.755709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.757632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:45.772068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.773308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.774498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.775130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.837559 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26e3f905-d8dd-42d1-bb07-2c4d690cfa05 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086831 Jul 25 16:29:45.845446 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2212/4444] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:45 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:45.897422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:45.909698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:45.912860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:45.921770 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8babd8c2-c3b1-4139-ba31-cffe1e295436 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1362 microversion: 2.47 time: 0.186961 Jul 25 16:29:45.922407 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2233/4445] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:45 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:29:45.949691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1239852337"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:45.952834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:45.965325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.970516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.975404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.976332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.339655 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cf5c23d1-9aa1-4559-9c56-79ca0d4d1231 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "POST /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8/action" status: 202 len: 52 microversion: 2.47 time: 0.394712 Jul 25 16:29:46.342569 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2213/4446] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:29:45 2022] POST /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8/action => generated 52 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:29:46.361904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:46.363257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:46.383150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.383597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.384607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.385306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.423005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:46.680686 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-485a1d4c-c7e8-461d-a109-82d700766444 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "DELETE /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 204 len: 0 microversion: 2.47 time: 0.324140 Jul 25 16:29:46.683587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2214/4447] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:29:46 2022] DELETE /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:29:46.706451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6e23486f-1249-43b8-89ff-0aa342d3ea93 req-48bc4248-6512-4ad0-a996-bdeb2b2e56aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e91322-74a5-461d-b281-6ef8a8a7119a", "name": "network-vif-deleted", "tag": "914628da-4671-4ab0-a013-e9c73a64c0df"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:46.753676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6e23486f-1249-43b8-89ff-0aa342d3ea93 req-48bc4248-6512-4ad0-a996-bdeb2b2e56aa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.755098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6e23486f-1249-43b8-89ff-0aa342d3ea93 req-48bc4248-6512-4ad0-a996-bdeb2b2e56aa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.759283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-964046384", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "bdb73ed2-afb5-41f9-a213-0471db41e9e6"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:46.781966 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6e23486f-1249-43b8-89ff-0aa342d3ea93 req-48bc4248-6512-4ad0-a996-bdeb2b2e56aa service nova] Creating event network-vif-deleted:914628da-4671-4ab0-a013-e9c73a64c0df for instance 22e91322-74a5-461d-b281-6ef8a8a7119a on n-h1-846219-13 Jul 25 16:29:46.797055 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6e23486f-1249-43b8-89ff-0aa342d3ea93 req-48bc4248-6512-4ad0-a996-bdeb2b2e56aa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107142 Jul 25 16:29:46.797731 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2215/4448] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:46.819546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:46.820570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:46.834826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.835483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.836651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.837280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.863272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] validate_networks() for [('bdb73ed2-afb5-41f9-a213-0471db41e9e6', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:29:47.023981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:47.045546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:47.047569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:47.048979 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20235f42-08a8-4f31-ad75-ce6cfe30ac23 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1368 microversion: 2.47 time: 0.233948 Jul 25 16:29:47.072809 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2216/4449] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:46 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:47.091246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:47.096440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:47.128558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.129025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.132103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.132387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.243100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.243609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.244362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lazy-loading 'fault' on Instance uuid 22e91322-74a5-461d-b281-6ef8a8a7119a {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:47.249692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:47.403828 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1902c6a-61e4-4319-a58e-93b66c09b25f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 200 len: 1460 microversion: 2.1 time: 0.329000 Jul 25 16:29:47.404634 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2217/4450] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:47 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 1460 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:47.411700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:47.414572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:47.423992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.424455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.426385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.426846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.467475 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a35f9e45-cbfe-4406-9d02-c2159eb4e664 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061612 Jul 25 16:29:47.468407 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2218/4451] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:47 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:47.681277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:29:47.682328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:29:47.682804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:29:47.683212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:29:47.683730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:29:47.693132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.693341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.694157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.694678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.711926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Getting quotas for project 685c3fc416fe4b14a33c7dd984a8b66e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:47.717698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Getting quotas for user b2b09fbd31484ddca44d6a2d5e6890df and project 685c3fc416fe4b14a33c7dd984a8b66e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:47.732266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:29:47.734966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:29:47.746667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:47.787987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0890eba7-292b-4e6a-a6a0-a10c06422eb3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.706977 Jul 25 16:29:47.789062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2234/4452] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:29:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:29:47.800231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4576dbf1-4acc-464f-a1a9-70fde4ed3836 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:47.800970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4576dbf1-4acc-464f-a1a9-70fde4ed3836 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:47.892024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4576dbf1-4acc-464f-a1a9-70fde4ed3836 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:47.901108 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4576dbf1-4acc-464f-a1a9-70fde4ed3836 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1219 microversion: 2.1 time: 0.105364 Jul 25 16:29:47.902828 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2219/4453] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:47 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:48.080063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.080964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.089413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.089869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.090653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.091292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.168024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:48.180113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:48.182285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:48.183880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9074957f-bc6c-4e1e-91f3-6965c2b18bd6 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1368 microversion: 2.47 time: 0.110030 Jul 25 16:29:48.201367 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2235/4454] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:48 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:48.426435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.427084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 22e91322-74a5-461d-b281-6ef8a8a7119a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.441141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.441600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.442436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.442833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.459033 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] HTTP exception thrown: Instance 22e91322-74a5-461d-b281-6ef8a8a7119a could not be found. Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Request method failure captured: Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a HTTP/1.1 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sTBxGWVwiQWGMNw1R1fd3CYQT3bsPllqnAlAaGixXhB0t-O_wb_lBP1V7LwEtWtIPVUwwhWtW4gGGoKSX7bJ4F9Fi-f6G1ExEvNBG44876xM7rLFt0ogXPdRoXfl6I2FhrpiIMgRdH_uRAfqPVBwiPBc9klZCYOA4PwLrCKI3d2l7s Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 1082acabdd794db4a56c08cb3467f7b4 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestServerMultinode-997918094 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1082acabdd794db4a56c08cb3467f7b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1082acabdd794db4a56c08cb3467f7b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/1082acabdd794db4a56c08cb3467f7b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_1082acabdd794db4a56c08cb3467f7b4"}]}] Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestServerMultinode-997918094 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 1082acabdd794db4a56c08cb3467f7b4 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestServerMultinode-997918094 Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestServerMultinode-997918094-project-admin Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 16bf2a0111b740459d36374e2ba3761d Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestServerMultinode-997918094-project-admin Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 22e91322-74a5-461d-b281-6ef8a8a7119a could not be found. Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '22e91322-74a5-461d-b281-6ef8a8a7119a'} Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e91322-74a5-461d-b281-6ef8a8a7119a could not be found. Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e91322-74a5-461d-b281-6ef8a8a7119a could not be found. Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:48.460743 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e91322-74a5-461d-b281-6ef8a8a7119a could not be found. Jul 25 16:29:48.465132 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:48.467220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Returning 404 to user: Instance 22e91322-74a5-461d-b281-6ef8a8a7119a could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:48.468466 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1b709b0-ec07-4628-b191-0baaf69154ba tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a" status: 404 len: 111 microversion: 2.1 time: 0.046511 Jul 25 16:29:48.469970 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2220/4455] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:48 2022] GET /compute/v2.1/servers/22e91322-74a5-461d-b281-6ef8a8a7119a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:48.480858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.484425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.484672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.485410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.493560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.494362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.496608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.497354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.499977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.501089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.502864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.503498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.536817 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f42dd8e5-7622-4111-ab2e-f9dc05cf9e2e tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060550 Jul 25 16:29:48.537999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2221/4456] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:29:48 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 16:29:48.558187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:48.568335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:48.746135 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ebf7f79f-2c85-4939-a46f-206693f98c20 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "DELETE /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 204 len: 0 microversion: 2.1 time: 0.268965 Jul 25 16:29:48.753563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2236/4457] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:48 2022] DELETE /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:29:48.758438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.759250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.775648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.776598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.777722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.778496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.791892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.795589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.824285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.827054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.829629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.831167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.904343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:49.111811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-62d0e7d4-5625-4e60-8092-b87ab5b2faf7 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1660 microversion: 2.1 time: 0.357253 Jul 25 16:29:49.113475 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2222/4458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:48 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1660 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:49.139290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:49.140648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:49.169239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.169868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.171666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.174795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.208243 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b00b075-c408-4a63-a6ae-bbf393c25227 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 204 len: 0 microversion: 2.1 time: 0.424868 Jul 25 16:29:49.210813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2237/4459] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:29:48 2022] DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:49.227818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:49.228610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:49.236664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.237235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.238180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.238715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.371010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.403343 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ca8979a-9a49-4f86-9c98-6bf9f7f785fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1271 microversion: 2.1 time: 0.288162 Jul 25 16:29:49.404367 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2223/4460] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:49 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:49.419892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:49.422166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:49.433815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.440010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.441608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.445902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.448888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.471052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.473836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.492918 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3180b6d9-5b6f-49d9-a971-e0458d80ef37 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1368 microversion: 2.47 time: 0.273829 Jul 25 16:29:49.496377 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2238/4461] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:49 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:49.720649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.746797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8256997-8aad-491c-b607-4d78f12b4e59 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1683 microversion: 2.1 time: 0.340413 Jul 25 16:29:49.750136 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2224/4462] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:49 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1683 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:50.154277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:50.155376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:50.169268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.170276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.171971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.172434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.443654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:50.445761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:50.468684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.470183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.471855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.473326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.506358 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a62df1c-65cb-40fc-8cde-cb981556f52a tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1660 microversion: 2.1 time: 0.356747 Jul 25 16:29:50.508665 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2239/4463] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:50 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1660 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:50.529663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:50.530802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:50.539737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.540573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.541626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.542445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.598159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:50.618938 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d5062903-1823-4856-8de2-3ecf431b02d9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1279 microversion: 2.1 time: 0.195424 Jul 25 16:29:50.619784 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2225/4464] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:50 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:50.663931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:50.684666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:50.689519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:50.689882 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c028d134-c723-4cbf-9c08-65b5e6c9e576 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1368 microversion: 2.47 time: 0.170515 Jul 25 16:29:50.691209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2240/4465] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:50 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:29:50.777385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:50.779486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:50.794263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.795509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.796967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.821357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.315592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:51.334025 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c62a168-c225-422f-9fe7-a2d6756c9ecb tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1683 microversion: 2.1 time: 0.559172 Jul 25 16:29:51.341354 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2226/4466] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:50 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1683 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:51.549342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:51.553082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:51.563288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.564145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.565448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.566121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.642115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:51.643675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:51.665454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.666453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.667763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.668600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.886060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:51.959383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fff2d42c-06c6-43cb-a311-886fe7eb8894 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1277 microversion: 2.1 time: 0.317177 Jul 25 16:29:51.961721 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2227/4467] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:51 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:51.980461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:51.981480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:51.998192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.003814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.004980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.005627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.072889 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4d42d656-8286-416b-8f68-0e483360404e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments/cbf42e97-01f7-4a50-a95a-787a019025cb" status: 200 len: 194 microversion: 2.20 time: 0.109627 Jul 25 16:29:52.074318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2228/4468] 10.222.0.105 () {60 vars in 1459 bytes} [Mon Jul 25 16:29:51 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments/cbf42e97-01f7-4a50-a95a-787a019025cb => generated 194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:29:52.087739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.088803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.096946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.097816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.098794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.099654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.160544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78485e95-f8fa-4053-aaaf-1e795b9ba015 tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1660 microversion: 2.1 time: 0.619340 Jul 25 16:29:52.161207 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2241/4469] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:51 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1660 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:52.175725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.176189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.178171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lazy-loading 'fault' on Instance uuid 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:52.212299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.212842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.232478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.233025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.233841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.234272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.295252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:52.307904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:52.316089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f525e521f26d440eb26682f3ddbc68b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3214d2647e4f4b944435f325b2aaa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:52.317537 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1f814102-a419-4a5b-81a5-45ef2bf4c780 tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 200 len: 1373 microversion: 2.47 time: 0.234583 Jul 25 16:29:52.319822 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2229/4470] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 1373 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:29:52.364270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lazy-loading 'services' on Instance uuid 937a6da3-2ec6-40fa-9f39-6f02632f3e82 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:52.367448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.368244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.380018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.380833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.381738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.382667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.482654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0f73538f-954e-4438-b3d3-e6f60d4b9072 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments/cbf42e97-01f7-4a50-a95a-787a019025cb" status: 202 len: 0 microversion: 2.20 time: 0.273855 Jul 25 16:29:52.483635 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2242/4471] 10.222.0.105 () {60 vars in 1462 bytes} [Mon Jul 25 16:29:52 2022] DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments/cbf42e97-01f7-4a50-a95a-787a019025cb => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:29:52.502404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.512216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.521671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.522497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.523463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.524060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.573474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bdcd9f86-ddf0-4813-ae9e-62a6364efaf1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083306 Jul 25 16:29:52.574526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2243/4472] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:29:52.783528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:52.800408 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11144664-5b7b-45a9-86e7-1150a4c52b64 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1683 microversion: 2.1 time: 0.440977 Jul 25 16:29:52.801405 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2230/4473] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1683 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:52.927135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-943fdfbe-17ca-4a12-af98-0afcea1328cd req-0e43fa9a-bc52-409a-a2a8-291907694419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b7320c-940d-4dd8-967c-89f6ceb37ef8", "name": "network-vif-deleted", "tag": "74254698-2645-4f37-a8e6-328a218f3b65"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:52.947807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-943fdfbe-17ca-4a12-af98-0afcea1328cd req-0e43fa9a-bc52-409a-a2a8-291907694419 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.950903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-943fdfbe-17ca-4a12-af98-0afcea1328cd req-0e43fa9a-bc52-409a-a2a8-291907694419 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.980501 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-943fdfbe-17ca-4a12-af98-0afcea1328cd req-0e43fa9a-bc52-409a-a2a8-291907694419 service nova] Creating event network-vif-deleted:74254698-2645-4f37-a8e6-328a218f3b65 for instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 on n-h2-846219-13 Jul 25 16:29:52.984732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.985556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.995161 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-943fdfbe-17ca-4a12-af98-0afcea1328cd req-0e43fa9a-bc52-409a-a2a8-291907694419 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071630 Jul 25 16:29:52.999773 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2244/4474] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:53.012735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.019552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.022027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.024589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.186733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:53.187450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:53.206261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.206720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.207511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.207941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.309986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.310413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.310876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lazy-loading 'fault' on Instance uuid 29b7320c-940d-4dd8-967c-89f6ceb37ef8 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:53.480358 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b26e9af-a3a7-4f64-b64e-ef85294f49bf tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 200 len: 1459 microversion: 2.1 time: 0.298307 Jul 25 16:29:53.509298 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2245/4475] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:53 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 1459 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:53.524095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:53.525913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] [instance: 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:53.534821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.535788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.536948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.537652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.553864 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] HTTP exception thrown: Instance 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 could not be found. Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Request method failure captured: Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 HTTP/1.1 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sTyLzug9QvsTxyTlWcsreD8y7uSwlr6yIuxVk85fTjM4N_jMlFUnRFyyTgIoDh8Ix0avFc9Xpr97uWkEeflxiVPbB_JNVnzUhSY6SM9VnphVnbHtiXxB82Dhd55H01sjNqVRr6bq3TEaEou6cvui56uUqFNHjzaYKS8oTU6ML7bVQM Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 2c3214d2647e4f4b944435f325b2aaa0 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersAaction247Test-1603162218 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2c3214d2647e4f4b944435f325b2aaa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/2c3214d2647e4f4b944435f325b2aaa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/2c3214d2647e4f4b944435f325b2aaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_2c3214d2647e4f4b944435f325b2aaa0"}]}] Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersAaction247Test-1603162218 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 2c3214d2647e4f4b944435f325b2aaa0 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersAaction247Test-1603162218 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersAaction247Test-1603162218-project Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: f525e521f26d440eb26682f3ddbc68b0 Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersAaction247Test-1603162218-project Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 could not be found. Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8'} Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 could not be found. Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 could not be found. Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:53.556265 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 could not be found. Jul 25 16:29:53.560209 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:29:53.562280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] Returning 404 to user: Instance 51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:53.563403 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a459b216-9f3b-4e98-848c-8519a16c960d tempest-ServersAaction247Test-1603162218 tempest-ServersAaction247Test-1603162218-project] 10.222.0.105 "GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8" status: 404 len: 111 microversion: 2.47 time: 0.052734 Jul 25 16:29:53.564325 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2246/4476] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:29:53 2022] GET /compute/v2.1/servers/51bd663e-bcbd-462d-a8cb-bd21fb7ed7a8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:29:53.591877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:53.595615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:53.614086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.614649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.615645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.616267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.659565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:53.663744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f59cd0a-7743-421a-bf57-4971a69c0751 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077553 Jul 25 16:29:53.664821 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2247/4477] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:53 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:29:53.681742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d8e3856-6566-4bf5-ac96-cddcc4a002b6 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.701622 Jul 25 16:29:53.682571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2231/4478] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:54.416761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-23a7ba72-54b2-4f8a-a8c2-8ff4da789ec2 req-166a0351-4dbd-450a-b477-c5366a86fde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7df86f-72b6-4bc6-890e-91ce32794b8f", "tag": "6ce55e00-8a4c-4d24-b34e-9a75a5ea2c3d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:54.441975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-23a7ba72-54b2-4f8a-a8c2-8ff4da789ec2 req-166a0351-4dbd-450a-b477-c5366a86fde8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.445128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-23a7ba72-54b2-4f8a-a8c2-8ff4da789ec2 req-166a0351-4dbd-450a-b477-c5366a86fde8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.478349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.479323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.481021 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-23a7ba72-54b2-4f8a-a8c2-8ff4da789ec2 req-166a0351-4dbd-450a-b477-c5366a86fde8 service nova] Creating event network-changed:6ce55e00-8a4c-4d24-b34e-9a75a5ea2c3d for instance ee7df86f-72b6-4bc6-890e-91ce32794b8f on n-h1-846219-13 Jul 25 16:29:54.499815 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-23a7ba72-54b2-4f8a-a8c2-8ff4da789ec2 req-166a0351-4dbd-450a-b477-c5366a86fde8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088368 Jul 25 16:29:54.500436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.500706 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2232/4479] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:54.501005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.502386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.507695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.513187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.514003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] [instance: 29b7320c-940d-4dd8-967c-89f6ceb37ef8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.522244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.523199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.526976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.527706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.567214 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] HTTP exception thrown: Instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 could not be found. Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Request method failure captured: Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 HTTP/1.1 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sTBxGWVwiQWGMNw1R1fd3CYQT3bsPllqnAlAaGixXhB0t-O_wb_lBP1V7LwEtWtIPVUwwhWtW4gGGoKSX7bJ4F9Fi-f6G1ExEvNBG44876xM7rLFt0ogXPdRoXfl6I2FhrpiIMgRdH_uRAfqPVBwiPBc9klZCYOA4PwLrCKI3d2l7s Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 1082acabdd794db4a56c08cb3467f7b4 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestServerMultinode-997918094 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1082acabdd794db4a56c08cb3467f7b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1082acabdd794db4a56c08cb3467f7b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/1082acabdd794db4a56c08cb3467f7b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_1082acabdd794db4a56c08cb3467f7b4"}]}] Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestServerMultinode-997918094 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 1082acabdd794db4a56c08cb3467f7b4 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestServerMultinode-997918094 Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestServerMultinode-997918094-project-admin Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 16bf2a0111b740459d36374e2ba3761d Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestServerMultinode-997918094-project-admin Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 could not be found. Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '29b7320c-940d-4dd8-967c-89f6ceb37ef8'} Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 could not be found. Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 could not be found. Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:54.570719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 could not be found. Jul 25 16:29:54.574879 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.578005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] Returning 404 to user: Instance 29b7320c-940d-4dd8-967c-89f6ceb37ef8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:54.579071 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4f8def1f-4f95-48fb-8ba9-9a3c8cb7042f tempest-TestServerMultinode-997918094 tempest-TestServerMultinode-997918094-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8" status: 404 len: 111 microversion: 2.1 time: 0.070051 Jul 25 16:29:54.582508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2233/4480] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:54 2022] GET /compute/v2.1/servers/29b7320c-940d-4dd8-967c-89f6ceb37ef8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:54.667788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.668338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.668886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lazy-loading 'fault' on Instance uuid cd4e924c-5cee-4432-8388-aa9faa67c2f3 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:54.687821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.714020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.751033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.751578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.772527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.777772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.816318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:54.832035 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-98b120c4-248e-4d94-a5f3-e3340bae487a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 200 len: 1334 microversion: 2.1 time: 1.012500 Jul 25 16:29:54.845606 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2248/4481] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:53 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 1334 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:54.851530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.874184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.892362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.892824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.906095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.906571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.957022 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39945e5c-5d8a-4638-95d0-664857268615 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.283761 Jul 25 16:29:54.965901 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2234/4482] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:54 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:29:55.124961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-68d8bc91-7fb2-419a-a7d2-ab132f1242a5 req-8e626726-e758-4552-9294-989353eed961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd4e924c-5cee-4432-8388-aa9faa67c2f3", "name": "network-vif-deleted", "tag": "56f7716c-53e5-41b9-99b2-38ed93aa7e9e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:55.156813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-68d8bc91-7fb2-419a-a7d2-ab132f1242a5 req-8e626726-e758-4552-9294-989353eed961 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.159832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-68d8bc91-7fb2-419a-a7d2-ab132f1242a5 req-8e626726-e758-4552-9294-989353eed961 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.195531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-68d8bc91-7fb2-419a-a7d2-ab132f1242a5 req-8e626726-e758-4552-9294-989353eed961 service nova] Creating event network-vif-deleted:56f7716c-53e5-41b9-99b2-38ed93aa7e9e for instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 on n-h1-846219-13 Jul 25 16:29:55.207253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-68d8bc91-7fb2-419a-a7d2-ab132f1242a5 req-8e626726-e758-4552-9294-989353eed961 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088213 Jul 25 16:29:55.208814 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2235/4483] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:55.394618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:55.407717 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-100a3202-667a-4ad4-9890-45303a9971c3 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.560220 Jul 25 16:29:55.421504 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2249/4484] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:54 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:55.876921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:55.878581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:55.901055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.901925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.903278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.905455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.950872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 HTTP/1.1 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'cd4e924c-5cee-4432-8388-aa9faa67c2f3'} Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:55.958277 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:29:55.963368 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:29:55.965462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:55.968789 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-16ae8b6b-7f0e-4f6c-a1fc-3fff70a62a57 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 404 len: 111 microversion: 2.1 time: 0.100027 Jul 25 16:29:55.973435 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2236/4485] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:55 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:55.974921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:55.978405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:55.987039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-adbc3b9c-d8ce-4305-a19c-1e98d697c8a5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '.version_select at 0x7f9d93c0a8b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:55.995889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.996642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.998961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.999613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:56.044395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-adbc3b9c-d8ce-4305-a19c-1e98d697c8a5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400121653" status: 202 len: 0 microversion: 2.1 time: 0.067722 Jul 25 16:29:56.044927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2237/4486] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400121653 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:56.054189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:56.071891 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d24ebb7-cc77-437e-8531-355ece43b6c6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102917 Jul 25 16:29:56.072996 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2250/4487] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:55 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:29:56.432895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:56.435012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:56.459521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:56.460660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:56.461731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:56.462389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:57.085892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:57.100893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:57.129825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:57.134966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:57.138388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:57.139029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:57.218132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-644a3a6c-2e9b-4fe7-bb57-365719c9d5c1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135484 Jul 25 16:29:57.223062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2251/4488] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:57 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:29:57.409520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:57.419226 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30d8aca4-1528-4c68-a82f-7deabc158627 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.993311 Jul 25 16:29:57.419827 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2238/4489] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:56 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:57.911822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99faa1ae-6017-4c67-82d4-c874b8f2e1e3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: .version_select at 0x7f9d92a49550>, body: {"keypair": {"name": "tempest-keypair-360110068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWlgSaYVe0Ww2qhJKSe4K/qYfLJHdSmcT7eBpw6D/UibPNgXcShAZUmU0M+NZzFNHGLh0WgPSpKibtEhsnpTmvRq+9+BTzg8iLzY3FsHo0LLhxY07NgR7EHhcSat6UwjQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:57.926315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:57.929451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:57.980671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-99faa1ae-6017-4c67-82d4-c874b8f2e1e3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:58.000259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-99faa1ae-6017-4c67-82d4-c874b8f2e1e3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:58.060315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99faa1ae-6017-4c67-82d4-c874b8f2e1e3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152614 Jul 25 16:29:58.064009 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2252/4490] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:29:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:58.237932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:58.242653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:58.249929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:58.262001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.263536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.265412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.266723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.277563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:58.324213 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1492f950-5964-4456-aadd-f8c45dcf4800 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095896 Jul 25 16:29:58.329639 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2239/4491] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:58 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:29:58.447591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:58.448209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:58.464297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.471794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.472828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.473964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.772219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:58.799493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-351b9a4e-3b87-43c4-b3f6-d51574afe021 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.358798 Jul 25 16:29:58.805325 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2253/4492] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:58 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:59.339482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:59.342699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:59.346207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:59.360560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.361081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:59.361907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.362350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:59.407826 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc8332a4-7c03-466f-86b4-c763e726a0a9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074356 Jul 25 16:29:59.414008 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2240/4493] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:29:59 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:29:59.832711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:59.833369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:59.843628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.844538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:59.845412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.845851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:00.423466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:00.426824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:00.435488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:00.436442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:00.437710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:00.439851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:00.473675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:00.484200 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-871e0b19-037f-42cc-b1c9-ca7bfa1a4512 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.653075 Jul 25 16:30:00.502536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2254/4494] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:29:59 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:00.502656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e070ba30-0360-41bf-bd4d-a16776a4b648 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073657 Jul 25 16:30:00.502656 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2241/4495] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:30:00 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:30:01.506799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:01.513806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:01.523104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:01.525976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:01.532184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.532685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.533773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.534027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.543275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.554095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.559874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.564304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.620377 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71aebdc1-865a-4dcc-a70f-211aef649207 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.118898 Jul 25 16:30:01.621002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2255/4496] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:30:01 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:01.735455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:01.737232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:01.744319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.746768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.750511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.751537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.822789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:30:02.070953 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-711880ac-3c16-46f2-b77d-cf3b985de8a4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 204 len: 0 microversion: 2.20 time: 0.322577 Jul 25 16:30:02.080478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2256/4497] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:30:01 2022] DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:30:02.092265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:02.093915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:02.114218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:02.115242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:02.116435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:02.118417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:02.389054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:02.409065 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0077fcae-77c7-4137-90c9-3072414faffd tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.901783 Jul 25 16:30:02.418602 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2242/4498] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:01 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:02.797592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:02.828525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:02.830326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:02.831623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d973420e-684b-4880-9035-4f7c97e78b57 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 0.749085 Jul 25 16:30:02.846688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2257/4499] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:02 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:03.447472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:03.448575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:03.469255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.470078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.471177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.471615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.723360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:03.732527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4aab46e-1ca1-40e5-b0a1-9ab8ba0672fb tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.291178 Jul 25 16:30:03.744999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2243/4500] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:03 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:03.871246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:03.872645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:03.895339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.896209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.898525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.901546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.139606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1479325380", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e812fb40-fcc6-40c5-a453-70ce5887f1c5"}], "security_groups": [{"name": "tempest-securitygroup--1899522500"}], "key_name": "tempest-keypair-360110068", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:04.963803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] validate_networks() for [('e812fb40-fcc6-40c5-a453-70ce5887f1c5', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:30:04.970423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:05.000564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:05.004418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:05.007556 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ac305fa-0182-4623-992e-af53e2c9432c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1727 microversion: 2.20 time: 1.151435 Jul 25 16:30:05.024120 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2258/4501] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:03 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1727 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:05.048735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9a4e7d65-d5c5-4160-8e73-0ed55d1e3c51 req-9d09eb87-976b-4784-b9b1-8153d6eb20da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7df86f-72b6-4bc6-890e-91ce32794b8f", "name": "network-vif-plugged", "status": "completed", "tag": "6ce55e00-8a4c-4d24-b34e-9a75a5ea2c3d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:05.078405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9a4e7d65-d5c5-4160-8e73-0ed55d1e3c51 req-9d09eb87-976b-4784-b9b1-8153d6eb20da service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:05.079636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9a4e7d65-d5c5-4160-8e73-0ed55d1e3c51 req-9d09eb87-976b-4784-b9b1-8153d6eb20da service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:05.104749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9a4e7d65-d5c5-4160-8e73-0ed55d1e3c51 req-9d09eb87-976b-4784-b9b1-8153d6eb20da service nova] Creating event network-vif-plugged:6ce55e00-8a4c-4d24-b34e-9a75a5ea2c3d for instance ee7df86f-72b6-4bc6-890e-91ce32794b8f on n-h1-846219-13 Jul 25 16:30:05.114834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9a4e7d65-d5c5-4160-8e73-0ed55d1e3c51 req-9d09eb87-976b-4784-b9b1-8153d6eb20da service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088148 Jul 25 16:30:05.116264 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2259/4502] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:05.127858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:05.129614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:05.142480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:05.143691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:05.145831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:05.155641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:05.696767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:05.709513 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49ac0f6e-dbc9-4f12-bf79-12138f3c9068 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 0.590722 Jul 25 16:30:05.729358 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2260/4503] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:05 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:06.050527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:06.051306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:06.088684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.091718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.094682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.096472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.329231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:06.350684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:06.351756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:06.353028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5687e3b9-7bcc-42eb-8786-f652b498a56f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 200 len: 1660 microversion: 2.20 time: 0.308404 Jul 25 16:30:06.353668 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2261/4504] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:06 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 1660 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:06.636021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:06.649387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:06.650483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Searching by: {'deleted': False, 'project_id': 'f27380e2a0f8453291be96f8f4172508'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:30:06.663505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.663809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.664591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.668185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.721485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:30:06.764137 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e619ca5d-3f04-4f52-bbc3-cd13639d18c1 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.132153 Jul 25 16:30:06.774333 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2262/4505] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 16:30:06 2022] GET /compute/v2.1/servers => generated 339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:06.792342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:06.794222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:06.848055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.849491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.851500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.852617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.954063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:30:06.955000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:30:06.955000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:30:06.955407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:30:06.956033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:30:06.982057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.982771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.983785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.986341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.029682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:07.038583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:07.075266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:30:07.083081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:30:07.199392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ab538b7-7635-4755-8ca1-488cfbb3454d tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.065603 Jul 25 16:30:07.200782 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2244/4506] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:30:04 2022] POST /compute/v2.1/servers => generated 404 bytes in 3069 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:30:07.207176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:07.213858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:07.215123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Searching by: {'deleted': False, 'project_id': 'f27380e2a0f8453291be96f8f4172508'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:30:07.224721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:07.226373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.228749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:07.229494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.291117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:30:07.436837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:07.459550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:07.460765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.018946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:08.492703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:08.503695 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a426b53f-a320-4a53-b04e-9f55511f1287 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1319 microversion: 2.1 time: 1.727563 Jul 25 16:30:08.504293 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2263/4507] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:06 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1319 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:08.545214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:08.545989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:08.577478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.577930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.578717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.579187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.868755 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-561ae29b-bc6a-403e-bf14-56f9703d7dba tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.665527 Jul 25 16:30:08.873129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2245/4508] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:30:07 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:08.873472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:08.880747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:08.881939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:08.888076 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee850abb-3ccf-4e28-81e7-48ec3e220493 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1241 microversion: 2.1 time: 0.371953 Jul 25 16:30:08.890471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2264/4509] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:08 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1241 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:08.900647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.902333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.905483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d25f4406-0d2d-4f84-b6c2-44100b59dab8 req-14a317dd-e3a9-421f-955e-a902a91376c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937a6da3-2ec6-40fa-9f39-6f02632f3e82", "name": "network-vif-deleted", "tag": "90f8c4ed-58c3-4371-b161-314b3809b26d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:08.906760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.907550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.925479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] HTTP exception thrown: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Request method failure captured: Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 HTTP/1.1 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPxkhW4kAgQppWJ9ur455qQMAiTliNsT2wCWGacDsz2SF6SKxyeDhfA_ErE63A35TBoMu3poSRhTZ4yKgoibgrFklsy7tJg17OFMq_aU0q8pozcH6Gn3r3fcT3asiMhpbyOKHxxUDHil9oHWPjbytvm9TxOCnRkwr-AXmhj-L7sSjE Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d5bb17bf33f845cd988f685ee08af589"}]}] Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 18df729ef0034f6a88f6acbc7054db92 Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '937a6da3-2ec6-40fa-9f39-6f02632f3e82'} Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:08.927607 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:30:08.932522 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:08.933010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d25f4406-0d2d-4f84-b6c2-44100b59dab8 req-14a317dd-e3a9-421f-955e-a902a91376c7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.936734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d25f4406-0d2d-4f84-b6c2-44100b59dab8 req-14a317dd-e3a9-421f-955e-a902a91376c7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.941040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Returning 404 to user: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:08.943304 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ab29153f-b575-4a4c-b0c4-cc3db17990bd tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 404 len: 111 microversion: 2.20 time: 0.068771 Jul 25 16:30:08.944441 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2246/4510] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:08 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:30:08.950233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-094d0d33-4e85-4f5a-97f4-b0304b79a3ad tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:08.962097 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d25f4406-0d2d-4f84-b6c2-44100b59dab8 req-14a317dd-e3a9-421f-955e-a902a91376c7 service nova] Creating event network-vif-deleted:90f8c4ed-58c3-4371-b161-314b3809b26d for instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 on n-h2-846219-13 Jul 25 16:30:08.965864 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-094d0d33-4e85-4f5a-97f4-b0304b79a3ad tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.015333 Jul 25 16:30:08.967280 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2247/4511] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:30:08 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:08.973888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb34e4ca-490b-4715-8e27-6fd09b6b6031 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '.version_select at 0x7f9d93788670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:08.977021 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d25f4406-0d2d-4f84-b6c2-44100b59dab8 req-14a317dd-e3a9-421f-955e-a902a91376c7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082512 Jul 25 16:30:08.978019 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2265/4512] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:09.022190 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb34e4ca-490b-4715-8e27-6fd09b6b6031 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808878095" status: 204 len: 0 microversion: 2.20 time: 0.053326 Jul 25 16:30:09.025082 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2248/4513] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808878095 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:30:09.289885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:09.290674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:09.315004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.316116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.317150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.317923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.417990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:30:09.464976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:09.529524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:09.530454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:09.548411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.549325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.550334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.550939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.581774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:09.622293 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91fc4356-4523-4510-9333-d422306c2e60 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 204 len: 0 microversion: 2.1 time: 0.340301 Jul 25 16:30:09.626819 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2266/4514] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:30:09 2022] DELETE /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:30:09.643018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:09.647440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:09.667355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.668189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.669315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.670175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.252162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:10.285543 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f011b72-fa38-4029-87ab-7a8510783cb4 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1715 microversion: 2.1 time: 0.656031 Jul 25 16:30:10.289859 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2267/4515] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:09 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1715 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:10.333732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.336271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.349546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.352921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.354176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.354864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.384337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:10.398269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f2f7d03-6495-4e60-bea2-b2f238a1e6ed tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1506 microversion: 2.1 time: 0.877468 Jul 25 16:30:10.400457 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2249/4516] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:09 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1506 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:10.426897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.427581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.445399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.446118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.447183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.450281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.490512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:10.513908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f760773-8d59-4f5f-9357-a68f646b3eaa tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1303 microversion: 2.1 time: 0.219190 Jul 25 16:30:10.515009 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2268/4517] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:10 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1303 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:10.549280 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-efbeaf3a-a0eb-4dc5-ae67-d5c2d8cea2f2 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.128121 Jul 25 16:30:10.550723 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2250/4518] 10.222.0.105 () {58 vars in 1301 bytes} [Mon Jul 25 16:30:10 2022] DELETE /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f/os-server-password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:30:10.579973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.580947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.595705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.596515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.598339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.599677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.656217 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1c6adb1-d3e6-431a-852d-18081dd0da1b tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.097256 Jul 25 16:30:10.666456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2269/4519] 10.222.0.105 () {58 vars in 1298 bytes} [Mon Jul 25 16:30:10 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f/os-server-password => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:30:10.677058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.678088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.698143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.700353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.704149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.711203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.799659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:30:10.989473 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f3ea379-4aa9-4408-888b-896527af8cf9 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 204 len: 0 microversion: 2.1 time: 0.317668 Jul 25 16:30:10.990855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2251/4520] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:30:10 2022] DELETE /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:30:11.001064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:11.002086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:11.017727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.018788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:11.020057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.020724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:11.320207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:11.320949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:11.332290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.332755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:11.333621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.344153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:11.907717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:11.937935 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e4e7bd4-aafc-4abe-aba8-331f75949d0a tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1512 microversion: 2.1 time: 0.940917 Jul 25 16:30:11.943275 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2270/4521] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:10 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1512 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:11.948873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:11.949878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:11.956637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.957348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:11.958298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.958926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.212256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:12.223143 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-495dccbc-d4e5-4f38-8b93-384f7a51f9be tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1303 microversion: 2.1 time: 0.278526 Jul 25 16:30:12.238664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2271/4522] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:11 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:12.267702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:12.306674 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-905e0bc3-3f9b-4b03-82f6-2ba70cff40b6 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1715 microversion: 2.1 time: 0.982568 Jul 25 16:30:12.309718 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2252/4523] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:11 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1715 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:12.317060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c227499b-7ad7-4f69-b437-f02f38fba854 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'create', calling method: .version_select at 0x7f9d92a10ca0>, body: {"keypair": {"name": "tempest-keypair-1495560200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK46pvR4QNGOMcvHUkH46JiQwnZYCyJoGzamWFqNW5cnlSahoJ62K1omYfhAUhJUtSFS9xq8DBJQus/xuqeyqzi12xhPkNiQYwgwA8TX20vzUj+lYxIakSgS4xB3YclfKQ=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:12.393179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c227499b-7ad7-4f69-b437-f02f38fba854 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for project d5bb17bf33f845cd988f685ee08af589. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:12.447693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c227499b-7ad7-4f69-b437-f02f38fba854 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for user 18df729ef0034f6a88f6acbc7054db92 and project d5bb17bf33f845cd988f685ee08af589. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:12.593163 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c227499b-7ad7-4f69-b437-f02f38fba854 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.280264 Jul 25 16:30:12.597628 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2272/4524] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:30:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 292 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:30:12.958550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:12.959216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:12.977290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.978116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.979017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.979561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:13.483945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-438569817", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "23e449c4-389a-465a-a3d7-863d459647a4"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:13.622170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b09fbd31484ddca44d6a2d5e6890df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '685c3fc416fe4b14a33c7dd984a8b66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:13.622837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] validate_networks() for [('23e449c4-389a-465a-a3d7-863d459647a4', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:30:13.631598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a77b71a0-c6d5-4bc2-a52e-fa7ac64e5e03 tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 200 len: 1512 microversion: 2.1 time: 0.677103 Jul 25 16:30:13.642193 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2253/4525] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:12 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 1512 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:13.649494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:13.653080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:13.668935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:13.669813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:13.671066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:13.673048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:16.227775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:16.290696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94354573-d491-4984-9af8-3021efda5475 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 2.645258 Jul 25 16:30:16.294564 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2254/4526] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:13 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:16.324121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:16.327206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:16.387151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:16.388567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:16.396431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:16.399110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:16.488437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:16.691168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:16.906945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382d0aa047e24da7b76ccfaf2a0fbcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f27380e2a0f8453291be96f8f4172508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:16.944959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1e449b88-0cb5-46c3-94fd-43fa5e61f296 tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 200 len: 1647 microversion: 2.1 time: 0.645891 Jul 25 16:30:16.958900 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2255/4527] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:16 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 1647 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:16.986622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:16.990310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] [instance: ee7df86f-72b6-4bc6-890e-91ce32794b8f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:17.002179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:17.003011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:17.004094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:17.005533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:17.044417 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] HTTP exception thrown: Instance ee7df86f-72b6-4bc6-890e-91ce32794b8f could not be found. Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Request method failure captured: Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f HTTP/1.1 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sT5j9N8qXcPa15Il3NxA2P_wp5Wx5RanjvXBkAtB4ffunis_Tnd9sccc5lJfFGr-BejNUhVJ7u3W7wkZFSexV0eTNePQ_IK7NetdycvpXcjAmyJmPOb6MVeeHye9Vjd1lZzK-TQPTDI5NKeF8n3Z3qzNIv_t8m5fQ2-q47khYYBtd4 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 685c3fc416fe4b14a33c7dd984a8b66e Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerPasswordTestJSON-278236325 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/685c3fc416fe4b14a33c7dd984a8b66e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/685c3fc416fe4b14a33c7dd984a8b66e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/685c3fc416fe4b14a33c7dd984a8b66e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_685c3fc416fe4b14a33c7dd984a8b66e"}]}] Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerPasswordTestJSON-278236325 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 685c3fc416fe4b14a33c7dd984a8b66e Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerPasswordTestJSON-278236325 Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerPasswordTestJSON-278236325-project Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b2b09fbd31484ddca44d6a2d5e6890df Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerPasswordTestJSON-278236325-project Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance ee7df86f-72b6-4bc6-890e-91ce32794b8f could not be found. Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'ee7df86f-72b6-4bc6-890e-91ce32794b8f'} Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee7df86f-72b6-4bc6-890e-91ce32794b8f could not be found. Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee7df86f-72b6-4bc6-890e-91ce32794b8f could not be found. Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:17.053285 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee7df86f-72b6-4bc6-890e-91ce32794b8f could not be found. Jul 25 16:30:17.060940 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:17.071019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] Returning 404 to user: Instance ee7df86f-72b6-4bc6-890e-91ce32794b8f could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:17.077589 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f1fd00da-2007-49ea-ab2a-ce0aa4d933ea tempest-ServerPasswordTestJSON-278236325 tempest-ServerPasswordTestJSON-278236325-project] 10.222.0.105 "GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f" status: 404 len: 111 microversion: 2.1 time: 0.099645 Jul 25 16:30:17.079738 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2256/4528] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:16 2022] GET /compute/v2.1/servers/ee7df86f-72b6-4bc6-890e-91ce32794b8f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:30:17.250984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:17.434739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:17.452910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-84cb67c0-f36e-4725-96a3-ea13d48fac0f req-f52d03ea-7360-463f-8148-9123177a32ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7df86f-72b6-4bc6-890e-91ce32794b8f", "name": "network-vif-deleted", "tag": "6ce55e00-8a4c-4d24-b34e-9a75a5ea2c3d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:17.487653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-84cb67c0-f36e-4725-96a3-ea13d48fac0f req-f52d03ea-7360-463f-8148-9123177a32ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:17.488243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-84cb67c0-f36e-4725-96a3-ea13d48fac0f req-f52d03ea-7360-463f-8148-9123177a32ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:17.528212 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-84cb67c0-f36e-4725-96a3-ea13d48fac0f req-f52d03ea-7360-463f-8148-9123177a32ef service nova] Creating event network-vif-deleted:6ce55e00-8a4c-4d24-b34e-9a75a5ea2c3d for instance ee7df86f-72b6-4bc6-890e-91ce32794b8f on n-h1-846219-13 Jul 25 16:30:17.535947 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-84cb67c0-f36e-4725-96a3-ea13d48fac0f req-f52d03ea-7360-463f-8148-9123177a32ef service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451571 Jul 25 16:30:17.544697 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2257/4529] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:17.555680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8a4d6d10-74e4-49c7-9318-ccbe8b84fcc2 req-139ac643-dd4e-49da-8ac6-144788cf5ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6687e9a-5a54-490c-bbe9-63d306daf7bb", "name": "network-vif-unplugged", "status": "completed", "tag": "6c700cce-f5e2-4d89-9d29-31db007ed96e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:17.582698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8a4d6d10-74e4-49c7-9318-ccbe8b84fcc2 req-139ac643-dd4e-49da-8ac6-144788cf5ed3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:17.585946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8a4d6d10-74e4-49c7-9318-ccbe8b84fcc2 req-139ac643-dd4e-49da-8ac6-144788cf5ed3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:17.639227 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8a4d6d10-74e4-49c7-9318-ccbe8b84fcc2 req-139ac643-dd4e-49da-8ac6-144788cf5ed3 service nova] Creating event network-vif-unplugged:6c700cce-f5e2-4d89-9d29-31db007ed96e for instance a6687e9a-5a54-490c-bbe9-63d306daf7bb on n-h2-846219-13 Jul 25 16:30:17.649480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8a4d6d10-74e4-49c7-9318-ccbe8b84fcc2 req-139ac643-dd4e-49da-8ac6-144788cf5ed3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102531 Jul 25 16:30:17.650849 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2258/4530] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:17.661290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1947944921", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b1b0602-8b2b-402c-b734-1a415e2686d1"}], "security_groups": [{"name": "tempest-securitygroup--435115290"}], "key_name": "tempest-keypair-1495560200", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:18.114346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] validate_networks() for [('2b1b0602-8b2b-402c-b734-1a415e2686d1', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:30:18.482372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:30:18.483195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:30:18.484107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:30:18.485779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:30:18.487096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:30:18.537722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:18.539070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:18.553515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:18.557349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:18.637421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Getting quotas for project 9478176ed4b7485b838e50afe057fb75. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:18.651105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Getting quotas for user 2c1c8bb2f8de4a9080fe0ab102482093 and project 9478176ed4b7485b838e50afe057fb75. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:18.700853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:30:18.722654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:30:18.880968 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-831248eb-e86a-4f35-9bdb-359112b15e0f tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.856874 Jul 25 16:30:18.881731 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2273/4531] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:30:13 2022] POST /compute/v2.1/servers => generated 382 bytes in 5860 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:30:18.891690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:18.901621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:18.917364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:18.918269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:18.919304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:18.928605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.087815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:20.099602 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9be06080-b94f-4e6b-8221-6fa99005b936 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 1.213134 Jul 25 16:30:20.113136 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2274/4532] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:18 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:20.123549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:20.124249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] [instance: a6687e9a-5a54-490c-bbe9-63d306daf7bb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:20.149749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.150226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.151031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.151467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.204826 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] HTTP exception thrown: Instance a6687e9a-5a54-490c-bbe9-63d306daf7bb could not be found. Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Request method failure captured: Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb HTTP/1.1 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sSvgUPGX7c7DC1-CW8AimUA6XlyKhuw0TLQJRn93rT_73DYhl9Ug5o4QVJdFEqNllxUUdwGFjVrdwwvUYnN3WrNWApPLKVk6K4TTZNdFbipulssNY8mHL2VVBcTUgj-u8RDhzvVva4MQpaUvoaTEkijSUiYQ6-YeLKQ9JGQ7S5tc4g Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: f27380e2a0f8453291be96f8f4172508 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestManualDisk-511455831 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f27380e2a0f8453291be96f8f4172508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/f27380e2a0f8453291be96f8f4172508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/f27380e2a0f8453291be96f8f4172508"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_f27380e2a0f8453291be96f8f4172508"}]}] Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestManualDisk-511455831 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: f27380e2a0f8453291be96f8f4172508 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestManualDisk-511455831 Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestManualDisk-511455831-project Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 382d0aa047e24da7b76ccfaf2a0fbcae Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestManualDisk-511455831-project Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance a6687e9a-5a54-490c-bbe9-63d306daf7bb could not be found. Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'a6687e9a-5a54-490c-bbe9-63d306daf7bb'} Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6687e9a-5a54-490c-bbe9-63d306daf7bb could not be found. Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6687e9a-5a54-490c-bbe9-63d306daf7bb could not be found. Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:20.211575 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6687e9a-5a54-490c-bbe9-63d306daf7bb could not be found. Jul 25 16:30:20.215805 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:20.217883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Returning 404 to user: Instance a6687e9a-5a54-490c-bbe9-63d306daf7bb could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:20.219385 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dae73b30-68e6-4dce-8351-46fd6ce2b79a tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb" status: 404 len: 111 microversion: 2.1 time: 0.109653 Jul 25 16:30:20.220206 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2275/4533] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:20 2022] GET /compute/v2.1/servers/a6687e9a-5a54-490c-bbe9-63d306daf7bb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:30:20.232005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4068a70c-9974-47f2-8c02-0cebf2328f81 req-7b1dcae1-c788-4573-a4df-5eb7b2ec26fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6687e9a-5a54-490c-bbe9-63d306daf7bb", "name": "network-vif-deleted", "tag": "6c700cce-f5e2-4d89-9d29-31db007ed96e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:20.259876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4068a70c-9974-47f2-8c02-0cebf2328f81 req-7b1dcae1-c788-4573-a4df-5eb7b2ec26fb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.260844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:30:20.261744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:30:20.262201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4068a70c-9974-47f2-8c02-0cebf2328f81 req-7b1dcae1-c788-4573-a4df-5eb7b2ec26fb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.262651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:30:20.273155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:30:20.277500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:30:20.293472 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4068a70c-9974-47f2-8c02-0cebf2328f81 req-7b1dcae1-c788-4573-a4df-5eb7b2ec26fb service nova] Creating event network-vif-deleted:6c700cce-f5e2-4d89-9d29-31db007ed96e for instance a6687e9a-5a54-490c-bbe9-63d306daf7bb on n-h2-846219-13 Jul 25 16:30:20.304855 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4068a70c-9974-47f2-8c02-0cebf2328f81 req-7b1dcae1-c788-4573-a4df-5eb7b2ec26fb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083150 Jul 25 16:30:20.306241 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2276/4534] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:20.313649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:20.314648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:20.333246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.337383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.346714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.349471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.350114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.353857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.356859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:20.361157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:20.475176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for project d5bb17bf33f845cd988f685ee08af589. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:20.513606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Getting quotas for user 18df729ef0034f6a88f6acbc7054db92 and project d5bb17bf33f845cd988f685ee08af589. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:20.546617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:30:20.551851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:30:20.622076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:20.640231 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-77e49035-88a5-4ae8-a67c-7f5131a2bf8e tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1232 microversion: 2.1 time: 0.330692 Jul 25 16:30:20.658006 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2277/4535] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:20 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1232 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:20.675085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1907a3af-7869-434c-98f4-4e517b46fd8f tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] Calling method '.version_select at 0x7f9d9237b5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:20.686748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5340cbd-f8ac-46a5-9840-d6b826c9cacf tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 3.032740 Jul 25 16:30:20.698007 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2259/4536] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:30:17 2022] POST /compute/v2.1/servers => generated 403 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:30:20.711443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f70107ab-6b20-4c29-bc4b-7d682ffb83b0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:20.717052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f70107ab-6b20-4c29-bc4b-7d682ffb83b0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:20.778003 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1907a3af-7869-434c-98f4-4e517b46fd8f tempest-ServersTestManualDisk-511455831 tempest-ServersTestManualDisk-511455831-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203217089" status: 202 len: 0 microversion: 2.1 time: 0.097742 Jul 25 16:30:20.779997 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2278/4537] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203217089 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:30:21.116395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f70107ab-6b20-4c29-bc4b-7d682ffb83b0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:21.136621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:21.142144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:21.159096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f70107ab-6b20-4c29-bc4b-7d682ffb83b0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:21.164265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f70107ab-6b20-4c29-bc4b-7d682ffb83b0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:21.171052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f70107ab-6b20-4c29-bc4b-7d682ffb83b0 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1286 microversion: 2.20 time: 0.470140 Jul 25 16:30:21.173259 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2260/4538] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:20 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1286 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:21.180196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:21.180649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:21.186229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:21.194058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:21.692379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:21.695197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:21.739902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:21.745029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:21.749129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:21.750898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:22.132445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:22.152942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30d9b22e-8b69-4a27-acd1-196a2ded8f21 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 1.021657 Jul 25 16:30:22.167103 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2279/4539] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:21 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:22.191231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:22.210435 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fa5b5a85-fef6-4293-b963-f90b7150a722 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1286 microversion: 2.1 time: 0.527860 Jul 25 16:30:22.225951 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2261/4540] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:21 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1286 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:22.360525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e5b28a8f-fd89-4970-b1e2-a1e395fc930f req-7405a2fb-2741-471b-96b8-065f6cfc7082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b606c4-5e61-4d40-a5cb-7255074efbef", "tag": "a7c9aa90-19d1-418e-a3a3-462456c58626"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:22.383833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e5b28a8f-fd89-4970-b1e2-a1e395fc930f req-7405a2fb-2741-471b-96b8-065f6cfc7082 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:22.385832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e5b28a8f-fd89-4970-b1e2-a1e395fc930f req-7405a2fb-2741-471b-96b8-065f6cfc7082 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:22.420703 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e5b28a8f-fd89-4970-b1e2-a1e395fc930f req-7405a2fb-2741-471b-96b8-065f6cfc7082 service nova] Creating event network-changed:a7c9aa90-19d1-418e-a3a3-462456c58626 for instance b2b606c4-5e61-4d40-a5cb-7255074efbef on n-h2-846219-13 Jul 25 16:30:22.431426 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e5b28a8f-fd89-4970-b1e2-a1e395fc930f req-7405a2fb-2741-471b-96b8-065f6cfc7082 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075027 Jul 25 16:30:22.437492 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2262/4541] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:22.933441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:22.934662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:22.966443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:22.967246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:22.979381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:22.980717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:23.182375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:23.184053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:23.207814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:23.208755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:23.215046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:23.215981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:24.688410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:24.715015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:24.735347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:24.736896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-62ae6ef4-6d0c-4d16-90f9-fde91330e906 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1338 microversion: 2.20 time: 2.523427 Jul 25 16:30:24.739596 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2280/4542] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:22 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1338 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:24.747175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:24.748241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:24.759679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:24.760552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:24.761851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:24.762485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:25.606400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:25.639974 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2905229e-3858-4f00-9cbf-8b6bf811be71 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 0.895334 Jul 25 16:30:25.642111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2281/4543] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:24 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:25.690652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:25.712412 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a1691ac5-732e-44cc-a1bb-126c51bccc1b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 2.535867 Jul 25 16:30:25.715817 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2263/4544] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:23 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:25.788845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:25.789582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:25.798155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:25.800893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:25.803406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:25.811139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:26.157043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:26.175428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:26.176970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:26.178185 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f03346b-4629-43af-886f-840b6a54ecd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1344 microversion: 2.20 time: 0.397922 Jul 25 16:30:26.178768 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2282/4545] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:25 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1344 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:26.668143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:26.669314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:26.688483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:26.689772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:26.692212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:26.694830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:26.766408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:26.767788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:26.813459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:26.814484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:26.819762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:26.820290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:27.650032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:27.669378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1556468d-c2ac-41f8-ba82-d25d6470aafe tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 1.009958 Jul 25 16:30:27.670332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2264/4546] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:26 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:27.678006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:27.708220 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-84b4c8ae-971d-46f3-ad4e-fe8b63c5a388 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 0.968981 Jul 25 16:30:27.712155 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2283/4547] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:26 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:27.731162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:27.732152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:27.743210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:27.743973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:27.745519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:27.746092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:27.898928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:27.918361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:27.920125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:27.921370 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35de93cc-7812-45ef-834b-6dd540d1b953 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1344 microversion: 2.20 time: 0.205964 Jul 25 16:30:27.922082 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2284/4548] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:27 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1344 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:28.218914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Calling method '.version_select at 0x7f9da046edc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:28.221835 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:30:28.221835 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:30:28.227148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.228370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:28.285641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.286694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:28.334845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.336021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:28.370285 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5ce17d2b-8a27-45fc-8461-a9c123082c61 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1269480735-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.696818 Jul 25 16:30:28.371448 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2265/4549] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:30:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:28.694174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:28.694816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:28.697503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:28.698207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:28.715385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.715923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:28.717031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.717588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:28.733589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:28.734422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:28.743357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.745890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:28.747081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:28.748750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:30.383055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:30.411684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:30.436055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2075a4cc-08ad-4526-9619-f6bd57042b38 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 1.741903 Jul 25 16:30:30.464778 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2285/4550] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:28 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:30.473944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:30.492223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:30.496685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:30.498356 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-339999b9-fbda-44c2-a45a-611e5e083ea8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 1.768985 Jul 25 16:30:30.514154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2266/4551] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:28 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:30.524825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-52ac8981-405d-4ad9-b696-a551744300a2 req-5f746428-2248-428b-95be-cc35f26e897e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b70365f-f3e7-4685-ad55-233298921bf2", "tag": "9240e177-9cc2-4b61-8bc0-a3b6fe24f7d3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:30.532675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:30.544667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-52ac8981-405d-4ad9-b696-a551744300a2 req-5f746428-2248-428b-95be-cc35f26e897e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:30.545450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-52ac8981-405d-4ad9-b696-a551744300a2 req-5f746428-2248-428b-95be-cc35f26e897e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:30.556735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:30.560138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:30.566696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:30.574800 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-52ac8981-405d-4ad9-b696-a551744300a2 req-5f746428-2248-428b-95be-cc35f26e897e service nova] Creating event network-changed:9240e177-9cc2-4b61-8bc0-a3b6fe24f7d3 for instance 7b70365f-f3e7-4685-ad55-233298921bf2 on n-h1-846219-13 Jul 25 16:30:30.575789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:30.582739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-52ac8981-405d-4ad9-b696-a551744300a2 req-5f746428-2248-428b-95be-cc35f26e897e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066480 Jul 25 16:30:30.583962 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2267/4552] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:30.594472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9d282cad-c8a7-4f11-9026-bf5232130c5e req-b0caa752-53fd-4d0f-a275-989f7af924d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b606c4-5e61-4d40-a5cb-7255074efbef", "name": "network-vif-plugged", "status": "completed", "tag": "a7c9aa90-19d1-418e-a3a3-462456c58626"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:30.616005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9d282cad-c8a7-4f11-9026-bf5232130c5e req-b0caa752-53fd-4d0f-a275-989f7af924d2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:30.616836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9d282cad-c8a7-4f11-9026-bf5232130c5e req-b0caa752-53fd-4d0f-a275-989f7af924d2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:30.661479 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9d282cad-c8a7-4f11-9026-bf5232130c5e req-b0caa752-53fd-4d0f-a275-989f7af924d2 service nova] Creating event network-vif-plugged:a7c9aa90-19d1-418e-a3a3-462456c58626 for instance b2b606c4-5e61-4d40-a5cb-7255074efbef on n-h2-846219-13 Jul 25 16:30:30.671183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:30.680786 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9d282cad-c8a7-4f11-9026-bf5232130c5e req-b0caa752-53fd-4d0f-a275-989f7af924d2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094741 Jul 25 16:30:30.684337 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2268/4553] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:31.510569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:31.523849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:31.537154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:31.544950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:31.548560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:31.551225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:31.551898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:32.579150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:32.620480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:32.627381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:32.636961 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07f2531b-d5f2-4087-88a7-71abf421d2d7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 2.162142 Jul 25 16:30:32.638536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2286/4554] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:30 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:32.660875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:32.670402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:32.706657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:32.707442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:32.708915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:32.714685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:33.248871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:33.283457 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fd41430c-19bc-43ae-8e91-c65b208cf9ab tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 1.797850 Jul 25 16:30:33.288342 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2269/4555] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:31 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:33.698201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:33.701043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:33.727811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:33.734171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:33.738037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:33.740726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:34.882200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:34.911005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:34.914019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:34.925032 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae677e61-650a-4d27-bb55-da61cd4622c4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.244275 Jul 25 16:30:34.932727 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2270/4556] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:33 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:34.940405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89372e19-681e-4961-9cd1-22e2749d3738 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'create', calling method: .version_select at 0x7f9d93a57040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-937675052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhaMOvqcAR1QMca3xdAQL9fZ4kcjrPnMz9GtTRGU9q9ZGyTuuLSVErRyxCTr9yEcoge/dOSUBfHAMFJYceVb1/XPj6sZhLy+RtRQdZ4CSZn7qkx5bVZnVZM3ru30tKmEw=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:35.007984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-89372e19-681e-4961-9cd1-22e2749d3738 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:35.032085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-89372e19-681e-4961-9cd1-22e2749d3738 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for user 0333f8e4e1e54bcda08bce44f79fbc9c and project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:35.114711 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89372e19-681e-4961-9cd1-22e2749d3738 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.176358 Jul 25 16:30:35.122295 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2271/4557] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:30:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:35.147664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:35.150068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:35.168229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:35.169916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:35.173325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:35.174190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:35.194650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:35.249751 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e516fe07-616d-407d-a714-7d62cbd791d7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1371 microversion: 2.1 time: 2.584781 Jul 25 16:30:35.253932 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2287/4558] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:32 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1371 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:35.991334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:35.993163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:36.011160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:36.011909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:36.015155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:36.021441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:36.756517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:36.773025 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e32e12b-863b-4b00-9d2a-43d39c25e204 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 1.644351 Jul 25 16:30:36.776172 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2272/4559] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:35 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:36.782445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:36.783877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:36.797254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:36.797990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:36.799003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:36.799759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:37.168130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:37.209966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:37.214018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:37.216943 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2119d9b0-5dec-43fb-979c-4a25b315195c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.239296 Jul 25 16:30:37.232175 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2288/4560] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:35 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:37.814017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:37.815039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:37.839230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:37.840503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:37.845435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:37.846195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:38.666661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:38.695165 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec80a3b7-8601-46ca-8e18-6918407d9a40 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1561 microversion: 2.1 time: 1.915895 Jul 25 16:30:38.698316 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2273/4561] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:36 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1561 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:38.719006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:38.722644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:38.741051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:38.742246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:38.743899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:38.744944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:39.715135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:39.760707 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5816b21-8c87-441b-ad57-7dcc3fae8424 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 1.940720 Jul 25 16:30:39.766571 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2289/4562] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:37 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:39.794795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-004dcda3-c9b3-47a8-beb2-b3db633ce5a5 req-033efe67-971d-48d0-9cd9-47bf334faf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:39.819270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:39.864223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-004dcda3-c9b3-47a8-beb2-b3db633ce5a5 req-033efe67-971d-48d0-9cd9-47bf334faf9d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:39.865981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-004dcda3-c9b3-47a8-beb2-b3db633ce5a5 req-033efe67-971d-48d0-9cd9-47bf334faf9d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:39.921114 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-004dcda3-c9b3-47a8-beb2-b3db633ce5a5 req-033efe67-971d-48d0-9cd9-47bf334faf9d service nova] Creating event network-changed:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h2-846219-13 Jul 25 16:30:39.979530 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-004dcda3-c9b3-47a8-beb2-b3db633ce5a5 req-033efe67-971d-48d0-9cd9-47bf334faf9d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190669 Jul 25 16:30:39.982176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2290/4563] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:40.006918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:40.013159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:40.051510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:40.053335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:40.056934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:40.061910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:40.432924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:40.458600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:40.464617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:40.468801 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bffb193e-0f3b-4cc8-846e-37a799b8454a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.764339 Jul 25 16:30:40.501297 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2274/4564] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:38 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:40.817976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:40.819872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:40.869301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:40.870346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:40.872023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:40.872888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:41.302217 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-88a67267-1437-4676-b9e2-cdf1729b3cdf tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.291131 Jul 25 16:30:41.303670 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2291/4565] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:30:39 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-interface => generated 285 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:41.513089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:41.519243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:41.558929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:41.560293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:41.562392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:41.568844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:44.586907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:44.662582 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-028fe639-ebc6-418a-8017-9b0c0d3a9605 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 3.860342 Jul 25 16:30:44.697335 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2275/4566] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:40 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 3897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:44.705363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:44.719373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-1d2d367a-046e-4968-b9f7-61ddd8cfb944 req-ac2ee145-7cd5-44e9-ba3a-7937cfc1f628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b70365f-f3e7-4685-ad55-233298921bf2", "name": "network-vif-plugged", "status": "completed", "tag": "9240e177-9cc2-4b61-8bc0-a3b6fe24f7d3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:44.748842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:44.752961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1d2d367a-046e-4968-b9f7-61ddd8cfb944 req-ac2ee145-7cd5-44e9-ba3a-7937cfc1f628 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:44.757729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:44.764231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-1d2d367a-046e-4968-b9f7-61ddd8cfb944 req-ac2ee145-7cd5-44e9-ba3a-7937cfc1f628 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:44.766242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c846240-d577-4d48-b21e-504ed6af1128 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 3.261425 Jul 25 16:30:44.770312 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2292/4567] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:41 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 3267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:44.806804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-1d2d367a-046e-4968-b9f7-61ddd8cfb944 req-ac2ee145-7cd5-44e9-ba3a-7937cfc1f628 service nova] Creating event network-vif-plugged:9240e177-9cc2-4b61-8bc0-a3b6fe24f7d3 for instance 7b70365f-f3e7-4685-ad55-233298921bf2 on n-h1-846219-13 Jul 25 16:30:44.826321 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-1d2d367a-046e-4968-b9f7-61ddd8cfb944 req-ac2ee145-7cd5-44e9-ba3a-7937cfc1f628 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124352 Jul 25 16:30:44.827289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2276/4568] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:45.708229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:45.712528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:45.753184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:45.754808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:45.757697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:45.758539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:45.834479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:45.841497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:45.871390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:45.875744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:45.881266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:45.889529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:45.890588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:46.710710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:46.808019 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-109ae3bc-9fbc-40c2-902d-634e40280cd2 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1328 microversion: 2.1 time: 1.100745 Jul 25 16:30:46.861047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2293/4569] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:45 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1328 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:47.276931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:47.285371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=89 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:47.318437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:47.327291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:47.330876 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-58b8263d-b9e1-4999-88c8-3ecbad1d49f6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.521148 Jul 25 16:30:47.332628 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2277/4570] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:45 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:47.438438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-641415327", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "4a8613e8-3d5d-4c7e-841d-39db90e38a0b"}], "key_name": "tempest-TestNetworkBasicOps-937675052", "security_groups": [{"name": "tempest-secgroup-smoke-243200346"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:47.863689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:47.864722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:47.876843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:47.881698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:47.883758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:47.884811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:48.427071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] validate_networks() for [('4a8613e8-3d5d-4c7e-841d-39db90e38a0b', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:30:48.977800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:48.996188 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-494cb8f5-abde-4d19-a991-c9dae8081afc tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1524 microversion: 2.1 time: 1.137873 Jul 25 16:30:48.996864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2278/4571] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:47 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1524 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:49.014258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:49.015034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:49.040429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:49.042554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:49.045895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:49.046781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.402704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:30:50.405142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:30:50.406197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:30:50.408363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:30:50.410275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:30:50.444385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:50.446091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.448731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:50.450250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.507902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:50.530087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for user 0333f8e4e1e54bcda08bce44f79fbc9c and project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:50.571016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:30:50.579405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:30:50.747858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:50.765610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:50.790945 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d095638-0b38-41dc-a297-e5d3d5f76f4e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.356766 Jul 25 16:30:50.794893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:50.796647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1647d95-3f5f-4895-b512-4c1f37015548 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.798603 Jul 25 16:30:50.797372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2279/4572] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:48 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:50.829242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:50.832194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:50.836469 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2294/4573] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:30:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 3404 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:30:50.860946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-206d24bb-42a7-4290-83d7-0d932acec5b9 req-0d26676a-0425-414d-9b12-aa1603cf8f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "name": "network-vif-plugged", "status": "completed", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:50.863616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:50.864359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.865505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:50.866205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.924676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-206d24bb-42a7-4290-83d7-0d932acec5b9 req-0d26676a-0425-414d-9b12-aa1603cf8f7b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:50.937195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-206d24bb-42a7-4290-83d7-0d932acec5b9 req-0d26676a-0425-414d-9b12-aa1603cf8f7b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.959341 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] HTTP exception thrown: Instance is not a member of specified network Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Request method failure captured: Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2/ips/invalid HTTP/1.1 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sUUwqNr7nBKDlcdAXdkSFwJCUXwRXS3Wt3w5JVCVGHnhh00RTvM8_qnysJTlevllGn_IBmZ3yW14ZyI0HrzOQV9J8ZF7sKK2CJQodboepleXuQwKYJXDeDaV4hX-kuvOURMjwd0YewDWyCPrrevn_I8MkN_Wa1M9erXXw4yZIQQZ5Y Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 9478176ed4b7485b838e50afe057fb75 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9478176ed4b7485b838e50afe057fb75"}]}] Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 9478176ed4b7485b838e50afe057fb75 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerAddressesNegativeTestJSON-1379164691-project Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2c1c8bb2f8de4a9080fe0ab102482093 Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1379164691-project Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance is not a member of specified network Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '7b70365f-f3e7-4685-ad55-233298921bf2', 'id': 'invalid'} Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 25 16:30:50.983858 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:30:50.991312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:51.001653 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a98377ef-9090-4d75-88e4-fdccd237924a tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.180156 Jul 25 16:30:51.001653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2280/4574] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:30:50 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2/ips/invalid => generated 91 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:30:51.008412 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-206d24bb-42a7-4290-83d7-0d932acec5b9 req-0d26676a-0425-414d-9b12-aa1603cf8f7b service nova] Creating event network-vif-plugged:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h2-846219-13 Jul 25 16:30:51.022478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-32886781-66a7-42e0-bb53-b83cc17cd045 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:51.023732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-32886781-66a7-42e0-bb53-b83cc17cd045 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:51.036102 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-206d24bb-42a7-4290-83d7-0d932acec5b9 req-0d26676a-0425-414d-9b12-aa1603cf8f7b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195022 Jul 25 16:30:51.037622 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2295/4575] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:51.076736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b91dc7fb-020f-4660-93c7-ddc705693a41 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:51.082153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b91dc7fb-020f-4660-93c7-ddc705693a41 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Failed to fetch instance by id 999 {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 16:30:51.083394 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b91dc7fb-020f-4660-93c7-ddc705693a41 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] HTTP exception thrown: Instance 999 could not be found. Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b91dc7fb-020f-4660-93c7-ddc705693a41 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Request method failure captured: Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sUUwqNr7nBKDlcdAXdkSFwJCUXwRXS3Wt3w5JVCVGHnhh00RTvM8_qnysJTlevllGn_IBmZ3yW14ZyI0HrzOQV9J8ZF7sKK2CJQodboepleXuQwKYJXDeDaV4hX-kuvOURMjwd0YewDWyCPrrevn_I8MkN_Wa1M9erXXw4yZIQQZ5Y Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9478176ed4b7485b838e50afe057fb75 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9478176ed4b7485b838e50afe057fb75"}]}] Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9478176ed4b7485b838e50afe057fb75 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerAddressesNegativeTestJSON-1379164691-project Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2c1c8bb2f8de4a9080fe0ab102482093 Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1379164691-project Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 999 could not be found. Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': '999'} Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 16:30:51.087141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:51.097151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b91dc7fb-020f-4660-93c7-ddc705693a41 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:51.102287 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b91dc7fb-020f-4660-93c7-ddc705693a41 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.062165 Jul 25 16:30:51.119356 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2296/4576] 10.222.0.105 () {58 vars in 1154 bytes} [Mon Jul 25 16:30:51 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:30:51.141483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:51.143052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:51.160800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.171296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.173314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.174370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.310945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:30:51.413302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32886781-66a7-42e0-bb53-b83cc17cd045 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:51.432974 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-32886781-66a7-42e0-bb53-b83cc17cd045 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1251 microversion: 2.1 time: 0.431045 Jul 25 16:30:51.446456 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2281/4577] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:50 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1251 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:51.672494 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f6d4dac-88f7-4045-809f-c0b8f8fbefd4 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 204 len: 0 microversion: 2.1 time: 0.548457 Jul 25 16:30:51.675301 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2297/4578] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:30:51 2022] DELETE /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:30:51.707289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:51.739230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:51.837591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:51.841972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:51.863926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.867736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.874160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.880035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.881717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.887289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.890457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.891034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.354565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.385973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d88af61d-9ffc-4e8c-9052-3d16e67569a3 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1530 microversion: 2.1 time: 1.702097 Jul 25 16:30:53.400753 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2282/4579] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:51 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1530 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:53.425653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:53.426825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:53.439356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:53.440079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.441221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.443265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:53.444173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.476234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.483100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.495408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cdc27373-e9aa-4da7-a5ec-482ae68976d5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.665420 Jul 25 16:30:53.496659 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2298/4580] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:51 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:53.770873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.786752 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6a846b31-9891-44c9-8a68-373505a035c5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1255 microversion: 2.1 time: 0.380646 Jul 25 16:30:53.803021 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2283/4581] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:53 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1255 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:54.165732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e6b4bcb4-7b28-4f04-804e-23b458308fb0 req-1cf0f06b-0b26-4fe5-942e-82a200f38ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b606c4-5e61-4d40-a5cb-7255074efbef", "tag": "a7c9aa90-19d1-418e-a3a3-462456c58626"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:54.191346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e6b4bcb4-7b28-4f04-804e-23b458308fb0 req-1cf0f06b-0b26-4fe5-942e-82a200f38ef3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.193227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e6b4bcb4-7b28-4f04-804e-23b458308fb0 req-1cf0f06b-0b26-4fe5-942e-82a200f38ef3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.228554 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e6b4bcb4-7b28-4f04-804e-23b458308fb0 req-1cf0f06b-0b26-4fe5-942e-82a200f38ef3 service nova] Creating event network-changed:a7c9aa90-19d1-418e-a3a3-462456c58626 for instance b2b606c4-5e61-4d40-a5cb-7255074efbef on n-h2-846219-13 Jul 25 16:30:54.242737 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e6b4bcb4-7b28-4f04-804e-23b458308fb0 req-1cf0f06b-0b26-4fe5-942e-82a200f38ef3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084222 Jul 25 16:30:54.244722 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2299/4582] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:54.452808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:54.459298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:54.516028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.517898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.518772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.520906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.548963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:54.553344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:54.605899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.606552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.609763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.610923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.018734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:55.034120 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c896cac5-3f21-4382-89c3-347d265f49fb tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1530 microversion: 2.1 time: 0.588664 Jul 25 16:30:55.052081 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2284/4583] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:54 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1530 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:55.060143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:55.062279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:55.078210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:55.079357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.081133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:55.082094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.424223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:55.461734 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cc2a916b-d46e-422f-86fb-4080de027658 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1309 microversion: 2.1 time: 0.395104 Jul 25 16:30:55.463483 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2285/4584] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:55 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:55.509026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9297ccdb-1942-4397-9892-24b90b36a2a6 req-75163dbe-6f86-45da-a270-18b39055a4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b70365f-f3e7-4685-ad55-233298921bf2", "name": "network-vif-deleted", "tag": "9240e177-9cc2-4b61-8bc0-a3b6fe24f7d3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:55.546186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9297ccdb-1942-4397-9892-24b90b36a2a6 req-75163dbe-6f86-45da-a270-18b39055a4a9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:55.551452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9297ccdb-1942-4397-9892-24b90b36a2a6 req-75163dbe-6f86-45da-a270-18b39055a4a9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.576851 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9297ccdb-1942-4397-9892-24b90b36a2a6 req-75163dbe-6f86-45da-a270-18b39055a4a9 service nova] Creating event network-vif-deleted:9240e177-9cc2-4b61-8bc0-a3b6fe24f7d3 for instance 7b70365f-f3e7-4685-ad55-233298921bf2 on n-h1-846219-13 Jul 25 16:30:55.598896 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9297ccdb-1942-4397-9892-24b90b36a2a6 req-75163dbe-6f86-45da-a270-18b39055a4a9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098573 Jul 25 16:30:55.605879 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2286/4585] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:55.728494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:55.739619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:55.751403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:55.757446 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94067884-dcad-47a8-ae43-eac43c4a0bb6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1411 microversion: 2.20 time: 1.219451 Jul 25 16:30:55.760525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2300/4586] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:54 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1411 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:56.066157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:56.067491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:56.108583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:56.130351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-948838553", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:56.131059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:56.133420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:56.133643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:56.422548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:56.423402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:56.424269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lazy-loading 'fault' on Instance uuid 7b70365f-f3e7-4685-ad55-233298921bf2 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:30:56.451950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] validate_networks() for [('5e408c88-a0a2-4658-b8a5-2f3e328e519b', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:30:57.135708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1c8bb2f8de4a9080fe0ab102482093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9478176ed4b7485b838e50afe057fb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:57.148438 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7313448-092b-4bc0-bbcc-18677faffa23 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 200 len: 1318 microversion: 2.1 time: 1.087589 Jul 25 16:30:57.151332 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2301/4587] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:56 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 1318 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:57.163160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:57.164463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:57.199696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.201400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.203376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.211979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.588541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:57.603057 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3645c86d-b8c4-483d-87ae-f2ee188a9ac5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1309 microversion: 2.1 time: 0.450287 Jul 25 16:30:57.606440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2302/4588] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:57 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1309 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:57.632067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:57.640287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:57.675211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.676372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.682117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.683270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:58.668976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:58.687620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:58.692299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:58.700932 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-990b32f3-cde0-4504-9d94-66e8756de39f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1603 microversion: 2.20 time: 1.088894 Jul 25 16:30:58.705588 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2303/4589] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:30:57 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1603 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:58.727361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:58.728856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] [instance: 7b70365f-f3e7-4685-ad55-233298921bf2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:58.749408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:58.751405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:58.755662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:58.756665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:58.812515 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] HTTP exception thrown: Instance 7b70365f-f3e7-4685-ad55-233298921bf2 could not be found. Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Request method failure captured: Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 HTTP/1.1 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sUUwqNr7nBKDlcdAXdkSFwJCUXwRXS3Wt3w5JVCVGHnhh00RTvM8_qnysJTlevllGn_IBmZ3yW14ZyI0HrzOQV9J8ZF7sKK2CJQodboepleXuQwKYJXDeDaV4hX-kuvOURMjwd0YewDWyCPrrevn_I8MkN_Wa1M9erXXw4yZIQQZ5Y Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9478176ed4b7485b838e50afe057fb75 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9478176ed4b7485b838e50afe057fb75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9478176ed4b7485b838e50afe057fb75"}]}] Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9478176ed4b7485b838e50afe057fb75 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1379164691 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerAddressesNegativeTestJSON-1379164691-project Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2c1c8bb2f8de4a9080fe0ab102482093 Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1379164691-project Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 7b70365f-f3e7-4685-ad55-233298921bf2 could not be found. Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '7b70365f-f3e7-4685-ad55-233298921bf2'} Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b70365f-f3e7-4685-ad55-233298921bf2 could not be found. Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b70365f-f3e7-4685-ad55-233298921bf2 could not be found. Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:58.817455 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b70365f-f3e7-4685-ad55-233298921bf2 could not be found. Jul 25 16:30:58.829800 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:30:58.837127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] Returning 404 to user: Instance 7b70365f-f3e7-4685-ad55-233298921bf2 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:58.837127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06b3a274-70e4-4d8b-85cb-5ba0997b9190 tempest-ServerAddressesNegativeTestJSON-1379164691 tempest-ServerAddressesNegativeTestJSON-1379164691-project] 10.222.0.105 "GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2" status: 404 len: 111 microversion: 2.1 time: 0.126422 Jul 25 16:30:58.837127 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2304/4590] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:58 2022] GET /compute/v2.1/servers/7b70365f-f3e7-4685-ad55-233298921bf2 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:30:58.860875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:58.861827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:58.886509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:58.888870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:58.894448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:58.895551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:59.319567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:59.324610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:59.362343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-203be66e-fc93-4108-be20-407a9617c30e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1309 microversion: 2.1 time: 0.524549 Jul 25 16:30:59.363670 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2305/4591] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:58 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1309 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:59.379399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:59.380380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:59.417164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:30:59.418006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:30:59.418827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:30:59.420996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:30:59.422099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:59.422464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:30:59.426658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:59.428352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:59.432892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:59.467940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:59.469531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:59.471773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:59.473005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:59.533816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Getting quotas for project 8f4fdab9f1c54ab590403f8b27ad21ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:59.547619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Getting quotas for user 10d8d2a8492d43508a7c69671a819808 and project 8f4fdab9f1c54ab590403f8b27ad21ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:59.585154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:30:59.603407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:30:59.641385 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15e5d880-260b-463c-b97e-4e6b822257f4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.275952 Jul 25 16:30:59.642074 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2306/4592] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:30:59 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:30:59.713218 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e876b52c-f0a4-4c68-aa57-12e0a30dda77 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.876266 Jul 25 16:30:59.715345 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2287/4593] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:30:55 2022] POST /compute/v2.1/servers => generated 385 bytes in 3880 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:30:59.733133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe308e34-811b-4b6f-bd8e-f2ad46da2fb9 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:59.733955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe308e34-811b-4b6f-bd8e-f2ad46da2fb9 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:00.445256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:00.446858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:00.478661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:00.480002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:00.486903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:00.488263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:00.492405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:00.555425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:00.964455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fe308e34-811b-4b6f-bd8e-f2ad46da2fb9 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:00.995346 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe308e34-811b-4b6f-bd8e-f2ad46da2fb9 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1226 microversion: 2.1 time: 1.262014 Jul 25 16:31:01.013135 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2307/4594] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:30:59 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1226 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:01.368823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:01.391009 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9f39d34-992f-4168-b5da-eaaa62e1da41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1309 microversion: 2.1 time: 0.998475 Jul 25 16:31:01.398229 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2288/4595] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:00 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1309 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:02.039516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:02.044233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:02.136969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:02.142982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:02.143877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:02.144338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:02.399040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:02.416388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2a8ad72-f8ec-4fb8-b920-01ee4e98eccb tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1278 microversion: 2.1 time: 0.392857 Jul 25 16:31:02.440990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:02.443304 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2308/4596] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:02 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1278 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:02.446013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:02.450451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:02.486587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:02.487612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:02.490240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:02.491405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:03.331570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:03.369843 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c31d7942-77ec-405a-b85d-a55712c0327e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 0.933241 Jul 25 16:31:03.372369 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2289/4597] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:02 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:03.465435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:03.470375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:03.495810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:03.497244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:03.499149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:03.500448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:03.718597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:03.751629 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8695428-d9bf-4532-ad8e-e0d8cdee21bc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1284 microversion: 2.1 time: 0.303963 Jul 25 16:31:03.789791 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2309/4598] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:03 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1284 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:04.405621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:04.406799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:04.432848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.433830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.435300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.436136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.789769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:04.791584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:04.811110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.812178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.813356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.814051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:06.176763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:06.205774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a28f99c0-2f49-4aa4-bf66-130ea3f0cb86 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 1.808066 Jul 25 16:31:06.206530 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2290/4599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:04 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:06.499734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ab5d5972-4417-4443-bb51-86543ed13ce6 req-3cb9c299-4826-4ed2-b69f-4aaf0d192d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a634a854-b117-4bff-9846-b4be4e94c51f", "tag": "963a5bb9-2d4c-463c-9fb6-372140d1d033"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:06.529895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ab5d5972-4417-4443-bb51-86543ed13ce6 req-3cb9c299-4826-4ed2-b69f-4aaf0d192d06 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:06.530714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ab5d5972-4417-4443-bb51-86543ed13ce6 req-3cb9c299-4826-4ed2-b69f-4aaf0d192d06 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:06.583409 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ab5d5972-4417-4443-bb51-86543ed13ce6 req-3cb9c299-4826-4ed2-b69f-4aaf0d192d06 service nova] Creating event network-changed:963a5bb9-2d4c-463c-9fb6-372140d1d033 for instance a634a854-b117-4bff-9846-b4be4e94c51f on n-h1-846219-13 Jul 25 16:31:06.590246 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ab5d5972-4417-4443-bb51-86543ed13ce6 req-3cb9c299-4826-4ed2-b69f-4aaf0d192d06 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094527 Jul 25 16:31:06.591631 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2291/4600] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:06.646618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:06.677729 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59644690-ea76-4aa2-8c94-0b9f7a3a414a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 1.891927 Jul 25 16:31:06.681137 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2310/4601] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:04 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:07.230503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:07.231430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:07.247153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.247680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.249282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.251925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.717677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:07.723329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:07.741969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.743796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.745823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.747034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:08.176984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:08.189897 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25e69ed0-c125-4549-8140-10ef412fbfe7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 0.963569 Jul 25 16:31:08.190880 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2292/4602] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:07 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:08.198698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-156f10d5-47d5-4cd5-8bfa-fd3e38a6f0d2 req-73ed6567-1aa9-443d-992c-d797bcc76909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:08.224696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-156f10d5-47d5-4cd5-8bfa-fd3e38a6f0d2 req-73ed6567-1aa9-443d-992c-d797bcc76909 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:08.228018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-156f10d5-47d5-4cd5-8bfa-fd3e38a6f0d2 req-73ed6567-1aa9-443d-992c-d797bcc76909 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:08.249560 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-156f10d5-47d5-4cd5-8bfa-fd3e38a6f0d2 req-73ed6567-1aa9-443d-992c-d797bcc76909 service nova] Creating event network-changed:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h2-846219-13 Jul 25 16:31:08.275319 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-156f10d5-47d5-4cd5-8bfa-fd3e38a6f0d2 req-73ed6567-1aa9-443d-992c-d797bcc76909 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081033 Jul 25 16:31:08.287633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2293/4603] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:08.449816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:08.473992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3675a253-7252-467c-87af-6df36f4dfe31 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.767870 Jul 25 16:31:08.478094 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2311/4604] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:07 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:09.220755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:09.221876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:09.239037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:09.246907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:09.248906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:09.249607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:09.494496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:09.504780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:09.506703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:09.515780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:09.517848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:09.519132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:09.519933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:09.564245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:10.295711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:10.335267 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fe978b4-1fce-4a0d-b25a-fb91fcb00810 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 1.117405 Jul 25 16:31:10.361715 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2294/4605] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:09 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:10.372193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0a7cd3ae-86a2-4ade-829f-f34a9b9056f3 req-ec4d8678-767d-422f-86be-ed5fc243c549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:10.388906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a7cd3ae-86a2-4ade-829f-f34a9b9056f3 req-ec4d8678-767d-422f-86be-ed5fc243c549 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:10.390161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a7cd3ae-86a2-4ade-829f-f34a9b9056f3 req-ec4d8678-767d-422f-86be-ed5fc243c549 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:10.410432 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0a7cd3ae-86a2-4ade-829f-f34a9b9056f3 req-ec4d8678-767d-422f-86be-ed5fc243c549 service nova] Creating event network-changed:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:31:10.423768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0a7cd3ae-86a2-4ade-829f-f34a9b9056f3 req-ec4d8678-767d-422f-86be-ed5fc243c549 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058598 Jul 25 16:31:10.425328 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2295/4606] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:10.451236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:10.492112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02383def-70a5-4c4e-b224-9159564450d7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.995823 Jul 25 16:31:10.493308 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2312/4607] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:09 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:11.382409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:11.384811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:11.430484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.431720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.433824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.435181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.520379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:11.521147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:11.524366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:11.538437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:11.545250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.545827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.546721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.547237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:12.931947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:12.944998 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d640962-f09b-4eec-803f-9fb6d97ea2df tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 1.580788 Jul 25 16:31:12.946164 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2296/4608] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:11 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:12.988395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:13.000673 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4032c038-5467-4a5c-8ee7-594b757c2425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 1.484011 Jul 25 16:31:13.017918 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2313/4609] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:11 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:13.981590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:13.982244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:13.994429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:13.994884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:13.995690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:13.996123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:14.025035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:14.026397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:14.047936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:14.048740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:14.051959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:14.052650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:14.740730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:14.753908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b32c886-e17e-416f-9d5e-b14f5cdca5cd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 0.776977 Jul 25 16:31:14.775876 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2297/4610] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:13 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:14.783788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:14.784867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:14.793970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:14.794927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:14.796488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:14.797218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:14.839647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-128ea69e-8642-4382-95f7-dda4255e5b41 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/ips" status: 200 len: 149 microversion: 2.1 time: 0.061784 Jul 25 16:31:14.840993 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2298/4611] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:31:14 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/ips => generated 149 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:14.873673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:14.895548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e4ef29a-bc82-4a4c-bb87-8d30761c3869 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.874124 Jul 25 16:31:14.898908 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2314/4612] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:14 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:15.265998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d47b4678-4241-4c19-b53b-f7f0cdfbbdad req-a32165b2-cc92-473e-afc0-8676b28969e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a634a854-b117-4bff-9846-b4be4e94c51f", "name": "network-vif-plugged", "status": "completed", "tag": "963a5bb9-2d4c-463c-9fb6-372140d1d033"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:15.288821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d47b4678-4241-4c19-b53b-f7f0cdfbbdad req-a32165b2-cc92-473e-afc0-8676b28969e2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.289376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d47b4678-4241-4c19-b53b-f7f0cdfbbdad req-a32165b2-cc92-473e-afc0-8676b28969e2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.330774 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d47b4678-4241-4c19-b53b-f7f0cdfbbdad req-a32165b2-cc92-473e-afc0-8676b28969e2 service nova] Creating event network-vif-plugged:963a5bb9-2d4c-463c-9fb6-372140d1d033 for instance a634a854-b117-4bff-9846-b4be4e94c51f on n-h1-846219-13 Jul 25 16:31:15.345726 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d47b4678-4241-4c19-b53b-f7f0cdfbbdad req-a32165b2-cc92-473e-afc0-8676b28969e2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083892 Jul 25 16:31:15.346386 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2299/4613] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:15.781000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:15.781729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:15.795620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.798632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.799731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.800429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.922232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:15.923837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:15.945037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.948051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.952068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.952955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.959866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:16.239343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:16.254002 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e27fd5b-9e7c-4efa-ad56-608b40246f41 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 0.475781 Jul 25 16:31:16.276103 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2315/4614] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:15 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:16.526793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:16.544561 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-964e7691-e8e4-43b5-a787-e7d0403dda70 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.626893 Jul 25 16:31:16.558432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2300/4615] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:15 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:17.293978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:17.296066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:17.310250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.310883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.311743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.312217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.571541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:17.572218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:17.588543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.589073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.590182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.591204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.269347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:18.287323 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-168ccce9-21be-47f8-abf7-3446d776b66d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 0.998047 Jul 25 16:31:18.289403 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2316/4616] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:17 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:18.320240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762f125b-8b70-4b17-a008-0c05e9a8e9f7"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:18.328035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:18.355439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:18.356418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.356987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.361856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.364490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.381608 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0da46f9d-2394-4b30-a543-f7de9757b1a5 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.807492 Jul 25 16:31:18.384716 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2301/4617] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:17 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:19.058090 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6519ed8f-b421-4909-b30a-8b96d6895e86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.751608 Jul 25 16:31:19.060297 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2317/4618] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:31:18 2022] POST /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:19.324373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:19.331727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:19.374936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:19.375568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:19.379634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:19.380107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:19.407424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:19.408191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:19.439335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:19.446624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:19.457532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:19.458567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:20.308110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:20.332181 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09a57f51-927e-4b7e-ab95-52fc44405388 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1376 microversion: 2.1 time: 1.017717 Jul 25 16:31:20.348035 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2302/4619] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:19 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1376 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:20.576671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:20.628212 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a6b6575c-384e-4e4d-95ad-84d19e6793ba tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 1.226308 Jul 25 16:31:20.646863 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2318/4620] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:19 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:21.387071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:21.388127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:21.427734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:21.428462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:21.435089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:21.454594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:21.666804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:21.667720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:21.686434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:21.686932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:21.697521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:21.699624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:22.348997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:22.366068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e9f9dbe1-fbff-4e4a-b9de-2e9cebc59ab5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1549 microversion: 2.1 time: 0.991007 Jul 25 16:31:22.377004 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2303/4621] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:21 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1549 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:22.404630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:22.406248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:22.441548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:22.442042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:22.445784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:22.446252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:22.518618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:22.536347 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b5a3496-6d94-4de6-957b-c6538dad2450 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.882755 Jul 25 16:31:22.537417 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2319/4622] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:21 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:23.089651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:23.120913 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51a9a0ee-04ce-464e-b498-b4bd055befe1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1549 microversion: 2.1 time: 0.720066 Jul 25 16:31:23.124013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2304/4623] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:22 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1549 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:23.457444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9aa941bb-4fc8-4374-a4e0-f32d3c546a33 req-37d3a0aa-1e12-4d6f-9dcb-8cf6d0ca6a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "name": "network-vif-plugged", "status": "completed", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:23.509882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9aa941bb-4fc8-4374-a4e0-f32d3c546a33 req-37d3a0aa-1e12-4d6f-9dcb-8cf6d0ca6a9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:23.512607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9aa941bb-4fc8-4374-a4e0-f32d3c546a33 req-37d3a0aa-1e12-4d6f-9dcb-8cf6d0ca6a9b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:23.562476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:23.564139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:23.588027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9aa941bb-4fc8-4374-a4e0-f32d3c546a33 req-37d3a0aa-1e12-4d6f-9dcb-8cf6d0ca6a9b service nova] Creating event network-vif-plugged:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:31:23.595642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:23.596112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:23.612190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:23.613261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:23.618929 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9aa941bb-4fc8-4374-a4e0-f32d3c546a33 req-37d3a0aa-1e12-4d6f-9dcb-8cf6d0ca6a9b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157312 Jul 25 16:31:23.620911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2320/4624] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:24.466221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:24.482893 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c231df21-7229-42c7-9f8e-894903e1e33c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.924370 Jul 25 16:31:24.486066 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2305/4625] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:23 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:25.526555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:25.528167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:25.556840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:25.557350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:25.558173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:25.565305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:26.106760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:26.119976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50c28f3b-c0f9-4cfd-8218-579ef9b1ed3c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1326 microversion: 2.1 time: 0.599179 Jul 25 16:31:26.121025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2321/4626] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:25 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1326 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:27.161352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:27.161985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:27.182012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:27.184561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:27.185739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:27.186438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:27.679621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:27.695977 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc5c2af1-f922-4695-9703-710dcea4608e tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1520 microversion: 2.1 time: 0.539786 Jul 25 16:31:27.696973 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2306/4627] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:27 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:27.719578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:27.729650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:27.743801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:27.749672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:27.750840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:27.751866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:27.807352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lazy-loading 'flavor' on Instance uuid 814cfab7-8f36-48f5-85e2-cf86629e3109 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:27.833083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:27.979222 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7c865a23-bb96-4292-a0b5-32ae2ffc98ff tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action" status: 200 len: 32 microversion: 2.1 time: 0.265062 Jul 25 16:31:27.984821 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2322/4628] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:31:27 2022] POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:31:27.991334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:27.993135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:28.014538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:28.014996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:28.015809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:28.016247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:29.076179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:29.088968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0597a5ff-f563-44a3-b46e-213b7bddba59 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.102789 Jul 25 16:31:29.097326 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2307/4629] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:27 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:30.135372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:30.151954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:30.172814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:30.173517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:30.178616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:30.179965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:31.045924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:31.066869 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-74b7977a-9f33-4353-826b-95953ca0218a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 0.949688 Jul 25 16:31:31.074483 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2323/4630] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:30 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:31.395875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:31.396488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:31.413510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:31.414165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:31.414994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:31.415436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:31.486000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-95a3af3f-913d-4212-9517-b7690071ef82 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/ips" status: 200 len: 152 microversion: 2.20 time: 0.113751 Jul 25 16:31:31.487882 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2308/4631] 10.222.0.105 () {60 vars in 1294 bytes} [Mon Jul 25 16:31:31 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/ips => generated 152 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:31:32.101710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:32.110829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:32.150012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:32.156186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:32.158042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:32.158925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:33.487893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:33.547192 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-77da59f2-cef1-44a0-a236-3a8592e39320 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.435974 Jul 25 16:31:33.565124 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2324/4632] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:32 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:34.582203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:34.582839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:34.605817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=40 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:34.608023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:34.623743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:34.626345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:34.627171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:35.589514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1601320563", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:35.689190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] validate_networks() for [('f45d589e-4aca-4e4d-8773-386621a15855', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:31:35.974345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:35.990327 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e78c0683-20fa-4cf7-a7df-6e0f09bbd2f1 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.411778 Jul 25 16:31:35.998176 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2309/4633] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:34 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:36.264268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:36.265192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:36.293536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:36.293901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:36.294706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:36.295139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:36.363327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lazy-loading 'flavor' on Instance uuid 67dfcce1-3e9e-4674-82e2-40e10fa82da5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:36.734083 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c73174f9-355e-4d21-ae84-16a82f66909b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/action" status: 202 len: 0 microversion: 2.20 time: 0.476010 Jul 25 16:31:36.742272 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2310/4634] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:31:36 2022] POST /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:31:36.756940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:36.765251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:36.790986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:36.791438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:36.792229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:36.792667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:37.682149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:37.732432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:37.758685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:37.761411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9b6ca05f-3aeb-4ebb-954f-c5c5a4b2f057 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.010484 Jul 25 16:31:37.765701 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2311/4635] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:36 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:37.774993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:37.794252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:37.832187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:37.833345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:37.834490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:37.835213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:38.595934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:38.604065 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d8977b3-2c52-4ef6-92fa-3a2677dfb2f2 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 0.836445 Jul 25 16:31:38.626372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2312/4636] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:37 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:38.631614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "762f125b-8b70-4b17-a008-0c05e9a8e9f7"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:38.634513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:38.657970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:38.658730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:38.659850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:38.660456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:38.866996 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Invalid volume: volume 762f125b-8b70-4b17-a008-0c05e9a8e9f7 is already attached to instances: b2b606c4-5e61-4d40-a5cb-7255074efbef Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments HTTP/1.1 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 74 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: {"volumeAttachment": {"volumeId": "762f125b-8b70-4b17-a008-0c05e9a8e9f7"}} Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid volume: volume 762f125b-8b70-4b17-a008-0c05e9a8e9f7 is already attached to instances: b2b606c4-5e61-4d40-a5cb-7255074efbef Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': 'b2b606c4-5e61-4d40-a5cb-7255074efbef', 'body': {'volumeAttachment': {'volumeId': '762f125b-8b70-4b17-a008-0c05e9a8e9f7'}}} Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 762f125b-8b70-4b17-a008-0c05e9a8e9f7 is already attached to instances: b2b606c4-5e61-4d40-a5cb-7255074efbef Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:31:38.876315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 762f125b-8b70-4b17-a008-0c05e9a8e9f7 is already attached to instances: b2b606c4-5e61-4d40-a5cb-7255074efbef Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 762f125b-8b70-4b17-a008-0c05e9a8e9f7 is already attached to instances: b2b606c4-5e61-4d40-a5cb-7255074efbef Jul 25 16:31:38.880469 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:31:38.888830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 400 to user: Invalid volume: volume 762f125b-8b70-4b17-a008-0c05e9a8e9f7 is already attached to instances: b2b606c4-5e61-4d40-a5cb-7255074efbef {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:31:38.890171 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3868904d-99e7-49e5-be33-53739476b156 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.262686 Jul 25 16:31:38.900552 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2313/4637] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:31:38 2022] POST /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 174 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:31:38.933739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:38.934691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:38.944503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:38.945623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:38.946842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:38.947532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.132132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:31:39.133365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:31:39.134050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:31:39.134638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:31:39.135215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:31:39.156492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:39.158663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.162953 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:39.165191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.224842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Getting quotas for project beb5133297c44d4d9c78c77e2990da44. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:31:39.238962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Getting quotas for user 27eee720955942068370ed221a5dad5e and project beb5133297c44d4d9c78c77e2990da44. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:31:39.289567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:31:39.306477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:31:39.425851 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d13a8489-f070-42f5-8436-6cda77a27ff3 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.132389 Jul 25 16:31:39.427157 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2325/4638] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:31:35 2022] POST /compute/v2.1/servers => generated 385 bytes in 4135 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:31:39.432902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:39.434129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:39.458635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:39.460032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.461470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:39.462163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.615411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lazy-loading 'services' on Instance uuid b2b606c4-5e61-4d40-a5cb-7255074efbef {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:39.725621 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ba27d94f-0387-4e94-a3a9-607037a83cb8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments/762f125b-8b70-4b17-a008-0c05e9a8e9f7" status: 202 len: 0 microversion: 2.1 time: 0.296659 Jul 25 16:31:39.726264 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2326/4639] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:31:39 2022] DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments/762f125b-8b70-4b17-a008-0c05e9a8e9f7 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:31:39.741924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f1e6f0ef-99b8-4e15-8bee-10b555d60368 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:39.744973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f1e6f0ef-99b8-4e15-8bee-10b555d60368 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:40.124667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f1e6f0ef-99b8-4e15-8bee-10b555d60368 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:40.138418 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f1e6f0ef-99b8-4e15-8bee-10b555d60368 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1218 microversion: 2.1 time: 0.407410 Jul 25 16:31:40.139349 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2327/4640] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:39 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1218 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:40.167122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:40.168339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:40.187698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:40.188203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:40.189261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:40.190190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:40.665243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:40.680804 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d57b025-30b0-4a5e-9720-714fabd69892 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 0.530349 Jul 25 16:31:40.689801 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2328/4641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:40 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:40.695996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:40.709851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:40.723630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:40.724250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:40.727093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:40.727694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:40.810745 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7ef0a5e-cd94-44ec-a910-df0bb96b8e09 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119413 Jul 25 16:31:40.813716 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2329/4642] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:40 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:41.008813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.024426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.026013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.027290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e464c25-8edd-4936-b1ea-077c5d7b043f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 2.122196 Jul 25 16:31:41.051891 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2314/4643] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:38 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:41.165117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:41.166568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:41.194434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.196046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.198314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.202358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.622951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.652457 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c5a72d7-ecc3-41d8-9b73-ce38bbb5c445 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1270 microversion: 2.1 time: 0.490099 Jul 25 16:31:41.671803 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2330/4644] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:41 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1270 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:41.712547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:41.714646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:41.767492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.771200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.772455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.785913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.830494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:41.833302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:41.839202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:41.851981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.853028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.854329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.856913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.885854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:42.003112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97fdcc58-5bd3-46de-bd15-9590fc1b6c25 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177860 Jul 25 16:31:42.007170 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2331/4645] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:41 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:42.052039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:42.053674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:42.069547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.070748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.074833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.076116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:43.496265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.531759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d261f06-8715-4366-b18d-77542bd72766 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.824753 Jul 25 16:31:43.539486 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2315/4646] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:41 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:43.563225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:43.564363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:43.595545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:43.596693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:43.598492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:43.606459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:43.659869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.671627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.686208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.688174 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67503729-c8db-4684-b6b8-6d8534770c7a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.639902 Jul 25 16:31:43.688326 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2332/4647] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:42 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:31:43.705639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:43.708090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:43.737689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:43.739393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:43.742006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:43.743125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:43.812682 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-431acb8b-a6a1-495a-b046-14b442b71b58 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122496 Jul 25 16:31:43.814352 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2333/4648] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:43 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:43.910305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.925771 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db9a994f-a0cb-4a90-8895-413788d7eea0 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1276 microversion: 2.1 time: 0.384721 Jul 25 16:31:43.926395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2316/4649] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:43 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1276 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:44.568319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:44.569237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:44.586816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:44.587531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:44.595645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:44.600256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:44.718039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:44.718941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:44.738470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:44.738927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:44.739725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:44.740165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.191656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:46.203766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:46.214117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:46.217996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:46.221506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-77177a13-e42a-4e6a-88e0-547897513772 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.653035 Jul 25 16:31:46.222757 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2334/4650] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:44 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:46.224223 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ea70df7-7f3e-46de-a86d-896802afd199 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.510992 Jul 25 16:31:46.236946 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2317/4651] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:44 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:46.243241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:46.243241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:46.252291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:46.256498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:46.265663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.266460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.267609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.268378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.279455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.281126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.283095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.288659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.332260 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-776121af-7e89-41c7-bded-fa4f4e89087c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108165 Jul 25 16:31:46.339110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2335/4652] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:46 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:47.243211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:47.243925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:47.293458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:47.294051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:47.307001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:47.310459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:47.648948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:47.684084 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61fde658-35d2-4d82-8f85-32e4a4b17488 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.445042 Jul 25 16:31:47.691558 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2318/4653] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:46 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:47.726713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:47.728828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:47.767428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:47.767919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:47.771042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:47.773517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.019908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.063242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-792b18cb-7197-4fa4-858e-344f2fe255d3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 0.811269 Jul 25 16:31:48.073005 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2336/4654] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:47 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:48.103075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:48.113629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:48.139776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.142353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.143739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.145440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.258987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ac4063d-7e35-43dc-a197-afa423343627 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179700 Jul 25 16:31:48.269410 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2337/4655] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:48 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:48.725506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:48.726337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:48.743323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.744924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.750107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.753205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.754422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.755186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.765972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.767796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57344e5c-5e67-4ffb-8e5d-6ac07a250673 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.073988 Jul 25 16:31:48.783852 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2319/4656] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:47 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:49.114794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:49.126443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:49.168440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:49.169748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:49.172500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:49.177726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:49.197185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:50.130867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:50.474672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:50.479482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:50.507519 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f25ada9f-7d37-4cd1-b007-9ad2053cb693 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.785920 Jul 25 16:31:50.530857 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2338/4657] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:48 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:50.548324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:50.558227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:50.596853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.597373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.598236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.598740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.732539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-150ee093-f10b-4382-8e87-a2263ec67aad tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199896 Jul 25 16:31:50.752988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2339/4658] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:50 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:50.763687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:50.771816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:50.809625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.811446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.813639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.815491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.892312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:50.951705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e48e5e55-0403-4634-a664-ef8d34b34425 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.845657 Jul 25 16:31:50.970113 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2320/4659] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:49 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:51.540444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:51.542599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:51.586393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.586980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:51.594244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.594992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:51.830063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:51.851940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:51.868148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:51.872238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5211dbd5-797b-45de-8323-c88fb29eb21f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.115973 Jul 25 16:31:51.897447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2340/4660] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:50 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:51.913789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:51.919613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:51.932709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.933723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:51.938591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.939876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.079283 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04473f08-5410-4ad6-aa8c-295651e790f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176055 Jul 25 16:31:52.088975 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2341/4661] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:31:51 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef/os-volume_attachments => generated 25 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:31:52.112608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:52.132995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:52.159329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.161515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.163824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.168347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.424300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:52.440879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56b4da36-eaf4-4a3c-b322-d0d987ff2f74 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 0.909964 Jul 25 16:31:52.466907 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2321/4662] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:51 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:52.475868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:52.478055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:52.492610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.493559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.494663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.495368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.541562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:31:52.771503 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c408c201-bca6-40b4-8cd0-c7aed8028847 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 204 len: 0 microversion: 2.1 time: 0.294894 Jul 25 16:31:52.775019 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2322/4663] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:31:52 2022] DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:31:52.791147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:52.791872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:52.829592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.835325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.838247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.839271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.884341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:52.896103 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2f097c2f-a9fc-4002-9ddc-0a1784224c7b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 0.787518 Jul 25 16:31:52.896801 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2342/4664] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:52 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:52.960819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:52.965472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:53.029408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.030246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.031814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.041909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.713807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.737547 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd330edc-1ba8-42e5-a56a-c86ad7a875de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1685 microversion: 2.1 time: 0.956053 Jul 25 16:31:53.737942 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2323/4665] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:52 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1685 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:53.771423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-467bfa75-c378-44f4-845f-ae519d8d6208 req-97c783be-0f7c-4a6f-818a-71ea54fac490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768f5082-c9b0-4d37-af93-90d00c08e812", "tag": "d3e6b393-3831-41aa-bf78-f87f8198c1d5"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:53.801904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.812088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-467bfa75-c378-44f4-845f-ae519d8d6208 req-97c783be-0f7c-4a6f-818a-71ea54fac490 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.812993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-467bfa75-c378-44f4-845f-ae519d8d6208 req-97c783be-0f7c-4a6f-818a-71ea54fac490 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.834512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.846363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.849738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-abe15d14-0b64-4cf3-b1da-0fd9c17d6018 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1749 microversion: 2.20 time: 0.920875 Jul 25 16:31:53.851095 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-467bfa75-c378-44f4-845f-ae519d8d6208 req-97c783be-0f7c-4a6f-818a-71ea54fac490 service nova] Creating event network-changed:d3e6b393-3831-41aa-bf78-f87f8198c1d5 for instance 768f5082-c9b0-4d37-af93-90d00c08e812 on n-h2-846219-13 Jul 25 16:31:53.877129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2343/4666] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:52 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1749 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:53.877373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-467bfa75-c378-44f4-845f-ae519d8d6208 req-97c783be-0f7c-4a6f-818a-71ea54fac490 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113798 Jul 25 16:31:53.887157 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2324/4667] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:53.887284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:53.887284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:53.904938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.906149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.909345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.911613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.923193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:53.931069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:53.965730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.967926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.969966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.970784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.708648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:54.733450 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2d9cfaf-0c34-453f-8ed8-66f3f8baa2ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 0.863165 Jul 25 16:31:54.741549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:54.755044 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2344/4668] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:53 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:54.757183 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48ac2fa9-460e-41fa-a385-193dea8c3af6 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 0.842251 Jul 25 16:31:54.763179 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2325/4669] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:53 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:54.769996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:54.771372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:54.783506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:54.784386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.785427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:54.786047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.899662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:54.900816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:54.950586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:54.954401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.956377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:54.962360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:56.771338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.837434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.840926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.848694 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c886f73b-002a-4bf9-bccd-aa8811bc72e3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1749 microversion: 2.20 time: 1.957625 Jul 25 16:31:56.870926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2326/4670] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:54 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1749 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:31:56.887836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:56.891137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:56.908215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:56.909337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:56.910397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:56.913116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.118238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:57.157037 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fbcbc9f6-20bb-47b6-a441-0137892c46ea tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1685 microversion: 2.1 time: 2.396410 Jul 25 16:31:57.163784 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2345/4671] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:54 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1685 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:57.197867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:57.201955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:57.256105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:57.258730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.267581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:57.268921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:58.122962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:58.134175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4a7ba2aa-d415-4d6b-862f-3a78e82d63e1 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.261951 Jul 25 16:31:58.144651 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2327/4672] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:56 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:58.161330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:58.178703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:58.211668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:58.221696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:58.222644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:58.223104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:59.664304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:59.679916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:59.685190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:59.695358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52615abe-bec2-4dda-b341-51fd724289e6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 1.542852 Jul 25 16:31:59.700421 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2328/4673] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:31:58 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:59.719531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:59.720851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:59.739615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:59.740350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:59.741928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:59.742755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:00.370077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:00.386568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-580a52ee-0f1b-4b67-b0a6-2efe8cec783a tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 3.211589 Jul 25 16:32:00.387994 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2346/4674] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:57 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 3219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:00.395660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-333825131", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6cfa217f-6854-4afa-8ee5-5af89129dc51", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:00.576802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:32:01.883052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:01.904968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fc7fb7f-87a1-43b7-824d-ff21c287226c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1685 microversion: 2.1 time: 2.203171 Jul 25 16:32:01.912224 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2329/4675] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:31:59 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1685 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:01.920488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-26875878-7ea3-4559-8947-7175ef214f58 req-d50f1436-e633-4100-92e5-901050a8112f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b606c4-5e61-4d40-a5cb-7255074efbef", "name": "network-vif-unplugged", "status": "completed", "tag": "a7c9aa90-19d1-418e-a3a3-462456c58626"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:01.963369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-26875878-7ea3-4559-8947-7175ef214f58 req-d50f1436-e633-4100-92e5-901050a8112f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:01.964026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-26875878-7ea3-4559-8947-7175ef214f58 req-d50f1436-e633-4100-92e5-901050a8112f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:02.012418 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-26875878-7ea3-4559-8947-7175ef214f58 req-d50f1436-e633-4100-92e5-901050a8112f service nova] Creating event network-vif-unplugged:a7c9aa90-19d1-418e-a3a3-462456c58626 for instance b2b606c4-5e61-4d40-a5cb-7255074efbef on n-h2-846219-13 Jul 25 16:32:02.034334 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-26875878-7ea3-4559-8947-7175ef214f58 req-d50f1436-e633-4100-92e5-901050a8112f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117488 Jul 25 16:32:02.038325 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2330/4676] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:02.061915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:02.072572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:02.112887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:02.119974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:02.122060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:02.126521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:02.259781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:03.039558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.066383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b721a0b-a6ab-4058-896b-ca203779df34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.020895 Jul 25 16:32:03.077172 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2331/4677] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:02 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:03.099625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:03.114093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:03.141533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.142323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.144037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.145558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.164137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:32:03.165741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:32:03.167347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:32:03.168360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:32:03.169734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:32:03.215590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.219438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.221281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.229490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.272385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:32:03.279954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:32:03.547475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:32:03.550126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cfa217f-6854-4afa-8ee5-5af89129dc51',volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:32:03.723784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.767068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.797877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.803398 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6a114ef-456d-49d9-ba5d-13c637d23723 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 0.722077 Jul 25 16:32:03.833218 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2332/4678] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:03 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:03.839196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:03.857032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:03.884801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.885326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.886148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.891794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.052842 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ba63672a-afde-4d75-ab03-a3b373e0689a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.663174 Jul 25 16:32:04.056629 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2347/4679] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:32:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 3668 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:32:04.088380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:04.108318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:04.141025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.144122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.145932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.150254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.523012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:04.552814 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e849aae-86a2-4d26-aa6a-21d36f5fa859 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1617 microversion: 2.1 time: 0.472165 Jul 25 16:32:04.574470 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2348/4680] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:04 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1617 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:04.592195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9bbdca5-9cb0-4fa5-8b07-15b0b6467378 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:04.592865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9bbdca5-9cb0-4fa5-8b07-15b0b6467378 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:04.814931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9bbdca5-9cb0-4fa5-8b07-15b0b6467378 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:04.836769 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9bbdca5-9cb0-4fa5-8b07-15b0b6467378 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1059 microversion: 2.1 time: 0.255951 Jul 25 16:32:04.842749 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2349/4681] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:04 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1059 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:04.885704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:04.886616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:04.906506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.912385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.917534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.920134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:05.114021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:05.135689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a51c90c8-0aa8-4f86-87de-f33ec38774a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1526 microversion: 2.1 time: 1.290064 Jul 25 16:32:05.153932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2333/4682] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:03 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1526 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:05.182075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9c80bff9-8867-4e7d-9b49-7977254b7c5b req-8271da65-20df-4cbd-a66e-24af7186db02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "name": "network-vif-plugged", "status": "completed", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:05.229256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:05.233371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9c80bff9-8867-4e7d-9b49-7977254b7c5b req-8271da65-20df-4cbd-a66e-24af7186db02 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.248215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9c80bff9-8867-4e7d-9b49-7977254b7c5b req-8271da65-20df-4cbd-a66e-24af7186db02 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:05.301493 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9c80bff9-8867-4e7d-9b49-7977254b7c5b req-8271da65-20df-4cbd-a66e-24af7186db02 service nova] Creating event network-vif-plugged:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h2-846219-13 Jul 25 16:32:05.320611 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9c80bff9-8867-4e7d-9b49-7977254b7c5b req-8271da65-20df-4cbd-a66e-24af7186db02 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158165 Jul 25 16:32:05.338630 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2334/4683] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:05.354827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:05.359174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:05.383555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.395055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:05.396600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.397474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.118030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.143822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-001fb40f-1404-4e04-b9ee-b301f5d348be tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.296966 Jul 25 16:32:06.149007 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2350/4684] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:04 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:06.156659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-53b4beae-15da-42e6-8eff-81991d7c1626 req-5170d332-0441-471d-93e7-ea11caeb4743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b606c4-5e61-4d40-a5cb-7255074efbef", "name": "network-vif-deleted", "tag": "a7c9aa90-19d1-418e-a3a3-462456c58626"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:06.209588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-53b4beae-15da-42e6-8eff-81991d7c1626 req-5170d332-0441-471d-93e7-ea11caeb4743 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.213168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-53b4beae-15da-42e6-8eff-81991d7c1626 req-5170d332-0441-471d-93e7-ea11caeb4743 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.274821 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-53b4beae-15da-42e6-8eff-81991d7c1626 req-5170d332-0441-471d-93e7-ea11caeb4743 service nova] Creating event network-vif-deleted:a7c9aa90-19d1-418e-a3a3-462456c58626 for instance b2b606c4-5e61-4d40-a5cb-7255074efbef on n-h2-846219-13 Jul 25 16:32:06.281411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.297021 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-53b4beae-15da-42e6-8eff-81991d7c1626 req-5170d332-0441-471d-93e7-ea11caeb4743 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139738 Jul 25 16:32:06.301703 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2351/4685] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:06.302198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.304024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.311121 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e72b44be-1def-4632-8e2b-425fb8bf3e98 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 0.970739 Jul 25 16:32:06.332496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:06.334183 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2335/4686] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:05 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:06.334361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:06.341312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:06.342377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:06.351471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.352232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.353541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.354283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.370686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.371076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.371960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.372411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.530830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.532080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.533643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lazy-loading 'fault' on Instance uuid b2b606c4-5e61-4d40-a5cb-7255074efbef {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:32:06.804048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.830550 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1bff5ba3-f5bb-4e8b-a914-87d132255871 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1157 microversion: 2.1 time: 0.493343 Jul 25 16:32:06.835204 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2336/4687] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:06 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1157 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:06.856999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:06.858291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:06.896259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.900466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.989869 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68775ce6-3976-4783-927e-3c6a74c260f8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 200 len: 1335 microversion: 2.1 time: 0.615769 Jul 25 16:32:06.989869 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2352/4688] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:06 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 1335 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:06.990172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.990172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.990172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:07.173008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:07.174288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:07.196015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:07.196528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:07.197457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:07.206540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.218898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.242769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.255953 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90406602-b122-4d02-b083-dd2c444821fa tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.088925 Jul 25 16:32:08.278734 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78c2fa44-24cc-49fe-a40c-bc7927a495ae tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1506 microversion: 2.1 time: 1.436221 Jul 25 16:32:08.291400 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2353/4689] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:07 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:08.295425 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2337/4690] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:06 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1506 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:08.311902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:08.322952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:08.330192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:08.334727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:08.347598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.348066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.348989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.353137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.354938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.356227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.357037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.359533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.602975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.620179 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9b754e3-3192-4f12-b5ec-fd6c27e97333 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1175 microversion: 2.1 time: 0.323278 Jul 25 16:32:08.626536 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2338/4691] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:08 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1175 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:08.643587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:08.646847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:08.663622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.667691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.673179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.677434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.729124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef HTTP/1.1 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b2b606c4-5e61-4d40-a5cb-7255074efbef'} Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:08.731189 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:32:08.735717 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:08.739514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:32:08.743059 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-130a372b-8fab-43fc-bb71-b82495af6b86 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 404 len: 111 microversion: 2.1 time: 0.114296 Jul 25 16:32:08.744759 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2339/4692] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:08 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:32:08.759611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-695c1bfd-57f1-4d56-8c36-eba2584488a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'create', calling method: .version_select at 0x7f9d93d0cdc0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-947285462", "description": "tempest-description-1170031694"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:08.947381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.967825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.974588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.978509 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef542553-ac25-42ed-b5df-f4afec7eaeeb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 0.685316 Jul 25 16:32:08.984709 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2354/4693] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:08 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:08.995629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f12ce5a-61f0-4a0e-b0b8-e2ea336613d5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '.version_select at 0x7f9d938f09d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:09.053548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f12ce5a-61f0-4a0e-b0b8-e2ea336613d5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360110068" status: 202 len: 0 microversion: 2.1 time: 0.066350 Jul 25 16:32:09.061323 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2355/4694] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:32:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360110068 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:09.286394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:09.287091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:09.295104 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-695c1bfd-57f1-4d56-8c36-eba2584488a7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.548372 Jul 25 16:32:09.296698 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2340/4695] 10.222.0.105 () {60 vars in 1185 bytes} [Mon Jul 25 16:32:08 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:09.313186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-947285462"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:09.313186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:09.317719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.317719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.317719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.320733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.331501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.331962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.332762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.339784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.773366 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Adding security group 0be31fc0-dd1d-4ea6-97f6-938a53ec4757 to port 9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d Jul 25 16:32:10.844074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:10.861616 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b2870fe8-d4d7-4e33-8678-e66c02acd215 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 1.576509 Jul 25 16:32:10.879253 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2356/4696] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:09 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:10.884876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:10.891958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:10.914500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:10.915394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:10.916479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:10.917219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.166847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:11.200379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78d38cb6-69a1-467f-9dbf-378eeb699272 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1175 microversion: 2.1 time: 0.319058 Jul 25 16:32:11.210461 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2357/4697] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:10 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1175 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:11.226971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-794083a1-156f-4e25-8739-103871e1abee req-f3e354e5-ed10-46fa-a2a8-00587f574114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768f5082-c9b0-4d37-af93-90d00c08e812", "name": "network-vif-plugged", "status": "completed", "tag": "d3e6b393-3831-41aa-bf78-f87f8198c1d5"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:11.302758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-794083a1-156f-4e25-8739-103871e1abee req-f3e354e5-ed10-46fa-a2a8-00587f574114 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.313935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-794083a1-156f-4e25-8739-103871e1abee req-f3e354e5-ed10-46fa-a2a8-00587f574114 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.349924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-794083a1-156f-4e25-8739-103871e1abee req-f3e354e5-ed10-46fa-a2a8-00587f574114 service nova] Creating event network-vif-plugged:d3e6b393-3831-41aa-bf78-f87f8198c1d5 for instance 768f5082-c9b0-4d37-af93-90d00c08e812 on n-h2-846219-13 Jul 25 16:32:11.358967 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-794083a1-156f-4e25-8739-103871e1abee req-f3e354e5-ed10-46fa-a2a8-00587f574114 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144122 Jul 25 16:32:11.366544 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2358/4698] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:11.379734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:11.383198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:11.404509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.405521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.409053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.410449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.416396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:12.529614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.542997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.548974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.550995 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b3d2b219-3464-4806-9d55-72331a7b501f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 1.182837 Jul 25 16:32:12.552758 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2359/4699] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:11 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:12.559501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:12.563630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:12.570524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:12.598966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.601839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.606320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.607595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.668648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:32:12.847935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-957df680-ee8f-4d5e-8956-6807b7bb2be8 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action" status: 202 len: 0 microversion: 2.1 time: 3.541408 Jul 25 16:32:12.849325 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2341/4700] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:32:09 2022] POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action => generated 0 bytes in 3544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:12.860259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:12.868998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:12.926318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.929741 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fb313c63-4e1b-4a09-9fe1-136f3bf433ea tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "DELETE /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 204 len: 0 microversion: 2.1 time: 0.366688 Jul 25 16:32:12.933212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2360/4701] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:32:12 2022] DELETE /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:12.945858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:12.947214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.949747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:12.949920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.951089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.964413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.965561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.966645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.969894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.257253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:13.812011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:13.832946 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0745a3e-421d-4e6c-bf07-0fa64f699158 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1318 microversion: 2.1 time: 0.982268 Jul 25 16:32:13.834533 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2342/4702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:12 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1318 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:13.853844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-947285462"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:13.857540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:13.875723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.878050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:13.879362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.882375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.883257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.888397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fa87e730-326d-44b7-b861-80e6c0000ce5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1217 microversion: 2.1 time: 0.953539 Jul 25 16:32:13.889116 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2361/4703] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:12 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1217 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:13.919462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:13.923547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:13.967046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.970296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.977404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.982451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.643883 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Removing security group 0be31fc0-dd1d-4ea6-97f6-938a53ec4757 from port 9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d Jul 25 16:32:14.791027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:14.803921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7baa2e80-c721-4926-9493-053e0c563423 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1555 microversion: 2.1 time: 0.913535 Jul 25 16:32:14.809446 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2362/4704] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:13 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1555 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:14.816084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b5f0d961-05dd-4df0-b2d7-4152bc8c2598 req-51658f61-bca8-46cf-a87e-8877b3a4edee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:14.846014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:14.851766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b5f0d961-05dd-4df0-b2d7-4152bc8c2598 req-51658f61-bca8-46cf-a87e-8877b3a4edee service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.857674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b5f0d961-05dd-4df0-b2d7-4152bc8c2598 req-51658f61-bca8-46cf-a87e-8877b3a4edee service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.899160 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b5f0d961-05dd-4df0-b2d7-4152bc8c2598 req-51658f61-bca8-46cf-a87e-8877b3a4edee service nova] Creating event network-changed:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:32:14.924541 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b5f0d961-05dd-4df0-b2d7-4152bc8c2598 req-51658f61-bca8-46cf-a87e-8877b3a4edee service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113007 Jul 25 16:32:14.931704 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2363/4705] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:14.955218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4d184cc-db04-4fc4-aa4b-f009beb9a2cc tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: .version_select at 0x7f9d92a10670>, body: {"keypair": {"name": "tempest-keypair-1456733245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEMbJ7SLMnayB3JUUQdm+jPciiynziS5ptC3ZM/y4iD/7k12JfNu9Ng9tvry/gnGyYKIZ+9Vyg22pAC9DI1/sDVbDdTJb4cRxWNsCOC3HUflWc3j8szlrY5UgcwMt6/Aw=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:15.013221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e4d184cc-db04-4fc4-aa4b-f009beb9a2cc tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:32:15.045376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e4d184cc-db04-4fc4-aa4b-f009beb9a2cc tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:32:15.180937 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4d184cc-db04-4fc4-aa4b-f009beb9a2cc tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245357 Jul 25 16:32:15.200664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2364/4706] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:15.228097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:15.229400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:15.237016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:15.238262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:15.239371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:15.240076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:15.994849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.007236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.015492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.021333 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d817dfa9-0f3f-448b-aa6d-ac77aab0404f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 0.818141 Jul 25 16:32:16.022538 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2365/4707] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:15 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:16.030173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:16.034833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:16.048358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.051662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.055846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.056746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.570627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.588098 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-620ebfc2-3e42-48b8-9b8e-d7499a77569a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1504 microversion: 2.1 time: 0.564267 Jul 25 16:32:16.608081 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2366/4708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:16 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1504 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:16.613962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:16.614890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:16.622071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.622808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.623773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.624378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.875135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.888804 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eae1646b-b668-40eb-b2df-722a9b55b759 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1217 microversion: 2.1 time: 0.279156 Jul 25 16:32:16.896267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2367/4709] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:16 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1217 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:16.917452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:16.921504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:16.940856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.941381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.942236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.942681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:17.766000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e820e5be-149b-4346-8ee5-18bbda7fb837 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action" status: 202 len: 0 microversion: 2.1 time: 3.929253 Jul 25 16:32:17.768633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2343/4710] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:32:13 2022] POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action => generated 0 bytes in 3933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:17.776698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:17.781237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:17.825837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:17.829186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:17.834104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:17.841931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:17.904207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lazy-loading 'flavor' on Instance uuid 768f5082-c9b0-4d37-af93-90d00c08e812 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:32:18.103320 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a1c4e8bc-293a-4d79-b5e2-88a0703b9d3f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "POST /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812/action" status: 200 len: 32 microversion: 2.1 time: 0.331305 Jul 25 16:32:18.104482 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2344/4711] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:32:17 2022] POST /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:32:18.113849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:18.129851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:18.144118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:18.147890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:18.151970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:18.153017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:18.168779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:18.187907 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-077689ce-b3c0-4274-b564-c2de1d798ba3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 200 len: 1555 microversion: 2.1 time: 1.288003 Jul 25 16:32:18.203693 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2368/4712] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:16 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 1555 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:18.224174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2e38feea-b2ad-4437-a7b7-457e89c79e7a req-75bb5426-a99a-44d5-966c-a9478beeaaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72038b76-3a5c-4928-b54b-cecabc796a03", "tag": "a7b2ef04-c478-4e1a-bec2-522bfa7a6033"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:18.248434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2e38feea-b2ad-4437-a7b7-457e89c79e7a req-75bb5426-a99a-44d5-966c-a9478beeaaf4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:18.264552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2e38feea-b2ad-4437-a7b7-457e89c79e7a req-75bb5426-a99a-44d5-966c-a9478beeaaf4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:18.296143 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2e38feea-b2ad-4437-a7b7-457e89c79e7a req-75bb5426-a99a-44d5-966c-a9478beeaaf4 service nova] Creating event network-changed:a7b2ef04-c478-4e1a-bec2-522bfa7a6033 for instance 72038b76-3a5c-4928-b54b-cecabc796a03 on n-h1-846219-13 Jul 25 16:32:18.313343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2e38feea-b2ad-4437-a7b7-457e89c79e7a req-75bb5426-a99a-44d5-966c-a9478beeaaf4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107794 Jul 25 16:32:18.322180 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2369/4713] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:18.328186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fdeba265-cb29-4d69-90e2-96b813a7db5b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'create', calling method: .version_select at 0x7f9d938f03a0>, body: {"pool": null} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:19.296411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:19.306758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:19.308471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:19.309761 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec7292c6-84c9-4834-a9a3-c8ab5739f930 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 1.202718 Jul 25 16:32:19.317582 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2345/4714] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:18 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:19.328131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b1ee3b75-9905-4cda-ab15-1cd029e956e4 req-8871623f-2bf7-4369-9c2f-e99aa8ff644f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:19.363974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b1ee3b75-9905-4cda-ab15-1cd029e956e4 req-8871623f-2bf7-4369-9c2f-e99aa8ff644f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:19.365166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b1ee3b75-9905-4cda-ab15-1cd029e956e4 req-8871623f-2bf7-4369-9c2f-e99aa8ff644f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:19.398092 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b1ee3b75-9905-4cda-ab15-1cd029e956e4 req-8871623f-2bf7-4369-9c2f-e99aa8ff644f service nova] Creating event network-changed:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:32:19.428979 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b1ee3b75-9905-4cda-ab15-1cd029e956e4 req-8871623f-2bf7-4369-9c2f-e99aa8ff644f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109575 Jul 25 16:32:19.436191 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2346/4715] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:19.442516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:19.448558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:19.468979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:19.469757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:19.470841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:19.473079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:21.191346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:21.237822 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43688958-6e57-48ea-b967-bf3ddacf3c61 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1217 microversion: 2.1 time: 1.799212 Jul 25 16:32:21.298627 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2347/4716] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:19 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1217 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:21.323151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:21.324291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:21.350960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:21.351759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:21.361322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:21.362384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.001044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:22.018745 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fd7d10c7-5edb-428c-8459-1c6516e30c8d tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1510 microversion: 2.1 time: 0.715496 Jul 25 16:32:22.034899 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2348/4717] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:21 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1510 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:22.048421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:22.049605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: a634a854-b117-4bff-9846-b4be4e94c51f] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:22.057985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:22.058810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.059865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:22.060566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.120974 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] HTTP exception thrown: Instance a634a854-b117-4bff-9846-b4be4e94c51f could not be found. Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Request method failure captured: Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f HTTP/1.1 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sSBDoADsA5sGzMvQ1neyvnH_bVQcZY-SOXK6IFsrYzprSAoP3Xqv_VMtXyYs2MSTU9Oo6ALresiZ-BdPgj4uZXhv7yDmbhvIWDAzoBYT7RI0Bc7leVu1XmvYuSb6sEcr31EcpoH8HTA36U_Es5nprE_rf8iL7-aGRsTdiQi18TOLKY Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 3dbafb0a4ca4428eaa651274f6939053 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_3dbafb0a4ca4428eaa651274f6939053"}]}] Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 3dbafb0a4ca4428eaa651274f6939053 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestNetworkBasicOps-1592225059-project Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 0333f8e4e1e54bcda08bce44f79fbc9c Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestNetworkBasicOps-1592225059-project Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance a634a854-b117-4bff-9846-b4be4e94c51f could not be found. Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'a634a854-b117-4bff-9846-b4be4e94c51f'} Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a634a854-b117-4bff-9846-b4be4e94c51f could not be found. Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a634a854-b117-4bff-9846-b4be4e94c51f could not be found. Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:22.130959 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a634a854-b117-4bff-9846-b4be4e94c51f could not be found. Jul 25 16:32:22.138394 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:32:22.147275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Returning 404 to user: Instance a634a854-b117-4bff-9846-b4be4e94c51f could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:32:22.149272 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b429e189-b2cb-4b87-bb09-ecc189811ca1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f" status: 404 len: 111 microversion: 2.1 time: 0.112951 Jul 25 16:32:22.165898 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2349/4718] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:22 2022] GET /compute/v2.1/servers/a634a854-b117-4bff-9846-b4be4e94c51f => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:32:22.187856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:22.191058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:22.217420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:22.223588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.227554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:22.228794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.264610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:23.499242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:23.512247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:23.514667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:23.521012 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-438ced2d-aaee-4cd3-8559-a412d4117066 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 1.353336 Jul 25 16:32:23.524468 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2350/4719] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:22 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:23.533017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-64be20d0-ce17-4dc0-840e-476eebfedcee req-0ee1d0e8-a545-4870-9f19-e5e5713b3ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a634a854-b117-4bff-9846-b4be4e94c51f", "name": "network-vif-deleted", "tag": "963a5bb9-2d4c-463c-9fb6-372140d1d033"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:23.551466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-64be20d0-ce17-4dc0-840e-476eebfedcee req-0ee1d0e8-a545-4870-9f19-e5e5713b3ed3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:23.552018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-64be20d0-ce17-4dc0-840e-476eebfedcee req-0ee1d0e8-a545-4870-9f19-e5e5713b3ed3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:23.567353 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-64be20d0-ce17-4dc0-840e-476eebfedcee req-0ee1d0e8-a545-4870-9f19-e5e5713b3ed3 service nova] Creating event network-vif-deleted:963a5bb9-2d4c-463c-9fb6-372140d1d033 for instance a634a854-b117-4bff-9846-b4be4e94c51f on n-h1-846219-13 Jul 25 16:32:23.576105 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-64be20d0-ce17-4dc0-840e-476eebfedcee req-0ee1d0e8-a545-4870-9f19-e5e5713b3ed3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047718 Jul 25 16:32:23.578203 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2351/4720] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:23.589729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-157254484", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e812fb40-fcc6-40c5-a453-70ce5887f1c5"}], "security_groups": [{"name": "tempest-securitygroup--709219502"}], "key_name": "tempest-keypair-1456733245", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:23.996105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] validate_networks() for [('e812fb40-fcc6-40c5-a453-70ce5887f1c5', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:32:25.098130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:25.675110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:32:25.675992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:32:25.675992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:32:25.676397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:32:25.677362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:32:25.719830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:25.726100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:25.729635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:25.730475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:25.793717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:32:25.810837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Getting quotas for user 4a6642b2b23848118d41454191733a71 and project 45db8f6a625c4d618009b07706fea599. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:32:25.852124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:32:25.858402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:32:25.988804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea5f258b-fea3-4f0a-866a-c3c6d5e03146 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.406546 Jul 25 16:32:25.991432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2352/4721] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:32:23 2022] POST /compute/v2.1/servers => generated 403 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:32:26.014290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:26.015659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:26.037577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.038831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:26.045027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.049045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:26.115734 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fdeba265-cb29-4d69-90e2-96b813a7db5b tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.791332 Jul 25 16:32:26.126789 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2370/4722] 10.222.0.105 () {60 vars in 1175 bytes} [Mon Jul 25 16:32:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:26.192453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67c957da-3825-44d0-9c79-f73d5b720df7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '.version_select at 0x7f9da4a2d3a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:26.256645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67c957da-3825-44d0-9c79-f73d5b720df7 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-937675052" status: 202 len: 0 microversion: 2.1 time: 0.105570 Jul 25 16:32:26.259640 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2371/4723] 10.222.0.105 () {58 vars in 1259 bytes} [Mon Jul 25 16:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-937675052 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:26.275834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:26.281559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:26.301442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.302261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:26.303204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.311131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:26.487507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:26.504385 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9a48608-d1b4-4368-9ce9-e18772f659cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1205 microversion: 2.1 time: 0.500894 Jul 25 16:32:26.526751 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2353/4724] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:25 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1205 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:26.539893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:26.540592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:26.563139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.564599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:26.565524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.565966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.155329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.185500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-473c03c1-e95e-41b4-8e3f-355575557179 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1510 microversion: 2.1 time: 0.923981 Jul 25 16:32:27.186262 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2372/4725] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:26 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1510 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:27.213072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:27.223938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:27.254878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.259266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:27.259751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.260585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:27.261044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.265703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.272806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.275245 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bfc9e482-6ac2-47a7-83d7-8ba8807b80e4 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 0.747206 Jul 25 16:32:27.275874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2354/4726] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:26 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:27.296825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.211"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:27.313871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:27.351904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:27.363220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.369597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:27.370368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.449987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Acquired lock "refresh_cache-814cfab7-8f36-48f5-85e2-cf86629e3109" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:32:27.625766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.650859 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30613daf-01c8-4dad-8dff-01038ebea5de tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1249 microversion: 2.1 time: 0.449862 Jul 25 16:32:27.653002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2373/4727] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:27 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1249 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:27.666177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:27.668885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:27.686069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:27.687568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.690505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:27.691555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:29.087456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:29.101241 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2af39bb8-7c5a-41bc-8c57-3d7f66fbbe42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1205 microversion: 2.1 time: 1.446005 Jul 25 16:32:29.114489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2374/4728] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:27 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1205 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:29.114489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:29.114489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:29.128808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:29.135646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:29.136652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:29.137168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:30.572888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:30.583905 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3b55493-1b4d-4582-9b04-71e82f354f98 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1510 microversion: 2.1 time: 1.477651 Jul 25 16:32:30.590611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2375/4729] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:29 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1510 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:30.606865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:30.609122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:30.621884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:30.622876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:30.624005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:30.631198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:31.666960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:31.688499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:31.693761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:31.695804 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a9727f7d-8dd8-4499-b8e0-017cecbd957d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1744 microversion: 2.20 time: 1.104169 Jul 25 16:32:31.718666 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2376/4730] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:30 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1744 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:31.730279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:31.734873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:31.756086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:31.756554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:31.757663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:31.758481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:32.050415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:32.082901 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aeafbe69-3aa2-41f8-8045-02db55db43d4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1303 microversion: 2.1 time: 0.362672 Jul 25 16:32:32.083847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2377/4731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:31 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1303 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:32.110481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:32.111409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:32.120050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:32.120796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:32.121877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:32.122544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:32.151885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:32.442629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:32.458605 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9202f692-024d-41cd-9607-35a12a102332 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1205 microversion: 2.1 time: 0.352610 Jul 25 16:32:32.460383 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2378/4732] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:32 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1205 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:32.476958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:32.478729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:32.491665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:32.492534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:32.493656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:32.494720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:33.136025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:33.150096 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-23b4f550-30f5-4d59-bb32-78a81be98500 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1510 microversion: 2.1 time: 0.685658 Jul 25 16:32:33.151034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2379/4733] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:32 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1510 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:33.158293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:33.160617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:33.169864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:33.171128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:33.172129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:33.172756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.115396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Building network info cache for instance {{(pid=119598) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:32:34.272904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.298461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.300241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.303294 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2551cdbe-81c7-4049-9a0d-59ad1ea2211c tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1726 microversion: 2.20 time: 1.151006 Jul 25 16:32:34.306348 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2380/4734] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:33 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1726 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:34.321401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:34.322802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:34.332165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.333039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.334174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.334776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.380588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:32:34.554146 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-21dd1a3b-d75a-4b7e-9c48-153bd8c37f07 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 204 len: 0 microversion: 2.1 time: 0.245960 Jul 25 16:32:34.555252 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2381/4735] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:32:34 2022] DELETE /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:34.569184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fda19431-1b39-449d-b09f-3dba748bb3df req-61239921-4d3d-465b-8785-bf8a9eb6329f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b289405c-2b33-4e47-b3f9-ed6883c30d5e", "tag": "612834dd-cb88-46cd-9773-769962d64ff4"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:34.587775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fda19431-1b39-449d-b09f-3dba748bb3df req-61239921-4d3d-465b-8785-bf8a9eb6329f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.588382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fda19431-1b39-449d-b09f-3dba748bb3df req-61239921-4d3d-465b-8785-bf8a9eb6329f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.613704 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fda19431-1b39-449d-b09f-3dba748bb3df req-61239921-4d3d-465b-8785-bf8a9eb6329f service nova] Creating event network-changed:612834dd-cb88-46cd-9773-769962d64ff4 for instance b289405c-2b33-4e47-b3f9-ed6883c30d5e on n-h1-846219-13 Jul 25 16:32:34.619962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fda19431-1b39-449d-b09f-3dba748bb3df req-61239921-4d3d-465b-8785-bf8a9eb6329f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062298 Jul 25 16:32:34.622253 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2382/4736] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:34.629179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:34.630206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:34.638327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.639142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.640174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.640849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.974456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.989489 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53574132-576b-409f-a3ba-cff0e4be0a16 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 0.365302 Jul 25 16:32:35.004394 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2383/4737] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:34 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:35.009791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:35.010698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:35.018464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.019858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.020841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.021517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.420064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:35.440871 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da4c8798-2364-476e-ad05-31af1bcb607c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1205 microversion: 2.1 time: 0.434349 Jul 25 16:32:35.440871 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2384/4738] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:35 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1205 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:35.470692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8886f0e7-1ed9-4265-adda-a7c829dc4e9c req-54dd8e65-0fb2-4aa7-ae3f-206a316d8279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72038b76-3a5c-4928-b54b-cecabc796a03", "name": "network-vif-plugged", "status": "completed", "tag": "a7b2ef04-c478-4e1a-bec2-522bfa7a6033"}, {"server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "name": "network-vif-unplugged", "status": "completed", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:35.513305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8886f0e7-1ed9-4265-adda-a7c829dc4e9c req-54dd8e65-0fb2-4aa7-ae3f-206a316d8279 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.513758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8886f0e7-1ed9-4265-adda-a7c829dc4e9c req-54dd8e65-0fb2-4aa7-ae3f-206a316d8279 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.551788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8886f0e7-1ed9-4265-adda-a7c829dc4e9c req-54dd8e65-0fb2-4aa7-ae3f-206a316d8279 service nova] Creating event network-vif-plugged:a7b2ef04-c478-4e1a-bec2-522bfa7a6033 for instance 72038b76-3a5c-4928-b54b-cecabc796a03 on n-h1-846219-13 Jul 25 16:32:35.553927 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8886f0e7-1ed9-4265-adda-a7c829dc4e9c req-54dd8e65-0fb2-4aa7-ae3f-206a316d8279 service nova] Creating event network-vif-unplugged:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h2-846219-13 Jul 25 16:32:35.580160 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8886f0e7-1ed9-4265-adda-a7c829dc4e9c req-54dd8e65-0fb2-4aa7-ae3f-206a316d8279 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.119183 Jul 25 16:32:35.581192 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2385/4739] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:35.592045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6d5c0fac-13df-40dd-9a33-d219005e2e57 req-00a2bce0-4cbb-4f2d-8ab5-e7f6a4a52f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:35.617672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6d5c0fac-13df-40dd-9a33-d219005e2e57 req-00a2bce0-4cbb-4f2d-8ab5-e7f6a4a52f5b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.623330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6d5c0fac-13df-40dd-9a33-d219005e2e57 req-00a2bce0-4cbb-4f2d-8ab5-e7f6a4a52f5b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.645837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Updating instance_info_cache with network_info: [{"id": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d", "address": "fa:16:3e:af:7a:14", "network": {"id": "5e408c88-a0a2-4658-b8a5-2f3e328e519b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-500906060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8f4fdab9f1c54ab590403f8b27ad21ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9a8a75b1-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119598) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:32:35.661711 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6d5c0fac-13df-40dd-9a33-d219005e2e57 req-00a2bce0-4cbb-4f2d-8ab5-e7f6a4a52f5b service nova] Creating event network-changed:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:32:35.663459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Releasing lock "refresh_cache-814cfab7-8f36-48f5-85e2-cf86629e3109" {{(pid=119598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:32:35.664694 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b77cd774-8e38-4a21-89d7-91104e6fbda7 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action" status: 202 len: 0 microversion: 2.1 time: 8.377035 Jul 25 16:32:35.666768 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2355/4740] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:32:27 2022] POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action => generated 0 bytes in 8390 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:32:35.671691 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6d5c0fac-13df-40dd-9a33-d219005e2e57 req-00a2bce0-4cbb-4f2d-8ab5-e7f6a4a52f5b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088814 Jul 25 16:32:35.676416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:35.677480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:35.678619 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2386/4741] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:35.685718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:35.686722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:35.686856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:35.690413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.691274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.692533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.693335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.695348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.696039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.697283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.697936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.785943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:35.836209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:36.531799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:36.551936 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-013f3978-46e7-4d64-a419-79f976086ad4 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1510 microversion: 2.1 time: 0.882290 Jul 25 16:32:36.556238 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2356/4742] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:35 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1510 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:36.567645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:36.568644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:36.577337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:36.578110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:36.579160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:36.579794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:36.610431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:36.627386 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91f0e03a-d130-481f-87ad-28720f163005 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1674 microversion: 2.1 time: 0.946413 Jul 25 16:32:36.630536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2387/4743] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:35 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1674 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:36.643734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.211"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:37.124435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:37.134878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.135485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.136751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.137406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.145393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.157403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.167828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.174377 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b121b92-4b81-457c-bddf-a39844946ae2 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1669 microversion: 2.20 time: 0.613406 Jul 25 16:32:37.175632 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2357/4744] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:36 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1669 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:37.181712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:37.182613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:37.190145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.190984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.192886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.193707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.593193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.602889 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-88d5db13-861c-400f-86c5-5ae67751b137 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 0.425838 Jul 25 16:32:37.617892 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2358/4745] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:37 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:37.621132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:37.621848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:37.636842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.637661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.638755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.639410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.947557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.959395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b0afec01-16aa-4be3-b06e-a12ab510104a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1205 microversion: 2.1 time: 0.350017 Jul 25 16:32:37.960090 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2359/4746] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:37 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1205 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:37.968364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d20d4ece-a378-4624-83d4-dda47f5864a2"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:37.979456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:37.997576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:37.998130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.999149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:38.002950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:38.018309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Acquired lock "refresh_cache-814cfab7-8f36-48f5-85e2-cf86629e3109" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:32:38.551051 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c97c4ae-4ea2-41f7-9424-3365bdd8cf7f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.589520 Jul 25 16:32:38.560029 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2360/4747] 10.222.0.105 () {62 vars in 1369 bytes} [Mon Jul 25 16:32:37 2022] POST /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-volume_attachments => generated 188 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:32:38.560029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:38.560029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:38.564743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:38.565231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:38.566146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:38.566586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.568608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:39.583119 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45ff0d9e-df8f-4c71-91e8-4091dd2314d9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1510 microversion: 2.1 time: 1.027165 Jul 25 16:32:39.584100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2361/4748] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:38 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1510 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:39.595412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:39.596221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:39.616925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.619860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.622056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.628576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.700309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.701313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.702008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lazy-loading 'fault' on Instance uuid b289405c-2b33-4e47-b3f9-ed6883c30d5e {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:32:39.866342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:39.882464 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c75af64-e0c0-4cb4-816e-366c60a81e42 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 200 len: 1342 microversion: 2.1 time: 0.297192 Jul 25 16:32:39.883855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2362/4749] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:39 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:39.892382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-34871833-dca9-4289-a323-7910a295a15f req-36adeae2-60c8-4eb1-aaec-95d27e5ceb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e76c6df-ea9a-47af-9309-1db0e79e4f65", "tag": "731061cd-e5e2-4309-8aa7-9aaaafef9ffe"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:39.906553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-34871833-dca9-4289-a323-7910a295a15f req-36adeae2-60c8-4eb1-aaec-95d27e5ceb13 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.907337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-34871833-dca9-4289-a323-7910a295a15f req-36adeae2-60c8-4eb1-aaec-95d27e5ceb13 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.927934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-34871833-dca9-4289-a323-7910a295a15f req-36adeae2-60c8-4eb1-aaec-95d27e5ceb13 service nova] Creating event network-changed:731061cd-e5e2-4309-8aa7-9aaaafef9ffe for instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 on n-h2-846219-13 Jul 25 16:32:39.935081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-34871833-dca9-4289-a323-7910a295a15f req-36adeae2-60c8-4eb1-aaec-95d27e5ceb13 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048663 Jul 25 16:32:39.936818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2363/4750] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:39.957341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:39.959250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:39.967292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.967978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.969309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.970083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:40.388371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:40.388789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Building network info cache for instance {{(pid=119599) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 16:32:40.409086 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ecbe5f65-a0bc-4c28-a537-d74237ca4bce tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 0.456750 Jul 25 16:32:40.421382 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2364/4751] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:39 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:40.439173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:40.441012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:40.459738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:40.460571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:40.463842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:40.466222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:40.502164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:40.942543 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23480875-018e-413a-99f7-9d89a0d734fc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-volume_attachments/d20d4ece-a378-4624-83d4-dda47f5864a2" status: 202 len: 0 microversion: 2.20 time: 0.529130 Jul 25 16:32:40.944755 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2365/4752] 10.222.0.105 () {60 vars in 1462 bytes} [Mon Jul 25 16:32:40 2022] DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-volume_attachments/d20d4ece-a378-4624-83d4-dda47f5864a2 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:40.958854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:40.959945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:40.979482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:40.980246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:40.986344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:40.987331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.313807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Updating instance_info_cache with network_info: [{"id": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d", "address": "fa:16:3e:af:7a:14", "network": {"id": "5e408c88-a0a2-4658-b8a5-2f3e328e519b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-500906060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8f4fdab9f1c54ab590403f8b27ad21ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9a8a75b1-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119599) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 16:32:41.352700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Releasing lock "refresh_cache-814cfab7-8f36-48f5-85e2-cf86629e3109" {{(pid=119599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:32:41.356249 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f744e5c1-ddd2-4088-9474-cec0a7f4e0a3 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action" status: 202 len: 0 microversion: 2.1 time: 4.722071 Jul 25 16:32:41.359905 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2388/4753] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:32:36 2022] POST /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109/action => generated 0 bytes in 4728 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 16:32:41.383453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-835d2075-8e6b-4136-a9b4-03268777de39 req-45a818fa-403f-4a02-9e94-519e8d8370d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b289405c-2b33-4e47-b3f9-ed6883c30d5e", "name": "network-vif-deleted", "tag": "612834dd-cb88-46cd-9773-769962d64ff4"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:41.393639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:41.403802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-316a505a-acbe-4fa7-8155-bd67cc36c334 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1393 microversion: 2.1 time: 0.456475 Jul 25 16:32:41.404398 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2366/4754] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:40 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1393 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:41.409788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-835d2075-8e6b-4136-a9b4-03268777de39 req-45a818fa-403f-4a02-9e94-519e8d8370d0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.410359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-835d2075-8e6b-4136-a9b4-03268777de39 req-45a818fa-403f-4a02-9e94-519e8d8370d0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.418649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:41.423730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:41.438017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.440893 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-835d2075-8e6b-4136-a9b4-03268777de39 req-45a818fa-403f-4a02-9e94-519e8d8370d0 service nova] Creating event network-vif-deleted:612834dd-cb88-46cd-9773-769962d64ff4 for instance b289405c-2b33-4e47-b3f9-ed6883c30d5e on n-h1-846219-13 Jul 25 16:32:41.441768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.442825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.443483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.465818 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-835d2075-8e6b-4136-a9b4-03268777de39 req-45a818fa-403f-4a02-9e94-519e8d8370d0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104241 Jul 25 16:32:41.467066 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2389/4755] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:41.481595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:41.482442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: b289405c-2b33-4e47-b3f9-ed6883c30d5e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:41.496002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.500988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.502769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.503376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.550761 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] HTTP exception thrown: Instance b289405c-2b33-4e47-b3f9-ed6883c30d5e could not be found. Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Request method failure captured: Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e HTTP/1.1 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sSBDoADsA5sGzMvQ1neyvnH_bVQcZY-SOXK6IFsrYzprSAoP3Xqv_VMtXyYs2MSTU9Oo6ALresiZ-BdPgj4uZXhv7yDmbhvIWDAzoBYT7RI0Bc7leVu1XmvYuSb6sEcr31EcpoH8HTA36U_Es5nprE_rf8iL7-aGRsTdiQi18TOLKY Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 3dbafb0a4ca4428eaa651274f6939053 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_3dbafb0a4ca4428eaa651274f6939053"}]}] Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 3dbafb0a4ca4428eaa651274f6939053 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkBasicOps-1592225059-project Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 0333f8e4e1e54bcda08bce44f79fbc9c Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkBasicOps-1592225059-project Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b289405c-2b33-4e47-b3f9-ed6883c30d5e could not be found. Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b289405c-2b33-4e47-b3f9-ed6883c30d5e'} Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b289405c-2b33-4e47-b3f9-ed6883c30d5e could not be found. Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b289405c-2b33-4e47-b3f9-ed6883c30d5e could not be found. Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:41.554444 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b289405c-2b33-4e47-b3f9-ed6883c30d5e could not be found. Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:41.559887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Returning 404 to user: Instance b289405c-2b33-4e47-b3f9-ed6883c30d5e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:32:41.561065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7297b5a8-c2c5-4c6b-a793-f802aaaa683e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e" status: 404 len: 111 microversion: 2.1 time: 0.089896 Jul 25 16:32:41.562068 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2390/4756] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:41 2022] GET /compute/v2.1/servers/b289405c-2b33-4e47-b3f9-ed6883c30d5e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:32:41.570744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:41.571333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:41.584970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.586667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.587493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.587937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.788898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:41.798765 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-660a655f-61ff-41fa-bfd9-d1390e50f30a tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1490 microversion: 2.1 time: 0.387002 Jul 25 16:32:41.806127 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2367/4757] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:41 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1490 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:41.815695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff2ca8cf-0f3d-4c4e-8f7e-61ff32a76f9c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '.version_select at 0x7f9d93d1f430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:41.841360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd338f1d-d09a-4ffc-8b63-f23a157fbcce tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "POST /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/action" status: 202 len: 0 microversion: 2.20 time: 0.273682 Jul 25 16:32:41.842000 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2391/4758] 10.222.0.105 () {62 vars in 1324 bytes} [Mon Jul 25 16:32:41 2022] POST /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:41.854032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:41.857425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:41.876966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.877445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.880200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.884594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:42.727267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:42.758283 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3db8f3b2-2e70-471c-986c-8b7f44e56491 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1393 microversion: 2.1 time: 0.910202 Jul 25 16:32:42.778676 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2392/4759] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:41 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1393 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:42.798479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:42.800771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:42.815480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:42.823750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:42.824610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:42.825708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:42.827681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:44.190987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:44.226860 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bbf8f0fd-72e8-4f35-9a53-655dd80fee24 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 1.444759 Jul 25 16:32:44.228133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2393/4760] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:42 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:44.233781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:44.234797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:44.247817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:44.248610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:44.250718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:44.251620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:44.634290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:44.642916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:44.663932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:44.667111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:44.672093 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e315f2bd-1a5a-4116-a5d2-ed5eb5e52234 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.440453 Jul 25 16:32:44.675785 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2394/4761] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:44 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:44.695427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-dba898e3-d32a-44e3-a4ec-d6bae6cab089 req-780cb8f5-8aca-4fcf-b62d-bcc053fa0086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:44.726091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-dba898e3-d32a-44e3-a4ec-d6bae6cab089 req-780cb8f5-8aca-4fcf-b62d-bcc053fa0086 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:44.726843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-dba898e3-d32a-44e3-a4ec-d6bae6cab089 req-780cb8f5-8aca-4fcf-b62d-bcc053fa0086 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:44.755661 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-dba898e3-d32a-44e3-a4ec-d6bae6cab089 req-780cb8f5-8aca-4fcf-b62d-bcc053fa0086 service nova] Creating event network-changed:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:32:44.772688 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-dba898e3-d32a-44e3-a4ec-d6bae6cab089 req-780cb8f5-8aca-4fcf-b62d-bcc053fa0086 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093268 Jul 25 16:32:44.776771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2395/4762] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:44.783963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1794025050", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:44.889537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] validate_networks() for [('f45d589e-4aca-4e4d-8773-386621a15855', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:32:45.774461 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff2ca8cf-0f3d-4c4e-8f7e-61ff32a76f9c tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "DELETE /compute/v2.1/os-floating-ips/effd7784-7134-4ead-82eb-2b282eb6f85f" status: 202 len: 0 microversion: 2.1 time: 3.966787 Jul 25 16:32:45.775266 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2368/4763] 10.222.0.105 () {58 vars in 1268 bytes} [Mon Jul 25 16:32:41 2022] DELETE /compute/v2.1/os-floating-ips/effd7784-7134-4ead-82eb-2b282eb6f85f => generated 0 bytes in 3968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:45.781214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:45.781956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:45.804848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:45.805555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:45.806650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:45.809495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:46.526005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:46.534785 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83f4b108-fc1a-43c7-aa0b-d57f2115978c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1393 microversion: 2.1 time: 0.758557 Jul 25 16:32:46.535395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2369/4764] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:45 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1393 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:46.550850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4df2923-5136-43ea-b18c-a232ebe4e2ec tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '.version_select at 0x7f9da051f430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:46.585549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4df2923-5136-43ea-b18c-a232ebe4e2ec tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1930356707" status: 202 len: 0 microversion: 2.1 time: 0.042211 Jul 25 16:32:46.586489 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2370/4765] 10.222.0.105 () {58 vars in 1262 bytes} [Mon Jul 25 16:32:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1930356707 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:46.593346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:46.594210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:46.604263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:46.604986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:46.616109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:46.617025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:46.768151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:32:46.768712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:32:46.769021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:32:46.769600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:32:46.769870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:32:46.794018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:46.794774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:46.795781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:46.796398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:46.825895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Getting quotas for project beb5133297c44d4d9c78c77e2990da44. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:32:46.833307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Getting quotas for user 27eee720955942068370ed221a5dad5e and project beb5133297c44d4d9c78c77e2990da44. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:32:46.850506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:32:46.854885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:32:46.910934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff33e465-2f03-4436-b68e-a175f74ce650 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.132341 Jul 25 16:32:46.912882 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2396/4766] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:32:44 2022] POST /compute/v2.1/servers => generated 385 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:32:46.918432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:46.919684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:46.928257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:46.928973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:46.930138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:46.930747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:47.410856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:47.422340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f1317c3-150a-44a5-a742-49e87acb6959 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 0.834371 Jul 25 16:32:47.439569 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2371/4767] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:46 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:47.455140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7934ec0b-b704-4e6f-8bc2-584b399e8906 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '.version_select at 0x7f9d93cff4c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:48.252192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:48.261279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:48.262819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:48.264068 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4f81107-d47f-4194-9b4c-6cac634a0fd1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 1.349472 Jul 25 16:32:48.264659 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2397/4768] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:46 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:48.282363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:48.284396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:48.294012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:48.294605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:48.295684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:48.296257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:48.358661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:32:48.525474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15e8542b-0c91-4e44-bba1-e5eb3c7f1558 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 204 len: 0 microversion: 2.1 time: 0.252165 Jul 25 16:32:48.527174 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2398/4769] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:32:48 2022] DELETE /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:48.539752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ad93ec4-3ebb-4029-b504-5d4e0c9cf256 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Action: 'create', calling method: .version_select at 0x7f9d93a9a550>, body: {"keypair": {"name": "tempest-keypair-167499711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM+kFm+0n0/3i7UGK2lfGoV2JrGY3R6ro01VhjsLp11N14mfbYl9HPBOCVvyelzQrX2mkUCboD3tHCvOJ+EH6tQXQK8pN513189Bwe9G4X2PDR+VAOrE5L8kJlkpGowlg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:48.592146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4ad93ec4-3ebb-4029-b504-5d4e0c9cf256 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Getting quotas for project ee5a12aa133d430189c82b17ade9ad92. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:32:48.604918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4ad93ec4-3ebb-4029-b504-5d4e0c9cf256 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Getting quotas for user 2f098d5d34404aa2907984bfe29910b8 and project ee5a12aa133d430189c82b17ade9ad92. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:32:48.669609 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ad93ec4-3ebb-4029-b504-5d4e0c9cf256 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.140670 Jul 25 16:32:48.671830 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2399/4770] 10.222.0.105 () {62 vars in 1205 bytes} [Mon Jul 25 16:32:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:32:48.688206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:48.690105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:48.706996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:48.707458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:48.708262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:48.708702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:49.412093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:49.421699 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8867fd84-2a43-4531-acb8-8c1382e99e14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1278 microversion: 2.1 time: 0.748052 Jul 25 16:32:49.433747 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2400/4771] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:48 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1278 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:49.438705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-af44c68a-0e4b-48d4-bb83-9d5653d9b3b1 req-32e66b82-9051-4290-8ad5-a732fcaf4b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:49.462383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-af44c68a-0e4b-48d4-bb83-9d5653d9b3b1 req-32e66b82-9051-4290-8ad5-a732fcaf4b88 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:49.462768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-af44c68a-0e4b-48d4-bb83-9d5653d9b3b1 req-32e66b82-9051-4290-8ad5-a732fcaf4b88 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:49.488136 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-af44c68a-0e4b-48d4-bb83-9d5653d9b3b1 req-32e66b82-9051-4290-8ad5-a732fcaf4b88 service nova] Creating event network-changed:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h1-846219-13 Jul 25 16:32:49.510196 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-af44c68a-0e4b-48d4-bb83-9d5653d9b3b1 req-32e66b82-9051-4290-8ad5-a732fcaf4b88 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075178 Jul 25 16:32:49.511074 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2401/4772] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:49.516468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1823f90d-f0c3-4ba4-94a3-6c0defdab0a6 req-5d17dec3-b32c-42cd-af6c-23c57e83a8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e76c6df-ea9a-47af-9309-1db0e79e4f65", "name": "network-vif-plugged", "status": "completed", "tag": "731061cd-e5e2-4309-8aa7-9aaaafef9ffe"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:49.533401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1823f90d-f0c3-4ba4-94a3-6c0defdab0a6 req-5d17dec3-b32c-42cd-af6c-23c57e83a8c3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:49.533983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1823f90d-f0c3-4ba4-94a3-6c0defdab0a6 req-5d17dec3-b32c-42cd-af6c-23c57e83a8c3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:49.550450 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1823f90d-f0c3-4ba4-94a3-6c0defdab0a6 req-5d17dec3-b32c-42cd-af6c-23c57e83a8c3 service nova] Creating event network-vif-plugged:731061cd-e5e2-4309-8aa7-9aaaafef9ffe for instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 on n-h2-846219-13 Jul 25 16:32:49.578307 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1823f90d-f0c3-4ba4-94a3-6c0defdab0a6 req-5d17dec3-b32c-42cd-af6c-23c57e83a8c3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065402 Jul 25 16:32:49.579340 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2402/4773] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:49.589461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:49.590714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:49.604315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:49.607787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:49.609543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:49.611037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:49.675779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7934ec0b-b704-4e6f-8bc2-584b399e8906 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "DELETE /compute/v2.1/os-security-groups/0be31fc0-dd1d-4ea6-97f6-938a53ec4757" status: 202 len: 0 microversion: 2.1 time: 2.233161 Jul 25 16:32:49.676387 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2372/4774] 10.222.0.105 () {58 vars in 1277 bytes} [Mon Jul 25 16:32:47 2022] DELETE /compute/v2.1/os-security-groups/0be31fc0-dd1d-4ea6-97f6-938a53ec4757 => generated 0 bytes in 2235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:32:49.681671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:49.682585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:49.696730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:49.697211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:49.700977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:49.705821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.262362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:50.272927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:50.276169 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-042d1315-3d42-45a8-bfba-1bb47f3eb404 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 0.695488 Jul 25 16:32:50.280970 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2403/4775] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:49 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:50.295234 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a742796c-2dc2-48cb-8ed0-e52f69d53302 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1399 microversion: 2.1 time: 0.614980 Jul 25 16:32:50.298574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:50.299103 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2373/4776] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:49 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1399 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:50.309343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:50.316421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:50.317274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:50.327710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.330486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.331981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.332820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.335010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.339632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.340657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.346583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.392231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:32:50.567964 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7326c7e9-b082-4dfb-889d-84ab2284b292 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "DELETE /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 204 len: 0 microversion: 2.1 time: 0.266662 Jul 25 16:32:50.569204 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2374/4777] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:32:50 2022] DELETE /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:50.578313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:50.579368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:50.586562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.587293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.588875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.589522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.773161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:50.785348 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-279700db-4cff-4c4e-8e7a-5e887256ebe5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1276 microversion: 2.1 time: 0.213783 Jul 25 16:32:50.786250 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2375/4778] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:50 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:50.791920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:50.792791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:50.804153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.804910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:50.806026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:50.806699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:51.103826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:51.112911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:51.114773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:51.116331 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-511417c7-a696-44e7-a90e-141affb73d6a tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.834053 Jul 25 16:32:51.116898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2404/4779] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:50 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:51.301086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:51.301994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:51.309891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:51.310335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:51.311457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:51.311922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:51.622825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:51.632253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-47d22b50-d3a0-4b2e-ae14-392f629852cd tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1512 microversion: 2.1 time: 0.844768 Jul 25 16:32:51.632850 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2376/4780] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:50 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1512 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:51.649736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:51.650523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:51.668791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:51.669278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:51.670069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:51.670509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:52.392826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:52.400979 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e383d940-c6c5-4b8d-b938-ee84aad17dc7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1370 microversion: 2.1 time: 1.103810 Jul 25 16:32:52.404014 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2405/4781] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:51 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1370 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:32:52.414648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:52.416108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:52.431539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:52.432737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:52.436312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:52.437131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:52.489213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:52.502679 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-00beb181-09d1-4090-9997-df34aa1eb92b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1399 microversion: 2.1 time: 0.858352 Jul 25 16:32:52.504062 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2377/4782] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:51 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1399 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:52.516257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:52.517708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:52.524636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:52.525440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:52.526510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:52.527261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.084703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:53.153295 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-179e5f12-5d2c-4541-a092-00de17c9a442 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 0.741406 Jul 25 16:32:53.154649 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2406/4783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:52 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:53.167606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:53.176861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:53.200860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.201858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.204081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.204853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.231306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:53.245860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:53.247975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:53.253802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3977df78-3888-4c6c-ab9a-c547a2105aa8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.743520 Jul 25 16:32:53.254694 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2378/4784] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:52 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:53.413025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f92f663d-9e95-4bf4-972c-d4d17cf9cae2 req-cab3a565-acf3-4f8c-abb7-b2fa10fc92a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72038b76-3a5c-4928-b54b-cecabc796a03", "name": "network-vif-unplugged", "status": "completed", "tag": "a7b2ef04-c478-4e1a-bec2-522bfa7a6033"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:53.423285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f92f663d-9e95-4bf4-972c-d4d17cf9cae2 req-cab3a565-acf3-4f8c-abb7-b2fa10fc92a8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.423984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f92f663d-9e95-4bf4-972c-d4d17cf9cae2 req-cab3a565-acf3-4f8c-abb7-b2fa10fc92a8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.436670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f92f663d-9e95-4bf4-972c-d4d17cf9cae2 req-cab3a565-acf3-4f8c-abb7-b2fa10fc92a8 service nova] Creating event network-vif-unplugged:a7b2ef04-c478-4e1a-bec2-522bfa7a6033 for instance 72038b76-3a5c-4928-b54b-cecabc796a03 on n-h1-846219-13 Jul 25 16:32:53.444974 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f92f663d-9e95-4bf4-972c-d4d17cf9cae2 req-cab3a565-acf3-4f8c-abb7-b2fa10fc92a8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035286 Jul 25 16:32:53.446907 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2379/4785] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:32:53.452808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:53.454010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:53.464871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.465793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.466990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.467979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.928960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:53.950529 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0caa7f08-1bf5-44ff-95d5-3bdd03d3d842 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1559 microversion: 2.1 time: 0.501884 Jul 25 16:32:53.952937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2380/4786] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:53 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1559 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:53.965337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:53.967341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:53.981297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.982681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:53.983907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:53.985123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.034586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:54.054525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:54.069276 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50167b1b-9ad3-4fca-87cb-2bae7b875f6f tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1512 microversion: 2.1 time: 0.913094 Jul 25 16:32:54.072456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2407/4787] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:53 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1512 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:54.087118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:54.089230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:54.109783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.111020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.112740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.113551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.425659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:54.447623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6abe7f3a-6ad4-4183-be20-fcc10af76a0d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1357 microversion: 2.1 time: 0.492720 Jul 25 16:32:54.448527 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2381/4788] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:53 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1357 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:54.457681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cf519f2c-5d14-4cec-8f83-aa90e072f6bd req-1fffc2bb-8c88-408c-85bb-c6119ae75bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72038b76-3a5c-4928-b54b-cecabc796a03", "name": "network-vif-deleted", "tag": "a7b2ef04-c478-4e1a-bec2-522bfa7a6033"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:54.469845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cf519f2c-5d14-4cec-8f83-aa90e072f6bd req-1fffc2bb-8c88-408c-85bb-c6119ae75bba service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.470471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cf519f2c-5d14-4cec-8f83-aa90e072f6bd req-1fffc2bb-8c88-408c-85bb-c6119ae75bba service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.531061 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cf519f2c-5d14-4cec-8f83-aa90e072f6bd req-1fffc2bb-8c88-408c-85bb-c6119ae75bba service nova] Creating event network-vif-deleted:a7b2ef04-c478-4e1a-bec2-522bfa7a6033 for instance 72038b76-3a5c-4928-b54b-cecabc796a03 on n-h1-846219-13 Jul 25 16:32:54.539016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cf519f2c-5d14-4cec-8f83-aa90e072f6bd req-1fffc2bb-8c88-408c-85bb-c6119ae75bba service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088755 Jul 25 16:32:54.561811 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2382/4789] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:54.589833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:54.592337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:54.603754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.605491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.608289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.610524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.638150 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1a06fb0-5abb-4ad9-a330-b3d07d6b9f1f tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.563271 Jul 25 16:32:54.639285 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2408/4790] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:32:54 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-interface => generated 284 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:54.644743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:54.645500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:54.661353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.662005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:54.662818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:54.664683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:55.897259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:55.909964 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dd8518f6-3c07-4f03-b591-40268b1a9852 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 1.336272 Jul 25 16:32:55.910910 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2383/4791] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:54 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:55.924968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:55.930658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:55.947473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:55.947870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:55.948635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:55.949062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:55.970804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:55.999362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:56.009363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:56.011818 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e01e10c-fe8f-49b0-adfe-40db760a9efe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 1.371180 Jul 25 16:32:56.019198 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2409/4792] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:54 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:56.042371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:56.047113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:56.078630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:56.080392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:56.082217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:56.090661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:56.329047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d8d2a8492d43508a7c69671a819808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f4fdab9f1c54ab590403f8b27ad21ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:56.340804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc130b9b-1298-4ebb-895f-531b472e8c46 tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 200 len: 1470 microversion: 2.1 time: 0.428540 Jul 25 16:32:56.357649 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2384/4793] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:55 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 1470 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:56.365328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-254484646", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2106d40c-7090-43f7-84df-b115f3853dc4"}, {"port": "c6da5128-e2d0-4fcf-bccf-fd97f40e76eb", "tag": "port-1"}, {"port": "e4703297-42bf-47c4-8e81-e51cf2f63f5a", "tag": "port-2"}, {"uuid": "2c83536d-7051-400e-94c2-92be07e2fe52", "tag": "net-1"}, {"uuid": "2c83536d-7051-400e-94c2-92be07e2fe52"}, {"uuid": "6a4bbe5b-1b9c-4d54-b5fd-4115b2b805c0", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6a4bbe5b-1b9c-4d54-b5fd-4115b2b805c0", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6e26682d-f7bf-4024-82f1-1f1d2802e13e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c47ca651-4435-4607-a1dd-281994263ada", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2afd92a7-c32f-407c-b759-d193c5f546a3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--848392473"}], "key_name": "tempest-keypair-167499711", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:56.669344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:56.687028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3de528af-edb2-42d4-9051-3a3a262b69d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1190 microversion: 2.1 time: 0.654894 Jul 25 16:32:56.688512 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2410/4794] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:56 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1190 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:56.699606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8e88b5b1-ade2-484a-b292-f6dee4138bbc req-56f92fba-9eae-4071-85d1-e133c5d46f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814cfab7-8f36-48f5-85e2-cf86629e3109", "name": "network-vif-deleted", "tag": "9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:56.722487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8e88b5b1-ade2-484a-b292-f6dee4138bbc req-56f92fba-9eae-4071-85d1-e133c5d46f33 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:56.725545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8e88b5b1-ade2-484a-b292-f6dee4138bbc req-56f92fba-9eae-4071-85d1-e133c5d46f33 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:56.767630 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8e88b5b1-ade2-484a-b292-f6dee4138bbc req-56f92fba-9eae-4071-85d1-e133c5d46f33 service nova] Creating event network-vif-deleted:9a8a75b1-dc8d-433e-8d8c-60d5ee34f90d for instance 814cfab7-8f36-48f5-85e2-cf86629e3109 on n-h1-846219-13 Jul 25 16:32:56.789011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8e88b5b1-ade2-484a-b292-f6dee4138bbc req-56f92fba-9eae-4071-85d1-e133c5d46f33 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097446 Jul 25 16:32:56.794726 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2411/4795] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:56.931318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:56.932043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:56.948273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:56.952925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:56.953491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:56.954407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:56.954851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:57.082175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] validate_networks() for [('2106d40c-7090-43f7-84df-b115f3853dc4', None, None, None, None, None), (None, None, 'c6da5128-e2d0-4fcf-bccf-fd97f40e76eb', None, None, None), (None, None, 'e4703297-42bf-47c4-8e81-e51cf2f63f5a', None, None, None), ('2c83536d-7051-400e-94c2-92be07e2fe52', None, None, None, None, None), ('2c83536d-7051-400e-94c2-92be07e2fe52', None, None, None, None, None), ('6a4bbe5b-1b9c-4d54-b5fd-4115b2b805c0', '10.2.2.100', None, None, None, None), ('6a4bbe5b-1b9c-4d54-b5fd-4115b2b805c0', '10.2.2.200', None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:32:57.882537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:57.903464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0e9af6f-28f4-453b-8830-49dd68bcc734 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 0.973950 Jul 25 16:32:57.905378 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2412/4796] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:56 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:32:57.919677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:57.921474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:57.943338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:57.945519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:57.951585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:57.952641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:58.289007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:58.306752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:58.309134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:58.315311 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a83f0d7b-a642-4ca3-bc04-3fe09dd2846f tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.407292 Jul 25 16:32:58.323797 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2413/4797] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:32:57 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:58.329768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:58.330678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] [instance: 814cfab7-8f36-48f5-85e2-cf86629e3109] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:58.349699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:58.354648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:58.356007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:58.357851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:58.398029 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] HTTP exception thrown: Instance 814cfab7-8f36-48f5-85e2-cf86629e3109 could not be found. Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Request method failure captured: Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 HTTP/1.1 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sU_XAx1XSk60tQ8p3v1pFitf3graRYLNtb1aCtyA49vnDJsLxqqwcp7a9sA00TOtAOENrkKQLQRTOWHW84o-kCpMTtlOUYHiz8pJZlZF9oMq8Eo-iih7NpQ1NDP1IskVYicOKvjl6P1P0441YL_e18BhE6IufDAk6FFDOETP3Pe7jA Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8f4fdab9f1c54ab590403f8b27ad21ba Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1539273516 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8f4fdab9f1c54ab590403f8b27ad21ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8f4fdab9f1c54ab590403f8b27ad21ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8f4fdab9f1c54ab590403f8b27ad21ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8f4fdab9f1c54ab590403f8b27ad21ba"}]}] Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1539273516 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8f4fdab9f1c54ab590403f8b27ad21ba Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1539273516 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerRescueTestJSONUnderV235-1539273516-project Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 10d8d2a8492d43508a7c69671a819808 Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1539273516-project Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 814cfab7-8f36-48f5-85e2-cf86629e3109 could not be found. Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '814cfab7-8f36-48f5-85e2-cf86629e3109'} Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814cfab7-8f36-48f5-85e2-cf86629e3109 could not be found. Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814cfab7-8f36-48f5-85e2-cf86629e3109 could not be found. Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:58.403244 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814cfab7-8f36-48f5-85e2-cf86629e3109 could not be found. Jul 25 16:32:58.410124 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:32:58.414653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] Returning 404 to user: Instance 814cfab7-8f36-48f5-85e2-cf86629e3109 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:32:58.415877 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3816503-622c-4913-a980-385b06ca31fc tempest-ServerRescueTestJSONUnderV235-1539273516 tempest-ServerRescueTestJSONUnderV235-1539273516-project] 10.222.0.105 "GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109" status: 404 len: 111 microversion: 2.1 time: 0.090513 Jul 25 16:32:58.422902 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2414/4798] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:58 2022] GET /compute/v2.1/servers/814cfab7-8f36-48f5-85e2-cf86629e3109 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:32:58.447743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:58.449857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:58.471743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:58.474147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:58.476773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:58.479358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:58.492261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:58.620880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:59.075012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:59.095721 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c37102c-50b2-481b-b090-c4a2e8ace56e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1190 microversion: 2.1 time: 0.671121 Jul 25 16:32:59.120910 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2415/4799] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:58 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1190 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:59.127446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:59.128062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:59.148539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:59.150384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:59.156933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:59.160072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:00.254082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:00.264879 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e590af93-e70f-4be9-ba2f-87ee8af8c587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 1.141347 Jul 25 16:33:00.270744 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2416/4800] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:32:59 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:00.284226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:00.289090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:00.311228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:00.311976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:00.313223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:00.313961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:02.357697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:02.373641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:02.378723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:02.383568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51eaea00-aeef-41ce-bb21-56d04ccff5fb tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 2.111466 Jul 25 16:33:02.384178 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2417/4801] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:00 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:02.408458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:02.411367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:02.425865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:02.428187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:02.429415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:02.431236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:02.645266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:02.655132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0dc181db-512d-4801-83a5-e95658d0cf32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1190 microversion: 2.1 time: 0.265859 Jul 25 16:33:02.670053 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2418/4802] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:02 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1190 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:02.675564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3f5a2d05-8ae9-4d2b-92df-bf4a07c1873d req-1a8cca1c-dc9c-44fe-9801-187732d76aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e76c6df-ea9a-47af-9309-1db0e79e4f65", "tag": "731061cd-e5e2-4309-8aa7-9aaaafef9ffe"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:02.715035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3f5a2d05-8ae9-4d2b-92df-bf4a07c1873d req-1a8cca1c-dc9c-44fe-9801-187732d76aeb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:02.718205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3f5a2d05-8ae9-4d2b-92df-bf4a07c1873d req-1a8cca1c-dc9c-44fe-9801-187732d76aeb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:02.765435 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3f5a2d05-8ae9-4d2b-92df-bf4a07c1873d req-1a8cca1c-dc9c-44fe-9801-187732d76aeb service nova] Creating event network-changed:731061cd-e5e2-4309-8aa7-9aaaafef9ffe for instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 on n-h2-846219-13 Jul 25 16:33:02.773733 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3f5a2d05-8ae9-4d2b-92df-bf4a07c1873d req-1a8cca1c-dc9c-44fe-9801-187732d76aeb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101868 Jul 25 16:33:02.775296 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2419/4803] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:02.782381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ff0e9395-d761-4deb-8e8a-d0204185252b req-b526211a-1d27-4e1d-8029-19550f773c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7", "tag": "31321198-0e68-4cfe-8bd2-183b5e1dd89b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:02.796468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ff0e9395-d761-4deb-8e8a-d0204185252b req-b526211a-1d27-4e1d-8029-19550f773c4d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:02.797351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ff0e9395-d761-4deb-8e8a-d0204185252b req-b526211a-1d27-4e1d-8029-19550f773c4d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:02.847037 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ff0e9395-d761-4deb-8e8a-d0204185252b req-b526211a-1d27-4e1d-8029-19550f773c4d service nova] Creating event network-changed:31321198-0e68-4cfe-8bd2-183b5e1dd89b for instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 on n-h2-846219-13 Jul 25 16:33:02.857313 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ff0e9395-d761-4deb-8e8a-d0204185252b req-b526211a-1d27-4e1d-8029-19550f773c4d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080030 Jul 25 16:33:02.858898 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2420/4804] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:02.865660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:02.866608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:02.890167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:02.890823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:02.892148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:02.893081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:04.350512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:04.366932 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f5be729-5570-42da-b3a5-9dff8f7a0bf5 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 1.506304 Jul 25 16:33:04.367590 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2421/4805] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:02 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:04.374145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:04.375136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:04.388944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:04.389583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:04.390532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:04.392838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:05.860926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:05.872753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:05.874852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:05.877193 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c6587a7e-6e88-4804-82c8-183248af8819 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 1.508544 Jul 25 16:33:05.877987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2422/4806] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:04 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:05.903788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:05.906078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:05.918046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:05.919492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:05.921030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:05.922041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:05.973914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:05.974611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:05.975244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lazy-loading 'fault' on Instance uuid 72038b76-3a5c-4928-b54b-cecabc796a03 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:33:06.169806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:06.178896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34335619-bac3-44b8-a099-bb80d2ffb356 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1195 microversion: 2.1 time: 0.286186 Jul 25 16:33:06.193221 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2423/4807] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:05 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1195 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:06.198612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:06.199483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:06.207651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:06.208410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:06.209452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:06.210053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:06.333083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=17 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:06.811074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:06.819648 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48256d12-0a48-4304-a881-b0fe357ea409 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 0.624871 Jul 25 16:33:06.820271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2424/4808] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:06 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:06.901379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:06.902144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:06.910905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:06.911393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:06.912384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:06.912836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:07.803204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:07.829582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:07.831935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:07.836772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e373d37c-734b-404b-8c81-dd6b556680fe tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.937458 Jul 25 16:33:07.840333 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2425/4809] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:06 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:07.854213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:07.858513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:07.891760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:07.892552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:07.895371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:07.896056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:07.958278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:07.963025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:07.963756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:07.965037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lazy-loading 'fault' on Instance uuid 72038b76-3a5c-4928-b54b-cecabc796a03 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:33:08.135095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:08.153161 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3db8fca-274c-4413-a455-44f6a1437f1c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1195 microversion: 2.1 time: 0.309810 Jul 25 16:33:08.155273 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2426/4810] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:07 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1195 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:08.163592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:08.164490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:08.176011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:08.177596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:08.179416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:08.180569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:08.537380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:08.578567 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d09c5693-052d-404e-9176-f33989185985 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 0.420238 Jul 25 16:33:08.580458 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2427/4811] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:08 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:08.867420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:08.868506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:08.881458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:08.881934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:08.882748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:08.883192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.310649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:09.326427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:09.327960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:09.329494 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04ca3787-4466-4501-913b-135d876cafd3 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.466917 Jul 25 16:33:09.330612 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2428/4812] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:08 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:09.336769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:09.343155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:09.357596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.358280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.364993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.365861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.488886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.489610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.494708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lazy-loading 'fault' on Instance uuid 72038b76-3a5c-4928-b54b-cecabc796a03 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:33:09.639743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:09.655183 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e25b567c-88c6-4d72-8425-07de66bd93a5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 200 len: 1149 microversion: 2.1 time: 0.323082 Jul 25 16:33:09.656360 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2429/4813] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:09 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 1149 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:09.657198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:33:09.657744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:33:09.658316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:33:09.658940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:33:09.659485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:33:09.662615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:09.665002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:09.668565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:09.680483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.686268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.687483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.691918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.692195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.693336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.696674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:09.697528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:09.774710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Getting quotas for project ee5a12aa133d430189c82b17ade9ad92. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:33:09.784963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Getting quotas for user 2f098d5d34404aa2907984bfe29910b8 and project ee5a12aa133d430189c82b17ade9ad92. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:33:10.020990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:33:10.024865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6e26682d-f7bf-4024-82f1-1f1d2802e13e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c47ca651-4435-4607-a1dd-281994263ada',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2afd92a7-c32f-407c-b759-d193c5f546a3',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:33:10.545560 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c3eec6c-f980-4fea-8773-a47971c49be9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.42 time: 14.184234 Jul 25 16:33:10.546845 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2385/4814] 10.222.0.105 () {62 vars in 1194 bytes} [Mon Jul 25 16:32:56 2022] POST /compute/v2.1/servers => generated 407 bytes in 14188 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 16:33:10.552214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d27b0bec-0f92-47b5-aca0-158ba77a0660 req-06800cb2-065c-40e1-b741-a3d8f2ccbe86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7", "name": "network-vif-plugged", "status": "completed", "tag": "31321198-0e68-4cfe-8bd2-183b5e1dd89b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:10.565141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d27b0bec-0f92-47b5-aca0-158ba77a0660 req-06800cb2-065c-40e1-b741-a3d8f2ccbe86 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:10.565788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d27b0bec-0f92-47b5-aca0-158ba77a0660 req-06800cb2-065c-40e1-b741-a3d8f2ccbe86 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:10.595246 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d27b0bec-0f92-47b5-aca0-158ba77a0660 req-06800cb2-065c-40e1-b741-a3d8f2ccbe86 service nova] Creating event network-vif-plugged:31321198-0e68-4cfe-8bd2-183b5e1dd89b for instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 on n-h2-846219-13 Jul 25 16:33:10.603307 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d27b0bec-0f92-47b5-aca0-158ba77a0660 req-06800cb2-065c-40e1-b741-a3d8f2ccbe86 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054706 Jul 25 16:33:10.604372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2386/4815] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:10.611624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:10.612583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:10.622105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:10.622634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:10.623471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:10.623924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:10.626246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:10.635706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-debefabd-cc04-42ca-bb89-8f40e160ad9f tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 0.977184 Jul 25 16:33:10.636384 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2430/4816] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:09 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:10.649310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9bb8849-4238-4236-b9a2-c3fc8948aaba tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:10.649946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9bb8849-4238-4236-b9a2-c3fc8948aaba tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:10.974570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9bb8849-4238-4236-b9a2-c3fc8948aaba tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:10.982920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9bb8849-4238-4236-b9a2-c3fc8948aaba tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:10.984609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9bb8849-4238-4236-b9a2-c3fc8948aaba tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:10.986205 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9bb8849-4238-4236-b9a2-c3fc8948aaba tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1288 microversion: 2.42 time: 0.340933 Jul 25 16:33:11.007264 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2431/4817] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:10 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1288 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:11.013836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:11.014715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 72038b76-3a5c-4928-b54b-cecabc796a03] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:11.022707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:11.023495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:11.025149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:11.025834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:11.055380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 72038b76-3a5c-4928-b54b-cecabc796a03 could not be found. Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 HTTP/1.1 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 72038b76-3a5c-4928-b54b-cecabc796a03 could not be found. Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '72038b76-3a5c-4928-b54b-cecabc796a03'} Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72038b76-3a5c-4928-b54b-cecabc796a03 could not be found. Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72038b76-3a5c-4928-b54b-cecabc796a03 could not be found. Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:11.064324 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72038b76-3a5c-4928-b54b-cecabc796a03 could not be found. Jul 25 16:33:11.069839 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:33:11.072506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 72038b76-3a5c-4928-b54b-cecabc796a03 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:33:11.073833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f97c2b16-c591-4c17-aa3a-787987975753 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03" status: 404 len: 111 microversion: 2.1 time: 0.065274 Jul 25 16:33:11.074908 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2432/4818] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:11 2022] GET /compute/v2.1/servers/72038b76-3a5c-4928-b54b-cecabc796a03 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:33:11.322881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:11.335507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:11.338382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:11.341546 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca15279e-05e9-4db6-84de-5018e8c78f50 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.735367 Jul 25 16:33:11.342937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2387/4819] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:10 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:11.660840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:11.682659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:11.702461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:11.703048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:11.704048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:11.704839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:12.011410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b2fe7fc6-9dd5-4efe-91c2-0010191b3506 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:12.012949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b2fe7fc6-9dd5-4efe-91c2-0010191b3506 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:12.245884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b2fe7fc6-9dd5-4efe-91c2-0010191b3506 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.262693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b2fe7fc6-9dd5-4efe-91c2-0010191b3506 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.264219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b2fe7fc6-9dd5-4efe-91c2-0010191b3506 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.267127 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b2fe7fc6-9dd5-4efe-91c2-0010191b3506 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1288 microversion: 2.42 time: 0.258700 Jul 25 16:33:12.277849 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2388/4820] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:12 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1288 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:12.379488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:12.380919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:12.391865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:12.392727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:12.393794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:12.394385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:12.411757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.415426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:12.423055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9d8912d-babf-4b66-b6a7-867ed6d5b73e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1318 microversion: 2.1 time: 0.768893 Jul 25 16:33:12.431211 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2433/4821] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:11 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:12.974462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.990363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.991954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:12.993364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ab137d11-9fdf-4847-9159-a4734d866cf8 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.624645 Jul 25 16:33:13.003272 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2389/4822] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:12 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:13.304333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:13.305692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:13.315727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:13.325955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:13.327346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:13.328006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:13.447702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:13.448314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:13.464253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:13.467187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:13.480854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:13.483514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:13.483963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:13.484080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:13.502381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:13.508645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d907b3d-34e5-4f84-93f8-29c3f72b8472 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1586 microversion: 2.42 time: 0.207583 Jul 25 16:33:13.509992 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2434/4823] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:13 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1586 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:13.957612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:13.965952 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e00580f-57c3-4543-9ed8-d67d1a94bc67 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1504 microversion: 2.1 time: 0.521899 Jul 25 16:33:13.972137 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2390/4824] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:13 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:13.996129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:13.999171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:14.010776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.014848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.016311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.017214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.030051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:14.031228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:14.042871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.049984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.052548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.055086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.119193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lazy-loading 'flavor' on Instance uuid aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:33:14.304288 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f1a407d-44f6-4e83-81f8-b81dc7a27ae9 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "POST /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7/action" status: 200 len: 32 microversion: 2.1 time: 0.313627 Jul 25 16:33:14.310683 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2435/4825] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:33:13 2022] POST /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7/action => generated 32 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:33:14.321871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:14.323131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:14.336389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.341691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.343028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.343695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.651807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:14.660822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:14.669071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:14.673649 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07632de7-0ec8-4c88-b6db-1d0cd649a86d tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.647817 Jul 25 16:33:14.678026 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2391/4826] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:14 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:14.695569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:14.696888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:14.717290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.718081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.721980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.722748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:15.025311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:15.048944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:15.050887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:15.052285 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca764b35-15e1-4deb-b4eb-2332a483c791 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1596 microversion: 2.42 time: 0.372491 Jul 25 16:33:15.052713 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2392/4827] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:14 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1596 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:15.667452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:15.677317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5087b662-a661-4eb0-aaa1-bccc9595e082 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.360354 Jul 25 16:33:15.685488 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2436/4828] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:14 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:15.706717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:15.707387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:15.724159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:15.727309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:15.731289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:15.737781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.076528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:16.077682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:16.092006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.094536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.095711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.099687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.840753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:16.859771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:16.864127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:16.865440 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8377d212-d231-473d-8f46-c62ef4dab94c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1596 microversion: 2.42 time: 0.793018 Jul 25 16:33:16.870851 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2437/4829] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:16 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1596 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:16.880703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:16.882335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:16.909365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.910055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.911325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.913043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:17.467716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:17.483581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:17.507839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:17.513158 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5970b690-8d7a-426e-800b-c39923eb007e tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 1.813191 Jul 25 16:33:17.531687 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2393/4830] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:15 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:17.889672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:17.890345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:17.931597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:17.940973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:17.951424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:17.955801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:18.051605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:18.103139 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d9b6311f-a2c1-4440-b57a-f1b00235c4ae tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.214636 Jul 25 16:33:18.112944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2438/4831] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:16 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:18.542593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:18.543384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:18.564046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:18.570709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:18.572111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:18.577707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:19.695818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.737140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.742044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.744705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de06bbf8-ce88-4621-b37b-ba5a005c84d0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1663 microversion: 2.42 time: 1.859328 Jul 25 16:33:19.781501 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2394/4832] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:17 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1663 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:19.811654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:19.818864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:19.857007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:19.869207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.873655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:19.874175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:19.875043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:19.875494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:19.882637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.889555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.898164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a6b4da5d-139b-4f71-b8bb-3692301a2bb5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 1.359956 Jul 25 16:33:19.905420 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2439/4833] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:18 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:20.782877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:20.784808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:20.814865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:20.820064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:20.838249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:20.840006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:20.852568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:20.875196 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5fdd07d-c5e1-4bd0-9128-f9bf5f21109b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.086812 Jul 25 16:33:20.877140 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2395/4834] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:19 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:20.936368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:20.938615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:20.973158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:20.981684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:20.983411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:20.987712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:20.989589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:21.593063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:21.609839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:21.613653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:21.620398 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4477d9e-f110-464f-a55e-1b76e689be5b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 0.690571 Jul 25 16:33:21.636983 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2396/4835] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:20 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:21.653603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:21.712710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:21.719549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:21.727003 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff171b8b-ebc2-4592-9a4e-8fb614da17ed tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1709 microversion: 2.42 time: 0.948887 Jul 25 16:33:21.746764 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2440/4836] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:20 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1709 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:21.899955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:21.900597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:21.919393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:21.919856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:21.920667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:21.921140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:22.050686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-43d8e299-8618-4a75-a784-e5d261f75bad req-146ea9a6-b240-4ef9-b1be-688e20a8a288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "name": "network-vif-plugged", "status": "completed", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:22.103911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-43d8e299-8618-4a75-a784-e5d261f75bad req-146ea9a6-b240-4ef9-b1be-688e20a8a288 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:22.104375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-43d8e299-8618-4a75-a784-e5d261f75bad req-146ea9a6-b240-4ef9-b1be-688e20a8a288 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:22.166607 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-43d8e299-8618-4a75-a784-e5d261f75bad req-146ea9a6-b240-4ef9-b1be-688e20a8a288 service nova] Creating event network-vif-plugged:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h1-846219-13 Jul 25 16:33:22.176879 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-43d8e299-8618-4a75-a784-e5d261f75bad req-146ea9a6-b240-4ef9-b1be-688e20a8a288 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131812 Jul 25 16:33:22.178737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2441/4837] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:33:22.259593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:22.645280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:22.645914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:22.683477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:22.684263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:22.685376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:22.686230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:25.297158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:25.323467 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12e557fb-f377-436d-97d1-6226ae96d157 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 3.412014 Jul 25 16:33:25.335591 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2397/4838] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:21 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 3440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:25.370528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:25.371492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:25.413545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:25.414389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:25.437870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:25.441047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:25.821124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:25.850500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:25.852563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:25.853937 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7abee36-e473-4810-9256-f49368573d23 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1735 microversion: 2.20 time: 3.213753 Jul 25 16:33:25.854561 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2442/4839] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:22 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1735 bytes in 3215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:26.351529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:26.363374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:26.370763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:26.373751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:26.382081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:26.383026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.349972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.376502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.395285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.397041 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a3c0380-67aa-4729-83bb-43255fc7d04c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1755 microversion: 2.42 time: 2.059651 Jul 25 16:33:27.408815 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2398/4840] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:25 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1755 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:27.431836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-095be28a-b36b-46f1-939d-ad3f9131cf01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'create', calling method: .version_select at 0x7f9d92dc5940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1976206920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2x6n3nIMBI4K/PF3j+sq7lrn4Cgqio11sahuYrj/nTC9BYCklgeh20wiLdYPkhFvbFQTo1Y7p/1ebrAJWOFRmVISr7zgOSuW8DkdFvGXfQPU3zU5ZGZi7dxoi0RZBbCg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:27.475091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-095be28a-b36b-46f1-939d-ad3f9131cf01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:33:27.509259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-095be28a-b36b-46f1-939d-ad3f9131cf01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for user 0333f8e4e1e54bcda08bce44f79fbc9c and project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:33:27.610361 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-095be28a-b36b-46f1-939d-ad3f9131cf01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.197910 Jul 25 16:33:27.613501 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2399/4841] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:33:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:27.634074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:27.634720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:27.649969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.656184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.656619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.659601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06ed9698-46d7-450c-ae71-3bd090e16a14 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.313412 Jul 25 16:33:27.669528 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2443/4842] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:26 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:27.671489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.672164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.738234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:27.738932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:27.755283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.762365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.764196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.764814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.866850 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-adfd40a3-e7e4-43f2-af6b-0078a2735322 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/ips" status: 200 len: 149 microversion: 2.1 time: 0.131883 Jul 25 16:33:27.886211 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2444/4843] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:33:27 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/ips => generated 149 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:28.391723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:28.409257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:28.410877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:28.425904 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8dd6e027-3e7b-4d06-b581-26b7831896d1 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1722 microversion: 2.20 time: 0.796466 Jul 25 16:33:28.429978 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2400/4844] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:27 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1722 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:28.442662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:28.443577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:28.453615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.465540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.470034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.472399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.709742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:28.711158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:28.760536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.763602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.766349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.772951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:30.042634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:30.059301 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a81aa26e-9fca-40d6-9e09-e6304db45a15 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.354900 Jul 25 16:33:30.062696 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2401/4845] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:28 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:30.241488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:30.272155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:30.274446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:30.278643 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7a8f3886-407d-4165-bf46-4be149c4d33a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1847 microversion: 2.42 time: 1.840181 Jul 25 16:33:30.286054 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2445/4846] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:28 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1847 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:30.923050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e0d306a-91bc-448c-a73e-3abe82a6a7b4"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:30.927253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:30.936869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.937820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:30.939049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.939782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.100495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:31.102441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:31.159770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.162438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.164465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.170302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.694052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14f792a7-edd1-4838-a92a-1cd7da571f17 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "POST /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758440 Jul 25 16:33:31.699996 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2402/4847] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:33:30 2022] POST /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:31.715591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:31.717851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:31.729197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.731138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.732721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.733452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.804376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:33.820763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.848000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.868668 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15796174-05e2-4564-a1bb-9265ad1b739b tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 2.778594 Jul 25 16:33:33.869402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.883866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.888589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2446/4848] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:31 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 2799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:33.896060 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-deb3001a-67e2-4360-949b-7790044a940a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1847 microversion: 2.42 time: 2.187495 Jul 25 16:33:33.903886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-286a3201-aed6-43da-941a-10acf9629f66 req-6b5ecb3b-7d43-482f-903c-bbfbba878f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "6afef70b-7f67-402e-8508-8cc2de9786ec"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:33.943256 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2403/4849] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:31 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1847 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:33.947394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-286a3201-aed6-43da-941a-10acf9629f66 req-6b5ecb3b-7d43-482f-903c-bbfbba878f89 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:33.948531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-286a3201-aed6-43da-941a-10acf9629f66 req-6b5ecb3b-7d43-482f-903c-bbfbba878f89 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:33.983543 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-286a3201-aed6-43da-941a-10acf9629f66 req-6b5ecb3b-7d43-482f-903c-bbfbba878f89 service nova] Creating event network-changed:6afef70b-7f67-402e-8508-8cc2de9786ec for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:34.005885 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-286a3201-aed6-43da-941a-10acf9629f66 req-6b5ecb3b-7d43-482f-903c-bbfbba878f89 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111752 Jul 25 16:33:34.007866 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2447/4850] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:34.921766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:34.924029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:34.955365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:34.957368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:34.980528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.988399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.989927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.993121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.994984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.996048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.997533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:35.001304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:35.590850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:35.632491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-483fe66f-4c11-45a8-8d99-e9a350aa4771 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.721427 Jul 25 16:33:35.645146 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2404/4851] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:34 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:36.059490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.075560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1978537646", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "329df307-b1d9-4e77-8049-81a078de81ce"}], "key_name": "tempest-TestNetworkBasicOps-1976206920", "security_groups": [{"name": "tempest-secgroup-smoke-1569504306"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:36.107822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.114554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.124956 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4858c169-8a15-4786-8efd-1764403eccbe tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1868 microversion: 2.42 time: 1.184760 Jul 25 16:33:36.126857 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2448/4852] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:34 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1868 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:36.168427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e9b815ec-11ef-44e2-9558-e0a5f25c7612 req-79d7314d-2a1f-4dfe-b888-a9e0113a47c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "c6da5128-e2d0-4fcf-bccf-fd97f40e76eb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:36.234480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e9b815ec-11ef-44e2-9558-e0a5f25c7612 req-79d7314d-2a1f-4dfe-b888-a9e0113a47c7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.234876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e9b815ec-11ef-44e2-9558-e0a5f25c7612 req-79d7314d-2a1f-4dfe-b888-a9e0113a47c7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.322231 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e9b815ec-11ef-44e2-9558-e0a5f25c7612 req-79d7314d-2a1f-4dfe-b888-a9e0113a47c7 service nova] Creating event network-changed:c6da5128-e2d0-4fcf-bccf-fd97f40e76eb for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:36.331465 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e9b815ec-11ef-44e2-9558-e0a5f25c7612 req-79d7314d-2a1f-4dfe-b888-a9e0113a47c7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199568 Jul 25 16:33:36.336705 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2449/4853] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:36.684401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:36.691349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:36.723747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.730727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.733190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.735219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.824678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] validate_networks() for [('329df307-b1d9-4e77-8049-81a078de81ce', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:33:37.542088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:37.553134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:37.569463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:37.635167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9491d74a-05d1-4ab5-a616-0db5a3603208 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.970661 Jul 25 16:33:37.640563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2450/4854] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:36 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:37.662369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:37.666554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:37.697901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.699700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:37.706220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.707543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.661543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:38.678958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:38.684187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:38.700222 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08cc1ce3-3b26-446e-a847-ec56051c8469 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 1.039628 Jul 25 16:33:38.702433 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2451/4855] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:37 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:38.709770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:38.710531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:38.751241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=56 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:38.754170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.754681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.755636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.756143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.181974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:33:39.182850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:33:39.183389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:33:39.184169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:33:39.184956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:33:39.222320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.226941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.230572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.237312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.314844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:33:39.331608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Getting quotas for user 0333f8e4e1e54bcda08bce44f79fbc9c and project 3dbafb0a4ca4428eaa651274f6939053. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:33:39.366048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:39.378766 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4e17a1bf-d910-4d58-bc01-e5fda1fd04b2 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.674890 Jul 25 16:33:39.384847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:33:39.397141 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2452/4856] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:38 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:39.397513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:33:39.461774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c7bddeea-124e-40be-bb5d-4a2c79134bbd req-4f5f0639-33d8-4586-9574-8c33876f3f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "e4703297-42bf-47c4-8e81-e51cf2f63f5a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:39.488281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c7bddeea-124e-40be-bb5d-4a2c79134bbd req-4f5f0639-33d8-4586-9574-8c33876f3f68 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.499115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c7bddeea-124e-40be-bb5d-4a2c79134bbd req-4f5f0639-33d8-4586-9574-8c33876f3f68 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.544883 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c7bddeea-124e-40be-bb5d-4a2c79134bbd req-4f5f0639-33d8-4586-9574-8c33876f3f68 service nova] Creating event network-changed:e4703297-42bf-47c4-8e81-e51cf2f63f5a for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:39.553280 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c7bddeea-124e-40be-bb5d-4a2c79134bbd req-4f5f0639-33d8-4586-9574-8c33876f3f68 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099722 Jul 25 16:33:39.557227 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2453/4857] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:39.559813 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4b3a3d5-3a4c-4879-bc0d-78139f568bac tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.497300 Jul 25 16:33:39.561558 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2405/4858] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:33:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 3501 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:33:39.580483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d8c1e8a-820d-4130-b927-5462d070279c tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:39.581513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d8c1e8a-820d-4130-b927-5462d070279c tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:39.706341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d8c1e8a-820d-4130-b927-5462d070279c tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:39.715371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d8c1e8a-820d-4130-b927-5462d070279c tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1253 microversion: 2.1 time: 0.142850 Jul 25 16:33:39.716946 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2454/4859] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:39 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1253 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:39.750191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:39.756437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:39.769315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:39.772363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.775110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.778317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.782006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.369604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:40.390767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:40.400357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:40.403152 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-19af0df7-9275-460b-85c9-2a7910f78509 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 0.656806 Jul 25 16:33:40.412110 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2406/4860] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:39 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:40.427071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:40.429312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:40.461921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.468192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.475157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.476048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.772386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4aa86f32-216f-4ead-a63f-c1b18bf0c735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:40.774029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4aa86f32-216f-4ead-a63f-c1b18bf0c735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:40.938118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:40.953208 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34c9cf2e-d102-432f-8eba-f8cf02ae67ad tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.532220 Jul 25 16:33:40.957607 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2455/4861] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:40 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:41.084099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4aa86f32-216f-4ead-a63f-c1b18bf0c735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:41.097142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4aa86f32-216f-4ead-a63f-c1b18bf0c735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1253 microversion: 2.1 time: 0.342519 Jul 25 16:33:41.102354 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2407/4862] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:40 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1253 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:41.459416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:41.465054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:41.497630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:41.498789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:41.500186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:41.500884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:41.981191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:41.982683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:41.999295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.006220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.015168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.020024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.203024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.236435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.238065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.248566 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b2bef3db-0b0d-47e9-89b2-95ca4bdae9e7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 0.796732 Jul 25 16:33:42.249217 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2456/4863] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:41 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:42.269534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:42.270232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:42.314928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.315535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.316369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.316879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.448621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.464097 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5050146-6232-4747-a16b-4bfa97eae564 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.488145 Jul 25 16:33:42.464919 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2408/4864] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:41 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:42.531110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.550000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d1fe747-737c-4a7c-98ac-dd6b3ee37a94 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1323 microversion: 2.1 time: 0.299438 Jul 25 16:33:42.551027 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2457/4865] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:42 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:43.280427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:43.281431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:43.309407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.318021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:43.319225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.319866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:43.510429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:43.511291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:43.543556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.546659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:43.547557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.550518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:44.010781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:44.037280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:44.039184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:44.040687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67b1bd9e-e854-4193-9b09-be9c839f4e03 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 0.768194 Jul 25 16:33:44.045632 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2409/4866] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:43 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:44.051807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:44.064031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:44.079258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:44.080369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:44.086175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:44.093201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:44.453249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:44.475380 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4d8ffc93-a840-455e-8a46-b7e31c2e478f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1311 microversion: 2.1 time: 0.427505 Jul 25 16:33:44.480437 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2410/4867] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:44 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:44.522590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cec5cfc3-ae0d-4a76-a56a-6596a0fef15f req-b9b32875-ce92-4cfa-89d5-4c7acee9e7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:44.571366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cec5cfc3-ae0d-4a76-a56a-6596a0fef15f req-b9b32875-ce92-4cfa-89d5-4c7acee9e7fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:44.573556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cec5cfc3-ae0d-4a76-a56a-6596a0fef15f req-b9b32875-ce92-4cfa-89d5-4c7acee9e7fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:44.630900 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cec5cfc3-ae0d-4a76-a56a-6596a0fef15f req-b9b32875-ce92-4cfa-89d5-4c7acee9e7fa service nova] Creating event network-changed:c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:44.643793 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cec5cfc3-ae0d-4a76-a56a-6596a0fef15f req-b9b32875-ce92-4cfa-89d5-4c7acee9e7fa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157893 Jul 25 16:33:44.655524 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2411/4868] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:44.850164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:44.878845 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-45887db2-df69-4355-8216-3ecc3ea4625c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.374293 Jul 25 16:33:44.894450 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2458/4869] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:43 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:45.095388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:45.096270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:45.121829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:45.124489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:45.126265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:45.129263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:45.529116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:45.534309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:45.568862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:45.569520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:45.577931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:45.578926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:46.128173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:46.146475 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c7f1392-f597-47fa-bcea-b5c1c6a6e723 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1311 microversion: 2.1 time: 0.629095 Jul 25 16:33:46.148099 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2459/4870] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:45 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1311 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:46.161346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:46.162130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:46.176419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:46.181718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:46.183221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:46.183926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:47.307592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:47.335791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:47.342712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:47.344006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc911ac1-b856-450f-ab57-1a86881acd0a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 2.254844 Jul 25 16:33:47.354799 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2412/4871] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:45 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:47.377279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:47.384244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:47.407137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:47.408322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:47.409491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:47.414613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:47.466808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:47.479354 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0faf15fc-8add-4dcd-a32e-7d899333e767 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 1.329848 Jul 25 16:33:47.487580 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2460/4872] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:46 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:47.813016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:47.828127 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57965287-f356-4c47-a271-507e1115083b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1311 microversion: 2.1 time: 0.470512 Jul 25 16:33:47.836819 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2413/4873] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:47 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1311 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:48.372295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:48.373692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:48.388546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:48.389557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:48.391656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:48.392307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:48.524316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:48.525652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:48.551984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:48.561798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:48.562665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:48.563326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:49.271569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:49.544888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:49.562724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:49.573822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:49.590479 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fa6886e0-7868-4517-a26f-df77975e7ab4 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 1.222111 Jul 25 16:33:49.593797 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2461/4874] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:48 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:49.600506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:49.614419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:49.625635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:49.639047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.639773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:49.639935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-968e154f-898e-42a6-bef6-6122ea189ea6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1490 microversion: 2.1 time: 1.121188 Jul 25 16:33:49.640913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.641664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:49.645253 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2414/4875] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:48 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1490 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:49.670103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-18827fd8-f714-423d-805d-6fe00997b2f5 req-7946b12c-6a00-4406-89a0-4b152d5cbedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "413593f7-3566-422c-9be7-06ba68784b70"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:49.714779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:49.735110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-18827fd8-f714-423d-805d-6fe00997b2f5 req-7946b12c-6a00-4406-89a0-4b152d5cbedb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.738112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-18827fd8-f714-423d-805d-6fe00997b2f5 req-7946b12c-6a00-4406-89a0-4b152d5cbedb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:49.780599 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-18827fd8-f714-423d-805d-6fe00997b2f5 req-7946b12c-6a00-4406-89a0-4b152d5cbedb service nova] Creating event network-changed:413593f7-3566-422c-9be7-06ba68784b70 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:49.810427 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-18827fd8-f714-423d-805d-6fe00997b2f5 req-7946b12c-6a00-4406-89a0-4b152d5cbedb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159898 Jul 25 16:33:49.817484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2415/4876] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:49.853343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:49.856317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:49.887336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.887948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:49.894454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.894951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:50.047569 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a61e68f2-ccb0-42a6-8d43-f22d3ca73b33 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "POST /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7/action" status: 202 len: 0 microversion: 2.1 time: 0.227626 Jul 25 16:33:50.051963 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2416/4877] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:33:49 2022] POST /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:33:50.066403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:50.067405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:50.078254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:50.079159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:50.080610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:50.081313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:50.841466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:50.870361 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d7f5c6d-6fa1-4e9d-beb0-a40db7c90be1 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 1.275023 Jul 25 16:33:50.873197 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2462/4878] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:49 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:50.888055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:50.889824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:50.907074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:50.908514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:50.910789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:50.913683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:51.093946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:51.682079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:51.711433 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bf78513e-9078-4bbf-8102-60f6246bca32 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1498 microversion: 2.1 time: 1.649723 Jul 25 16:33:51.729332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2417/4879] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:50 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1498 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:51.909856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:51.910905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:51.937180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:51.937752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:51.939241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:51.939960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:52.811796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:52.865212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:52.876100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:52.886716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:52.894408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92929565-9a31-477f-a40f-9e753ff4c14c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 2.003779 Jul 25 16:33:52.909589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2463/4880] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:50 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:52.917433 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-76fbcb27-a981-41d1-b913-737171016735 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 1.012103 Jul 25 16:33:52.929194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:52.931730 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2418/4881] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:51 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:52.936632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:52.958209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:52.958690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:52.959540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:52.959997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:53.586967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:53.625068 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aaa6a21c-923b-4cc7-9883-30574a4ec587 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1498 microversion: 2.1 time: 0.721742 Jul 25 16:33:53.626562 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2464/4882] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:52 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1498 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:53.969035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:53.970230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:53.986629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:53.987757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:54.002017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:54.003273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:54.008786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:54.010090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:54.021229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:54.040496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:54.049407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:54.058881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:55.334177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:55.368897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c57740d6-29d9-41af-b624-b0ef0171c95e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 1.410773 Jul 25 16:33:55.371130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2465/4883] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:53 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:55.387828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:55.405048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b921be49-a58e-4494-912c-9190db564d25 req-b21a16a8-2f93-4138-82f0-d2d5fb6098aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "3023088a-a54b-4442-8e02-6038517007c3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:55.450242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:55.460341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:55.467499 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e2758b9-561c-495d-9381-9c968496c8b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 1.508605 Jul 25 16:33:55.473049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b921be49-a58e-4494-912c-9190db564d25 req-b21a16a8-2f93-4138-82f0-d2d5fb6098aa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:55.480115 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2419/4884] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:53 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:55.486581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b921be49-a58e-4494-912c-9190db564d25 req-b21a16a8-2f93-4138-82f0-d2d5fb6098aa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:55.501464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:55.507346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:55.544450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:55.552163 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b921be49-a58e-4494-912c-9190db564d25 req-b21a16a8-2f93-4138-82f0-d2d5fb6098aa service nova] Creating event network-changed:3023088a-a54b-4442-8e02-6038517007c3 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:55.553744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:55.558861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:55.561453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:55.575475 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b921be49-a58e-4494-912c-9190db564d25 req-b21a16a8-2f93-4138-82f0-d2d5fb6098aa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200743 Jul 25 16:33:55.576815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2466/4885] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:56.095369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-343853b6-902c-46bb-ba4c-8eec040aac8c req-e7f5c1e3-f279-424f-83a3-b87899c21d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51941f7a-4ca1-497f-987c-607d1604998a", "tag": "0f11cf9f-e1f9-4931-bf00-529b05c2903e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:56.121384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-343853b6-902c-46bb-ba4c-8eec040aac8c req-e7f5c1e3-f279-424f-83a3-b87899c21d94 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:56.122838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-343853b6-902c-46bb-ba4c-8eec040aac8c req-e7f5c1e3-f279-424f-83a3-b87899c21d94 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:56.149005 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-343853b6-902c-46bb-ba4c-8eec040aac8c req-e7f5c1e3-f279-424f-83a3-b87899c21d94 service nova] Creating event network-changed:0f11cf9f-e1f9-4931-bf00-529b05c2903e for instance 51941f7a-4ca1-497f-987c-607d1604998a on n-h1-846219-13 Jul 25 16:33:56.162561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-343853b6-902c-46bb-ba4c-8eec040aac8c req-e7f5c1e3-f279-424f-83a3-b87899c21d94 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.582732 Jul 25 16:33:56.166218 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2467/4886] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:56.412172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:56.415954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:56.450855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:56.456427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:56.458181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:56.462595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:57.280654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:57.300695 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61606d42-641f-4a3b-9d03-4f48ae129229 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1504 microversion: 2.1 time: 1.819005 Jul 25 16:33:57.303185 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2420/4887] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:55 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1504 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:57.320875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:57.324987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:57.344143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:57.347990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:57.351151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:57.353415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:58.455834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:58.483464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c43de200-a7b7-4177-a363-5baab5fdcffc tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 2.079902 Jul 25 16:33:58.493548 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2468/4888] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:56 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:58.509428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:58.513317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:58.537623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:58.544003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:58.548595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:58.554120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:58.661415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:33:58.768848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:59.006205 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65c4e3c6-6f12-49da-ad82-343adedcde34 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "DELETE /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 204 len: 0 microversion: 2.1 time: 0.505281 Jul 25 16:33:59.017161 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2469/4889] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:33:58 2022] DELETE /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:33:59.040356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5cecf2aa-4bd2-4e07-b21f-8556ba70d64e req-514ba537-325e-4210-9cae-0224246fbe82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "72acbf75-e548-4547-b749-1640257cd1c2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:59.111176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5cecf2aa-4bd2-4e07-b21f-8556ba70d64e req-514ba537-325e-4210-9cae-0224246fbe82 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:59.112831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5cecf2aa-4bd2-4e07-b21f-8556ba70d64e req-514ba537-325e-4210-9cae-0224246fbe82 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:59.188288 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5cecf2aa-4bd2-4e07-b21f-8556ba70d64e req-514ba537-325e-4210-9cae-0224246fbe82 service nova] Creating event network-changed:72acbf75-e548-4547-b749-1640257cd1c2 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:33:59.218055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5cecf2aa-4bd2-4e07-b21f-8556ba70d64e req-514ba537-325e-4210-9cae-0224246fbe82 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196076 Jul 25 16:33:59.218740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2470/4890] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:59.233014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:59.239211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:59.281820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:59.282650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:59.284234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:59.285004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:59.847770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:59.867158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:59.869355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:59.870642 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60ec2d63-24a3-4226-847f-367acb049887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 2.565392 Jul 25 16:33:59.881737 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2421/4891] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:33:57 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 2577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:59.887803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:59.888979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:59.904617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:59.905067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:59.905911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:59.906351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:59.971766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:00.165331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:00.173907 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9eb9183b-2682-4abb-ace6-d9dcf9e70b73 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.951983 Jul 25 16:34:00.181905 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2471/4892] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:59 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:00.876348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:00.914548 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9bb39ae2-3dad-4793-96fb-53c43f5bb346 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 1.030143 Jul 25 16:34:00.915612 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2422/4893] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:33:59 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:00.920354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:00.927355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:01.018093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:01.045065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:01.047684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:01.052500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:01.213339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:01.214386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:01.260875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:01.261685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:01.270054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:01.270590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:01.886527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:01.899231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bbb24966-41bd-4e8a-a96b-4c0c6b736c17 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.694238 Jul 25 16:34:01.910274 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2423/4894] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:01 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:01.926301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:01.940082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:01.941238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:01.950543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:01.957155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:01.959447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:01.960240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:01.961334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:01.962944 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-580a24ba-75b4-439f-9894-d4b6ccb9a830 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 1.065096 Jul 25 16:34:01.965377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:01.975012 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2472/4895] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:00 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:02.508631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:02.520648 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6721c2d8-ee2a-406f-9551-10b48cfeec0f tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 0.584475 Jul 25 16:34:02.525775 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2424/4896] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:01 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:02.933328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:02.935553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:02.954746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:02.955505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:02.956371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:02.957487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:02.993667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:02.994497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:03.004297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:03.004747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:03.005592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:03.006222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:03.529917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:03.550895 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1ad3e61-e0e4-4c35-9cda-5619ab958d1e tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1510 microversion: 2.1 time: 0.624047 Jul 25 16:34:03.553293 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2473/4897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:02 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1510 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:03.559176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:03.560243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:03.587964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:03.589237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:03.591678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:03.592535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:03.632998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:03.656765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:03.661353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:03.665590 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f483273-85b5-44c2-94ce-3219873178a9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 0.675975 Jul 25 16:34:03.668117 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2425/4898] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:02 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:04.431786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:04.432469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:04.450172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:04.450708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:04.451577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:04.452011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:04.615431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:04.639948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c30d051-26cb-4c57-b80c-0c16adc1ac06 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 1.079010 Jul 25 16:34:04.644767 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2474/4899] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:03 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:04.659462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:04.668420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:04.696286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:04.699031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:04.700188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:04.703976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:04.774241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lazy-loading 'services' on Instance uuid 7e76c6df-ea9a-47af-9309-1db0e79e4f65 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:34:04.990785 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e51a411-eddd-4021-8ef9-ad860d4c4772 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments/9e0d306a-91bc-448c-a73e-3abe82a6a7b4" status: 202 len: 0 microversion: 2.1 time: 0.564808 Jul 25 16:34:04.991569 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2426/4900] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:34:04 2022] DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments/9e0d306a-91bc-448c-a73e-3abe82a6a7b4 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:34:05.019514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:05.020142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:05.036713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.037200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.046334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.051557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.167079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:05.188339 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ef7429d-51eb-4139-8aea-74587b3809fc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 200 len: 1468 microversion: 2.1 time: 0.540430 Jul 25 16:34:05.190998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2475/4901] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:04 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 1468 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:05.226744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:05.240542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:05.269124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.269757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.288684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.289172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.470888 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c7872999-8e4e-474a-91eb-12b5f93c90e1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262772 Jul 25 16:34:05.476645 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2476/4902] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:05 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:05.496398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-dc528b09-3e1a-449f-ad08-4d50cad4d58e req-e3ef8bb5-ad58-472e-8fed-6775157157fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7", "name": "network-vif-deleted", "tag": "31321198-0e68-4cfe-8bd2-183b5e1dd89b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:05.536764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-dc528b09-3e1a-449f-ad08-4d50cad4d58e req-e3ef8bb5-ad58-472e-8fed-6775157157fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.537548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-dc528b09-3e1a-449f-ad08-4d50cad4d58e req-e3ef8bb5-ad58-472e-8fed-6775157157fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.555284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-dc528b09-3e1a-449f-ad08-4d50cad4d58e req-e3ef8bb5-ad58-472e-8fed-6775157157fa service nova] Creating event network-vif-deleted:31321198-0e68-4cfe-8bd2-183b5e1dd89b for instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 on n-h2-846219-13 Jul 25 16:34:05.566611 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-dc528b09-3e1a-449f-ad08-4d50cad4d58e req-e3ef8bb5-ad58-472e-8fed-6775157157fa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081881 Jul 25 16:34:05.567683 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2477/4903] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:05.664330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:05.664884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:05.674696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.676994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.680349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:05.687938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:05.795235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:05.814089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:05.821875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:05.823886 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83cdc730-930c-4a78-9380-ddb42e306f82 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 0.827450 Jul 25 16:34:05.825186 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2427/4904] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:04 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:06.036786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:06.049128 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7785edfd-8640-4f8d-ade3-194e751d5b9b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 0.389084 Jul 25 16:34:06.062573 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2478/4905] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:05 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:06.212383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:06.213439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:06.254741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.256177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.260619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.264086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.317149 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] HTTP exception thrown: Instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 could not be found. Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Request method failure captured: Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 HTTP/1.1 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVmqXJuZRfg0QVgvzWKowVP5AtdtR5_9D2fkwkkuZyWkTvIpX9K5CWg7fXN9lzgTyt-l1gEJpwyDIlQP7BGY_H-JyMomA6JrG0ka_1RZOdbPKR0qiedWewv8meziC-9QmIEYuDLfvptYTv3mccsppWF1yvziZqmtFLQoJwE3C52RuQ Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: beb5133297c44d4d9c78c77e2990da44 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueTestJSON-224230337 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/beb5133297c44d4d9c78c77e2990da44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/beb5133297c44d4d9c78c77e2990da44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/beb5133297c44d4d9c78c77e2990da44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_beb5133297c44d4d9c78c77e2990da44"}]}] Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueTestJSON-224230337 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: beb5133297c44d4d9c78c77e2990da44 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueTestJSON-224230337 Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueTestJSON-224230337-project Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 27eee720955942068370ed221a5dad5e Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueTestJSON-224230337-project Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 could not be found. Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7'} Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 could not be found. Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 could not be found. Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:06.323303 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 could not be found. Jul 25 16:34:06.328071 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:06.336430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Returning 404 to user: Instance aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:06.338014 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23ed3e10-a936-45f4-adf8-6b84b48406dc tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7" status: 404 len: 111 microversion: 2.1 time: 0.130333 Jul 25 16:34:06.342790 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2428/4906] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:06 2022] GET /compute/v2.1/servers/aac98fb2-09a3-4e1b-9c1d-c91074c3a9f7 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:06.353402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:06.354206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:06.374689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.378729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.383292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.384246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.431498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:34:06.488870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:06.492107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:06.537790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.538242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.539099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.539536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.605614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-70944d61-c1a7-42ac-8613-f1cea0b34480 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "DELETE /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 204 len: 0 microversion: 2.1 time: 0.259747 Jul 25 16:34:06.606624 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2479/4907] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:34:06 2022] DELETE /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:34:06.619624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:06.620458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:06.651969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.653089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.655734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.656498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.670273 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6f7bd4c-c91a-4007-abaa-c50fb96c10da tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184696 Jul 25 16:34:06.675992 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2429/4908] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:06 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:34:06.862779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:06.863462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:06.914048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.916840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:06.920961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:06.921996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:07.730505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:07.745921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b3cdfc1-8f56-46c2-9a91-3c2bbaf2a65c tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1496 microversion: 2.1 time: 1.133625 Jul 25 16:34:07.747419 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2480/4909] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:06 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1496 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:07.753078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:07.760520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:07.775594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:07.776614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:07.777777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:07.778218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:08.195559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:08.212241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:08.214082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:08.215408 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae446ece-b8ca-49cb-97c5-06fd648a7f5e tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1889 microversion: 2.42 time: 1.362447 Jul 25 16:34:08.215887 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2430/4910] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:06 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1889 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:08.233350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:08.235946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:08.254587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:08.255266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:08.256070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:08.256512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:08.295985 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04c0fac8-a95c-43af-a933-06169664e8a7 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069892 Jul 25 16:34:08.297066 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2431/4911] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:08 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:08.312997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c07bd48f-6aa7-4ffc-b1d3-97af3a7aa035 req-3b387f4a-6017-4f6e-9967-0590314cb660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51941f7a-4ca1-497f-987c-607d1604998a", "name": "network-vif-plugged", "status": "completed", "tag": "0f11cf9f-e1f9-4931-bf00-529b05c2903e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:08.323389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c07bd48f-6aa7-4ffc-b1d3-97af3a7aa035 req-3b387f4a-6017-4f6e-9967-0590314cb660 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:08.323841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c07bd48f-6aa7-4ffc-b1d3-97af3a7aa035 req-3b387f4a-6017-4f6e-9967-0590314cb660 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:08.336607 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c07bd48f-6aa7-4ffc-b1d3-97af3a7aa035 req-3b387f4a-6017-4f6e-9967-0590314cb660 service nova] Creating event network-vif-plugged:0f11cf9f-e1f9-4931-bf00-529b05c2903e for instance 51941f7a-4ca1-497f-987c-607d1604998a on n-h1-846219-13 Jul 25 16:34:08.342407 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c07bd48f-6aa7-4ffc-b1d3-97af3a7aa035 req-3b387f4a-6017-4f6e-9967-0590314cb660 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043798 Jul 25 16:34:08.343682 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2432/4912] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:08.350338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-704606649", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "85da041c-5552-4180-885a-f224fd7103d7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:08.485394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:08.494121 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-82b8e63d-9720-4656-b405-d31a080095c4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1379 microversion: 2.1 time: 0.745333 Jul 25 16:34:08.494744 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2481/4913] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:07 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1379 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:08.506057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:34:08.780097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:08.788550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:08.794821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:08.846695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:08.847617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:08.849597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:08.850273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:09.378192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:09.387889 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c35fdb4a-4379-4d9f-8b88-bce734e54ec6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1496 microversion: 2.1 time: 0.624390 Jul 25 16:34:09.388458 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2482/4914] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:08 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1496 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:09.403102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:09.404004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:09.413634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:09.414322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:09.415510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:09.416941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.110084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:10.140546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:34:10.141380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:34:10.142790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:34:10.143620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:34:10.145238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:34:10.157859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:10.161001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:10.166325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=58 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:10.173213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67f6261c-535f-4321-a3ca-7b97b0643708 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.771314 Jul 25 16:34:10.174561 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2483/4915] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:09 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:10.183645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:10.212951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:10.226172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.227074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.228215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.230035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.238352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.240711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.242232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.245233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.274200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:34:10.295055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:34:10.321881 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e768cb65-749e-4dc0-b709-6809755edde5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145058 Jul 25 16:34:10.326569 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2484/4916] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:10 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:10.326873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:34:10.330623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='85da041c-5552-4180-885a-f224fd7103d7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:34:10.348368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:10.351847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:10.370781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.371419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.372273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.372712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.385214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:10.490831 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-af0fa160-9fdb-4575-9f97-cbca6cec41a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.145619 Jul 25 16:34:10.492143 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2433/4917] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:34:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:34:10.504001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:10.505087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:10.515600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.516452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.517508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:10.518255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:10.711196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27eee720955942068370ed221a5dad5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb5133297c44d4d9c78c77e2990da44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:10.734550 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cccfadc1-a171-4e11-bdf0-7c42d67c3a31 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 200 len: 1454 microversion: 2.1 time: 0.231427 Jul 25 16:34:10.737990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2434/4918] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:10 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 1454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:10.767232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc475fa5-4458-4cc3-8ccd-d754e2b9cdc7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:10.767989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc475fa5-4458-4cc3-8ccd-d754e2b9cdc7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:11.189643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc475fa5-4458-4cc3-8ccd-d754e2b9cdc7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:11.201331 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc475fa5-4458-4cc3-8ccd-d754e2b9cdc7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1059 microversion: 2.1 time: 0.458032 Jul 25 16:34:11.202364 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2435/4919] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:10 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1059 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:11.222521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c83e3bb5-c836-4ef9-aa5a-e39183bb3e5d req-b649cace-262a-42f0-b905-90c41962bd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768f5082-c9b0-4d37-af93-90d00c08e812", "name": "network-vif-deleted", "tag": "d3e6b393-3831-41aa-bf78-f87f8198c1d5"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:11.274753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:11.295023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3f34c35-2de4-4ef4-aae7-482b08c4ba7d tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1552 microversion: 2.1 time: 0.958196 Jul 25 16:34:11.297790 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2485/4920] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:10 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1552 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:11.309495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:11.310437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:11.317797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:11.318429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:11.319341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:11.320069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:11.326321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c83e3bb5-c836-4ef9-aa5a-e39183bb3e5d req-b649cace-262a-42f0-b905-90c41962bd46 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:11.326849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c83e3bb5-c836-4ef9-aa5a-e39183bb3e5d req-b649cace-262a-42f0-b905-90c41962bd46 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:11.372121 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c83e3bb5-c836-4ef9-aa5a-e39183bb3e5d req-b649cace-262a-42f0-b905-90c41962bd46 service nova] Creating event network-vif-deleted:d3e6b393-3831-41aa-bf78-f87f8198c1d5 for instance 768f5082-c9b0-4d37-af93-90d00c08e812 on n-h2-846219-13 Jul 25 16:34:11.385395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c83e3bb5-c836-4ef9-aa5a-e39183bb3e5d req-b649cace-262a-42f0-b905-90c41962bd46 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180798 Jul 25 16:34:11.387570 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2436/4921] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:11.402562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:11.404425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:11.431146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:11.431724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:11.435606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:11.436499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.076084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:12.095946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:12.098573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:12.102572 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d1fc3c4-6c52-4365-af9f-66fa7cf69ce6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.803324 Jul 25 16:34:12.106842 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2486/4922] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:11 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:12.113545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:12.116505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:12.123176 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d5bc1540-656e-45d8-a722-f7a75f8d92d5 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1552 microversion: 2.1 time: 0.732655 Jul 25 16:34:12.124573 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2437/4923] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:11 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1552 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:12.138537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:12.149525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:12.150238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.161059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:12.162558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.164348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:12.165435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] [instance: 768f5082-c9b0-4d37-af93-90d00c08e812] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:12.193512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:12.194158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.199677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:12.213589 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24324879-b3ec-424b-ac50-ddd1fa505d80 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105074 Jul 25 16:34:12.218863 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2487/4924] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:12 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:12.232634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:12.238563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.239937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:12.256181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:12.256832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.257850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:12.259269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:12.309567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] HTTP exception thrown: Instance 768f5082-c9b0-4d37-af93-90d00c08e812 could not be found. Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Request method failure captured: Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 HTTP/1.1 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVmqXJuZRfg0QVgvzWKowVP5AtdtR5_9D2fkwkkuZyWkTvIpX9K5CWg7fXN9lzgTyt-l1gEJpwyDIlQP7BGY_H-JyMomA6JrG0ka_1RZOdbPKR0qiedWewv8meziC-9QmIEYuDLfvptYTv3mccsppWF1yvziZqmtFLQoJwE3C52RuQ Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: beb5133297c44d4d9c78c77e2990da44 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueTestJSON-224230337 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/beb5133297c44d4d9c78c77e2990da44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/beb5133297c44d4d9c78c77e2990da44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/beb5133297c44d4d9c78c77e2990da44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_beb5133297c44d4d9c78c77e2990da44"}]}] Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueTestJSON-224230337 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: beb5133297c44d4d9c78c77e2990da44 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueTestJSON-224230337 Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueTestJSON-224230337-project Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 27eee720955942068370ed221a5dad5e Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueTestJSON-224230337-project Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 768f5082-c9b0-4d37-af93-90d00c08e812 could not be found. Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '768f5082-c9b0-4d37-af93-90d00c08e812'} Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768f5082-c9b0-4d37-af93-90d00c08e812 could not be found. Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768f5082-c9b0-4d37-af93-90d00c08e812 could not be found. Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:12.315980 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768f5082-c9b0-4d37-af93-90d00c08e812 could not be found. Jul 25 16:34:12.320730 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:12.331366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] Returning 404 to user: Instance 768f5082-c9b0-4d37-af93-90d00c08e812 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:12.332535 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc9754d1-037f-42b1-a630-3dd223e197d6 tempest-ServerRescueTestJSON-224230337 tempest-ServerRescueTestJSON-224230337-project] 10.222.0.105 "GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812" status: 404 len: 111 microversion: 2.1 time: 0.206529 Jul 25 16:34:12.334365 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2438/4925] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:12 2022] GET /compute/v2.1/servers/768f5082-c9b0-4d37-af93-90d00c08e812 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:13.158068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:13.175054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:13.204163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:13.206718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:13.208860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:13.209944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:13.535617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:13.549173 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8d9cb56d-6e6e-41e6-b496-0072c1e576ec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1055 microversion: 2.1 time: 1.328046 Jul 25 16:34:13.549799 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2488/4926] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:12 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1055 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:13.569391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:13.572315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:13.585507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:13.585959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:13.586756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:13.587199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:13.666744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c6c83318-74fa-4180-b2a3-e91e74993418 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107826 Jul 25 16:34:13.681534 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2489/4927] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:13 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:14.571127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:14.572883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:14.593970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:14.594831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:14.595767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:14.599659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:15.064456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:15.076813 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-44f09dd8-cd77-4ecb-aca1-a9ba24cc2edb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1129 microversion: 2.1 time: 0.509747 Jul 25 16:34:15.095567 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2490/4928] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:14 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1129 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:15.108495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:15.114494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:15.129811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:15.131539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:15.133690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:15.135504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:15.251456 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fcd7a914-8611-42eb-b37d-f2cbfae692f5 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151915 Jul 25 16:34:15.254435 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2491/4929] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:15 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:15.479152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:15.490406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:15.503195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:15.504725 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-509e3153-427d-4abe-b995-61c2688ba9d8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 2.355792 Jul 25 16:34:15.505556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2439/4930] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:13 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:16.106116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:16.107359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:16.121802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.122360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.123264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.127525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.267142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:16.270574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:16.285913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.286379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.287174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.287623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.354949 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75ca350d-07f9-405a-b739-74eb775bc054 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091556 Jul 25 16:34:16.356267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2440/4931] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:34:16 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 16:34:16.482557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:16.501514 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2cbb06b8-7793-4e80-9a60-ff96b0a5eff9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1129 microversion: 2.1 time: 0.402552 Jul 25 16:34:16.504220 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2492/4932] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:16 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1129 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:16.518688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:16.519319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:16.532367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:16.532660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.533076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.533711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:16.534724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.535392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.546073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.546758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.547744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.550434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.609566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:34:16.707002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:16.840168 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a569808c-d1fd-471b-97af-50e6c16b1c2a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 204 len: 0 microversion: 2.1 time: 0.342906 Jul 25 16:34:16.845717 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2441/4933] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:34:16 2022] DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:34:16.856640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:16.865006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:16.873488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.879258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.885981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.886616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:17.282510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.295883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.297451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.298665 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8b669a4-dff6-4882-8a13-70928eb0016a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.770440 Jul 25 16:34:17.307277 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2493/4934] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:16 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:17.400788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.427622 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57671763-3414-4bae-8356-80bab1dcb136 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1684 microversion: 2.1 time: 0.579629 Jul 25 16:34:17.432754 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2442/4935] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:16 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1684 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:17.527126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:17.527774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:17.539198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:17.539718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:17.540586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:17.541030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:17.866772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.878917 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-993a0722-98f8-420f-a44a-b36e4536eed8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1129 microversion: 2.1 time: 0.357481 Jul 25 16:34:17.893794 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2494/4936] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:17 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1129 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:18.334343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:18.335009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:18.390527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:18.391428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:18.392449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:18.392991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:18.462046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:18.464221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:18.494156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:18.495117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:18.496362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:18.497070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:19.493455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:19.507029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:19.508721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:19.510798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:19.511872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dfa0fc2f-fa01-446d-b010-b8bc0af8d26b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.187917 Jul 25 16:34:19.514589 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2443/4937] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:18 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:19.527265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:19.528526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:19.533628 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-27b62b06-1119-4621-938b-6db041248e27 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1684 microversion: 2.1 time: 1.074341 Jul 25 16:34:19.534511 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2495/4938] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:18 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1684 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:19.538948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:19.539742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:19.540762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:19.541867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:20.252001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:20.458103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:20.494466 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-337cc001-b919-4b08-bf83-45109c2e284b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.976660 Jul 25 16:34:20.496283 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2444/4939] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:19 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:20.542899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:20.544223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:20.556184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:20.572799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:20.577987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:20.580387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:20.586147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:20.587780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:20.653330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:20.659840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:20.669365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:20.671008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:21.196755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:22.309602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.336781 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e080b90-7821-40bc-9f9d-cb5c35125ce3 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1684 microversion: 2.1 time: 1.759639 Jul 25 16:34:22.337688 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2445/4940] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:20 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1684 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:22.339665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.344651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:22.347247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:22.364241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.375762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:22.379969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:22.382923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:22.385816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:22.409245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.426546 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d189af3a-b409-4a64-a33b-e5d89c59b55d tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.882003 Jul 25 16:34:22.467955 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2496/4941] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:20 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:22.488936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d15ff214-94d9-47f6-b3ce-f7eea26a2db9 req-40ac6b92-2838-41b4-a035-ce3ade9afa46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51941f7a-4ca1-497f-987c-607d1604998a", "tag": "0f11cf9f-e1f9-4931-bf00-529b05c2903e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:22.556434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d15ff214-94d9-47f6-b3ce-f7eea26a2db9 req-40ac6b92-2838-41b4-a035-ce3ade9afa46 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:22.562530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d15ff214-94d9-47f6-b3ce-f7eea26a2db9 req-40ac6b92-2838-41b4-a035-ce3ade9afa46 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:22.583569 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d15ff214-94d9-47f6-b3ce-f7eea26a2db9 req-40ac6b92-2838-41b4-a035-ce3ade9afa46 service nova] Creating event network-changed:0f11cf9f-e1f9-4931-bf00-529b05c2903e for instance 51941f7a-4ca1-497f-987c-607d1604998a on n-h1-846219-13 Jul 25 16:34:22.597714 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d15ff214-94d9-47f6-b3ce-f7eea26a2db9 req-40ac6b92-2838-41b4-a035-ce3ade9afa46 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120682 Jul 25 16:34:22.599483 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2497/4942] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:23.364996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:23.365763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:23.379349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:23.381795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:23.382938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:23.385748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:24.520850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:24.585832 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-593864c1-9d12-48db-a208-496954e54d28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 2.246749 Jul 25 16:34:24.586450 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2446/4943] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:22 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:24.792934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:24.808413 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-106e4db5-46fc-436e-8180-91cc433be49c tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1684 microversion: 2.1 time: 1.447841 Jul 25 16:34:24.821405 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2498/4944] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:23 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1684 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:24.831404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:24.831989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:24.856086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:24.856806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:24.858028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:24.861182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:25.178508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c8f8d1dd-6652-4b1e-aa4e-c34e94b0031a req-5655c550-4640-4185-8cdc-f9666c507215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e76c6df-ea9a-47af-9309-1db0e79e4f65", "name": "network-vif-unplugged", "status": "completed", "tag": "731061cd-e5e2-4309-8aa7-9aaaafef9ffe"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:25.222581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c8f8d1dd-6652-4b1e-aa4e-c34e94b0031a req-5655c550-4640-4185-8cdc-f9666c507215 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:25.231665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c8f8d1dd-6652-4b1e-aa4e-c34e94b0031a req-5655c550-4640-4185-8cdc-f9666c507215 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:25.284804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c8f8d1dd-6652-4b1e-aa4e-c34e94b0031a req-5655c550-4640-4185-8cdc-f9666c507215 service nova] Creating event network-vif-unplugged:731061cd-e5e2-4309-8aa7-9aaaafef9ffe for instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 on n-h2-846219-13 Jul 25 16:34:25.296559 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c8f8d1dd-6652-4b1e-aa4e-c34e94b0031a req-5655c550-4640-4185-8cdc-f9666c507215 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.682674 Jul 25 16:34:25.302537 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2447/4945] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:25.617448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:25.618888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:25.632703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:25.633215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:25.634006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:25.634446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:26.087617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.105844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.108296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.114073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8c98f4f4-1e13-48af-bf5e-bae9153075c7 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.298962 Jul 25 16:34:26.116447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2499/4946] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:24 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:26.137430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:26.139001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:26.151292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:26.152462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:26.156332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:26.157126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:26.704746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6642b2b23848118d41454191733a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db8f6a625c4d618009b07706fea599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.715606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.718127 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b3e1ab5-a2ac-47ed-b295-772729a3ed70 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 200 len: 1617 microversion: 2.1 time: 0.600128 Jul 25 16:34:26.738470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3e72b29-6367-41b4-bc4e-3f5e6bd3a361 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 1.129010 Jul 25 16:34:26.741473 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2500/4947] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:26 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 1617 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:26.741765 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2448/4948] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:25 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:26.842778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a0b3e7c4-2da6-4d4e-8595-c15a3460d4ab req-9c1734df-10ea-4a71-b9f9-650ec1034b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e76c6df-ea9a-47af-9309-1db0e79e4f65", "name": "network-vif-deleted", "tag": "731061cd-e5e2-4309-8aa7-9aaaafef9ffe"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:26.866712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a0b3e7c4-2da6-4d4e-8595-c15a3460d4ab req-9c1734df-10ea-4a71-b9f9-650ec1034b21 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:26.871036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a0b3e7c4-2da6-4d4e-8595-c15a3460d4ab req-9c1734df-10ea-4a71-b9f9-650ec1034b21 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:26.984345 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a0b3e7c4-2da6-4d4e-8595-c15a3460d4ab req-9c1734df-10ea-4a71-b9f9-650ec1034b21 service nova] Creating event network-vif-deleted:731061cd-e5e2-4309-8aa7-9aaaafef9ffe for instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 on n-h2-846219-13 Jul 25 16:34:27.025999 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a0b3e7c4-2da6-4d4e-8595-c15a3460d4ab req-9c1734df-10ea-4a71-b9f9-650ec1034b21 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178672 Jul 25 16:34:27.044350 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2501/4949] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 16:34:27.163438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:27.166717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:27.238051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.240457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.247754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.250691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.759047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:27.761346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:27.775570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.780135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.781483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.782878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.854951 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 HTTP/1.1 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '7e76c6df-ea9a-47af-9309-1db0e79e4f65'} Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:27.856723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:27.861753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17bce4be-bd3c-41b0-bcaa-7f22d46f2bc1 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 404 len: 111 microversion: 2.1 time: 0.104867 Jul 25 16:34:27.865623 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2502/4950] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:27 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:27.879793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:27.880435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:27.897213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.897665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.903163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.906008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:28.349653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:28.374177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:28.379351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:28.383995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1880fe22-c207-455c-a4f0-5b2aae64b383 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.236368 Jul 25 16:34:28.390543 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2449/4951] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:27 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:28.406526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-053e930d-da10-4420-bf71-266f30bd9577 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '.version_select at 0x7f9da49400d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:28.423782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:28.432892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:28.436822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0475b19-8f2d-499e-9b06-4aba66ca6415 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.564898 Jul 25 16:34:28.442752 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2503/4952] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:27 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:28.476860 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-053e930d-da10-4420-bf71-266f30bd9577 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456733245" status: 202 len: 0 microversion: 2.1 time: 0.080597 Jul 25 16:34:28.479009 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2450/4953] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456733245 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:34:29.167488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9f2e7edb-143f-44fd-80e2-34ad8e43aef7 req-ce873f74-0f27-4b2b-b5a7-937b43ea36c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b625714-671b-426c-8229-fdbb939bd5d4", "tag": "5abae8d1-fe62-4826-8bd7-210723faae01"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:29.190262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9f2e7edb-143f-44fd-80e2-34ad8e43aef7 req-ce873f74-0f27-4b2b-b5a7-937b43ea36c7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:29.192121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9f2e7edb-143f-44fd-80e2-34ad8e43aef7 req-ce873f74-0f27-4b2b-b5a7-937b43ea36c7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:29.220527 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9f2e7edb-143f-44fd-80e2-34ad8e43aef7 req-ce873f74-0f27-4b2b-b5a7-937b43ea36c7 service nova] Creating event network-changed:5abae8d1-fe62-4826-8bd7-210723faae01 for instance 3b625714-671b-426c-8229-fdbb939bd5d4 on n-h2-846219-13 Jul 25 16:34:29.227195 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9f2e7edb-143f-44fd-80e2-34ad8e43aef7 req-ce873f74-0f27-4b2b-b5a7-937b43ea36c7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064027 Jul 25 16:34:29.228639 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2504/4954] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:29.419491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:29.420260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:29.435595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:29.438213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:29.439163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:29.440425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:29.468084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:29.469022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:29.504129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:29.505068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:29.507674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:29.510679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:30.147268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.155395 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5546717e-4a87-4932-959e-cd5d4676a536 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.694146 Jul 25 16:34:30.162633 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2505/4955] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:29 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:30.233482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.252385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.254288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.259743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68e58497-d4b9-4d84-a56b-44c4370b844f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.845720 Jul 25 16:34:30.261018 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2451/4956] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:29 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:31.180582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:31.182657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:31.196008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:31.196616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:31.197321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:31.200911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:31.284423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:31.285431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:31.294956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:31.296995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:31.298847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:31.299327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:31.809015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.825705 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4642c9a3-50a1-4cb7-9e3d-ca938bd0bfed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.647716 Jul 25 16:34:31.830440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2506/4957] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:31 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:31.884146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.910291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.916114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.924916 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0ddf1e1-5e1e-429b-b52c-cf6b38ac4a44 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.643066 Jul 25 16:34:31.927932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2452/4958] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:31 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:32.862042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:32.862672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:32.876312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:32.881194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:32.882250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:32.882712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:32.955764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:32.956418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:32.973944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:32.975357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:32.975900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:32.977027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:33.723463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:33.756548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b19a631-4f52-408e-b8ef-d6bfcc62c470 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.904471 Jul 25 16:34:33.757643 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2507/4959] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:32 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:33.782784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:33.809608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:33.835088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:33.848606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:33.850496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:33.858036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:33.930822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64016deb-8513-411d-a1d7-22efa0b5ebf7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.148268 Jul 25 16:34:33.939353 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2508/4960] 10.222.0.105 () {60 vars in 1348 bytes} [Mon Jul 25 16:34:33 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:34.102294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:34.103195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:34.113565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.116051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.118184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.123867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.178316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:34:34.217199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:34.245702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:34.252892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:34.254796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69c93e17-2025-4ab4-93c2-2405c25214a5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.304291 Jul 25 16:34:34.257906 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2453/4961] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:32 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:34.422214 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f5708810-0ad1-4533-8039-729dd1ec34b5 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 204 len: 0 microversion: 2.20 time: 0.323341 Jul 25 16:34:34.423203 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2509/4962] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:34:34 2022] DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:34:34.434909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:34.435540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:34.461742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.462203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.463026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.463464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.779243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:34.779965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:34.794828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.795283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.804308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.805064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:35.654107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.672708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.684060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.686401 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ff337f2-0c1b-4ba0-b279-a6dd49cc25ad tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.256806 Jul 25 16:34:35.691101 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2454/4963] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:34 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:35.708205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:35.708940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:35.717738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:35.724142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:35.725591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:35.732584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:35.751807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.766946 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f46b1d98-8d1c-475b-9073-df4b3d245ec5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.992886 Jul 25 16:34:35.772071 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2510/4964] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:34 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:36.268636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:36.284258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:36.287008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:36.292612 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c2fd5e8-54b2-47a3-9d99-75cb498992e8 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.600211 Jul 25 16:34:36.296053 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2455/4965] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:35 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:36.715318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:36.716505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:36.770439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:36.776078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:36.780533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:36.793625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:36.794286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:36.795804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:36.811810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:36.812707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:36.815018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:36.817301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:37.854148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:37.887196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:37.890293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:37.892078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c7740c40-6a84-46b8-9a57-402e65dc07d9 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1728 microversion: 2.20 time: 1.182917 Jul 25 16:34:37.901878 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2511/4966] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:36 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1728 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:37.907454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e2a94a68-9ea3-4c5e-a68c-ef0164ac343c req-5f670b24-f1c8-408b-a68a-b5dfd72677d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "6afef70b-7f67-402e-8508-8cc2de9786ec"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:37.914755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:37.930383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc3536aa-6bfb-4a65-b6c9-5bec282afe71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 1.143140 Jul 25 16:34:37.934822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e2a94a68-9ea3-4c5e-a68c-ef0164ac343c req-5f670b24-f1c8-408b-a68a-b5dfd72677d6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:37.935604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e2a94a68-9ea3-4c5e-a68c-ef0164ac343c req-5f670b24-f1c8-408b-a68a-b5dfd72677d6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:37.942527 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2456/4967] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:36 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:37.965696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:37.966438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:37.986614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:37.987110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:37.992163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:37.992666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:37.998990 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e2a94a68-9ea3-4c5e-a68c-ef0164ac343c req-5f670b24-f1c8-408b-a68a-b5dfd72677d6 service nova] Creating event network-vif-plugged:6afef70b-7f67-402e-8508-8cc2de9786ec for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:38.046991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e2a94a68-9ea3-4c5e-a68c-ef0164ac343c req-5f670b24-f1c8-408b-a68a-b5dfd72677d6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139947 Jul 25 16:34:38.050673 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2512/4968] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:38.079771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:38.101231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:38.140321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:38.149022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:38.155534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:38.156959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:38.208043 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 HTTP/1.1 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '7e76c6df-ea9a-47af-9309-1db0e79e4f65'} Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:38.220835 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.230192 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.241651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:38.243963 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9895e174-161f-4df6-8062-bf0fe20f6791 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 404 len: 111 microversion: 2.1 time: 0.191164 Jul 25 16:34:38.254406 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2513/4969] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:34:38 2022] DELETE /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:38.272191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:38.284667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: 7e76c6df-ea9a-47af-9309-1db0e79e4f65] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:38.308519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:38.309436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:38.310913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:38.311830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:38.367136 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 HTTP/1.1 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '7e76c6df-ea9a-47af-9309-1db0e79e4f65'} Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:38.379202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance 7e76c6df-ea9a-47af-9309-1db0e79e4f65 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:38.390447 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef284040-56ee-40f1-824e-5a2925e9d49a tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65" status: 404 len: 111 microversion: 2.1 time: 0.125856 Jul 25 16:34:38.401598 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2514/4970] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:38 2022] GET /compute/v2.1/servers/7e76c6df-ea9a-47af-9309-1db0e79e4f65 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:38.951530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:38.954008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:38.960527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:38.976296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:38.978025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:38.979987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:38.981357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:39.698748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.730648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.732680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.734223 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41566024-d6da-44c3-8ffd-1ebdddca5bca tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.788813 Jul 25 16:34:39.735021 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2457/4971] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:37 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:39.758966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:39.766237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:39.783673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:39.784415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:39.785429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:39.786057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:39.868630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.886599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.894604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.903739 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2cb54c0d-135b-4688-b6e2-c193acb3dd42 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1661 microversion: 2.20 time: 0.957795 Jul 25 16:34:39.910307 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2515/4972] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:38 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1661 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:40.339163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2ebe92f9-9f8b-4dda-8d90-e4ab2ebce03b req-960f7852-f41f-47a5-bc11-90b980d86dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "c6da5128-e2d0-4fcf-bccf-fd97f40e76eb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:40.366576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2ebe92f9-9f8b-4dda-8d90-e4ab2ebce03b req-960f7852-f41f-47a5-bc11-90b980d86dce service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:40.367027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2ebe92f9-9f8b-4dda-8d90-e4ab2ebce03b req-960f7852-f41f-47a5-bc11-90b980d86dce service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:40.403939 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2ebe92f9-9f8b-4dda-8d90-e4ab2ebce03b req-960f7852-f41f-47a5-bc11-90b980d86dce service nova] Creating event network-vif-plugged:c6da5128-e2d0-4fcf-bccf-fd97f40e76eb for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:40.419713 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2ebe92f9-9f8b-4dda-8d90-e4ab2ebce03b req-960f7852-f41f-47a5-bc11-90b980d86dce service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082487 Jul 25 16:34:40.420733 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2516/4973] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:40.552861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:40.567426 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a449f255-e48d-47ac-85b2-8e6c9d01281f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.815458 Jul 25 16:34:40.568042 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2458/4974] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:39 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:40.767119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:40.768446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:40.789299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:40.790306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:40.794432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:40.795137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:40.830867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5aa0b8ac-1167-4ce4-a7ce-4fd51654a17a req-be2bcb9e-dbca-42c0-9dac-1e94738d6a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dfcce1-3e9e-4674-82e2-40e10fa82da5", "name": "network-vif-deleted", "tag": "acb2a645-b1e5-4515-ab66-0c3b4104ca4f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:40.869486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:40.920456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5aa0b8ac-1167-4ce4-a7ce-4fd51654a17a req-be2bcb9e-dbca-42c0-9dac-1e94738d6a8a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:40.925564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5aa0b8ac-1167-4ce4-a7ce-4fd51654a17a req-be2bcb9e-dbca-42c0-9dac-1e94738d6a8a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:40.938881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:40.997071 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5aa0b8ac-1167-4ce4-a7ce-4fd51654a17a req-be2bcb9e-dbca-42c0-9dac-1e94738d6a8a service nova] Creating event network-vif-deleted:acb2a645-b1e5-4515-ab66-0c3b4104ca4f for instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 on n-h1-846219-13 Jul 25 16:34:41.019261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5aa0b8ac-1167-4ce4-a7ce-4fd51654a17a req-be2bcb9e-dbca-42c0-9dac-1e94738d6a8a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191530 Jul 25 16:34:41.023386 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2459/4975] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:34:41.077629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:41.079059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:41.104278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:41.105024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:41.106434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:41.118431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:41.359271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.384364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.386809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18df729ef0034f6a88f6acbc7054db92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bb17bf33f845cd988f685ee08af589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.397603 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c2f32c6-7d1c-4e72-88d1-4be6d42969b6 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 200 len: 1371 microversion: 2.20 time: 0.372013 Jul 25 16:34:41.398245 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2460/4976] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:41 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 1371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:41.517791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.549252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.555892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.560634 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7690a4fb-38a7-4900-8cd9-8bb5789124be tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.799073 Jul 25 16:34:41.570644 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2517/4977] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:40 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:41.600490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:41.600490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:41.623697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:41.624162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:41.625066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:41.625534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:42.179679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:42.188325 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4285bf3-3bdc-4e5f-9eca-18f04826d81e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.593662 Jul 25 16:34:42.194063 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2461/4978] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:41 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:42.420151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:42.421194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:42.435488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:42.444440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:42.451248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:42.451912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:42.527564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] HTTP exception thrown: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Request method failure captured: Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 HTTP/1.1 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPxkhW4kAgQppWJ9ur455qQMAiTliNsT2wCWGacDsz2SF6SKxyeDhfA_ErE63A35TBoMu3poSRhTZ4yKgoibgrFklsy7tJg17OFMq_aU0q8pozcH6Gn3r3fcT3asiMhpbyOKHxxUDHil9oHWPjbytvm9TxOCnRkwr-AXmhj-L7sSjE Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d5bb17bf33f845cd988f685ee08af589"}]}] Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 18df729ef0034f6a88f6acbc7054db92 Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '67dfcce1-3e9e-4674-82e2-40e10fa82da5'} Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:42.529598 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Returning 404 to user: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:42.536180 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7bc41127-5831-4d6d-a9c9-cf880984934b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 404 len: 111 microversion: 2.20 time: 0.114995 Jul 25 16:34:42.540981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fbd13eb9-e853-404c-b5e9-7219615d3efc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '.version_select at 0x7f9d929f6280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:42.555715 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2518/4979] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:42 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:34:42.593949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:42.594633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:42.603231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fbd13eb9-e853-404c-b5e9-7219615d3efc tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495560200" status: 204 len: 0 microversion: 2.20 time: 0.061784 Jul 25 16:34:42.605476 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2462/4980] 10.222.0.105 () {60 vars in 1267 bytes} [Mon Jul 25 16:34:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495560200 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:34:42.619326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:42.620115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:42.621190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:42.624444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:43.220181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:43.221604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:43.233372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:43.241663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:43.242872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:43.243645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:43.505841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.516062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.517832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.519179 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15bfde18-b7d9-43d0-bda6-9abe0882bf41 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.929306 Jul 25 16:34:43.519770 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2519/4981] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:42 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:43.917912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.926661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2aa1b772-b8cf-4dc6-ae5d-b9fe4539ba2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.710367 Jul 25 16:34:43.935044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2463/4982] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:43 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:44.548410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:44.549743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:44.573240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:44.575622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:44.579506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:44.580066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:44.950907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:44.951570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:44.966397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:44.967159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:44.969423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:44.973287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:45.173767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.190739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.192658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.198019 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4eb275a7-8b6e-4350-9234-fdce19e2d20a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.654655 Jul 25 16:34:45.198914 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2520/4983] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:44 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:45.293711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.305317 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9b3caab6-253a-4a2c-9d7b-8c43ac9c2ccb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1171 microversion: 2.1 time: 0.356470 Jul 25 16:34:45.310736 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2464/4984] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:44 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1171 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:46.227765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:46.229084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:46.239198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.239845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.240828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.241616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.327919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:46.328693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:46.343149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.343597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.344409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.344843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.845411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.857708 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59ebf5c7-0a1f-4ab6-bc31-afa910162216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1217 microversion: 2.1 time: 0.533443 Jul 25 16:34:46.874657 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2465/4985] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:46 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1217 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:46.874657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:46.874657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:46.881261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.887195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.889421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.890406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.890848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.893164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.895390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.897537 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b2da29a-92de-4f2a-bd51-b7039f1a71e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.674954 Jul 25 16:34:46.898427 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2521/4986] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:46 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:46.939217 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef HTTP/1.1 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b2b606c4-5e61-4d40-a5cb-7255074efbef'} Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:46.941215 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-821387e0-d6f5-4fac-8e3c-f15fc7cb778b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 404 len: 111 microversion: 2.1 time: 0.080118 Jul 25 16:34:46.945982 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2466/4987] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:34:46 2022] DELETE /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:46.954832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:46.955509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b2b606c4-5e61-4d40-a5cb-7255074efbef] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:46.968056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.968923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.970055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.971294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.994073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef HTTP/1.1 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b2b606c4-5e61-4d40-a5cb-7255074efbef'} Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:46.996070 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. Jul 25 16:34:47.000602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.005469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance b2b606c4-5e61-4d40-a5cb-7255074efbef could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:47.006375 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31e1bf42-2525-434e-81f1-c9e9d68704b8 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef" status: 404 len: 111 microversion: 2.1 time: 0.058175 Jul 25 16:34:47.006981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2522/4988] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:46 2022] GET /compute/v2.1/servers/b2b606c4-5e61-4d40-a5cb-7255074efbef => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:47.016097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:47.016595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:47.023037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.023490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.024270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.024818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.071287 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec HTTP/1.1 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b6b4d249-05a5-4cf2-87e1-bd2446fab3ec'} Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:47.073076 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4aaf0378-b6f1-4e78-a8f8-f70593596d4b tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 404 len: 111 microversion: 2.1 time: 0.062887 Jul 25 16:34:47.082817 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2467/4989] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:34:47 2022] DELETE /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:47.087835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:47.088559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: b6b4d249-05a5-4cf2-87e1-bd2446fab3ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:47.105504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.106083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.107052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.107541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.126966 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec HTTP/1.1 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b6b4d249-05a5-4cf2-87e1-bd2446fab3ec'} Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:47.128753 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. Jul 25 16:34:47.134664 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:47.136473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance b6b4d249-05a5-4cf2-87e1-bd2446fab3ec could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:47.137663 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-027437c8-f8d8-40d0-8bac-4af67d9402f4 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec" status: 404 len: 111 microversion: 2.1 time: 0.057406 Jul 25 16:34:47.138779 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2523/4990] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:47 2022] GET /compute/v2.1/servers/b6b4d249-05a5-4cf2-87e1-bd2446fab3ec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:47.882497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:47.883963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:47.905085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.906134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.908238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.909009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.945567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:47.946221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:47.961614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.965611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:47.966681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:47.973919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.026588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:48.518830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.531411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9d16cff-3282-4ae1-9f58-79262339b22e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1205 microversion: 2.1 time: 0.652682 Jul 25 16:34:48.538037 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2468/4991] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:47 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1205 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:48.695363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.739288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.742506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.744301 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49f8d33c-9194-4fb8-8825-09e86a2ec4b2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 0.803791 Jul 25 16:34:48.745730 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2524/4992] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:47 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:49.156032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-801a6896-9afe-4ea8-8dec-9897c2588d92 req-a198e249-eeec-4971-b3fc-3c2375a7194b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "3023088a-a54b-4442-8e02-6038517007c3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:49.187245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-801a6896-9afe-4ea8-8dec-9897c2588d92 req-a198e249-eeec-4971-b3fc-3c2375a7194b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.188090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-801a6896-9afe-4ea8-8dec-9897c2588d92 req-a198e249-eeec-4971-b3fc-3c2375a7194b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.212417 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-801a6896-9afe-4ea8-8dec-9897c2588d92 req-a198e249-eeec-4971-b3fc-3c2375a7194b service nova] Creating event network-vif-plugged:3023088a-a54b-4442-8e02-6038517007c3 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:49.218976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-801a6896-9afe-4ea8-8dec-9897c2588d92 req-a198e249-eeec-4971-b3fc-3c2375a7194b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067922 Jul 25 16:34:49.220813 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2469/4993] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:49.563858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:49.564595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:49.579032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.579601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.583734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.584297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.791530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:49.792432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:49.806041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.806492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.815025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.816007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.616907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:51.629886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:51.632038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:51.633610 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7cda9233-0555-4d69-9b0a-3fe79baacb17 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.855352 Jul 25 16:34:51.634799 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2470/4994] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:49 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:51.671897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:51.678548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:51.692749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.693289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.696241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.697948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:51.700071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.722705 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b02bff4e-f072-472f-bb13-db85fe5bd837 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1205 microversion: 2.1 time: 2.163283 Jul 25 16:34:51.724145 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2525/4995] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:49 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1205 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:51.730627 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] HTTP exception thrown: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.732127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-18fcc4f0-31d4-4564-906f-e8d55413f289 req-0263b6ae-743d-4a05-bccd-54475294af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Request method failure captured: Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 HTTP/1.1 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPxkhW4kAgQppWJ9ur455qQMAiTliNsT2wCWGacDsz2SF6SKxyeDhfA_ErE63A35TBoMu3poSRhTZ4yKgoibgrFklsy7tJg17OFMq_aU0q8pozcH6Gn3r3fcT3asiMhpbyOKHxxUDHil9oHWPjbytvm9TxOCnRkwr-AXmhj-L7sSjE Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d5bb17bf33f845cd988f685ee08af589"}]}] Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 18df729ef0034f6a88f6acbc7054db92 Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '67dfcce1-3e9e-4674-82e2-40e10fa82da5'} Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:51.732810 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.737557 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.739267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Returning 404 to user: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:51.740604 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d11f9cd-f2cc-4380-8519-f8ead7b98ae7 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 404 len: 111 microversion: 2.20 time: 0.104380 Jul 25 16:34:51.741408 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2471/4996] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:34:51 2022] DELETE /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:34:51.749750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-18fcc4f0-31d4-4564-906f-e8d55413f289 req-0263b6ae-743d-4a05-bccd-54475294af1e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.751785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-18fcc4f0-31d4-4564-906f-e8d55413f289 req-0263b6ae-743d-4a05-bccd-54475294af1e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.850518 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-18fcc4f0-31d4-4564-906f-e8d55413f289 req-0263b6ae-743d-4a05-bccd-54475294af1e service nova] Creating event network-vif-plugged:c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:51.875030 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-18fcc4f0-31d4-4564-906f-e8d55413f289 req-0263b6ae-743d-4a05-bccd-54475294af1e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149307 Jul 25 16:34:51.879428 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2526/4997] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:51.906412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:51.907427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 67dfcce1-3e9e-4674-82e2-40e10fa82da5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:51.915279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.916064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.917217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.918050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.937981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] HTTP exception thrown: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Request method failure captured: Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 HTTP/1.1 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPxkhW4kAgQppWJ9ur455qQMAiTliNsT2wCWGacDsz2SF6SKxyeDhfA_ErE63A35TBoMu3poSRhTZ4yKgoibgrFklsy7tJg17OFMq_aU0q8pozcH6Gn3r3fcT3asiMhpbyOKHxxUDHil9oHWPjbytvm9TxOCnRkwr-AXmhj-L7sSjE Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d5bb17bf33f845cd988f685ee08af589"}]}] Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 18df729ef0034f6a88f6acbc7054db92 Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '67dfcce1-3e9e-4674-82e2-40e10fa82da5'} Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.940433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. Jul 25 16:34:51.946519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:51.948852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Returning 404 to user: Instance 67dfcce1-3e9e-4674-82e2-40e10fa82da5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:51.950117 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8902ecc-240c-473a-a97e-e7bd6494930b tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5" status: 404 len: 111 microversion: 2.20 time: 0.069054 Jul 25 16:34:51.951774 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2527/4998] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:51 2022] GET /compute/v2.1/servers/67dfcce1-3e9e-4674-82e2-40e10fa82da5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:34:52.183388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1601128904", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:52.322514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:34:52.662591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:52.663791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:52.693280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:52.698647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:52.702874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:52.703975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.309352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:54.327822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:54.329602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:54.334539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f25b5f09-b99b-4583-a63c-aa0421eb9508 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.673432 Jul 25 16:34:54.335645 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2528/4999] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:52 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:54.351747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:54.352935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:54.369378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:54.369378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.372636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:54.376206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.664142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:34:54.665434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:34:54.666178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:34:54.667050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:34:54.667885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:34:54.710792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:54.713590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.714768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:54.723105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.828119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:34:54.859577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:34:54.930737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:34:54.944598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:34:55.062971 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5503852f-6ebd-414c-9ccb-d66ef52551d1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.318375 Jul 25 16:34:55.065937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2472/5000] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:34:51 2022] POST /compute/v2.1/servers => generated 382 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:34:55.076376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-caff707a-d60b-40a9-bae1-85dc7df46d91 req-235b8f71-1621-4a0a-839a-fd8fb8daedd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "e4703297-42bf-47c4-8e81-e51cf2f63f5a"}, {"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "413593f7-3566-422c-9be7-06ba68784b70"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:55.078731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:55.092568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-caff707a-d60b-40a9-bae1-85dc7df46d91 req-235b8f71-1621-4a0a-839a-fd8fb8daedd9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.097958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-caff707a-d60b-40a9-bae1-85dc7df46d91 req-235b8f71-1621-4a0a-839a-fd8fb8daedd9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.103707 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-217465c5-d387-42ee-9981-36a7f2d92038 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1205 microversion: 2.1 time: 0.762179 Jul 25 16:34:55.107652 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2529/5001] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:54 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1205 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:55.127718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:55.128393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:55.139275 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-caff707a-d60b-40a9-bae1-85dc7df46d91 req-235b8f71-1621-4a0a-839a-fd8fb8daedd9 service nova] Creating event network-vif-plugged:e4703297-42bf-47c4-8e81-e51cf2f63f5a for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:55.145140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.145595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.146409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.146849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.147462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-caff707a-d60b-40a9-bae1-85dc7df46d91 req-235b8f71-1621-4a0a-839a-fd8fb8daedd9 service nova] Creating event network-vif-plugged:413593f7-3566-422c-9be7-06ba68784b70 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:55.160687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-caff707a-d60b-40a9-bae1-85dc7df46d91 req-235b8f71-1621-4a0a-839a-fd8fb8daedd9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092713 Jul 25 16:34:55.167271 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2473/5002] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:55.187020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38376d7f-894a-464b-9942-223a764eae4e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:55.192166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38376d7f-894a-464b-9942-223a764eae4e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:55.200545 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 HTTP/1.1 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'cd4e924c-5cee-4432-8388-aa9faa67c2f3'} Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:55.212068 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9605ea1b-05db-4cb8-8273-b74f6b83c929 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 404 len: 111 microversion: 2.1 time: 0.104698 Jul 25 16:34:55.217186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2530/5003] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:34:55 2022] DELETE /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:55.228272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:55.229032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] [instance: cd4e924c-5cee-4432-8388-aa9faa67c2f3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:55.258039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.258513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.259335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.269060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.299673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38376d7f-894a-464b-9942-223a764eae4e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:55.306344 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] HTTP exception thrown: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Request method failure captured: Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 HTTP/1.1 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sPUE0YdNqD1P2S_DbUXx2092lffSSHgDftQrlVlHb-lfOOU7I78FVs5eV9r16oucyen4iY85QaHE7QNQLYtWm4sz_6r1nW52fGR1usjGGQn4W-y_llzbTbmPM84V_sFtHwLsUHzyO0TU02cu0hQKWQf7h0CChNruuT5FYfOCFeXFto Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/45db8f6a625c4d618009b07706fea599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/45db8f6a625c4d618009b07706fea599"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_45db8f6a625c4d618009b07706fea599"}]}] Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 45db8f6a625c4d618009b07706fea599 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-369571467 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4a6642b2b23848118d41454191733a71 Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeNegativeTest-369571467-project Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'cd4e924c-5cee-4432-8388-aa9faa67c2f3'} Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:55.317051 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] Returning 404 to user: Instance cd4e924c-5cee-4432-8388-aa9faa67c2f3 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:55.322608 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0f49876-0d74-442c-afc3-1a34cc57bef0 tempest-AttachVolumeNegativeTest-369571467 tempest-AttachVolumeNegativeTest-369571467-project] 10.222.0.105 "GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3" status: 404 len: 111 microversion: 2.1 time: 0.097887 Jul 25 16:34:55.323337 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2531/5004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:55 2022] GET /compute/v2.1/servers/cd4e924c-5cee-4432-8388-aa9faa67c2f3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:34:55.328225 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38376d7f-894a-464b-9942-223a764eae4e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1197 microversion: 2.1 time: 0.140486 Jul 25 16:34:55.329221 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2474/5005] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:55 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:55.361149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:55.361417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:55.378793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.379595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.380768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.381431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.520929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:55.523916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:55.551797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.556580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.562023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.563075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.802943 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5525a48-be7f-4dc0-a556-721bf1855a92 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a/action" status: 200 len: 24577 microversion: 2.1 time: 0.285962 Jul 25 16:34:55.804076 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2475/5006] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:34:55 2022] POST /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a/action => generated 24577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:34:56.131457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:56.132569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:56.157690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:56.163571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:56.165837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:56.166314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:56.388624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:56.404575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:56.406707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:56.408197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a0f0d2c-f936-4d40-9b91-3573d5258e58 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.051751 Jul 25 16:34:56.409683 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2532/5007] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:55 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:56.416629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:56.417595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:56.437611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:56.441152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:56.442539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:56.443234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:56.640709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:56.658788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a1eb4d39-c195-425b-8ca3-0b6b3614be84 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1201 microversion: 2.1 time: 0.246304 Jul 25 16:34:56.663025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2533/5008] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:56 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1201 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:56.835650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:56.850755 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0b68dca3-a929-4640-8600-538a5271ac7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1205 microversion: 2.1 time: 0.726265 Jul 25 16:34:56.851372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2476/5009] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:56 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1205 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:57.303523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-22ade26e-d40b-4ec3-9885-3a30f441b38c req-b2522f09-aa1f-4040-8d8b-4f227dc8a715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-plugged", "status": "completed", "tag": "72acbf75-e548-4547-b749-1640257cd1c2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:57.325361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-22ade26e-d40b-4ec3-9885-3a30f441b38c req-b2522f09-aa1f-4040-8d8b-4f227dc8a715 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:57.331969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-22ade26e-d40b-4ec3-9885-3a30f441b38c req-b2522f09-aa1f-4040-8d8b-4f227dc8a715 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:57.374885 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-22ade26e-d40b-4ec3-9885-3a30f441b38c req-b2522f09-aa1f-4040-8d8b-4f227dc8a715 service nova] Creating event network-vif-plugged:72acbf75-e548-4547-b749-1640257cd1c2 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:34:57.395788 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-22ade26e-d40b-4ec3-9885-3a30f441b38c req-b2522f09-aa1f-4040-8d8b-4f227dc8a715 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096408 Jul 25 16:34:57.405063 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2534/5010] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:34:57.440298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:57.442094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:57.462997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:57.467457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:57.470313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:57.472217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:57.686552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:57.687446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:57.702998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:57.703619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:57.704555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:57.705136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:58.045411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.065896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8077a08-6d36-4927-a652-e8dd4bd3e894 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1267 microversion: 2.1 time: 0.381074 Jul 25 16:34:58.067887 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2535/5011] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:57 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1267 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:34:58.086501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:58.087255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:58.094849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:58.095301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:58.096428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:58.096889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:58.784477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.797426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.809668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.811649 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-536c8f60-c6af-478e-a09d-c84efc73e6ac tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.375589 Jul 25 16:34:58.812464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2477/5012] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:57 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:59.062920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:59.063728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:59.082632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.084072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.086679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.088298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.131398 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] HTTP exception thrown: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Request method failure captured: Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 HTTP/1.1 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPxkhW4kAgQppWJ9ur455qQMAiTliNsT2wCWGacDsz2SF6SKxyeDhfA_ErE63A35TBoMu3poSRhTZ4yKgoibgrFklsy7tJg17OFMq_aU0q8pozcH6Gn3r3fcT3asiMhpbyOKHxxUDHil9oHWPjbytvm9TxOCnRkwr-AXmhj-L7sSjE Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d5bb17bf33f845cd988f685ee08af589"}]}] Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 18df729ef0034f6a88f6acbc7054db92 Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '937a6da3-2ec6-40fa-9f39-6f02632f3e82'} Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:59.135840 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Returning 404 to user: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:59.144688 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-afb06eb2-f8da-4a0b-b9af-e96ded15a991 tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 404 len: 111 microversion: 2.20 time: 0.083602 Jul 25 16:34:59.146427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2478/5013] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:34:59 2022] DELETE /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:34:59.160031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:59.160703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:59.179288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.180758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.183454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.186606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.768707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:59.781350 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-131d6858-6abe-4170-96fe-01add32fdd3e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1255 microversion: 2.1 time: 0.634616 Jul 25 16:34:59.782615 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2479/5014] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:59 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1255 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:59.789651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:59.791084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] [instance: 937a6da3-2ec6-40fa-9f39-6f02632f3e82] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:59.799367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.800551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.801410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.802091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.820145 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] HTTP exception thrown: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Request method failure captured: Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 HTTP/1.1 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sPxkhW4kAgQppWJ9ur455qQMAiTliNsT2wCWGacDsz2SF6SKxyeDhfA_ErE63A35TBoMu3poSRhTZ4yKgoibgrFklsy7tJg17OFMq_aU0q8pozcH6Gn3r3fcT3asiMhpbyOKHxxUDHil9oHWPjbytvm9TxOCnRkwr-AXmhj-L7sSjE Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d5bb17bf33f845cd988f685ee08af589"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d5bb17bf33f845cd988f685ee08af589"}]}] Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: d5bb17bf33f845cd988f685ee08af589 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1038340057 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 18df729ef0034f6a88f6acbc7054db92 Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1038340057-project Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '937a6da3-2ec6-40fa-9f39-6f02632f3e82'} Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.822152 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. Jul 25 16:34:59.827045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:34:59.831047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] Returning 404 to user: Instance 937a6da3-2ec6-40fa-9f39-6f02632f3e82 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:34:59.832269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f8603cde-22aa-4458-9ab0-4ce2f3050dac tempest-AttachVolumeShelveTestJSON-1038340057 tempest-AttachVolumeShelveTestJSON-1038340057-project] 10.222.0.105 "GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82" status: 404 len: 111 microversion: 2.20 time: 0.047286 Jul 25 16:34:59.835296 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2480/5015] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:59 2022] GET /compute/v2.1/servers/937a6da3-2ec6-40fa-9f39-6f02632f3e82 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:34:59.841753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d4500848-815e-4bf8-9ef1-876467d4dba6 req-44e06c16-ce66-4ef0-a4ea-ce9caf132111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b625714-671b-426c-8229-fdbb939bd5d4", "name": "network-vif-plugged", "status": "completed", "tag": "5abae8d1-fe62-4826-8bd7-210723faae01"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:59.856633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d4500848-815e-4bf8-9ef1-876467d4dba6 req-44e06c16-ce66-4ef0-a4ea-ce9caf132111 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.857462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d4500848-815e-4bf8-9ef1-876467d4dba6 req-44e06c16-ce66-4ef0-a4ea-ce9caf132111 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.868863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:59.876832 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d4500848-815e-4bf8-9ef1-876467d4dba6 req-44e06c16-ce66-4ef0-a4ea-ce9caf132111 service nova] Creating event network-vif-plugged:5abae8d1-fe62-4826-8bd7-210723faae01 for instance 3b625714-671b-426c-8229-fdbb939bd5d4 on n-h2-846219-13 Jul 25 16:34:59.882232 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-906825a3-6359-47cb-8e55-1e037a3b6121 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1205 microversion: 2.1 time: 1.812235 Jul 25 16:34:59.883589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2536/5016] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:34:58 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1205 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:34:59.885201 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d4500848-815e-4bf8-9ef1-876467d4dba6 req-44e06c16-ce66-4ef0-a4ea-ce9caf132111 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047913 Jul 25 16:34:59.886336 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2481/5017] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:59.925720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:59.932834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:59.951333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.962136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.963870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.964807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:00.806092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:00.806872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:00.817277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:00.818159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:00.819259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:00.819887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:01.092996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:01.115122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:01.117002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:01.121400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d60ac9d-f574-49cc-8108-a7a4d3c480d9 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1877 microversion: 2.42 time: 1.222172 Jul 25 16:35:01.127617 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2537/5018] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:34:59 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1877 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:01.132987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:01.137432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:01.154816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:01.155946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:01.158732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:01.159213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:01.735721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:01.750787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dfbb1c6a-5508-4acd-bc44-ac3d2cb03c50 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1255 microversion: 2.1 time: 0.949669 Jul 25 16:35:01.767232 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2482/5019] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:00 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1255 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:02.163212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:02.173813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:02.211298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:02.211874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:02.212673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:02.214595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:02.227044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:02.276914 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff0123e4-b1c3-4b88-9e21-10c7a19ad060 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1205 microversion: 2.1 time: 1.147796 Jul 25 16:35:02.285769 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2538/5020] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:01 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1205 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:02.780672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:02.781362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:02.826223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:02.834897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:02.841177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:02.842216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.091084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.106258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.107852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.109175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d2e124d-89aa-47e1-93c9-4ca500145b4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2835 microversion: 2.42 time: 0.961623 Jul 25 16:35:03.109772 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2483/5021] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:35:02 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2835 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:03.175544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:03.180530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:03.193508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.194724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.198376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.199205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.488229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.502104 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6815b4c-205c-47b1-9096-3fed439462e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 0.730847 Jul 25 16:35:03.522493 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2539/5022] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:02 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:03.530333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:03.531229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:03.541945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.546123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.549210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.549794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.562896 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74667355-a708-4e54-8644-e201fd08d212 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.397955 Jul 25 16:35:03.564277 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2484/5023] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:35:03 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64/os-interface => generated 1832 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:03.871580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.885518 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d068b73e-173e-4a7e-bbbc-28ad4ee769bf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1393 microversion: 2.1 time: 0.360515 Jul 25 16:35:03.905424 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2540/5024] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:03 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1393 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:03.910284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:03.910905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:03.925010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.926097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.926890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.927323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.990294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:04.249855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:04.264184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ece649d-29d3-4d0c-bb43-5510c27e8071 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1393 microversion: 2.1 time: 0.353347 Jul 25 16:35:04.265182 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2485/5025] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:03 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1393 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:04.286449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:04.287355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:04.296100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.297175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.299128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.300040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.529784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:04.530430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:04.544806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.547006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.550433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.551212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.776424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:04.936426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:04.947382 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-04f39353-10d8-4f5b-8088-2e3099b64eb4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1393 microversion: 2.1 time: 0.664974 Jul 25 16:35:04.948720 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2541/5026] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:04 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1393 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:04.951077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:04.962041 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e709c9f8-8407-4995-822c-86f867d4aa0a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 0.437076 Jul 25 16:35:04.984810 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2486/5027] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:04 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:05.062006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:05.063663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:05.077012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.077361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.078916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.079819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.132486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:35:05.253893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:05.280455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2f07e665-719b-45b3-84ce-9558b15c9d6e req-ff92f446-17d3-4780-9879-1b80370135dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c149a3-992e-4f91-88b3-fe2921c835ec", "tag": "c23ec48f-7d61-408c-9be4-75c9ee474253"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:05.326099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:05.330890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2f07e665-719b-45b3-84ce-9558b15c9d6e req-ff92f446-17d3-4780-9879-1b80370135dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.334245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2f07e665-719b-45b3-84ce-9558b15c9d6e req-ff92f446-17d3-4780-9879-1b80370135dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.343065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1cea72c8-6465-4660-b4f3-889dd3d8329c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 204 len: 0 microversion: 2.1 time: 0.287960 Jul 25 16:35:05.346267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2542/5028] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:35:05 2022] DELETE /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:35:05.359121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:05.360875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:05.367732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2f07e665-719b-45b3-84ce-9558b15c9d6e req-ff92f446-17d3-4780-9879-1b80370135dc service nova] Creating event network-changed:c23ec48f-7d61-408c-9be4-75c9ee474253 for instance 56c149a3-992e-4f91-88b3-fe2921c835ec on n-h2-846219-13 Jul 25 16:35:05.373404 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2f07e665-719b-45b3-84ce-9558b15c9d6e req-ff92f446-17d3-4780-9879-1b80370135dc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137766 Jul 25 16:35:05.374387 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2487/5029] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:05.384624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.385762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.387404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.388073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.685740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:05.697759 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7888639-cdcb-424f-90d8-5f2e209796b7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1399 microversion: 2.1 time: 0.345440 Jul 25 16:35:05.698886 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2543/5030] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:05 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1399 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:05.995288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:05.995810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:06.007731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:06.008523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:06.009442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:06.009987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:06.164442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:06.176160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86ac824b-1e07-40bb-9bbe-8e18ddf936ef tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 0.185115 Jul 25 16:35:06.180763 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2488/5031] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:05 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:06.733611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:06.734229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:06.743095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:06.743551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:06.744348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:06.744782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:07.203601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:07.206056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:07.240228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:07.244476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:07.246371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:07.250111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:08.222532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:08.236762 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-563b7f0e-8b50-4b90-bdb1-055a1b0de260 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1399 microversion: 2.1 time: 1.505754 Jul 25 16:35:08.238234 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2544/5032] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:06 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1399 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:08.243546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1f240227-10c4-4e7a-ac32-d531900ce454 req-b1a94bb3-77d8-4b13-96f0-b486264e63a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "tag": "6afef70b-7f67-402e-8508-8cc2de9786ec"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:08.270299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1f240227-10c4-4e7a-ac32-d531900ce454 req-b1a94bb3-77d8-4b13-96f0-b486264e63a8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:08.271890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1f240227-10c4-4e7a-ac32-d531900ce454 req-b1a94bb3-77d8-4b13-96f0-b486264e63a8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:08.303232 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1f240227-10c4-4e7a-ac32-d531900ce454 req-b1a94bb3-77d8-4b13-96f0-b486264e63a8 service nova] Creating event network-changed:6afef70b-7f67-402e-8508-8cc2de9786ec for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:35:08.313569 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1f240227-10c4-4e7a-ac32-d531900ce454 req-b1a94bb3-77d8-4b13-96f0-b486264e63a8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073800 Jul 25 16:35:08.326341 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2545/5033] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:08.350506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:08.359070 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4f76d3c-a75b-4ce7-9e4d-5d2b5f3dda21 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 1.162566 Jul 25 16:35:08.359668 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2489/5034] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:07 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:09.260492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:09.262593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:09.263523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:09.273603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:09.274105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:09.275327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:09.275996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:09.379865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:09.381293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:09.398198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:09.398866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:09.400039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:09.400984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:10.028697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:10.040044 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d700553-ecec-48dd-8396-2ff1e14cef97 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 0.664211 Jul 25 16:35:10.041405 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2490/5035] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:09 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:10.099888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:10.116908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a90ec7c-c064-431c-9cde-b60c49db2185 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1399 microversion: 2.1 time: 0.861879 Jul 25 16:35:10.134721 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2546/5036] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:09 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1399 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:10.619935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fdb637ff-51c6-40ea-91ae-e54d44e1e557 req-3fc272a1-5a4f-4981-ac4c-b1fa61eece23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b625714-671b-426c-8229-fdbb939bd5d4", "name": "network-vif-deleted", "tag": "5abae8d1-fe62-4826-8bd7-210723faae01"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:10.642086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fdb637ff-51c6-40ea-91ae-e54d44e1e557 req-3fc272a1-5a4f-4981-ac4c-b1fa61eece23 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:10.642542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fdb637ff-51c6-40ea-91ae-e54d44e1e557 req-3fc272a1-5a4f-4981-ac4c-b1fa61eece23 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:10.670838 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fdb637ff-51c6-40ea-91ae-e54d44e1e557 req-3fc272a1-5a4f-4981-ac4c-b1fa61eece23 service nova] Creating event network-vif-deleted:5abae8d1-fe62-4826-8bd7-210723faae01 for instance 3b625714-671b-426c-8229-fdbb939bd5d4 on n-h2-846219-13 Jul 25 16:35:10.680227 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fdb637ff-51c6-40ea-91ae-e54d44e1e557 req-3fc272a1-5a4f-4981-ac4c-b1fa61eece23 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063217 Jul 25 16:35:10.682939 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2491/5037] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:11.060982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:11.061764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:11.086951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:11.087311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:11.088121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:11.088564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:11.144027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:11.144803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:11.159732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:11.160190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:11.160977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:11.161452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:12.151073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:12.175112 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c661c75-e401-447c-8676-34fc46d4500a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1190 microversion: 2.1 time: 1.034227 Jul 25 16:35:12.177286 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2492/5038] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:11 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1190 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:13.199280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:13.200595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:13.211303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:13.222445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:13.224507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:13.227370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:13.228429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:13.512767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:13.520929 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e652008d-a0dc-4f16-8aed-467630a9c591 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 2.464238 Jul 25 16:35:13.528535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:13.529060 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2547/5039] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:11 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:13.558437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-335aa9d7-b367-481c-88a7-8ff90243b2b1 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1190 microversion: 2.1 time: 0.361614 Jul 25 16:35:13.559756 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2493/5040] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:13 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1190 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:14.542815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:14.544084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:14.580054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:14.586048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:14.600474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:14.605795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:14.611256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:14.611748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:14.615880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:14.617114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:14.618458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:14.621048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:14.740219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:14.774438 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5477601e-7e1e-46e8-9e66-c32e57efd218 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1190 microversion: 2.1 time: 0.196885 Jul 25 16:35:14.776593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2494/5041] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:14 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1190 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:15.175378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:15.185421 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-182b8958-f4f2-475a-94c0-cfade66faeab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 0.646590 Jul 25 16:35:15.193502 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2548/5042] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:14 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:15.316626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-46a559bd-517f-467e-bfa3-c9ef3f13cc61 req-fcf65595-aefe-49f9-8d0d-3400d14ae943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c149a3-992e-4f91-88b3-fe2921c835ec", "name": "network-vif-plugged", "status": "completed", "tag": "c23ec48f-7d61-408c-9be4-75c9ee474253"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:15.334239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-46a559bd-517f-467e-bfa3-c9ef3f13cc61 req-fcf65595-aefe-49f9-8d0d-3400d14ae943 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:15.334682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-46a559bd-517f-467e-bfa3-c9ef3f13cc61 req-fcf65595-aefe-49f9-8d0d-3400d14ae943 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:15.374231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-46a559bd-517f-467e-bfa3-c9ef3f13cc61 req-fcf65595-aefe-49f9-8d0d-3400d14ae943 service nova] Creating event network-vif-plugged:c23ec48f-7d61-408c-9be4-75c9ee474253 for instance 56c149a3-992e-4f91-88b3-fe2921c835ec on n-h2-846219-13 Jul 25 16:35:15.390732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-46a559bd-517f-467e-bfa3-c9ef3f13cc61 req-fcf65595-aefe-49f9-8d0d-3400d14ae943 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078789 Jul 25 16:35:15.393771 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2495/5043] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:15.797257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:15.798636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:15.808001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:15.809034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:15.815579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:15.818350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:15.983989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:16.003147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c27d527-1efc-4bd0-abfd-66df1cb94c7d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1190 microversion: 2.1 time: 0.206453 Jul 25 16:35:16.006905 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2549/5044] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:15 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1190 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:16.221566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:16.222361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:16.248846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:16.256067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:16.259349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:16.259830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:16.511822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-263ab8e9-7dcc-4d1e-8045-69f6be76e77f tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Action: 'create', calling method: .version_select at 0x7f9d92a49e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-206638766"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:16.592243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:16.604959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b7d0b98-fd0e-4c52-af71-4de26343d7cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1297 microversion: 2.1 time: 0.390108 Jul 25 16:35:16.623975 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2496/5045] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:16 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1297 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:17.027969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:17.028746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:17.058348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:17.063129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:17.064962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:17.066820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:17.342122 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-263ab8e9-7dcc-4d1e-8045-69f6be76e77f tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.017671 Jul 25 16:35:17.343123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2550/5046] 10.222.0.105 () {60 vars in 1160 bytes} [Mon Jul 25 16:35:16 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1020 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 25 16:35:17.355818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc849618-7206-4814-83e6-f1a99e58500e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d927423a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:17.453763 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc849618-7206-4814-83e6-f1a99e58500e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 344 microversion: 2.1 time: 0.102242 Jul 25 16:35:17.454696 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2551/5047] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:17 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:17.637201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:17.637823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:17.656978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:17.657471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:17.658260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:17.658723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:17.797733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:17.826031 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-79c43c27-73ec-4ef5-a6d7-e2b915c18f75 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1190 microversion: 2.1 time: 0.802513 Jul 25 16:35:17.828962 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2497/5048] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:17 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1190 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:18.098869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:18.117679 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17e397f6-aeb8-4fb9-87c5-e3eb23c877c6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1479 microversion: 2.1 time: 0.487748 Jul 25 16:35:18.137963 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2552/5049] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:17 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1479 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:18.350520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2134146372", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:18.467240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:35:18.468506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4cb7488-377e-4ec2-9aea-7c2b5b0c8793 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92a49ee0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:18.559885 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4cb7488-377e-4ec2-9aea-7c2b5b0c8793 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 344 microversion: 2.1 time: 0.095567 Jul 25 16:35:18.560725 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2553/5050] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:18 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:18.853587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:18.855021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:18.893957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:18.895085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:18.904728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:18.905662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:18.996125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:18.996577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:18.997054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lazy-loading 'fault' on Instance uuid 3b625714-671b-426c-8229-fdbb939bd5d4 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:35:19.163826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:19.178525 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b02ee3b-418e-4a4d-85e2-839870b17d4f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 200 len: 1195 microversion: 2.1 time: 0.332681 Jul 25 16:35:19.200617 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2554/5051] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:18 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 1195 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:19.574864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3542071-e083-4aa3-89ec-2fb44660fb7e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d927a5940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:19.645326 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3542071-e083-4aa3-89ec-2fb44660fb7e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 345 microversion: 2.1 time: 0.074879 Jul 25 16:35:19.646542 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2555/5052] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:19 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:19.661263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7e55daa-098f-494c-ad59-47b1b832feef tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Action: 'create', calling method: .version_select at 0x7f9d928b4040>, body: {"snapshot": {"volume_id": "727232a2-eed3-4b47-92f5-b997e1bafc5c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-932886963"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:19.963676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7e55daa-098f-494c-ad59-47b1b832feef tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.308407 Jul 25 16:35:19.975524 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2556/5053] 10.222.0.105 () {60 vars in 1167 bytes} [Mon Jul 25 16:35:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:19.989274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-753d487c-4172-4f74-849c-baf2ebebae4c tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9da4948280>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:20.078214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:35:20.078663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:35:20.079079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:35:20.079479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:35:20.079915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:35:20.084240 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-753d487c-4172-4f74-849c-baf2ebebae4c tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.100237 Jul 25 16:35:20.085689 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2557/5054] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:19 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:20.098365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e16088eb-ad77-4912-92e6-1142444d927d tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d928a1af0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:20.121838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:20.122680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:20.123999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:20.124695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:20.182581 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e16088eb-ad77-4912-92e6-1142444d927d tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.088824 Jul 25 16:35:20.183171 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2558/5055] 10.222.0.105 () {58 vars in 1145 bytes} [Mon Jul 25 16:35:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:20.190107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:35:20.194980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e01b27c0-11f5-43c3-ba1c-5fdd3a934dfd tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9da4aea040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:20.206722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:35:20.250543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:35:20.254245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:35:20.266255 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e01b27c0-11f5-43c3-ba1c-5fdd3a934dfd tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.075505 Jul 25 16:35:20.267196 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2559/5056] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:20 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:20.272177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:20.272889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:20.293047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:20.293546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:20.294335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:20.294783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:20.368096 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 HTTP/1.1 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3b625714-671b-426c-8229-fdbb939bd5d4'} Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:20.373888 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:20.380519 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:20.383500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:20.384686 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c92393d-74a2-49c0-8a26-dd68e03910dd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 404 len: 111 microversion: 2.1 time: 0.116437 Jul 25 16:35:20.386613 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d48bab7-4196-4214-aabe-90effcd2564b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.040513 Jul 25 16:35:20.389439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2560/5057] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:20 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:20.397260 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2498/5058] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:35:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:35:20.406207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6fdc44ef-8ea5-4d3b-9823-9251a41d463c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:20.407090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6fdc44ef-8ea5-4d3b-9823-9251a41d463c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:20.428976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6fdc44ef-8ea5-4d3b-9823-9251a41d463c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:35:21.232467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.scheduler.client.report [None req-6fdc44ef-8ea5-4d3b-9823-9251a41d463c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Deleted allocations for instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf Jul 25 16:35:21.242904 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.compute.api [None req-6fdc44ef-8ea5-4d3b-9823-9251a41d463c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] Instance Mapping does not exist while attempting local delete cleanup. Jul 25 16:35:21.246314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6fdc44ef-8ea5-4d3b-9823-9251a41d463c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf" status: 204 len: 0 microversion: 2.1 time: 0.844931 Jul 25 16:35:21.249323 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2561/5059] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:35:20 2022] DELETE /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:35:21.258878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e06fb90-4359-4f55-a0bf-c241014adcd8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:21.262356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6e06fb90-4359-4f55-a0bf-c241014adcd8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:21.280548 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-6e06fb90-4359-4f55-a0bf-c241014adcd8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:35:21.282797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-670a9f4d-b951-465b-b60d-b50fed0f85df tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d929f6550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e06fb90-4359-4f55-a0bf-c241014adcd8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf HTTP/1.1 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'de444616-4bc5-45fa-8c74-a43fa6bcf7cf'} Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:21.288929 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:21.296934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:21.296934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:21.296934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:21.296934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:35:21.296934 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:21.302710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e06fb90-4359-4f55-a0bf-c241014adcd8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:21.303899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6e06fb90-4359-4f55-a0bf-c241014adcd8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf" status: 404 len: 111 microversion: 2.1 time: 0.049929 Jul 25 16:35:21.307047 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2499/5060] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:21 2022] GET /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:21.360285 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-670a9f4d-b951-465b-b60d-b50fed0f85df tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.084596 Jul 25 16:35:21.361048 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2562/5061] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:21 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:21.701906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-937462683", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:21.871189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:35:22.374966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e5b229d-dde2-40a9-8080-7572faa1c36a tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9390d790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:22.451933 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e5b229d-dde2-40a9-8080-7572faa1c36a tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.082563 Jul 25 16:35:22.452520 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2563/5062] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:22 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:23.483227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bcc5b0b8-7022-499d-830b-c7627d1934e5 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92f32c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:23.562818 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bcc5b0b8-7022-499d-830b-c7627d1934e5 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.097477 Jul 25 16:35:23.566533 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2564/5063] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:23 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:23.731304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:35:23.731871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:35:23.733186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:35:23.733844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:35:23.734440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:35:23.779504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:23.781134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:23.782477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:23.785852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:23.829463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:35:23.861746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:35:23.927822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:35:23.933132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:35:24.066901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0980d3b3-dd98-4ce0-b98a-9eea03f220af tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.369638 Jul 25 16:35:24.077516 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2500/5064] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:35:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:35:24.082914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6e959fc0-bc03-47f8-bb86-40cdf711fe28 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:24.084286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6e959fc0-bc03-47f8-bb86-40cdf711fe28 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:24.266428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6e959fc0-bc03-47f8-bb86-40cdf711fe28 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:24.276775 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6e959fc0-bc03-47f8-bb86-40cdf711fe28 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1224 microversion: 2.1 time: 0.197877 Jul 25 16:35:24.277439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2565/5065] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:24 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1224 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:24.580628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f5af0abe-e5f5-4266-ae0a-c9d6aec29bd5 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92971430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:24.661576 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f5af0abe-e5f5-4266-ae0a-c9d6aec29bd5 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 287 microversion: 2.1 time: 0.086980 Jul 25 16:35:24.662502 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2501/5066] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:24 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:24.675542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-21d0896b-9b9e-4928-b011-21fe39739015 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9390d430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:24.774070 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-21d0896b-9b9e-4928-b011-21fe39739015 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "DELETE /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 202 len: 0 microversion: 2.1 time: 0.101524 Jul 25 16:35:24.779327 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2566/5067] 10.222.0.105 () {58 vars in 1259 bytes} [Mon Jul 25 16:35:24 2022] DELETE /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:35:24.784714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0576076e-fd03-4e62-a9d1-4342df645226 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9295a670>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:24.832633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0576076e-fd03-4e62-a9d1-4342df645226 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.052426 Jul 25 16:35:24.833955 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2502/5068] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:24 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:25.304970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:25.306409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:25.328783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:25.329670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:25.337130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:25.339313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:25.550127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:25.565239 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-376453f1-bfa6-4fab-8c63-6efab70a73d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1220 microversion: 2.1 time: 0.267934 Jul 25 16:35:25.581005 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2567/5069] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:25 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:25.846575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4931cc8-831d-4d0b-b5c9-429f1beec466 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9295a700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:25.905598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4931cc8-831d-4d0b-b5c9-429f1beec466 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.063431 Jul 25 16:35:25.906780 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2503/5070] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:25 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:26.121243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:26.123658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:26.147580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:26.152361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:26.158289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:26.160682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:26.226445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 HTTP/1.1 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3b625714-671b-426c-8229-fdbb939bd5d4'} Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:26.228453 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.234084 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.238978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:26.242608 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-adefe0ea-d7cb-4519-94bb-5076670e49b4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 404 len: 111 microversion: 2.1 time: 0.127992 Jul 25 16:35:26.246204 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2568/5071] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:35:26 2022] DELETE /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:26.255798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:26.256736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 3b625714-671b-426c-8229-fdbb939bd5d4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:26.275237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:26.277633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:26.281687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:26.283799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:26.329016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 HTTP/1.1 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '3b625714-671b-426c-8229-fdbb939bd5d4'} Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:26.331898 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. Jul 25 16:35:26.339108 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:26.342399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 3b625714-671b-426c-8229-fdbb939bd5d4 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:26.343625 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75aa3420-e896-4b38-944f-bd99ab4d733e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4" status: 404 len: 111 microversion: 2.1 time: 0.094128 Jul 25 16:35:26.348011 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2504/5072] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:26 2022] GET /compute/v2.1/servers/3b625714-671b-426c-8229-fdbb939bd5d4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:26.600996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:26.606415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:26.642093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:26.642853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:26.644362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:26.652090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:26.940470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d506d5d2-acac-46fc-b966-310ce9a8ac52 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92901c10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:27.003005 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d506d5d2-acac-46fc-b966-310ce9a8ac52 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 200 len: 286 microversion: 2.1 time: 0.073312 Jul 25 16:35:27.010160 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2505/5073] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:26 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:27.062843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:27.099645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc69c3ce-303d-430c-8dab-71f9f56b3cbe tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1282 microversion: 2.1 time: 0.498162 Jul 25 16:35:27.102866 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2569/5074] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:26 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1282 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:28.039062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ca97c57-52db-45d8-8249-c3b222b9a5af tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d929015e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:28.120032 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9ca97c57-52db-45d8-8249-c3b222b9a5af tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] HTTP exception thrown: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. Jul 25 16:35:28.126021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:28.127194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ca97c57-52db-45d8-8249-c3b222b9a5af tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Request method failure captured: Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 HTTP/1.1 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sZE6UkBWkZ9unfg4luS3XxAX0fUHUfvB8qKX6jQ6TcTL-mcPkXBcnT4kQwxCKUzJvGixNx0D6HcjHyQNWuyIGxbL3WPBbAdHgdzMDGehCXjdxuD0gsyYhUaAD7mbr-bXJX0ptSTjsg70ohS9-m3B2wNUielKs2_FqqUEk37e9tEpjs Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9c0bcc87d13c419d9073cf5df06eb4eb"}]}] Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 534c55ae879d444488328506f9872a0b Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: exception: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '87dfcf9b-ef28-4476-ade9-46eb4c36e882'} Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. (HTTP 404) (Request-ID: req-842662a3-3019-4971-9d3e-28b3a8a46afc) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:35:28.131461 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ca97c57-52db-45d8-8249-c3b222b9a5af tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Returning 404 to user: Snapshot 87dfcf9b-ef28-4476-ade9-46eb4c36e882 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:28.136967 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ca97c57-52db-45d8-8249-c3b222b9a5af tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882" status: 404 len: 111 microversion: 2.1 time: 0.120631 Jul 25 16:35:28.142556 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2506/5075] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 16:35:28 2022] GET /compute/v2.1/os-snapshots/87dfcf9b-ef28-4476-ade9-46eb4c36e882 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:28.151909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:28.153684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:28.154760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:28.155878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aeac57cc-cc1d-401c-bec4-23e73d4a1481 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9297a280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:28.165985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:28.343581 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aeac57cc-cc1d-401c-bec4-23e73d4a1481 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 202 len: 0 microversion: 2.1 time: 0.202421 Jul 25 16:35:28.344349 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2507/5076] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:35:28 2022] DELETE /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:35:28.363287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9821238d-3015-4945-9367-ca87274fca04 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9297a1f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:28.421425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:28.434362 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc6f2843-34c9-4c1b-9dd7-c264824cf754 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1282 microversion: 2.1 time: 0.313323 Jul 25 16:35:28.434988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2570/5077] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:28 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:28.526703 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9821238d-3015-4945-9367-ca87274fca04 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 344 microversion: 2.1 time: 0.175420 Jul 25 16:35:28.527443 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2508/5078] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:28 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:29.463196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:29.463654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:29.480574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:29.484282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:29.488874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:29.489781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:29.546691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9729fd6-20f3-4952-a313-d60808336e56 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92901820>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:29.670008 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9729fd6-20f3-4952-a313-d60808336e56 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 344 microversion: 2.1 time: 0.131359 Jul 25 16:35:29.671118 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2509/5079] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:29 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:30.117871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:30.132722 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-380e87d8-bcd8-4682-b8de-615c6b56cde5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.674733 Jul 25 16:35:30.134278 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2571/5080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:29 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:30.686538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3791222-2a19-4cfc-aa74-fdefcdb7011c tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92969b80>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:30.784200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3791222-2a19-4cfc-aa74-fdefcdb7011c tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 344 microversion: 2.1 time: 0.103371 Jul 25 16:35:30.785081 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2510/5081] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:30 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:31.167501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a93514d4-77bf-41e8-87cf-7f91ac05060c req-4d4889f6-f2e3-469c-9162-0e501fa19fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c353791-3deb-4553-a794-649ac75c822e", "tag": "3d0a80ba-4493-4f6b-9112-ddf6159246f3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:31.170986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:31.171652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:31.202967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:31.203097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:31.203877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:31.204321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:31.225674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a93514d4-77bf-41e8-87cf-7f91ac05060c req-4d4889f6-f2e3-469c-9162-0e501fa19fe6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:31.228405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a93514d4-77bf-41e8-87cf-7f91ac05060c req-4d4889f6-f2e3-469c-9162-0e501fa19fe6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:31.298394 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a93514d4-77bf-41e8-87cf-7f91ac05060c req-4d4889f6-f2e3-469c-9162-0e501fa19fe6 service nova] Creating event network-changed:3d0a80ba-4493-4f6b-9112-ddf6159246f3 for instance 3c353791-3deb-4553-a794-649ac75c822e on n-h1-846219-13 Jul 25 16:35:31.312363 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a93514d4-77bf-41e8-87cf-7f91ac05060c req-4d4889f6-f2e3-469c-9162-0e501fa19fe6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545670 Jul 25 16:35:31.314857 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2572/5082] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:31.800875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-52e46022-bea7-457b-a6eb-14cea31c6a65 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d927fcca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:31.980416 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-52e46022-bea7-457b-a6eb-14cea31c6a65 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 200 len: 344 microversion: 2.1 time: 0.182819 Jul 25 16:35:31.981731 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2573/5083] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:31 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 344 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:31.992477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:32.003399 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5d139275-ddab-4426-aea6-105cd7e41d93 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.846767 Jul 25 16:35:32.005653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2511/5084] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:31 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:33.005693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db4fa037-fd39-4606-bb29-c0c9045d133e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d9275c700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:33.030240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:33.032833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:33.060517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:33.063797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:33.069043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:33.076116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:33.105242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-db4fa037-fd39-4606-bb29-c0c9045d133e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] HTTP exception thrown: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db4fa037-fd39-4606-bb29-c0c9045d133e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Request method failure captured: Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c HTTP/1.1 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sZE6UkBWkZ9unfg4luS3XxAX0fUHUfvB8qKX6jQ6TcTL-mcPkXBcnT4kQwxCKUzJvGixNx0D6HcjHyQNWuyIGxbL3WPBbAdHgdzMDGehCXjdxuD0gsyYhUaAD7mbr-bXJX0ptSTjsg70ohS9-m3B2wNUielKs2_FqqUEk37e9tEpjs Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9c0bcc87d13c419d9073cf5df06eb4eb"}]}] Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 534c55ae879d444488328506f9872a0b Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '727232a2-eed3-4b47-92f5-b997e1bafc5c'} Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. (HTTP 404) (Request-ID: req-63ea97e3-a139-4b01-b977-349e3df725e1) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:35:33.111248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.117251 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.128684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db4fa037-fd39-4606-bb29-c0c9045d133e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Returning 404 to user: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:33.129905 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db4fa037-fd39-4606-bb29-c0c9045d133e tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 404 len: 109 microversion: 2.1 time: 0.137537 Jul 25 16:35:33.130950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2574/5085] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:32 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:33.152137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7315b74-4920-4035-9011-4bfbfc084b61 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d92e9ce50>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:33.244789 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b7315b74-4920-4035-9011-4bfbfc084b61 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] HTTP exception thrown: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7315b74-4920-4035-9011-4bfbfc084b61 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Request method failure captured: Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c HTTP/1.1 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sZE6UkBWkZ9unfg4luS3XxAX0fUHUfvB8qKX6jQ6TcTL-mcPkXBcnT4kQwxCKUzJvGixNx0D6HcjHyQNWuyIGxbL3WPBbAdHgdzMDGehCXjdxuD0gsyYhUaAD7mbr-bXJX0ptSTjsg70ohS9-m3B2wNUielKs2_FqqUEk37e9tEpjs Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9c0bcc87d13c419d9073cf5df06eb4eb"}]}] Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 534c55ae879d444488328506f9872a0b Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '727232a2-eed3-4b47-92f5-b997e1bafc5c'} Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. (HTTP 404) (Request-ID: req-208ec9fb-fdff-4389-9089-424954d5c51a) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:35:33.246801 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7315b74-4920-4035-9011-4bfbfc084b61 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Returning 404 to user: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7315b74-4920-4035-9011-4bfbfc084b61 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 404 len: 109 microversion: 2.1 time: 0.112211 Jul 25 16:35:33.252808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2575/5086] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:35:33 2022] DELETE /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:33.273591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4887b53-59be-4c5b-9a14-59e1f7ceec97 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Calling method '.version_select at 0x7f9d93845d30>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a4887b53-59be-4c5b-9a14-59e1f7ceec97 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] HTTP exception thrown: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4887b53-59be-4c5b-9a14-59e1f7ceec97 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Request method failure captured: Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c HTTP/1.1 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sZE6UkBWkZ9unfg4luS3XxAX0fUHUfvB8qKX6jQ6TcTL-mcPkXBcnT4kQwxCKUzJvGixNx0D6HcjHyQNWuyIGxbL3WPBbAdHgdzMDGehCXjdxuD0gsyYhUaAD7mbr-bXJX0ptSTjsg70ohS9-m3B2wNUielKs2_FqqUEk37e9tEpjs Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/9c0bcc87d13c419d9073cf5df06eb4eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_9c0bcc87d13c419d9073cf5df06eb4eb"}]}] Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 9c0bcc87d13c419d9073cf5df06eb4eb Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-626147941 Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 534c55ae879d444488328506f9872a0b Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesSnapshotsTestJSON-626147941-project Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '727232a2-eed3-4b47-92f5-b997e1bafc5c'} Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. (HTTP 404) (Request-ID: req-028d1d8d-6584-41ea-841e-0f6e6eeec43b) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:35:33.384693 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4887b53-59be-4c5b-9a14-59e1f7ceec97 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] Returning 404 to user: Volume 727232a2-eed3-4b47-92f5-b997e1bafc5c could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4887b53-59be-4c5b-9a14-59e1f7ceec97 tempest-VolumesSnapshotsTestJSON-626147941 tempest-VolumesSnapshotsTestJSON-626147941-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c" status: 404 len: 109 microversion: 2.1 time: 0.128968 Jul 25 16:35:33.403397 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2576/5087] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:33 2022] GET /compute/v2.1/os-volumes/727232a2-eed3-4b47-92f5-b997e1bafc5c => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:33.755872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:33.772059 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c2feedb1-f72f-46db-9ed0-670b46a4aa29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.746024 Jul 25 16:35:33.772680 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2512/5088] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:33 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:34.793001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:34.797894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:34.798342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:34.820006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:34.823660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:34.827966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:34.829158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:35.211845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:35.222766 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb9f4871-b972-4ec6-958e-e620afc2b0a2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.431269 Jul 25 16:35:35.241593 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2577/5089] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:34 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:36.253305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:36.253938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:36.257259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:36.260229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=12 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:36.274951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:36.277726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:36.279035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:36.280856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:36.284315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=83 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:36.578649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:36.593587 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a710a45d-6e51-4f85-aff6-5f1275710db2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.346077 Jul 25 16:35:36.594923 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2513/5090] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:36 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:37.616614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:37.617265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:37.641763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:37.642463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:37.644379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:37.644823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:37.659080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:38.043115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:38.075994 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef2c29bf-f5a1-4e4c-8614-54badf671c94 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.463078 Jul 25 16:35:38.077664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2578/5091] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:37 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:38.243388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92aa897f-e05f-455f-a4ae-dda261909238 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Action: 'create', calling method: .version_select at 0x7f9d93cff820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-400584758", "metadata": {"Type": "work"}}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:38.868940 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92aa897f-e05f-455f-a4ae-dda261909238 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.950803 Jul 25 16:35:38.873154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2514/5092] 10.222.0.105 () {60 vars in 1161 bytes} [Mon Jul 25 16:35:37 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 959 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 25 16:35:38.887079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-52b0bb8e-1063-49f3-8b4a-f9bcf06edc16 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d928b4040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:39.006112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-52b0bb8e-1063-49f3-8b4a-f9bcf06edc16 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 352 microversion: 2.1 time: 0.122843 Jul 25 16:35:39.007016 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2579/5093] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:38 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:39.113954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:39.122381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:39.144446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.145373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.150746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.151862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.600455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:39.632803 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a22f2e64-57e0-4003-81ae-32d746f9dc33 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.528585 Jul 25 16:35:39.637142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2515/5094] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:39 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:40.023124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc27f505-0fcb-40c9-b790-e38fbaa84397 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d9288b940>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:40.161598 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc27f505-0fcb-40c9-b790-e38fbaa84397 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 352 microversion: 2.1 time: 0.145175 Jul 25 16:35:40.162403 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2580/5095] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:40 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:40.665821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:40.666740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:40.706006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:40.707116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:40.709125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:40.711720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:41.177963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0cc22736-45a6-48d1-a4ed-2910f9f8df59 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d927a5c10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:41.255109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:41.290320 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0cc22736-45a6-48d1-a4ed-2910f9f8df59 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 353 microversion: 2.1 time: 0.117534 Jul 25 16:35:41.290838 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2581/5096] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:41 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:41.295384 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-562ff2ed-76dc-4cae-894d-b67b65bbf8f6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.638015 Jul 25 16:35:41.305937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d451b8bc-1759-4964-b5e7-c1923cc45a66 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d9277b0d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:41.316342 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2516/5097] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:40 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:41.430191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fab03cb8-cc16-4440-aeb3-e3400926b766 req-6414d21d-9569-4522-bc1b-fd3c54e28b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c353791-3deb-4553-a794-649ac75c822e", "name": "network-vif-plugged", "status": "completed", "tag": "3d0a80ba-4493-4f6b-9112-ddf6159246f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:41.432261 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d451b8bc-1759-4964-b5e7-c1923cc45a66 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 353 microversion: 2.1 time: 0.131192 Jul 25 16:35:41.434019 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2582/5098] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:41 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:41.465154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f2acbf2-2595-4995-bfc7-3dd65dca1dfc tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d93845700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:41.476272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fab03cb8-cc16-4440-aeb3-e3400926b766 req-6414d21d-9569-4522-bc1b-fd3c54e28b25 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:41.479220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fab03cb8-cc16-4440-aeb3-e3400926b766 req-6414d21d-9569-4522-bc1b-fd3c54e28b25 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:41.545879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fab03cb8-cc16-4440-aeb3-e3400926b766 req-6414d21d-9569-4522-bc1b-fd3c54e28b25 service nova] Creating event network-vif-plugged:3d0a80ba-4493-4f6b-9112-ddf6159246f3 for instance 3c353791-3deb-4553-a794-649ac75c822e on n-h1-846219-13 Jul 25 16:35:41.579712 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fab03cb8-cc16-4440-aeb3-e3400926b766 req-6414d21d-9569-4522-bc1b-fd3c54e28b25 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154259 Jul 25 16:35:41.580328 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f2acbf2-2595-4995-bfc7-3dd65dca1dfc tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 202 len: 0 microversion: 2.1 time: 0.122230 Jul 25 16:35:41.585539 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2583/5099] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:35:41 2022] DELETE /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:35:41.589584 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2517/5100] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:41.593015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-173cd6ab-2378-4b7d-9f91-71f79f2cb99a tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d927423a0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:41.784782 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-173cd6ab-2378-4b7d-9f91-71f79f2cb99a tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 352 microversion: 2.1 time: 0.196862 Jul 25 16:35:41.787699 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2584/5101] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:41 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:42.342413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:42.344758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:42.375360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.376592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.378540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.379722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.735121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:42.762216 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e7b2ce96-d916-43ca-b741-6617409a4b58 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 0.420550 Jul 25 16:35:42.770241 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2518/5102] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:42 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:42.806719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af523410-6d03-4859-90d2-59577eaec18b tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d92fb6160>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:42.976156 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af523410-6d03-4859-90d2-59577eaec18b tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 352 microversion: 2.1 time: 0.175375 Jul 25 16:35:42.976805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2585/5103] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:42 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:43.796978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:43.798271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:43.802207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:43.837168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:43.837624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:43.838419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:43.842386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:44.000786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e68a65a1-8c93-41ca-903f-cfe4ba529d1f tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d9288be50>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:44.173408 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e68a65a1-8c93-41ca-903f-cfe4ba529d1f tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 352 microversion: 2.1 time: 0.185116 Jul 25 16:35:44.175512 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2586/5104] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:43 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:44.641821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:44.652171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:44.716623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:44.724879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:44.731023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:44.735690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:44.739311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:44.860653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:44.891577 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4921ff2e-76e1-45b7-9dbf-113a321de970 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1324 microversion: 2.1 time: 1.096961 Jul 25 16:35:44.895954 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2519/5105] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:43 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1324 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:44.988256 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe80952a-4c29-4e7d-b090-51036d018bb3 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "POST /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a/action" status: 200 len: 32651 microversion: 2.1 time: 0.353874 Jul 25 16:35:44.989965 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2587/5106] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:35:44 2022] POST /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a/action => generated 32651 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:35:45.200773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23e86b81-39cb-4d48-bc35-911e0b2840b4 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d9295aee0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:45.328140 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23e86b81-39cb-4d48-bc35-911e0b2840b4 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 200 len: 352 microversion: 2.1 time: 0.134401 Jul 25 16:35:45.329407 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2520/5107] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:45 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:45.918456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:45.921443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:45.932045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:45.936750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:45.940518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:45.949181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.356222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-baa7b5bf-a74f-4822-9707-ecd7de79d9d3 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Calling method '.version_select at 0x7f9d9297aa60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:46.532019 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-baa7b5bf-a74f-4822-9707-ecd7de79d9d3 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] HTTP exception thrown: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-baa7b5bf-a74f-4822-9707-ecd7de79d9d3 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Request method failure captured: Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f HTTP/1.1 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sZZuTIahi4oQl8DzUwKJpAt2MeagiHVx-n_UipICS3d14Cb8w6ggT_DdA1YODkfSyW2DWJeuJS2f_7Dali3Da9WYlpZlT2PtpZQHZSdvq-dYzEFbROpRU5U8GNow37qbIJu4kIHyNa3wy1_30u9JOFs-QbR8HAvTwwWD_QaXXZ7fW4 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 1436f9ec18dd4d22a9cacc6f99ec642f Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesGetTestJSON-147786831 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1436f9ec18dd4d22a9cacc6f99ec642f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/1436f9ec18dd4d22a9cacc6f99ec642f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/1436f9ec18dd4d22a9cacc6f99ec642f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_1436f9ec18dd4d22a9cacc6f99ec642f"}]}] Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesGetTestJSON-147786831 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 1436f9ec18dd4d22a9cacc6f99ec642f Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesGetTestJSON-147786831 Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesGetTestJSON-147786831-project Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ceed6d4ea7ef4ffba3533a1a0c93d1ab Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesGetTestJSON-147786831-project Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: method: Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: exception: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '2499e964-21f4-47ab-8976-5c96057d0e8f'} Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. (HTTP 404) (Request-ID: req-7901a9fb-739b-40e1-8217-2663fc6ba49a) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:35:46.534640 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-baa7b5bf-a74f-4822-9707-ecd7de79d9d3 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] Returning 404 to user: Volume 2499e964-21f4-47ab-8976-5c96057d0e8f could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-baa7b5bf-a74f-4822-9707-ecd7de79d9d3 tempest-VolumesGetTestJSON-147786831 tempest-VolumesGetTestJSON-147786831-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f" status: 404 len: 109 microversion: 2.1 time: 0.193823 Jul 25 16:35:46.548667 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2521/5108] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:35:46 2022] GET /compute/v2.1/os-volumes/2499e964-21f4-47ab-8976-5c96057d0e8f => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:46.993230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:47.012379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0446948f-ffcb-4d96-8eed-5a01db7e31d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1506 microversion: 2.1 time: 1.099713 Jul 25 16:35:47.015578 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2588/5109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:45 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1506 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:47.042788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:47.043678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:47.060552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.068197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.074755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.075644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:48.221957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:48.249006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2767d0e3-a6c2-4cf8-803a-21b57c53b477 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1506 microversion: 2.1 time: 1.211671 Jul 25 16:35:48.286801 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2522/5110] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:47 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1506 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:48.312759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:48.321864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:48.494956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:48.499349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:48.510175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:48.519845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:48.697555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:35:48.993057 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02bd58bd-2d94-4414-a6f9-a172c5a1e556 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 204 len: 0 microversion: 2.1 time: 0.699647 Jul 25 16:35:48.996043 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2589/5111] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:35:48 2022] DELETE /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:35:49.014635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:49.017863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:49.051064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:49.052128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:49.053788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:49.054468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:50.587029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:50.607851 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8595f79-3151-4b41-a8bb-2757fe87a899 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1512 microversion: 2.1 time: 1.606809 Jul 25 16:35:50.613389 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2523/5112] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:48 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1512 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:51.473450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:51.475689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:51.491412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-df0f1aa6-9194-4c0e-a2c3-da91f16c7417 req-090264c3-cb6e-4f1c-8d33-15cdefff8765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51941f7a-4ca1-497f-987c-607d1604998a", "tag": "0f11cf9f-e1f9-4931-bf00-529b05c2903e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:51.512425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.517175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.520563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-df0f1aa6-9194-4c0e-a2c3-da91f16c7417 req-090264c3-cb6e-4f1c-8d33-15cdefff8765 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.524350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.526891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.532199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-df0f1aa6-9194-4c0e-a2c3-da91f16c7417 req-090264c3-cb6e-4f1c-8d33-15cdefff8765 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.585371 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-df0f1aa6-9194-4c0e-a2c3-da91f16c7417 req-090264c3-cb6e-4f1c-8d33-15cdefff8765 service nova] Creating event network-changed:0f11cf9f-e1f9-4931-bf00-529b05c2903e for instance 51941f7a-4ca1-497f-987c-607d1604998a on n-h1-846219-13 Jul 25 16:35:51.627161 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-df0f1aa6-9194-4c0e-a2c3-da91f16c7417 req-090264c3-cb6e-4f1c-8d33-15cdefff8765 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134989 Jul 25 16:35:51.632065 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2524/5113] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:51.675968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:51.676810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:51.679384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:35:51.705604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.714276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.724048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.728811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.927700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eccc5c12-5b0c-4f0f-aa80-9918cf3cf93b tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "DELETE /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 204 len: 0 microversion: 2.1 time: 0.462776 Jul 25 16:35:51.930147 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2590/5114] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:35:51 2022] DELETE /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:35:51.944751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:51.945757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:51.968905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.969724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.970601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.971050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:52.841227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:52.864488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:52.869562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:52.883380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93f68218-08ab-472d-9f5a-8680f5c9775b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2953 microversion: 2.42 time: 0.940023 Jul 25 16:35:52.887169 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2591/5115] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:35:51 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2953 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:52.915433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:52.920135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:52.921367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:52.935326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e73770b4-3f1d-407d-b355-e2e2c25fcb91 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1512 microversion: 2.1 time: 1.276110 Jul 25 16:35:52.935932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2525/5116] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:51 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1512 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:52.964046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:52.964626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:52.968659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:52.970753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:52.974188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:52.976768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:53.005992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:53.008258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:53.017002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:53.018099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:54.020925 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08d2b8d1-1956-45ec-99ce-6457ff968976 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64/os-interface" status: 200 len: 1832 microversion: 2.42 time: 1.062285 Jul 25 16:35:54.022560 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2526/5117] 10.222.0.105 () {60 vars in 1321 bytes} [Mon Jul 25 16:35:52 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64/os-interface => generated 1832 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:54.030306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-75238f66-fb16-45f8-b164-e44b04f9effd req-dd4885e8-c3f0-4926-813d-fbbcca5b6797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c353791-3deb-4553-a794-649ac75c822e", "name": "network-vif-deleted", "tag": "3d0a80ba-4493-4f6b-9112-ddf6159246f3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:54.080666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-75238f66-fb16-45f8-b164-e44b04f9effd req-dd4885e8-c3f0-4926-813d-fbbcca5b6797 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:54.081578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-75238f66-fb16-45f8-b164-e44b04f9effd req-dd4885e8-c3f0-4926-813d-fbbcca5b6797 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:54.180085 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-75238f66-fb16-45f8-b164-e44b04f9effd req-dd4885e8-c3f0-4926-813d-fbbcca5b6797 service nova] Creating event network-vif-deleted:3d0a80ba-4493-4f6b-9112-ddf6159246f3 for instance 3c353791-3deb-4553-a794-649ac75c822e on n-h1-846219-13 Jul 25 16:35:54.214124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-75238f66-fb16-45f8-b164-e44b04f9effd req-dd4885e8-c3f0-4926-813d-fbbcca5b6797 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185523 Jul 25 16:35:54.219131 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2527/5118] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:54.241767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:54.242652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:54.282216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:54.286989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:54.293945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:54.300529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:54.386020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:54.420661 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca6f014f-cc25-4dae-98c6-c319bbcac5ff tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1676 microversion: 2.1 time: 1.515105 Jul 25 16:35:54.430110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2592/5119] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:52 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1676 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:54.513121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:54.518685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:54.521300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lazy-loading 'fault' on Instance uuid 3c353791-3deb-4553-a794-649ac75c822e {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:35:55.449369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:55.450269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:55.500678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:55.503432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:55.504544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:55.504999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:55.813369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:55.838670 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7077593c-48ad-40f5-9f82-88fb1d015c7f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 200 len: 1314 microversion: 2.1 time: 1.615172 Jul 25 16:35:55.842885 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2528/5120] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:54 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 1314 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:56.548331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:56.568455 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af8474f5-afe6-4782-916e-49ec11b54d3e tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1676 microversion: 2.1 time: 1.122256 Jul 25 16:35:56.577743 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2593/5121] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:55 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1676 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:56.631642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-78167250-9d1f-49fb-87ba-39c0d85e3867 req-54fdcdc8-2301-4b8e-8393-4803c8c14526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51941f7a-4ca1-497f-987c-607d1604998a", "name": "network-vif-deleted", "tag": "0f11cf9f-e1f9-4931-bf00-529b05c2903e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:56.675942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-78167250-9d1f-49fb-87ba-39c0d85e3867 req-54fdcdc8-2301-4b8e-8393-4803c8c14526 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:56.677396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-78167250-9d1f-49fb-87ba-39c0d85e3867 req-54fdcdc8-2301-4b8e-8393-4803c8c14526 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:56.699865 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-78167250-9d1f-49fb-87ba-39c0d85e3867 req-54fdcdc8-2301-4b8e-8393-4803c8c14526 service nova] Creating event network-vif-deleted:0f11cf9f-e1f9-4931-bf00-529b05c2903e for instance 51941f7a-4ca1-497f-987c-607d1604998a on n-h1-846219-13 Jul 25 16:35:56.707775 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-78167250-9d1f-49fb-87ba-39c0d85e3867 req-54fdcdc8-2301-4b8e-8393-4803c8c14526 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081339 Jul 25 16:35:56.709411 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2529/5122] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:56.873539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:56.878482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:56.891746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:56.896700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:56.898301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:56.899150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:56.939421 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e HTTP/1.1 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3c353791-3deb-4553-a794-649ac75c822e'} Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:56.946476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:56.953228 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:56.953228 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:56.953228 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:56.953228 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:56.953228 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:35:56.953228 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:35:56.955511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:56.957967 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a6c9e58-1c0a-4b1e-aa72-232703fa3ad3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 404 len: 111 microversion: 2.1 time: 0.091197 Jul 25 16:35:56.960737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2594/5123] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:56 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:35:56.980021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d0e6db1-9d9e-46cf-a66c-ca2537c0fbe3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: .version_select at 0x7f9d93915dc0>, body: {"keypair": {"name": "tempest-key-503165430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH/FMrj2OCpipGEM5TRSvxssXf+O9xkNk/rt/lezVXF9m4nkKGWY/K4K9fm/3bubjZG7ZaWCClphHy7NnyHEQqDqCudmXY51i8+3KXXkn9JTVXrHpQ13v1O0xZGA3cyjQ=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:57.025959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7d0e6db1-9d9e-46cf-a66c-ca2537c0fbe3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:35:57.047698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7d0e6db1-9d9e-46cf-a66c-ca2537c0fbe3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:35:57.133308 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d0e6db1-9d9e-46cf-a66c-ca2537c0fbe3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.158358 Jul 25 16:35:57.136677 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2530/5124] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:35:56 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:57.147705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ade629fe-992a-4f57-a239-893177ac4d70 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '.version_select at 0x7f9da4948ca0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:57.160896 n-d-846219-13 devstack@n-api.service[119599]: WARNING oslo_db.sqlalchemy.utils [None req-ade629fe-992a-4f57-a239-893177ac4d70 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 16:35:57.171050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ade629fe-992a-4f57-a239-893177ac4d70 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.026849 Jul 25 16:35:57.172674 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2595/5125] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:35:57 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:57.596788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:57.597856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:57.623865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:57.624344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:57.646110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:57.646744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:57.735446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-817835172", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-key-503165430", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:57.778266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:57.778736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:57.779330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lazy-loading 'fault' on Instance uuid 51941f7a-4ca1-497f-987c-607d1604998a {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:35:57.908969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:35:58.193788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0333f8e4e1e54bcda08bce44f79fbc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbafb0a4ca4428eaa651274f6939053', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:58.216814 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-635a5e15-437a-4787-8eca-487c1cea6a01 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 200 len: 1495 microversion: 2.1 time: 0.619623 Jul 25 16:35:58.221763 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2531/5126] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:57 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 1495 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:59.254717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:59.266709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] [instance: 51941f7a-4ca1-497f-987c-607d1604998a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:59.351877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:59.418499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:59.418499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:59.418499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:59.483490 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] HTTP exception thrown: Instance 51941f7a-4ca1-497f-987c-607d1604998a could not be found. Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Request method failure captured: Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a HTTP/1.1 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sSBDoADsA5sGzMvQ1neyvnH_bVQcZY-SOXK6IFsrYzprSAoP3Xqv_VMtXyYs2MSTU9Oo6ALresiZ-BdPgj4uZXhv7yDmbhvIWDAzoBYT7RI0Bc7leVu1XmvYuSb6sEcr31EcpoH8HTA36U_Es5nprE_rf8iL7-aGRsTdiQi18TOLKY Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 3dbafb0a4ca4428eaa651274f6939053 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/3dbafb0a4ca4428eaa651274f6939053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_3dbafb0a4ca4428eaa651274f6939053"}]}] Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 3dbafb0a4ca4428eaa651274f6939053 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestNetworkBasicOps-1592225059 Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestNetworkBasicOps-1592225059-project Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 0333f8e4e1e54bcda08bce44f79fbc9c Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestNetworkBasicOps-1592225059-project Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 51941f7a-4ca1-497f-987c-607d1604998a could not be found. Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '51941f7a-4ca1-497f-987c-607d1604998a'} Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51941f7a-4ca1-497f-987c-607d1604998a could not be found. Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51941f7a-4ca1-497f-987c-607d1604998a could not be found. Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:59.497895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51941f7a-4ca1-497f-987c-607d1604998a could not be found. Jul 25 16:35:59.508123 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:35:59.511380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Returning 404 to user: Instance 51941f7a-4ca1-497f-987c-607d1604998a could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:59.517567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a436e646-2583-4a71-9db2-1e49b97eacc4 tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a" status: 404 len: 111 microversion: 2.1 time: 0.269598 Jul 25 16:35:59.520964 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2532/5127] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:35:59 2022] GET /compute/v2.1/servers/51941f7a-4ca1-497f-987c-607d1604998a => generated 111 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:36:00.279383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:36:00.281316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:36:00.282556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:36:00.283544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:36:00.284572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:36:00.354645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:00.357397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:00.359277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:00.368255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:00.424620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:36:00.455649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:36:00.495210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:36:00.505087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:36:00.620781 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [1fb617e5-559e-496e-bf39-d89bf2e69624] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:36:01.067332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-185ccf0f-d1b2-4370-aa24-147169190ecd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] Calling method '.version_select at 0x7f9d92901430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:01.106990 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-185ccf0f-d1b2-4370-aa24-147169190ecd tempest-TestNetworkBasicOps-1592225059 tempest-TestNetworkBasicOps-1592225059-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1976206920" status: 202 len: 0 microversion: 2.1 time: 0.068778 Jul 25 16:36:01.109883 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2533/5128] 10.222.0.105 () {58 vars in 1262 bytes} [Mon Jul 25 16:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1976206920 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:36:01.655728 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [1fb617e5-559e-496e-bf39-d89bf2e69624] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 46736. Jul 25 16:36:01.682359 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3975bdb1-e34a-4ce0-b6a4-293881d4101b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.956659 Jul 25 16:36:01.683950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2596/5129] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:35:57 2022] POST /compute/v2.1/servers => generated 382 bytes in 3960 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:36:01.695910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e48c0a34-2274-4343-b5c9-fe4e01fa923d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:01.696898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e48c0a34-2274-4343-b5c9-fe4e01fa923d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:02.103433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e48c0a34-2274-4343-b5c9-fe4e01fa923d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:02.133767 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e48c0a34-2274-4343-b5c9-fe4e01fa923d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1231 microversion: 2.1 time: 0.442198 Jul 25 16:36:02.140369 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2534/5130] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:01 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1231 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:03.158503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:03.161379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:03.183373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:03.183373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:03.184164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:03.184562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:03.609707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:03.646570 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0437a6db-bd92-4353-8a0b-7005cccfdcaa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1227 microversion: 2.1 time: 0.490165 Jul 25 16:36:03.649370 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2597/5131] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:03 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1227 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:03.708893 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:36:03.708893 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:36:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:36:04.685274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:04.686347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:04.764143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:04.766897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:04.767824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:04.768501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:05.634960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:05.669126 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-208d3f0e-28d4-4634-b10d-e3b5ef3dab04 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1289 microversion: 2.1 time: 0.986959 Jul 25 16:36:05.677508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2535/5132] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:04 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1289 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:06.717394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:06.722017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:06.765981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:06.767598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:06.768486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:06.768964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:07.023054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:07.032541 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c830c0ed-8fdf-47e6-b172-595504246dde tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1289 microversion: 2.1 time: 0.321944 Jul 25 16:36:07.050082 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2598/5133] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:06 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1289 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:08.067519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:08.069540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:08.128658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:08.128658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:08.129561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:08.130090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:08.210971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=84 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:08.662561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:08.671968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5aa65be4-5b11-41fa-a06f-cdfea89c4c2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1289 microversion: 2.1 time: 0.612043 Jul 25 16:36:08.677686 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2536/5134] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:08 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1289 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:09.717590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:09.721127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:09.756734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:09.763302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:09.767388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:09.767857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:09.787251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:10.392240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:10.479831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:11.209820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:11.221387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68323784-755f-4b5f-b0d8-4a82a61f4aff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 1.510631 Jul 25 16:36:11.222347 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2599/5135] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:09 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:12.252334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:12.254071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:12.257839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:12.276610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:12.277271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:12.282075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:12.282751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:13.495461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:13.512217 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07077ca2-501a-44c4-90ef-fa91ebb56296 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 1.261705 Jul 25 16:36:13.516689 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2537/5136] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:12 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:14.542250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:14.543832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:14.562588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:14.564895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:14.579108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:14.585009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:14.981627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cb70b85c-85e9-42e4-8e6c-4f2a35717164 req-309189ce-56e3-46d7-b630-dba06a54b507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270fa225-551f-4c08-898c-38c61b255dd1", "tag": "04de42aa-9fd4-427d-b6a9-47f4b646df19"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:14.998619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:15.012084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cb70b85c-85e9-42e4-8e6c-4f2a35717164 req-309189ce-56e3-46d7-b630-dba06a54b507 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:15.014129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cb70b85c-85e9-42e4-8e6c-4f2a35717164 req-309189ce-56e3-46d7-b630-dba06a54b507 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:15.053506 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cb70b85c-85e9-42e4-8e6c-4f2a35717164 req-309189ce-56e3-46d7-b630-dba06a54b507 service nova] Creating event network-changed:04de42aa-9fd4-427d-b6a9-47f4b646df19 for instance 270fa225-551f-4c08-898c-38c61b255dd1 on n-h1-846219-13 Jul 25 16:36:15.072759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cb70b85c-85e9-42e4-8e6c-4f2a35717164 req-309189ce-56e3-46d7-b630-dba06a54b507 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090867 Jul 25 16:36:15.075170 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2538/5137] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:36:15.440356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:15.452097 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71f7a503-9924-4a2a-88a9-7babe0452637 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 0.911897 Jul 25 16:36:15.455030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2600/5138] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:14 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:15.701371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1820667869", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0206f4c9-3cc3-4135-9139-c3997a71bc3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:15.838629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:36:16.481771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:16.485737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:16.497016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:16.502770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:16.504747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:16.508219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:16.510245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:17.161133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:17.177618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-106c3906-78db-42c2-8172-a662aee9b3aa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 0.700906 Jul 25 16:36:17.180688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2601/5139] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:16 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:17.695003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:36:17.697514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:36:17.699150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:36:17.699980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:36:17.703983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:36:17.743973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:17.745950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:17.759206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:17.760930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:17.817921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:36:17.830930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:36:17.992088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:36:17.998228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0206f4c9-3cc3-4135-9139-c3997a71bc3f',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:36:18.216500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:18.218855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:18.257150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:18.260652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:18.268847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:18.270441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:18.287634 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-083812d5-7d32-4085-9e4c-ebac6c571072 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.591124 Jul 25 16:36:18.294087 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2539/5140] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:36:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:36:18.333306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8b228ae-3411-442a-8a89-09422343e27a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:18.333803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8b228ae-3411-442a-8a89-09422343e27a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:18.683591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a8b228ae-3411-442a-8a89-09422343e27a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:18.692606 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8b228ae-3411-442a-8a89-09422343e27a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1074 microversion: 2.1 time: 0.375014 Jul 25 16:36:18.705554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2540/5141] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:18 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1074 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:19.444506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:19.458214 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a889423-238b-4409-9bcf-fae5bbbf6628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 1.251634 Jul 25 16:36:19.461526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2602/5142] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:18 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:19.715144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:19.715772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:19.734190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:19.735298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:19.736741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:19.737554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:20.026027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:20.039717 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fa75ffa7-69e3-4b56-a5f1-d91a07b80675 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1172 microversion: 2.1 time: 0.330365 Jul 25 16:36:20.043932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2541/5143] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:19 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1172 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:20.491917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:20.492663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:20.511088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:20.512077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:20.518415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:20.519249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:21.021155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:21.037202 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a9f3818-bf02-4ebf-8cce-2c642eab7797 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 0.546898 Jul 25 16:36:21.039813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2603/5144] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:20 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:21.064367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:21.068010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:21.096502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:21.098456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:21.103482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:21.105124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:21.464740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:21.480650 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51471eee-2809-43fe-8144-f4e3e9f0509e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1190 microversion: 2.1 time: 0.420533 Jul 25 16:36:21.483335 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2542/5145] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:21 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1190 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:22.061029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:22.062803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:22.079564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:22.080805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:22.082391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:22.085823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:22.507752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:22.510068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:22.525652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:22.530307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:22.537520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:22.538639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:22.857267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:22.872836 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f69356a-06bf-4ddb-85db-933f164d4180 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1190 microversion: 2.1 time: 0.366506 Jul 25 16:36:22.878252 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2543/5146] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:22 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1190 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:23.863238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:23.873882 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe204adc-8837-4301-98e8-f929675ab695 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 1.816967 Jul 25 16:36:23.890611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2604/5147] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:22 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:23.897977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:23.899332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:23.907488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:23.910393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:23.911481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:23.913342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:24.529848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:24.551897 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8de31ab-87db-44e2-ac5a-0be8f4a6a9d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1232 microversion: 2.1 time: 0.658215 Jul 25 16:36:24.569139 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2544/5148] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:23 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1232 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:24.896791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:24.897401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:24.914331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:24.918237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:24.920921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:24.922682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:25.582461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:25.583950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:25.607923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:25.609703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:25.611664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:25.615447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:26.242053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:26.257661 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c5e36d3-7812-47c8-8330-9327b697d28f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 1.364963 Jul 25 16:36:26.258540 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2605/5149] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:24 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:26.287976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1df3bc4f-da7b-47d0-95ce-4f1535ea5993 req-72bf1f82-3800-4cb9-aed1-bdbd092eff3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270fa225-551f-4c08-898c-38c61b255dd1", "name": "network-vif-plugged", "status": "completed", "tag": "04de42aa-9fd4-427d-b6a9-47f4b646df19"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:26.325282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1df3bc4f-da7b-47d0-95ce-4f1535ea5993 req-72bf1f82-3800-4cb9-aed1-bdbd092eff3d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:26.326203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1df3bc4f-da7b-47d0-95ce-4f1535ea5993 req-72bf1f82-3800-4cb9-aed1-bdbd092eff3d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:26.360391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1df3bc4f-da7b-47d0-95ce-4f1535ea5993 req-72bf1f82-3800-4cb9-aed1-bdbd092eff3d service nova] Creating event network-vif-plugged:04de42aa-9fd4-427d-b6a9-47f4b646df19 for instance 270fa225-551f-4c08-898c-38c61b255dd1 on n-h1-846219-13 Jul 25 16:36:26.372565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1df3bc4f-da7b-47d0-95ce-4f1535ea5993 req-72bf1f82-3800-4cb9-aed1-bdbd092eff3d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090963 Jul 25 16:36:26.378453 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2606/5150] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:26.671448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:26.688344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e30f5f0f-e20e-49ba-954f-fcbde51f5797 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1232 microversion: 2.1 time: 1.112162 Jul 25 16:36:26.707708 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2545/5151] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:25 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1232 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:27.295564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:27.299162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:27.329657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:27.331542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:27.338207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:27.339650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:27.545745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f04353fa-791a-4fdb-bc34-9c09dff2811e req-78b9ac9d-b6f3-4344-89ca-bcac1268104a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13effe71-08d1-4247-9629-26049806de8c", "tag": "41c21b15-d98a-4060-bd68-d14f081d266d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:27.569487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f04353fa-791a-4fdb-bc34-9c09dff2811e req-78b9ac9d-b6f3-4344-89ca-bcac1268104a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:27.584278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f04353fa-791a-4fdb-bc34-9c09dff2811e req-78b9ac9d-b6f3-4344-89ca-bcac1268104a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:27.635508 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f04353fa-791a-4fdb-bc34-9c09dff2811e req-78b9ac9d-b6f3-4344-89ca-bcac1268104a service nova] Creating event network-changed:41c21b15-d98a-4060-bd68-d14f081d266d for instance 13effe71-08d1-4247-9629-26049806de8c on n-h2-846219-13 Jul 25 16:36:27.645790 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f04353fa-791a-4fdb-bc34-9c09dff2811e req-78b9ac9d-b6f3-4344-89ca-bcac1268104a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104471 Jul 25 16:36:27.650066 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2546/5152] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:27.721446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:27.724788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:27.736162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:27.736956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:27.739288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:27.740113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:27.789416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:28.534134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:28.550910 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fd72448-cafb-487f-8727-bab42d356648 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1331 microversion: 2.1 time: 1.264766 Jul 25 16:36:28.554768 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2607/5153] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:27 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1331 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:28.691374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:28.736404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:28.747018 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cecc40d8-7ae6-49a3-bdcc-297620deba30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1232 microversion: 2.1 time: 1.036303 Jul 25 16:36:28.749658 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2547/5154] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:27 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1232 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:29.573915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:29.574610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:29.591156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:29.593145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:29.594593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:29.595466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:29.771320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:29.771934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:29.787740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:29.788348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:29.790150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:29.790595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:30.731131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:30.739345 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ebb51ae-744f-4c46-8706-ebb0abf668cb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1232 microversion: 2.1 time: 0.972495 Jul 25 16:36:30.746803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2548/5155] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:29 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1232 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:30.807725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:30.824972 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-045677d9-4686-4c19-8663-1409fa9920e4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1512 microversion: 2.1 time: 1.256117 Jul 25 16:36:30.826193 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2608/5156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:29 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1512 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:30.848878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:30.850873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:30.858628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:30.859396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:30.860547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:30.861254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:31.288250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:31.309871 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-007644f8-0d2c-4116-91ca-58a34e464031 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1512 microversion: 2.1 time: 0.463239 Jul 25 16:36:31.314463 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2549/5157] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:30 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:31.332781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:31.336633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:31.350024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:31.350480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:31.351269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:31.353483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:31.436915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:36:31.609963 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-28169853-b987-41ac-854f-0984e9020ffb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 204 len: 0 microversion: 2.1 time: 0.280801 Jul 25 16:36:31.611181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2609/5158] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:36:31 2022] DELETE /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:36:31.620561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:31.621593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:31.631952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:31.633319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:31.634322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:31.634919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:31.764179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:31.765212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:31.781256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:31.782079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:31.783056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:31.784045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:32.134960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:32.158613 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-15ff470f-540d-44f6-936f-eb339adb90d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1518 microversion: 2.1 time: 0.543176 Jul 25 16:36:32.160163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2550/5159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:31 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1518 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:32.242070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:32.251176 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a184c885-ef20-4ce2-bf6c-4d5f313475e6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.491402 Jul 25 16:36:32.252159 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2610/5160] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:31 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:33.184596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:33.185668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:33.197716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:33.200191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:33.201265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:33.205077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:33.285260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:33.287693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:33.302303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:33.303833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:33.305084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:33.305784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:33.623825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:33.632263 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a27f8d97-95f9-47cd-a522-97919acab919 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1518 microversion: 2.1 time: 0.453244 Jul 25 16:36:33.640373 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2551/5161] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:33 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1518 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:34.256373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:34.269082 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-feecaddf-e62e-48ac-b0eb-b6f9eb0c9dc0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.997884 Jul 25 16:36:34.269890 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2611/5162] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:33 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:34.664715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:34.666106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:34.677686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:34.678620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:34.679681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:34.680321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:35.168849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:35.186556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe6c91d5-dc7b-4ffb-8295-0fe5a7b18ca1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1518 microversion: 2.1 time: 0.533211 Jul 25 16:36:35.187550 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2552/5163] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:34 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1518 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:35.290599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:35.291373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:35.308109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:35.309486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:35.310301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:35.310803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:36.037700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ea4b943d-0fbd-466c-8c46-5cd54b5ef0ee req-7a62f921-df44-4454-8dce-9ad1010662be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270fa225-551f-4c08-898c-38c61b255dd1", "name": "network-vif-deleted", "tag": "04de42aa-9fd4-427d-b6a9-47f4b646df19"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:36.056670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ea4b943d-0fbd-466c-8c46-5cd54b5ef0ee req-7a62f921-df44-4454-8dce-9ad1010662be service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:36.067313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:36.076372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ea4b943d-0fbd-466c-8c46-5cd54b5ef0ee req-7a62f921-df44-4454-8dce-9ad1010662be service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:36.093414 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dbdf4dec-f135-404e-be47-dbe86b623652 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.794915 Jul 25 16:36:36.115938 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2612/5164] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:35 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:36.129830 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ea4b943d-0fbd-466c-8c46-5cd54b5ef0ee req-7a62f921-df44-4454-8dce-9ad1010662be service nova] Creating event network-vif-deleted:04de42aa-9fd4-427d-b6a9-47f4b646df19 for instance 270fa225-551f-4c08-898c-38c61b255dd1 on n-h1-846219-13 Jul 25 16:36:36.148234 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ea4b943d-0fbd-466c-8c46-5cd54b5ef0ee req-7a62f921-df44-4454-8dce-9ad1010662be service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112900 Jul 25 16:36:36.151008 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2553/5165] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:36.212376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:36.213086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:36.222983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:36.226465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:36.227499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:36.229465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:36.280944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:36.281857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:36.282536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lazy-loading 'fault' on Instance uuid 270fa225-551f-4c08-898c-38c61b255dd1 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:36:36.443917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:36.453888 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-96b57795-f431-4b78-9615-2b42d54f4ed6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 200 len: 1321 microversion: 2.1 time: 0.247274 Jul 25 16:36:36.453888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2613/5166] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:36 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:37.124264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:37.125083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:37.136751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:37.137255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:37.138088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:37.138524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:37.416642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:37.425488 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2deecb95-8d39-44d3-8d03-a338e4908edd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.306921 Jul 25 16:36:37.426195 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2554/5167] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:37 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:37.475408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:37.476027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:37.483798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:37.484255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:37.485276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:37.485858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:37.504120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 HTTP/1.1 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '270fa225-551f-4c08-898c-38c61b255dd1'} Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:36:37.505901 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:36:37.509311 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dcd021a8-99dd-4fb0-9a83-d50a5b650848 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 404 len: 111 microversion: 2.1 time: 0.036058 Jul 25 16:36:37.513650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2614/5168] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:37 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:36:37.522285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-31e542dd-2e9f-41cd-8ed2-fe28525d5218 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '.version_select at 0x7f9d92969a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:37.552058 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-31e542dd-2e9f-41cd-8ed2-fe28525d5218 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-key-503165430" status: 202 len: 0 microversion: 2.1 time: 0.037359 Jul 25 16:36:37.552804 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2555/5169] 10.222.0.105 () {58 vars in 1211 bytes} [Mon Jul 25 16:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-503165430 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:36:37.701554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1124017661", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:37.762690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:36:38.446838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:38.447609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:38.464269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:38.464887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:38.465831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:38.466544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:38.475885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:38.943754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:36:38.944441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:36:38.944825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:36:38.945708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:36:38.946361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:36:38.957855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:38.958441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:38.959564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:38.960042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:38.966888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:38.994075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:39.007286 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8408ed56-64e7-4a3f-952f-e647052ca2f2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.565051 Jul 25 16:36:39.010734 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2556/5170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:38 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:39.016728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:36:39.023891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:36:39.040104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:36:39.042720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:36:39.154482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a406f954-0398-4af2-ab49-b3f2c05d31e7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.462608 Jul 25 16:36:39.161135 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2615/5171] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:36:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:36:39.166996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7de644ae-522c-4267-9c7c-7c3941bfe74b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:39.167616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7de644ae-522c-4267-9c7c-7c3941bfe74b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:39.263626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7de644ae-522c-4267-9c7c-7c3941bfe74b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:39.272141 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7de644ae-522c-4267-9c7c-7c3941bfe74b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1213 microversion: 2.1 time: 0.109035 Jul 25 16:36:39.272773 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2557/5172] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:39 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:40.030472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:40.031846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:40.047194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:40.048028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:40.051045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:40.051551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:40.295835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:40.296537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:40.311109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:40.317491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:40.317882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:40.318704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:40.319171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:40.322930 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69f66b90-538a-4edf-81c5-fa2d9ed4de63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.296252 Jul 25 16:36:40.326592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2616/5173] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:40 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:40.405751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:40.415518 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e989c39f-f662-479c-90c8-6d611e7bba57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1265 microversion: 2.1 time: 0.125869 Jul 25 16:36:40.437058 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2558/5174] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:40 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:41.287463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-cf2f4e9a-2418-4fbe-ae54-966cc771bcbb req-d357ce3f-d4d8-4bf4-9e5e-12a980cf3108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13effe71-08d1-4247-9629-26049806de8c", "name": "network-vif-plugged", "status": "completed", "tag": "41c21b15-d98a-4060-bd68-d14f081d266d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:41.350285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:41.350919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:41.356298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cf2f4e9a-2418-4fbe-ae54-966cc771bcbb req-d357ce3f-d4d8-4bf4-9e5e-12a980cf3108 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:41.368766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cf2f4e9a-2418-4fbe-ae54-966cc771bcbb req-d357ce3f-d4d8-4bf4-9e5e-12a980cf3108 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:41.387060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:41.387821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:41.391040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:41.391739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:41.405065 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-cf2f4e9a-2418-4fbe-ae54-966cc771bcbb req-d357ce3f-d4d8-4bf4-9e5e-12a980cf3108 service nova] Creating event network-vif-plugged:41c21b15-d98a-4060-bd68-d14f081d266d for instance 13effe71-08d1-4247-9629-26049806de8c on n-h2-846219-13 Jul 25 16:36:41.421036 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-cf2f4e9a-2418-4fbe-ae54-966cc771bcbb req-d357ce3f-d4d8-4bf4-9e5e-12a980cf3108 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144583 Jul 25 16:36:41.423734 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2617/5175] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:41.446897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:41.447793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:41.468804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:41.469341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:41.470157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:41.494802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:41.778295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:41.792646 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-848abb52-21c5-45bc-9ece-3a9df227c49e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1271 microversion: 2.1 time: 0.351319 Jul 25 16:36:41.795444 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2618/5176] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:41 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1271 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:42.054665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:42.063124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2917bfe-a44a-4975-8047-887761814b7f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.721122 Jul 25 16:36:42.064321 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2559/5177] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:41 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:42.817575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:42.818976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:42.833806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:42.834884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:42.836101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:42.837665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:43.085928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:43.086837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:43.098645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:43.102875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:43.107339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:43.108549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:43.484831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:43.497251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41b688ec-d06f-434e-b243-662c1ff48628 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.683665 Jul 25 16:36:43.500123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2619/5178] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:42 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:44.052067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:44.062541 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f8d47ec-d0a6-489f-84f8-d832bf04e152 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1220 microversion: 2.1 time: 0.981450 Jul 25 16:36:44.082555 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2560/5179] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:43 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1220 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:44.522475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:44.523096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:44.535903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:44.536362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:44.537165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:44.537604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:45.000328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:45.010678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90c8ae38-2837-4afc-a3a8-24a60523214b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.491889 Jul 25 16:36:45.022013 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2620/5180] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:44 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:45.100209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:45.103183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:45.123104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:45.142754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:45.146822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:45.146822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:45.502246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:45.524236 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d871772d-b623-4add-98f1-56c48733b8d2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1408 microversion: 2.1 time: 0.439007 Jul 25 16:36:45.526861 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2561/5181] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:45 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:45.561970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:45.564120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:45.595978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:45.598396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:45.600440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:45.606113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:45.721708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e6c404c1-21ab-4836-b259-978d968c31d7 req-a6a81caf-6e8f-4cc6-a816-17515f0e2562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ac4660-7f69-4d6d-bdcf-e354b7187d9d", "tag": "9126518e-4000-40da-91e7-871852612d12"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:45.769524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:45.786410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e6c404c1-21ab-4836-b259-978d968c31d7 req-a6a81caf-6e8f-4cc6-a816-17515f0e2562 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:45.788621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e6c404c1-21ab-4836-b259-978d968c31d7 req-a6a81caf-6e8f-4cc6-a816-17515f0e2562 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:45.846802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e6c404c1-21ab-4836-b259-978d968c31d7 req-a6a81caf-6e8f-4cc6-a816-17515f0e2562 service nova] Creating event network-changed:9126518e-4000-40da-91e7-871852612d12 for instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d on n-h1-846219-13 Jul 25 16:36:45.857729 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e6c404c1-21ab-4836-b259-978d968c31d7 req-a6a81caf-6e8f-4cc6-a816-17515f0e2562 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143953 Jul 25 16:36:45.859809 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2562/5182] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:46.051519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:46.052612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:46.084472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:46.085247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:46.086218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:46.086973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:46.374715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:46.386486 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-195cfc80-78c3-43e1-81a4-fe12e9012266 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1408 microversion: 2.1 time: 0.834867 Jul 25 16:36:46.403707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2621/5183] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:45 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1408 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:46.414326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2130664746"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:46.417948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:46.431240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:46.431913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:46.433822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:46.434503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:46.589267 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.compute.api [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Attempting to quiesce instance before volume snapshot. Jul 25 16:36:46.673669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:46.681029 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.compute.api [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 25 16:36:46.685659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b00d49d3-b07b-479b-b640-3b01f5b8ea80 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.639202 Jul 25 16:36:46.686994 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2563/5184] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:46 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:46.806668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Creating snapshot from volume 0206f4c9-3cc3-4135-9139-c3997a71bc3f. {{(pid=119599) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 25 16:36:47.727095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Calling method '.version_select at 0x7f9d92df59d0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:47.728107 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:36:47.728107 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:36:47.730246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:47.731002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:47.749284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:47.749788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:47.764911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:47.766611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:47.783911 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee2f885f-537c-47d5-a087-6e1c500d1f40 tempest-PortsAdminExtendedAttrsTestJSON-1352885266 tempest-PortsAdminExtendedAttrsTestJSON-1352885266-project-admin] 10.222.0.105 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.479566 Jul 25 16:36:47.793683 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2564/5185] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 16:36:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:47.802488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:47.803401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:47.811024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:47.811476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:47.813789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:47.814241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:48.557360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:48.582989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-13bc9f68-3d42-4686-93da-870c28a8d7e9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.787079 Jul 25 16:36:48.583610 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2565/5186] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:47 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:48.829322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59294ed3-182b-467d-84b1-adc5d70b1924 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c/action" status: 202 len: 0 microversion: 2.1 time: 2.420887 Jul 25 16:36:48.837862 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2622/5187] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:36:46 2022] POST /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c/action => generated 0 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 16:36:49.616243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:49.617032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:49.627954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:49.633204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:49.633667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:49.634465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:49.634900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:50.218247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:50.220738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:50.236268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2006548557", "imageRef": "ad678111-bffb-464d-9d10-4e588a2d305e", "flavorRef": "452", "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:50.257349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:50.386233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:36:50.419787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:50.435718 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f43bf6e0-cc0f-48f6-87a5-bc2d09d86b5e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.826672 Jul 25 16:36:50.437765 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2566/5188] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:49 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:51.477755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:51.485029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:51.501213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:51.501786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:51.504716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:51.505912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:51.960071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:36:51.961816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:36:51.962683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:36:51.963328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:36:51.964187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:36:51.992057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:51.996429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:52.001540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:52.004746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:52.071078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:52.084551 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eec82b3b-ed6d-4cc2-81b3-bcd848887888 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.617001 Jul 25 16:36:52.094682 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2567/5189] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:51 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:52.150292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:36:52.159715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:36:52.182085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:36:52.188214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='737ed09e-809d-4b79-b0a4-5c27f13cf310',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:36:52.307011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ac39da6-6b50-430e-8af4-3b906663c50b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.089912 Jul 25 16:36:52.308490 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2623/5190] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:36:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:36:52.330568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59168436-1e65-46ef-8a1c-c1ad1d9b7c63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:52.331738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59168436-1e65-46ef-8a1c-c1ad1d9b7c63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:53.013423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-59168436-1e65-46ef-8a1c-c1ad1d9b7c63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:53.044899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59168436-1e65-46ef-8a1c-c1ad1d9b7c63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1234 microversion: 2.1 time: 0.722611 Jul 25 16:36:53.047179 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2568/5191] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:52 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1234 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:53.119586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:53.121668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:53.134188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:53.135231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:53.137994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:53.139141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:54.037686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:54.049968 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-66d0bb13-5b95-4e5b-9550-1952cc09d04f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.937400 Jul 25 16:36:54.063062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2624/5192] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:53 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:54.085797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:54.086887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:54.097304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:54.097758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:54.098649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:54.099088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:54.202104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:54.211354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e45ac547-10bb-4193-a22b-3c7ac90a0607 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1286 microversion: 2.1 time: 0.133054 Jul 25 16:36:54.212645 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2569/5193] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:54 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1286 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:55.079454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:55.085274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:55.104328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:55.105741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:55.109008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:55.109694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:55.234284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:55.234882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:55.247036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:55.247529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:55.253201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:55.253824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:55.513066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:55.546258 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c15d78bc-7502-46a7-8b2f-e5a0ea60681d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1304 microversion: 2.1 time: 0.313890 Jul 25 16:36:55.572926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2570/5194] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:55 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:55.730866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:55.763933 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3458cd8d-7d39-4e8b-be35-4abffe9405be tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.678585 Jul 25 16:36:55.764929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2625/5195] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:55 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:56.605788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:56.606642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:56.650727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:56.653334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:56.656741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:56.658650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:56.790981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:56.791733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:56.816114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:56.816857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:56.818167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:56.818875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:56.998831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:57.008925 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0805eeb-262b-4bcd-b49b-5f4ffa9cee28 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1304 microversion: 2.1 time: 0.416984 Jul 25 16:36:57.010589 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2571/5196] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:56 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1304 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:57.015925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cf647972-86a7-4879-b209-985269c95c56 req-1ab340d1-da9f-4ee5-9b1c-bde0dc202248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ac4660-7f69-4d6d-bdcf-e354b7187d9d", "name": "network-vif-plugged", "status": "completed", "tag": "9126518e-4000-40da-91e7-871852612d12"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:57.028492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cf647972-86a7-4879-b209-985269c95c56 req-1ab340d1-da9f-4ee5-9b1c-bde0dc202248 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:57.029325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cf647972-86a7-4879-b209-985269c95c56 req-1ab340d1-da9f-4ee5-9b1c-bde0dc202248 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:57.071673 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cf647972-86a7-4879-b209-985269c95c56 req-1ab340d1-da9f-4ee5-9b1c-bde0dc202248 service nova] Creating event network-vif-plugged:9126518e-4000-40da-91e7-871852612d12 for instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d on n-h1-846219-13 Jul 25 16:36:57.079442 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cf647972-86a7-4879-b209-985269c95c56 req-1ab340d1-da9f-4ee5-9b1c-bde0dc202248 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067252 Jul 25 16:36:57.080383 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2572/5197] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:57.235961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:57.258568 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d6cdb8f-781f-4ef4-9fda-bed902ba1b07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 0.473670 Jul 25 16:36:57.259316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2626/5198] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:56 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:58.048546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:58.053411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:58.074850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:58.075315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:58.076127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:58.082389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:58.285460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:58.287702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:58.299427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:58.300540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:58.302374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:58.303587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:59.698813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:59.713542 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b97a94a3-450f-4769-af93-45dba3c4c906 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1313 microversion: 2.1 time: 1.431657 Jul 25 16:36:59.714476 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2627/5199] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:58 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1313 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:59.836608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:59.866185 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a97870fc-de8d-4e0c-949a-3bd27ebc4057 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 1.834491 Jul 25 16:36:59.870430 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2573/5200] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:36:58 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:00.745652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:00.746439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:00.763996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:00.768367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:00.770178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:00.773983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:00.895255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:00.896834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:00.918786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:00.926416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:00.931089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:00.934310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:01.859819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:01.903160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:01.914507 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6896e230-fee6-4a3c-a7e8-0f2755788892 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1495 microversion: 2.1 time: 1.173415 Jul 25 16:37:01.920019 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2628/5201] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:00 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1495 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:02.020997 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c890da0d-48b0-4a6d-b94f-f9331524e89a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 1.130517 Jul 25 16:37:02.029217 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2574/5202] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:00 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:02.598128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1124017661", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:02.639857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:02.658038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:02.890090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:37:03.078550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:03.082378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:03.121700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:03.131041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:03.149919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:03.151655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:03.152593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:05.552929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:05.595978 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aaf8148d-0d73-48dc-9544-86896c528d77 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 2.521015 Jul 25 16:37:05.597419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2575/5203] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:03 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 2528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:05.613897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bd887bc7-df93-4917-84cf-6d876ec0872d req-a37646d6-c2ed-462f-8004-06030295b6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0ce776-bd19-43a7-8224-149a17f3aa99", "tag": "5ba18aa0-e025-4908-9b50-0d2a27b13695"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:05.668361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bd887bc7-df93-4917-84cf-6d876ec0872d req-a37646d6-c2ed-462f-8004-06030295b6c8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:05.670288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bd887bc7-df93-4917-84cf-6d876ec0872d req-a37646d6-c2ed-462f-8004-06030295b6c8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:05.742080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:05.747765 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bd887bc7-df93-4917-84cf-6d876ec0872d req-a37646d6-c2ed-462f-8004-06030295b6c8 service nova] Creating event network-changed:5ba18aa0-e025-4908-9b50-0d2a27b13695 for instance fb0ce776-bd19-43a7-8224-149a17f3aa99 on n-h1-846219-13 Jul 25 16:37:05.787015 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bd887bc7-df93-4917-84cf-6d876ec0872d req-a37646d6-c2ed-462f-8004-06030295b6c8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187170 Jul 25 16:37:05.802082 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2576/5204] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:06.671389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:06.680423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:06.698398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:06.698862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:06.700243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:06.700811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:07.530078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:37:07.531825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:37:07.534593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:37:07.535887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:37:07.536932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:37:07.565738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:07.566962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:07.569031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:07.570913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:07.635402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:37:07.648732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:37:07.711479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:37:07.733982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:37:08.076231 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b76c7f6b-9f3c-4ef4-b0f1-d7fb3873f4a1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.490618 Jul 25 16:37:08.078316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2629/5205] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:37:02 2022] POST /compute/v2.1/servers => generated 382 bytes in 5494 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:37:08.095507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c54aa159-7b53-427e-aba9-770f26bc7334 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:08.096907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c54aa159-7b53-427e-aba9-770f26bc7334 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:08.668019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c54aa159-7b53-427e-aba9-770f26bc7334 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:08.707964 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c54aa159-7b53-427e-aba9-770f26bc7334 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1213 microversion: 2.1 time: 0.617934 Jul 25 16:37:08.711589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2630/5206] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:08 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1213 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:08.763048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:08.801724 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4225c85f-7095-4a1d-805a-1ef0604d22ba tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 2.143425 Jul 25 16:37:08.802886 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2577/5207] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:06 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:09.759397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:09.760599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:09.809613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.811730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:09.819069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.819250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:09.830846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:09.857030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:09.869958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:09.918806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.923571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:09.925624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.933249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:09.992269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:10.010119 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4ddc687-ab16-4e85-acf0-7cb019bdf332 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1217 microversion: 2.1 time: 0.261842 Jul 25 16:37:10.030937 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2631/5208] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:09 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1217 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:10.436559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:10.448294 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bbbdef85-7896-4a4c-b80b-fc24dc0fd45e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.607469 Jul 25 16:37:10.451156 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2578/5209] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:09 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:11.046942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:11.052379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:11.091179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:11.092023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:11.093379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:11.094216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:11.476264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:11.476891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:11.493817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:11.494662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:11.498277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:11.499057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:11.800018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:11.835738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-861fefcc-753e-4601-abd7-237bab4ba170 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1273 microversion: 2.1 time: 0.786133 Jul 25 16:37:11.840459 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2632/5210] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:11 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1273 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:12.019643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:12.078855 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9bda269a-563a-4aa2-99d9-02bd96f4b99f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.584572 Jul 25 16:37:12.086668 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2579/5211] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:11 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:12.869605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:12.870893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:12.882937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:12.886590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:12.887713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:12.890654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:13.084932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:13.102812 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aeac97fd-b767-4c00-a20a-3390478682a4 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1271 microversion: 2.1 time: 0.237061 Jul 25 16:37:13.105954 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2633/5212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:12 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:13.124940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:13.125564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:13.135625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:13.136080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:13.136853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:13.137347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:13.663086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:13.674863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0725b57b-0a0e-4393-96d4-cab6ef6feef2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.569457 Jul 25 16:37:13.675682 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2580/5213] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:13 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:14.127272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:14.128511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:14.143364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:14.144305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:14.148493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:14.150352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:14.702752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:14.704862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:14.725053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:14.725643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:14.726810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:14.727509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:14.940397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:14.956402 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cfec5b45-8315-4e5f-ac71-1736f57b55ed tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 0.833396 Jul 25 16:37:14.970751 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2634/5214] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:14 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:15.385447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:15.405202 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14aa105f-ec0a-4a0f-b8db-baf77a97054a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.709102 Jul 25 16:37:15.422947 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2581/5215] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:14 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:15.999105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:15.999787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:16.012725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:16.014487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:16.016630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:16.018091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:16.431051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:16.431720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:16.439943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=44 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:16.448160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:16.448600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:16.457070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:16.457800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:16.607100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:16.633826 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb56d353-a4fa-46ec-bc08-da3f99f9fbb0 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 0.639853 Jul 25 16:37:16.653125 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2635/5216] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:15 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:16.886500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:16.905630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03076109-1e30-4bbc-82cb-de519ff0a968 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.476802 Jul 25 16:37:16.907173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2582/5217] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:16 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:17.667100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:17.668888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:17.672907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:17.694021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:17.694992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:17.700264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:17.705615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:17.930165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:17.931222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:17.949555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:17.951375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:17.957839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:17.959609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:18.326175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:18.343025 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8437d28-9fc4-4e81-b765-8c9e4069bb07 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 0.676414 Jul 25 16:37:18.346412 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2636/5218] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:17 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:18.913977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d0d7a8a6-a045-4024-9038-d1876baa2744 req-dc61dbf9-dd74-4b24-b53c-75643e5d823e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8508134d-5f56-430b-8edb-f60cc86979a6", "tag": "4e98f34c-7416-4717-9a47-435abee00ab9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:18.937804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:18.943941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d0d7a8a6-a045-4024-9038-d1876baa2744 req-dc61dbf9-dd74-4b24-b53c-75643e5d823e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:18.946865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d0d7a8a6-a045-4024-9038-d1876baa2744 req-dc61dbf9-dd74-4b24-b53c-75643e5d823e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:18.993198 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d0d7a8a6-a045-4024-9038-d1876baa2744 req-dc61dbf9-dd74-4b24-b53c-75643e5d823e service nova] Creating event network-changed:4e98f34c-7416-4717-9a47-435abee00ab9 for instance 8508134d-5f56-430b-8edb-f60cc86979a6 on n-h2-846219-13 Jul 25 16:37:19.003598 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d0d7a8a6-a045-4024-9038-d1876baa2744 req-dc61dbf9-dd74-4b24-b53c-75643e5d823e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094686 Jul 25 16:37:19.008346 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2637/5219] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:19.087148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:19.134754 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e48db0e-ee57-4390-bbdd-33f434908a42 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 1.206610 Jul 25 16:37:19.138399 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2583/5220] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:17 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:19.391432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:19.395145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:19.433441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:19.435263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:19.437583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:19.465560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:20.038855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:20.055235 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3a0ae91-16cc-4877-a63c-0fbfabf0a7b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 0.689206 Jul 25 16:37:20.058890 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2638/5221] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:19 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:20.170049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:20.172340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:20.187447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:20.188200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:20.189516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:20.190305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:20.601143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:20.616619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f0fab155-f39a-4472-ad29-7cea145a3041 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.453427 Jul 25 16:37:20.620078 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2584/5222] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:20 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:21.086074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:21.086796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:21.105923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:21.107694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:21.108184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:21.109021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:21.109530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:21.646856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:21.647750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:21.671384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:21.672031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:21.672938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:21.673540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:22.210709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:22.220829 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7946569-36ed-479b-a185-903d16076ea2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 1.139292 Jul 25 16:37:22.226502 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2639/5223] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:21 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:22.318405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:22.337261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da93835f-ab9f-42be-a852-304f3bc41d85 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1346 microversion: 2.1 time: 0.694199 Jul 25 16:37:22.338459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2585/5224] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:21 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1346 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:23.270884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:23.271549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:23.305354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:23.305806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:23.306713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:23.312415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:23.360212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:23.361510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:23.375836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:23.377721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:23.379569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:23.381986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:24.286829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:24.297682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:24.299930 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ca2548e-9861-4f9a-a8f4-557eb5d1e19c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 1.035527 Jul 25 16:37:24.300554 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2640/5225] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:23 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:24.310394 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e538bf18-96c8-4b4e-bf85-dc9ec3714b19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1392 microversion: 2.1 time: 0.954560 Jul 25 16:37:24.315023 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2586/5226] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:23 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1392 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:25.324316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:25.333322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:25.338167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:25.339022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:25.355397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:25.359622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:25.361982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:25.362128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:25.362631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:25.365676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:25.366828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:25.367484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:25.661278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:25.674924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2eedf481-562e-4d72-a558-821b5aedec82 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 0.356379 Jul 25 16:37:25.690725 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2641/5227] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:25 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:25.712835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-84d5947c-41fa-4dd3-9db0-89cd600afaa3 req-77808ed9-7971-497c-9666-97b25addafa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8508134d-5f56-430b-8edb-f60cc86979a6", "name": "network-vif-plugged", "status": "completed", "tag": "4e98f34c-7416-4717-9a47-435abee00ab9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:25.742733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:25.758719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-84d5947c-41fa-4dd3-9db0-89cd600afaa3 req-77808ed9-7971-497c-9666-97b25addafa2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:25.759247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-84d5947c-41fa-4dd3-9db0-89cd600afaa3 req-77808ed9-7971-497c-9666-97b25addafa2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:25.766123 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8086d285-4446-4dd9-9992-3d010b4a26f3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.432696 Jul 25 16:37:25.774051 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-84d5947c-41fa-4dd3-9db0-89cd600afaa3 req-77808ed9-7971-497c-9666-97b25addafa2 service nova] Creating event network-vif-plugged:4e98f34c-7416-4717-9a47-435abee00ab9 for instance 8508134d-5f56-430b-8edb-f60cc86979a6 on n-h2-846219-13 Jul 25 16:37:25.780561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-84d5947c-41fa-4dd3-9db0-89cd600afaa3 req-77808ed9-7971-497c-9666-97b25addafa2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087796 Jul 25 16:37:25.786011 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2642/5228] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:25.788428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2587/5229] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:25 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:26.720867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:26.723462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:26.735551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:26.748509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:26.749449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:26.749917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:26.791141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:26.792407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:26.799810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:26.800260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:26.801180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:26.801615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:27.021345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:27.055492 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8cf7d775-0ea5-4a4e-835c-fa059cee250e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1313 microversion: 2.1 time: 0.342772 Jul 25 16:37:27.056743 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2643/5230] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:26 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:27.066545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:27.075585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23111b49-2606-425f-924a-ff7e200dabc4 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.288312 Jul 25 16:37:27.079169 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2588/5231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:26 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:28.080385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:28.084063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:28.099655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:28.101835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:28.126062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:28.126551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:28.129964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:28.131536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:28.132917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:28.134906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:28.135884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:28.137589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:28.998263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:29.003990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:29.010205 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f817fa8-1309-485f-935b-f47c185a8819 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1494 microversion: 2.1 time: 0.934269 Jul 25 16:37:29.010853 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2644/5232] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:28 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1494 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:29.027739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55b400da-4196-46c9-9d96-f9c4e18ff944 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.934270 Jul 25 16:37:29.032485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:29.032669 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2589/5233] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:28 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:29.052099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:29.067479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.068297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.069313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.069922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.264058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:29.273274 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-27a1535b-87e1-40f5-9fa6-7e9ba9aa84b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1495 microversion: 2.1 time: 0.245547 Jul 25 16:37:29.274505 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2645/5234] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:29 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1495 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:29.296870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:29.298304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:29.308050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.309137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.310172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.310801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.614361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:29.631197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9a5af3e-4598-436f-97dc-3947b28b6208 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1494 microversion: 2.1 time: 0.338924 Jul 25 16:37:29.642306 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2590/5235] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:29 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1494 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:29.655066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:29.655886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:29.663212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.664115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.665972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.666748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.715310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:29.861660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e436e1b2-18bb-4412-ac51-fc21d05eafcd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 204 len: 0 microversion: 2.1 time: 0.210539 Jul 25 16:37:29.863497 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2646/5236] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:37:29 2022] DELETE /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:37:29.872216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:29.872878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:29.879591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.880043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:29.881347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:29.881347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:30.056243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:30.057050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:30.065413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:30.066034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:30.067587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:30.069777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:30.126664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:30.347268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:30.375525 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-64717480-118a-404b-a4b7-a2f889e379fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1500 microversion: 2.1 time: 0.507364 Jul 25 16:37:30.391887 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2591/5237] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:29 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1500 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:30.654080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:30.692056 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ce2eadbf-ab09-4858-8816-d2e83fcd2082 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.641398 Jul 25 16:37:30.699316 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2647/5238] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:30 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:31.403264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:31.404788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:31.416449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.417894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.418889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.419643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.731338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:31.732380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:31.750552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.751044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.752192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.756418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:32.087650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:32.120989 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-abecf192-5436-425a-9115-be1ee22fd9ce tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1500 microversion: 2.1 time: 0.724212 Jul 25 16:37:32.122857 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2592/5239] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:31 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1500 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:32.158708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:32.184112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a995297-cf0a-480a-b844-089af182ba8e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.456891 Jul 25 16:37:32.201436 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2648/5240] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:31 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:33.168941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:33.170265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:33.188729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e963ac1f-b155-4eb4-adda-65bfea842197 req-aa2bf96b-f579-4ba8-aa3f-a06ff273a32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8508134d-5f56-430b-8edb-f60cc86979a6", "name": "network-vif-deleted", "tag": "4e98f34c-7416-4717-9a47-435abee00ab9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:33.261547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.262630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.268722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.270481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.274559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e963ac1f-b155-4eb4-adda-65bfea842197 req-aa2bf96b-f579-4ba8-aa3f-a06ff273a32c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.281630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e963ac1f-b155-4eb4-adda-65bfea842197 req-aa2bf96b-f579-4ba8-aa3f-a06ff273a32c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.325231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:33.328675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e963ac1f-b155-4eb4-adda-65bfea842197 req-aa2bf96b-f579-4ba8-aa3f-a06ff273a32c service nova] Creating event network-vif-deleted:4e98f34c-7416-4717-9a47-435abee00ab9 for instance 8508134d-5f56-430b-8edb-f60cc86979a6 on n-h2-846219-13 Jul 25 16:37:33.345831 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e963ac1f-b155-4eb4-adda-65bfea842197 req-aa2bf96b-f579-4ba8-aa3f-a06ff273a32c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164595 Jul 25 16:37:33.350722 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2649/5241] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:33.382923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:33.384180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:33.411786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.413513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.414766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.416084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.517890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:33.546905 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35ddfaf1-abe9-40dd-8901-e28803a9ba29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 200 len: 1298 microversion: 2.1 time: 0.404001 Jul 25 16:37:33.548565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2593/5242] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:33 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 1298 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:33.725822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:33.739651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9086a133-90c7-49e7-86a6-767259b91669 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.387372 Jul 25 16:37:33.744571 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2650/5243] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:33 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:34.576290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:34.577646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:34.609164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.610083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.611563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.612381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.685745 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 HTTP/1.1 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '8508134d-5f56-430b-8edb-f60cc86979a6'} Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:37:34.687943 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:34.692890 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:34.692890 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:34.692890 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:34.692890 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:34.692890 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:37:34.692890 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:37:34.703468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:34.709153 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-018eabc1-33af-4d38-aa89-3ccb09ab59e1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 404 len: 111 microversion: 2.1 time: 0.137534 Jul 25 16:37:34.711251 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2594/5244] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:34 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:34.725159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:34.725949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:34.754651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.757272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.758762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.763546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.773572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:34.774823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:34.799041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.799940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.801587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.802338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.846640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:35.115625 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6d6561e-32ba-4b53-8c4a-389d9b04bf8e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 204 len: 0 microversion: 2.1 time: 0.396045 Jul 25 16:37:35.116917 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2651/5245] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:37:34 2022] DELETE /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:37:35.131787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:35.133600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:35.144291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:35.149849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:35.151458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:35.152156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:35.320256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:35.345016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-232cb6bc-435e-48f3-a98a-51799b57748d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.578964 Jul 25 16:37:35.348044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2595/5246] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:34 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:35.536469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:35.551516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-309784c2-ec60-4e08-ad2b-6961529754a6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1501 microversion: 2.1 time: 0.428172 Jul 25 16:37:35.583026 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2652/5247] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:35 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1501 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:36.372221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:36.373030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:36.390837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:36.391412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:36.394456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:36.395032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:36.579125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:36.580505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:36.589898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:36.590663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:36.591653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:36.592255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:37.523277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:37.556418 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fcfe138c-2937-42a1-b22c-79309a5d3697 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 1.177264 Jul 25 16:37:37.580262 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2596/5248] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:36 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:37.589452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:37.600912 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5229cc81-aa7a-480d-a877-c7c603bab667 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1501 microversion: 2.1 time: 1.025866 Jul 25 16:37:37.613351 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2653/5249] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:36 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1501 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:38.579237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:38.582860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:38.597503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:38.598640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:38.599751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:38.600438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:38.636886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:38.638178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:38.698815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:38.708219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:38.710539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:38.715351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.106073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:39.122213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:39.122514 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab659c23-6342-451f-b919-83b7ec0143b5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 200 len: 1298 microversion: 2.1 time: 0.500722 Jul 25 16:37:39.123362 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2654/5250] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:38 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 1298 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:39.146887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6245b4a6-1b92-46a8-b699-e7508a992a97 req-561b8255-f2bf-4d54-9b1f-cd6a095d7f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ac4660-7f69-4d6d-bdcf-e354b7187d9d", "name": "network-vif-deleted", "tag": "9126518e-4000-40da-91e7-871852612d12"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:39.148386 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d5d0d92-4df5-4be6-abc8-8ee0e93d8862 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.574175 Jul 25 16:37:39.167090 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2597/5251] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:38 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:39.167422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6245b4a6-1b92-46a8-b699-e7508a992a97 req-561b8255-f2bf-4d54-9b1f-cd6a095d7f50 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.169814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6245b4a6-1b92-46a8-b699-e7508a992a97 req-561b8255-f2bf-4d54-9b1f-cd6a095d7f50 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.181194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7a92e8b0-5416-4c8a-96e0-984ac0a43a97 req-8fe2fe00-614a-43b9-92ca-1b90ae6bc456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0ce776-bd19-43a7-8224-149a17f3aa99", "name": "network-vif-plugged", "status": "completed", "tag": "5ba18aa0-e025-4908-9b50-0d2a27b13695"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:39.196638 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6245b4a6-1b92-46a8-b699-e7508a992a97 req-561b8255-f2bf-4d54-9b1f-cd6a095d7f50 service nova] Creating event network-vif-deleted:9126518e-4000-40da-91e7-871852612d12 for instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d on n-h1-846219-13 Jul 25 16:37:39.215217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7a92e8b0-5416-4c8a-96e0-984ac0a43a97 req-8fe2fe00-614a-43b9-92ca-1b90ae6bc456 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.215397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6245b4a6-1b92-46a8-b699-e7508a992a97 req-561b8255-f2bf-4d54-9b1f-cd6a095d7f50 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089856 Jul 25 16:37:39.217437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7a92e8b0-5416-4c8a-96e0-984ac0a43a97 req-8fe2fe00-614a-43b9-92ca-1b90ae6bc456 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.218209 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2655/5252] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:39.255418 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7a92e8b0-5416-4c8a-96e0-984ac0a43a97 req-8fe2fe00-614a-43b9-92ca-1b90ae6bc456 service nova] Creating event network-vif-plugged:5ba18aa0-e025-4908-9b50-0d2a27b13695 for instance fb0ce776-bd19-43a7-8224-149a17f3aa99 on n-h1-846219-13 Jul 25 16:37:39.264565 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7a92e8b0-5416-4c8a-96e0-984ac0a43a97 req-8fe2fe00-614a-43b9-92ca-1b90ae6bc456 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088478 Jul 25 16:37:39.266357 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2598/5253] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:40.148196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:40.149591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:40.164859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:40.167600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:40.169598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:40.170238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:40.173515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:40.174296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:40.190082 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d HTTP/1.1 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '43ac4660-7f69-4d6d-bdcf-e354b7187d9d'} Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:40.192200 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:40.196511 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:40.196511 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:40.196511 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:40.196511 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:40.196511 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:37:40.196511 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:40.196903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:40.196903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:40.196903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:40.196903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:40.198346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:40.199510 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b93f631f-d9b0-4f32-8d74-81385f093b74 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 404 len: 111 microversion: 2.1 time: 0.056108 Jul 25 16:37:40.204542 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2656/5254] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:40 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:40.365322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1731723300", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:40.445290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:37:40.824272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:40.862383 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98ffad2f-2035-4d0a-8fe1-8ef7d0e022c5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.693212 Jul 25 16:37:40.864148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2599/5255] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:40 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:41.599400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:37:41.601362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:37:41.602068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:37:41.602645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:37:41.603594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:37:41.616697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.617465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.618451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.619082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.641162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:37:41.657326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:37:41.677487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:37:41.679904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:37:41.740422 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b55ebc5-0e72-4eeb-a293-b4bbaed2672f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.379502 Jul 25 16:37:41.753508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0af184dd-a616-42d7-b66b-6798a8aa442f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:41.754784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0af184dd-a616-42d7-b66b-6798a8aa442f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:41.759867 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2657/5256] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:37:40 2022] POST /compute/v2.1/servers => generated 382 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:37:41.868346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0af184dd-a616-42d7-b66b-6798a8aa442f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:41.882861 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0af184dd-a616-42d7-b66b-6798a8aa442f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1213 microversion: 2.1 time: 0.133990 Jul 25 16:37:41.883800 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2600/5257] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:41 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:41.913725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:41.914470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:41.923559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.924521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.925921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.926604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:42.280049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:42.293674 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5391c9d1-8382-4cb8-adac-44dc217adc71 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1380 microversion: 2.1 time: 0.382702 Jul 25 16:37:42.294580 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2658/5258] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:41 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1380 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:42.910189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:42.912574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:42.926176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:42.926875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:42.927808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:42.928394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.128442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:43.148352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1590d411-65c1-47c0-a18f-22c248bf87ab tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1265 microversion: 2.1 time: 0.244524 Jul 25 16:37:43.149348 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2601/5259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:42 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:43.315686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:43.317415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:43.327476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.328062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.330051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.330829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.885679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:43.895664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d3974d70-1b55-47de-a699-8ee106c2eb5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1568 microversion: 2.1 time: 0.584236 Jul 25 16:37:43.897225 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2659/5260] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:43 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1568 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:43.924368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:43.927099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:43.939298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.940394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.942051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.944892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.170071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:44.170695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:44.179115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:44.179859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.180845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:44.181496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.295415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:44.301039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:44.312630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d00d757-edcb-4938-8fd4-3c60efb8cbd5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1568 microversion: 2.1 time: 0.397701 Jul 25 16:37:44.316771 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2602/5261] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:43 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:44.317529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2479ed38-5c0b-479f-bc06-9b3051df05fd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1271 microversion: 2.1 time: 0.149626 Jul 25 16:37:44.332438 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2660/5262] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:44 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:44.428783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:44.429290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:44.452243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:44.452726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.453680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:44.454304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.501244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:44.615326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0e9815e-5a1e-42c8-a075-3b2a26b943ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 204 len: 0 microversion: 2.1 time: 0.190198 Jul 25 16:37:44.616227 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2603/5263] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:37:44 2022] DELETE /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:37:44.625333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:44.626363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:44.640939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:44.641738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.642851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:44.643479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:44.968856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:44.996806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69299a32-ca56-480d-8068-809b75e86e64 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1574 microversion: 2.1 time: 0.375515 Jul 25 16:37:44.997839 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2661/5264] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:44 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1574 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:45.337592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:45.339122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:45.354833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:45.355719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:45.357149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:45.362635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:46.022558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:46.024015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:46.034549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:46.035713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:46.037142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:46.038292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:46.146170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:46.161302 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-64cca7df-e8f1-4fa2-ac6b-70b1af77f964 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 0.828162 Jul 25 16:37:46.175489 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2604/5265] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:45 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:46.552115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:46.569676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8aefc4b-d6f8-4b1a-aca0-07473239e4d9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1574 microversion: 2.1 time: 0.552874 Jul 25 16:37:46.588398 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2662/5266] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:46 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1574 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:47.186695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:47.187899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:47.191171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:47.212466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:47.213196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:47.214301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:47.214884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:47.612057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:47.616616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:47.669293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:47.669768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:47.677706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:47.682448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:47.773909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:47.794342 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ccee25fc-4468-42da-ae9e-d08366d9b221 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 0.610033 Jul 25 16:37:47.812362 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2605/5267] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:47 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:48.500639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-740acc7d-062c-4dd1-8ee2-744fadecde1e req-125ea8e6-6326-4c1c-9697-716662fe4e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0ce776-bd19-43a7-8224-149a17f3aa99", "name": "network-vif-deleted", "tag": "5ba18aa0-e025-4908-9b50-0d2a27b13695"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:48.531232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-740acc7d-062c-4dd1-8ee2-744fadecde1e req-125ea8e6-6326-4c1c-9697-716662fe4e15 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:48.534329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-740acc7d-062c-4dd1-8ee2-744fadecde1e req-125ea8e6-6326-4c1c-9697-716662fe4e15 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:48.575127 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-740acc7d-062c-4dd1-8ee2-744fadecde1e req-125ea8e6-6326-4c1c-9697-716662fe4e15 service nova] Creating event network-vif-deleted:5ba18aa0-e025-4908-9b50-0d2a27b13695 for instance fb0ce776-bd19-43a7-8224-149a17f3aa99 on n-h1-846219-13 Jul 25 16:37:48.582824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-740acc7d-062c-4dd1-8ee2-744fadecde1e req-125ea8e6-6326-4c1c-9697-716662fe4e15 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092596 Jul 25 16:37:48.584054 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2606/5268] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:48.805697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:48.827442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:48.828292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:48.852852 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2b5e882-89f7-441f-8065-e979f5bc65c6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1574 microversion: 2.1 time: 1.257720 Jul 25 16:37:48.857489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2663/5269] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:47 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1574 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:48.858456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:48.859147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:48.860257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:48.862775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:49.578458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7c9a1d35-b09a-4c41-9424-4c861b1b4488 req-f29be9d3-f2f3-4c55-a7d7-a1173d325943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b949b311-45ce-41e2-a113-086f4317f49e", "tag": "4a3db78d-959b-4096-9f41-b655abc6916e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:49.595087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7c9a1d35-b09a-4c41-9424-4c861b1b4488 req-f29be9d3-f2f3-4c55-a7d7-a1173d325943 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:49.595795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7c9a1d35-b09a-4c41-9424-4c861b1b4488 req-f29be9d3-f2f3-4c55-a7d7-a1173d325943 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:49.626511 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7c9a1d35-b09a-4c41-9424-4c861b1b4488 req-f29be9d3-f2f3-4c55-a7d7-a1173d325943 service nova] Creating event network-changed:4a3db78d-959b-4096-9f41-b655abc6916e for instance b949b311-45ce-41e2-a113-086f4317f49e on n-h2-846219-13 Jul 25 16:37:49.635495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7c9a1d35-b09a-4c41-9424-4c861b1b4488 req-f29be9d3-f2f3-4c55-a7d7-a1173d325943 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061606 Jul 25 16:37:49.636421 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2664/5270] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:49.710856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:49.731723 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a4e3b74-d27d-4578-8ad4-1712be0a8bb6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 0.913323 Jul 25 16:37:49.733485 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2607/5271] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:48 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:49.897238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:49.898262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:49.910179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:49.911025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:49.912499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:49.914354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:50.330124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:50.337445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:50.340762 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a89a2229-d3b9-43ab-a538-e71fbcbbb3c7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1365 microversion: 2.1 time: 0.449701 Jul 25 16:37:50.355805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2665/5272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:49 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:50.756410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:50.757237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:50.769504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:50.772114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:50.773336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:50.774930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:51.225915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:51.267835 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e06ad9c5-1d02-44eb-ac3a-415bc3dca83e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 0.507593 Jul 25 16:37:51.269161 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2608/5273] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:50 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:51.363010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:51.363658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:51.375105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:51.377122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:51.386821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:51.387705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:51.388382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:51.527427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:51.541542 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b2c6574b-b5f8-4399-8e1b-e0d0e2e6028c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1365 microversion: 2.1 time: 0.182179 Jul 25 16:37:51.548659 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2666/5274] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:51 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:52.297222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:52.299322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:52.314863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:52.340596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.348962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.350682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.355194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.584132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:52.588882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:52.616014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:52.617887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:52.621345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.622024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.624482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.625161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.988115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:53.001509 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7a50291-43a4-4a3c-9018-f97df2755309 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1365 microversion: 2.1 time: 0.426809 Jul 25 16:37:53.008988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2667/5275] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:52 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:53.415458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:53.428374 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43236b70-9922-410e-b1d0-2e66af173794 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 1.138341 Jul 25 16:37:53.441545 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2609/5276] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:52 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:54.035102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:54.037614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:54.062529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:54.070586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:54.088688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:54.095981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:54.248768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:54.263287 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fb240260-d3ca-45bb-90f6-421c0b177fdf tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1365 microversion: 2.1 time: 0.235834 Jul 25 16:37:54.264025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2668/5277] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:54 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:54.463234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:54.463234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:54.466949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:54.478252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:54.479749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:54.483147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:54.914690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:54.927099 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9530a42-fe55-4885-bfde-abb52b833028 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 0.477879 Jul 25 16:37:54.931914 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2610/5278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:54 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:55.286602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:55.288329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:55.300124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.304576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:55.305583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.313324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:55.570194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:55.586749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e5aee4d7-7ebd-49a0-a3b5-23a9d6978926 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1365 microversion: 2.1 time: 0.305616 Jul 25 16:37:55.593577 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2669/5279] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:55 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:55.952994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:55.953688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:55.974294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.976130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:55.976978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.977478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.012132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:56.085197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e42e7a08-3780-4f78-b956-2726597b87cd req-0558ccc7-2576-4916-9948-39c7a19e5f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b949b311-45ce-41e2-a113-086f4317f49e", "name": "network-vif-plugged", "status": "completed", "tag": "4a3db78d-959b-4096-9f41-b655abc6916e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:56.107452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e42e7a08-3780-4f78-b956-2726597b87cd req-0558ccc7-2576-4916-9948-39c7a19e5f55 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:56.108173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e42e7a08-3780-4f78-b956-2726597b87cd req-0558ccc7-2576-4916-9948-39c7a19e5f55 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.134511 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e42e7a08-3780-4f78-b956-2726597b87cd req-0558ccc7-2576-4916-9948-39c7a19e5f55 service nova] Creating event network-vif-plugged:4a3db78d-959b-4096-9f41-b655abc6916e for instance b949b311-45ce-41e2-a113-086f4317f49e on n-h2-846219-13 Jul 25 16:37:56.146621 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e42e7a08-3780-4f78-b956-2726597b87cd req-0558ccc7-2576-4916-9948-39c7a19e5f55 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065349 Jul 25 16:37:56.149381 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2670/5280] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:56.632643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:56.639651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:56.688446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:56.688913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.694227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:56.694918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.763210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:56.763933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.764561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lazy-loading 'fault' on Instance uuid fb0ce776-bd19-43a7-8224-149a17f3aa99 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:37:56.936199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:56.952062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34a21c20-37eb-4cd7-a977-b0f2720c6366 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 200 len: 1370 microversion: 2.1 time: 0.342754 Jul 25 16:37:56.952728 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2671/5281] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:56 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:56.990541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:57.005663 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-537f66ac-796a-4e82-b3ea-e2d15b8d6306 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 1.057817 Jul 25 16:37:57.008975 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2611/5282] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:55 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:57.980286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:57.981793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:57.993556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:57.996877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:57.997949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:57.999368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.027909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:58.030353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:58.050166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.052026 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:37:58.053908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.060700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.061777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 HTTP/1.1 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fb0ce776-bd19-43a7-8224-149a17f3aa99'} Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:58.065849 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:37:58.070569 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:37:58.075648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:58.081957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e82d934-0e35-48bb-940a-0f6deb033749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 404 len: 111 microversion: 2.1 time: 0.103610 Jul 25 16:37:58.105422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2672/5283] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:57 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:58.810710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:58.831701 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39aebb6c-82d2-40a5-a7ba-0992b7249312 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1313 microversion: 2.1 time: 0.804225 Jul 25 16:37:58.843100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2612/5284] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:58 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:59.858162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:59.860127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:59.874067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:59.876235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:59.879846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:59.881658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:00.393972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:00.445075 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85bdd78f-2086-45a0-a494-60ad919cab41 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1494 microversion: 2.1 time: 0.590290 Jul 25 16:38:00.447110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2673/5285] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:37:59 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1494 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:00.475030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:00.482652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:00.499140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:00.499819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:00.500826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:00.502831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:00.689661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37c8281e-08c7-4a02-9b45-14d0435d3c64 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "PUT /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1089 microversion: 2.1 time: 0.222618 Jul 25 16:38:00.703294 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2613/5286] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:38:00 2022] PUT /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1089 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:00.708685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:00.709600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:00.724574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:00.729721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:00.736312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:00.740405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.319819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:01.331506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc18dc09-73e9-4d1d-b85b-549e39ea25da tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1515 microversion: 2.1 time: 0.626981 Jul 25 16:38:01.334123 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2674/5287] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:00 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1515 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:01.353143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:01.355054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:01.371515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:01.372351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:01.375237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.378075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.379910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.380676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.385966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.387404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.391642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.392347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.464893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:38:01.674201 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-823140f2-3e78-4519-bad8-5086e8c15fd2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "DELETE /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 204 len: 0 microversion: 2.42 time: 0.641855 Jul 25 16:38:01.682614 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2614/5288] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:38:01 2022] DELETE /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:38:01.701618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:01.702201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:01.703083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:01.714743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.715552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.715686 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bbe8d3af-94ed-4e58-a2ae-af42fe6b8361 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1515 microversion: 2.1 time: 0.364143 Jul 25 16:38:01.716703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.717380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.717680 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2675/5289] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:01 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:01.751594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:01.753537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:01.769495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.771760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.775007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.775772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.869934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:38:02.106518 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31a0616b-bf07-4efe-b3cd-ef353352a016 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 204 len: 0 microversion: 2.1 time: 0.358955 Jul 25 16:38:02.107358 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2676/5290] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:38:01 2022] DELETE /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:38:02.118394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:02.122813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:02.137347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:02.140248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:02.142018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:02.142791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:02.822114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:02.835525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:02.837178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:02.849156 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7276e977-0c43-4a35-b328-b2d7d6e2c295 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2959 microversion: 2.42 time: 1.152793 Jul 25 16:38:02.850282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2615/5291] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:01 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2959 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:03.144722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:03.169801 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-677f3a8e-abd3-438e-b809-c86ac4ab9f29 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1521 microversion: 2.1 time: 1.047800 Jul 25 16:38:03.186210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2677/5292] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:02 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1521 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:03.838352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:03.839242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:03.859137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:03.860538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:03.862570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:03.863581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:03.882867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:03.883574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:03.896173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:03.896630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:03.897633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:03.898174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:03.916444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:38:04.034062 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b875d46-dd64-4862-81e0-66c0467c9c23 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 204 len: 0 microversion: 2.1 time: 0.202661 Jul 25 16:38:04.035490 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2616/5293] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:38:03 2022] DELETE /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:38:04.050540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:04.054314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:04.065297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:04.065945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:04.067019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:04.067791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:04.558008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:04.567771 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43d52bab-095e-422d-9c63-22f90a996d54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1414 microversion: 2.1 time: 0.521948 Jul 25 16:38:04.569035 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2617/5294] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:04 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1414 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:04.576661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:04.579133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:04.594255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:04.596564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:04.597583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:04.598034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:04.602243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:04.628562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:04.644834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:04.649474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-040e7bac-7ca0-4536-b8d8-1f47f7855a75 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2959 microversion: 2.42 time: 0.771471 Jul 25 16:38:04.655020 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2678/5295] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:03 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2959 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:04.996273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:05.024728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d2e0abd-6088-455f-9dc9-22ff7ccf1ee9 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 200 len: 1521 microversion: 2.1 time: 0.453964 Jul 25 16:38:05.038570 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2618/5296] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:04 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:05.591636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:05.592348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:05.614582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:05.615388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:05.616543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:05.617131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:05.682152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:05.682909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:05.697273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:05.697734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:05.698637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:05.698983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:06.730248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:06.741999 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-281ac8e1-e899-4ed4-be91-1f1bfc92af3b tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1414 microversion: 2.1 time: 1.154536 Jul 25 16:38:06.743393 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2679/5297] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:05 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1414 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:06.750007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-40589983-7a8c-40ab-a82a-e5cc65aadc3c req-2d51de2b-5b91-48dd-ba8b-21878df340dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b949b311-45ce-41e2-a113-086f4317f49e", "name": "network-vif-deleted", "tag": "4a3db78d-959b-4096-9f41-b655abc6916e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:06.767791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-40589983-7a8c-40ab-a82a-e5cc65aadc3c req-2d51de2b-5b91-48dd-ba8b-21878df340dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:06.769613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-40589983-7a8c-40ab-a82a-e5cc65aadc3c req-2d51de2b-5b91-48dd-ba8b-21878df340dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:06.786023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-40589983-7a8c-40ab-a82a-e5cc65aadc3c req-2d51de2b-5b91-48dd-ba8b-21878df340dc service nova] Creating event network-vif-deleted:4a3db78d-959b-4096-9f41-b655abc6916e for instance b949b311-45ce-41e2-a113-086f4317f49e on n-h2-846219-13 Jul 25 16:38:06.794302 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-40589983-7a8c-40ab-a82a-e5cc65aadc3c req-2d51de2b-5b91-48dd-ba8b-21878df340dc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049176 Jul 25 16:38:06.795707 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2680/5298] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:06.800038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:06.806611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:06.808428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:06.817531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:06.822724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:06.823549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:06.824947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:06.825699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:06.825926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:06.827743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f2e10b4-f86b-464c-9d95-93e4d1bcac7b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2959 microversion: 2.42 time: 1.149792 Jul 25 16:38:06.843438 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2619/5299] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:05 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2959 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:06.846730 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e HTTP/1.1 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b949b311-45ce-41e2-a113-086f4317f49e'} Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:06.850678 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:06.855710 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:06.855710 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:06.855710 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:06.855710 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:06.855710 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:38:06.855710 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:06.859153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:06.861055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-87528b05-71df-4091-b422-d1fc2c447e57 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 404 len: 111 microversion: 2.1 time: 0.063507 Jul 25 16:38:06.862396 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2681/5300] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:06 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:38:07.056568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-469978059", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "868c0e42-8ebe-4298-9b2b-2912235eb51f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:07.201734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] validate_networks() for [('868c0e42-8ebe-4298-9b2b-2912235eb51f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:38:07.768248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:07.770011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:07.781269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:07.782908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:07.784651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:07.785866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.006427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:08.037040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2d701ca7-996a-4ad7-8c49-160709ab8ae3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1372 microversion: 2.1 time: 0.273386 Jul 25 16:38:08.039098 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2682/5301] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:07 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:08.058155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:08.059321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:08.077275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.080177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.083645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.089986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.147067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:08.558964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:38:08.560758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:38:08.562870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:38:08.564446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:38:08.565358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:38:08.582383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.583164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.584611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.585465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.613495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:38:08.620893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Getting quotas for user 9bdc9f2fc6394e49995b1be6ff9c4915 and project 826be553824b46c8bd1e43084477d4f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:38:08.639932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:38:08.643319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:38:08.665046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:08.680979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:08.682577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:08.683919 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5040fe48-7a52-4074-8978-d9a0c9bbbc67 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2938 microversion: 2.42 time: 0.643488 Jul 25 16:38:08.692267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2683/5302] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:08 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2938 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:08.730160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68786c2d-d718-4fb5-bc8d-a7372c3d14b3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.677155 Jul 25 16:38:08.744011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a25469e1-bdaf-483e-96a9-f2844ff21025 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:08.744875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a25469e1-bdaf-483e-96a9-f2844ff21025 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:08.750013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2620/5303] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:38:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:38:08.838149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b975f190-37d4-4ad7-a06d-9f40a57d4c47 req-c372469a-77c5-4d41-9120-e7554242c0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13effe71-08d1-4247-9629-26049806de8c", "name": "network-vif-deleted", "tag": "41c21b15-d98a-4060-bd68-d14f081d266d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:08.851573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a25469e1-bdaf-483e-96a9-f2844ff21025 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:08.862935 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a25469e1-bdaf-483e-96a9-f2844ff21025 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1212 microversion: 2.1 time: 0.123774 Jul 25 16:38:08.880443 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2684/5304] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:08 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:08.883204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b975f190-37d4-4ad7-a06d-9f40a57d4c47 req-c372469a-77c5-4d41-9120-e7554242c0d7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.884233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b975f190-37d4-4ad7-a06d-9f40a57d4c47 req-c372469a-77c5-4d41-9120-e7554242c0d7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.903001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b975f190-37d4-4ad7-a06d-9f40a57d4c47 req-c372469a-77c5-4d41-9120-e7554242c0d7 service nova] Creating event network-vif-deleted:41c21b15-d98a-4060-bd68-d14f081d266d for instance 13effe71-08d1-4247-9629-26049806de8c on n-h2-846219-13 Jul 25 16:38:08.908798 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b975f190-37d4-4ad7-a06d-9f40a57d4c47 req-c372469a-77c5-4d41-9120-e7554242c0d7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075675 Jul 25 16:38:08.913059 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2621/5305] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:38:09.067704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:09.068363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:09.076412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.077208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.078213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.078824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.113967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0a4b879b-3a75-4593-86db-732a196810fc req-e19945ed-718d-4ae0-8e7c-a92308b48ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-unplugged", "status": "completed", "tag": "3023088a-a54b-4442-8e02-6038517007c3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:09.144416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a4b879b-3a75-4593-86db-732a196810fc req-e19945ed-718d-4ae0-8e7c-a92308b48ed3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.144861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a4b879b-3a75-4593-86db-732a196810fc req-e19945ed-718d-4ae0-8e7c-a92308b48ed3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.196731 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0a4b879b-3a75-4593-86db-732a196810fc req-e19945ed-718d-4ae0-8e7c-a92308b48ed3 service nova] Creating event network-vif-unplugged:3023088a-a54b-4442-8e02-6038517007c3 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:09.213557 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0a4b879b-3a75-4593-86db-732a196810fc req-e19945ed-718d-4ae0-8e7c-a92308b48ed3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106053 Jul 25 16:38:09.214550 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2622/5306] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:38:09.221527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:09.236244 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-199f5eb7-d8ea-4dbe-aa91-5e48698e1a63 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1205 microversion: 2.1 time: 0.171234 Jul 25 16:38:09.238248 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2685/5307] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:09 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1205 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:09.718960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:09.722259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:09.737495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.737959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.738762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.743409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.884762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:09.885430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:09.906881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.911434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.915194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.916102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:10.133047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:10.146614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a843542-49ff-49ab-bbc2-e948a8795e7a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1264 microversion: 2.1 time: 0.266433 Jul 25 16:38:10.155172 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2686/5308] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:09 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:10.249496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:10.263984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:10.269487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:10.289737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:10.294407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:10.294674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:10.297927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:10.298631 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-27316521-450f-461e-8b58-5dd7ad314435 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2917 microversion: 2.42 time: 0.584777 Jul 25 16:38:10.313270 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2623/5309] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:09 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2917 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:10.341577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:10.342555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:10.500789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:10.512132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-83205b7b-6d44-4b74-8b26-4b7679c0ef57 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1205 microversion: 2.1 time: 0.255411 Jul 25 16:38:10.519829 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2687/5310] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:10 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1205 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:11.169347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:11.170003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:11.190987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.194581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.198568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.200296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.343703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:11.345208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:11.358131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.358601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.363125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.363586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.634656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:11.655577 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c2df0709-b62b-424b-ae1e-522b0232ded5 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1270 microversion: 2.1 time: 0.486521 Jul 25 16:38:11.657291 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2624/5311] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:11 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1270 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:11.671236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-unplugged", "status": "completed", "tag": "6afef70b-7f67-402e-8508-8cc2de9786ec"}, {"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-unplugged", "status": "completed", "tag": "413593f7-3566-422c-9be7-06ba68784b70"}, {"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-unplugged", "status": "completed", "tag": "72acbf75-e548-4547-b749-1640257cd1c2"}, {"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-unplugged", "status": "completed", "tag": "c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:11.704905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.707900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.759023 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Creating event network-vif-unplugged:6afef70b-7f67-402e-8508-8cc2de9786ec for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:11.759471 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Creating event network-vif-unplugged:413593f7-3566-422c-9be7-06ba68784b70 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:11.765542 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Creating event network-vif-unplugged:72acbf75-e548-4547-b749-1640257cd1c2 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:11.769081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] Creating event network-vif-unplugged:c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:11.784665 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6f6f5826-3b91-4a08-b8a8-3aa4c4779dd7 req-378a256d-c06c-407e-a793-8813aa054cc5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.124484 Jul 25 16:38:11.792893 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2625/5312] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:11.811763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:11.812664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:11.831337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:11.836755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.837241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.838077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.838514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.847209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:11.848747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:11.850098 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b557ee9-4231-4dc6-baee-7abcf57dff06 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2871 microversion: 2.42 time: 0.510499 Jul 25 16:38:11.853003 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2688/5313] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:11 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2871 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:11.858561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e90e0e1f-3528-4490-a042-bb313edb8e0b req-dbf9d0d9-2f6d-482d-9958-878a80ec2e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-deleted", "tag": "c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:11.869679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e90e0e1f-3528-4490-a042-bb313edb8e0b req-dbf9d0d9-2f6d-482d-9958-878a80ec2e47 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:11.887111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e90e0e1f-3528-4490-a042-bb313edb8e0b req-dbf9d0d9-2f6d-482d-9958-878a80ec2e47 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.922487 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e90e0e1f-3528-4490-a042-bb313edb8e0b req-dbf9d0d9-2f6d-482d-9958-878a80ec2e47 service nova] Creating event network-vif-deleted:c0fbbdd5-ec45-49d7-9031-4d0b6f40ff6b for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:11.937971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e90e0e1f-3528-4490-a042-bb313edb8e0b req-dbf9d0d9-2f6d-482d-9958-878a80ec2e47 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082885 Jul 25 16:38:11.941173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2689/5314] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:12.015367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:12.026431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:12.035195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2839fff-ec1a-44e7-a6e2-ff8e1b308472 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1205 microversion: 2.1 time: 0.237774 Jul 25 16:38:12.049121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2626/5315] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:11 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1205 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:12.679104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:12.679843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:12.696025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:12.696498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:12.697358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:12.697815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:12.886140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:12.886712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:12.924488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:12.924984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:12.925842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:12.926282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:13.405553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:13.427718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:13.430466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:13.431822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:13.431972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-467067ee-f435-4467-a127-4aef78ea98bf tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2758 microversion: 2.42 time: 0.559541 Jul 25 16:38:13.433420 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2627/5316] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:12 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2758 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:13.443418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:13.448382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:13.463283 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3452efd3-68f8-4de1-bfc9-cd9d1cdea504 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 0.789514 Jul 25 16:38:13.463511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:13.464345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:13.464552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:13.464991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:13.482318 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2690/5317] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:12 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:13.648936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:13.665836 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6963680c-8f2c-4d64-9c6e-695dcac1b6d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1205 microversion: 2.1 time: 0.231256 Jul 25 16:38:13.666468 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2628/5318] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:13 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1205 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:14.028191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7df8b579-0295-4529-891e-c556ec3f2ea8 req-38555bd5-9b6e-4b09-a81e-ca25cbdf8501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-deleted", "tag": "72acbf75-e548-4547-b749-1640257cd1c2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:14.077525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7df8b579-0295-4529-891e-c556ec3f2ea8 req-38555bd5-9b6e-4b09-a81e-ca25cbdf8501 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.082911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7df8b579-0295-4529-891e-c556ec3f2ea8 req-38555bd5-9b6e-4b09-a81e-ca25cbdf8501 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.134969 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7df8b579-0295-4529-891e-c556ec3f2ea8 req-38555bd5-9b6e-4b09-a81e-ca25cbdf8501 service nova] Creating event network-vif-deleted:72acbf75-e548-4547-b749-1640257cd1c2 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:14.146856 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7df8b579-0295-4529-891e-c556ec3f2ea8 req-38555bd5-9b6e-4b09-a81e-ca25cbdf8501 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119763 Jul 25 16:38:14.147839 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2691/5319] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:14.465994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:14.466624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:14.491507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:14.492851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:14.493111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.493540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.498618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.501845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.514321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.515246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.533377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.534449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.980159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:14.996115 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a290376-705d-4fb8-bff9-a23fb390d0b1 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 0.509532 Jul 25 16:38:14.999013 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2692/5320] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:14 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:15.023515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:15.025349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:15.046266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:15.048730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:15.050654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:15.052454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:15.101356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:15.140159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:15.154345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:15.162783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61efb2ec-7414-468c-9e05-e93689020c6b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2598 microversion: 2.42 time: 0.703664 Jul 25 16:38:15.169928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2629/5321] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:14 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2598 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:15.187443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-17e6bf8a-aaf9-4fa2-abf7-5ec0bbe870de req-a0472f6d-31a5-4559-8eee-d311d677d083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb484db-0999-46e2-83f6-cde5cd796ecd", "tag": "8437627a-5003-4835-a642-c3f1fd6f923b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:15.250595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-17e6bf8a-aaf9-4fa2-abf7-5ec0bbe870de req-a0472f6d-31a5-4559-8eee-d311d677d083 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:15.251263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-17e6bf8a-aaf9-4fa2-abf7-5ec0bbe870de req-a0472f6d-31a5-4559-8eee-d311d677d083 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:15.314397 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-17e6bf8a-aaf9-4fa2-abf7-5ec0bbe870de req-a0472f6d-31a5-4559-8eee-d311d677d083 service nova] Creating event network-changed:8437627a-5003-4835-a642-c3f1fd6f923b for instance 8fb484db-0999-46e2-83f6-cde5cd796ecd on n-h1-846219-13 Jul 25 16:38:15.334821 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-17e6bf8a-aaf9-4fa2-abf7-5ec0bbe870de req-a0472f6d-31a5-4559-8eee-d311d677d083 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158557 Jul 25 16:38:15.339917 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2630/5322] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:15.428153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:15.444200 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c10a93c0-e5dd-41d2-8252-2e1a94cbe086 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1205 microversion: 2.1 time: 0.441551 Jul 25 16:38:15.444845 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2693/5323] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:14 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1205 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:16.022844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:16.024166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:16.048613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:16.049607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:16.050453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:16.051085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:16.193146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:16.194630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:16.209801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:16.210153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:16.210968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:16.235094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:16.582342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:16.596927 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4546e2e8-1bf9-4226-9ddf-e5a3114537cd tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 0.579497 Jul 25 16:38:16.597593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2631/5324] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:16 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:16.608623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:16.623093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:16.623758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:16.625054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:16.629285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:16.630786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31511300-4133-4330-ab44-7319ea3754a3 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2598 microversion: 2.42 time: 0.443141 Jul 25 16:38:16.631426 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2694/5325] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:16 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2598 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:16.645281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:16.645281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:16.645281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:16.645281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:16.742162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:16.752480 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69e48abc-a407-4832-86bb-b16ce05ae1f8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 200 len: 1205 microversion: 2.1 time: 0.153563 Jul 25 16:38:16.753755 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2632/5326] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:16 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 1205 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:17.262273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-903d929c-4b64-474e-8a46-68ab19392686 req-f1d030bc-aad9-4c62-ae70-98a89cb1f13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-deleted", "tag": "3023088a-a54b-4442-8e02-6038517007c3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:17.277766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-903d929c-4b64-474e-8a46-68ab19392686 req-f1d030bc-aad9-4c62-ae70-98a89cb1f13b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.278900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-903d929c-4b64-474e-8a46-68ab19392686 req-f1d030bc-aad9-4c62-ae70-98a89cb1f13b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:17.301981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-903d929c-4b64-474e-8a46-68ab19392686 req-f1d030bc-aad9-4c62-ae70-98a89cb1f13b service nova] Creating event network-vif-deleted:3023088a-a54b-4442-8e02-6038517007c3 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:17.309784 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-903d929c-4b64-474e-8a46-68ab19392686 req-f1d030bc-aad9-4c62-ae70-98a89cb1f13b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058041 Jul 25 16:38:17.310972 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2695/5327] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:17.623366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:17.624235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:17.643273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:17.647932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.648740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:17.651714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.653602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:17.668169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:17.669213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:17.696940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.700502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:17.703532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.704835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.122115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:18.142484 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-986c30c2-e6dc-463f-a97d-1351e0c1178f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 0.523782 Jul 25 16:38:18.144690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2633/5328] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:17 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:18.157387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:18.157690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:18.158476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:18.174085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:18.177436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:18.178060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:18.178651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.179596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:18.181159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.181319 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e792590-6a8c-4ef8-969e-1a0515a5d178 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2552 microversion: 2.42 time: 0.520539 Jul 25 16:38:18.183502 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2696/5329] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:17 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2552 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:18.218628 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c HTTP/1.1 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '13effe71-08d1-4247-9629-26049806de8c'} Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:18.222881 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:18.227492 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:18.238790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:18.239421 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b3b3bac-57ec-4634-84ee-7fb818dc38bd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 404 len: 111 microversion: 2.1 time: 0.091734 Jul 25 16:38:18.240235 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2634/5330] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:18 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:38:19.170948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:19.171795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:19.177646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:19.193870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:19.193870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:19.195251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:19.195885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:19.217701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:19.218862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:19.221192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:19.222059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:19.253479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:19.265655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:19.267263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:19.268517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:19.867781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:19.880333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:19.889685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:19.892972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:19.910318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e42056fe-83a9-4bf0-97c5-32dc29bc5126 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2394 microversion: 2.42 time: 0.695798 Jul 25 16:38:19.910997 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2635/5331] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:19 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2394 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:19.930315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38d643e3-72fd-4884-b39b-e3fc46397621 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 0.764375 Jul 25 16:38:19.939321 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2697/5332] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:19 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:20.945865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:20.947663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:20.959732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:20.960594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:20.962167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:20.963065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:20.963819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:20.964632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:20.988623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:20.989121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:20.989948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:20.990399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:21.743280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:21.792197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:21.800014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:21.809877 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b403dba-3020-43bb-8e7a-bcbf7056edf6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2394 microversion: 2.42 time: 0.871036 Jul 25 16:38:21.821597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2636/5333] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:20 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2394 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:21.993994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:22.008255 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fc5d93d2-3c79-431c-abd6-3302b98ec3cb tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 1.048234 Jul 25 16:38:22.010575 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2698/5334] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:20 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:22.770147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-46f479ae-265b-44b2-a4ba-3d59656b408e req-2d40f98c-60c5-41e2-9325-e05f6f0eccf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-deleted", "tag": "6afef70b-7f67-402e-8508-8cc2de9786ec"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:22.799827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-46f479ae-265b-44b2-a4ba-3d59656b408e req-2d40f98c-60c5-41e2-9325-e05f6f0eccf9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.806244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:22.807050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:22.816883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-46f479ae-265b-44b2-a4ba-3d59656b408e req-2d40f98c-60c5-41e2-9325-e05f6f0eccf9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.821968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:22.839242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.840762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.842286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.848437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.865666 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-46f479ae-265b-44b2-a4ba-3d59656b408e req-2d40f98c-60c5-41e2-9325-e05f6f0eccf9 service nova] Creating event network-vif-deleted:6afef70b-7f67-402e-8508-8cc2de9786ec for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:22.878964 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-46f479ae-265b-44b2-a4ba-3d59656b408e req-2d40f98c-60c5-41e2-9325-e05f6f0eccf9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115992 Jul 25 16:38:22.879585 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2637/5335] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:38:22.882948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.887182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 HTTP/1.1 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fb0ce776-bd19-43a7-8224-149a17f3aa99'} Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:22.890220 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.893606 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.896618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:22.898853 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67692b4f-80d6-436c-8fc6-e13c6fd4dcd0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 404 len: 111 microversion: 2.1 time: 0.096179 Jul 25 16:38:22.904025 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2699/5336] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:38:22 2022] DELETE /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:38:22.913927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:22.916308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: fb0ce776-bd19-43a7-8224-149a17f3aa99] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:22.920642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:22.932243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.933067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.937069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.937851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.942995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.943454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.944238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:22.944671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:22.969420 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 HTTP/1.1 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fb0ce776-bd19-43a7-8224-149a17f3aa99'} Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:22.975302 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. Jul 25 16:38:22.978811 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:22.990305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance fb0ce776-bd19-43a7-8224-149a17f3aa99 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:22.992327 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc7533e7-9ce0-4819-943f-7703065b9856 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99" status: 404 len: 111 microversion: 2.1 time: 0.083672 Jul 25 16:38:22.993181 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2700/5337] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:22 2022] GET /compute/v2.1/servers/fb0ce776-bd19-43a7-8224-149a17f3aa99 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:38:23.159467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:23.160988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:23.177007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:23.180399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:23.182028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:23.186742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:24.259190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:24.283313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:24.284873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:24.288348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:24.293080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-797f27be-6647-4bea-bb8c-3e34f6850d55 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 2057 microversion: 2.42 time: 1.410069 Jul 25 16:38:24.294418 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aa2f2615-9b9f-486f-8e56-0d85fcd721d6 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 1.137810 Jul 25 16:38:24.295146 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2638/5338] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:22 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 2057 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:24.306924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0c39c071-a7df-469b-9414-eabd5adb40e4 req-6a864687-e119-4073-9d3b-86f0443157cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb484db-0999-46e2-83f6-cde5cd796ecd", "name": "network-vif-plugged", "status": "completed", "tag": "8437627a-5003-4835-a642-c3f1fd6f923b"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:24.313893 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2701/5339] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:23 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:24.342410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0c39c071-a7df-469b-9414-eabd5adb40e4 req-6a864687-e119-4073-9d3b-86f0443157cc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:24.343291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0c39c071-a7df-469b-9414-eabd5adb40e4 req-6a864687-e119-4073-9d3b-86f0443157cc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:24.378281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0c39c071-a7df-469b-9414-eabd5adb40e4 req-6a864687-e119-4073-9d3b-86f0443157cc service nova] Creating event network-vif-plugged:8437627a-5003-4835-a642-c3f1fd6f923b for instance 8fb484db-0999-46e2-83f6-cde5cd796ecd on n-h1-846219-13 Jul 25 16:38:24.393908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0c39c071-a7df-469b-9414-eabd5adb40e4 req-6a864687-e119-4073-9d3b-86f0443157cc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096288 Jul 25 16:38:24.394898 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2639/5340] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:24.952926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:24.953698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:24.972221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:24.972828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:24.973766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:24.975857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.024991 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c HTTP/1.1 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '13effe71-08d1-4247-9629-26049806de8c'} Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:25.030973 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.034716 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.044014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:25.069957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c826821f-30f7-4630-9d39-91bf13f31b9a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 404 len: 111 microversion: 2.1 time: 0.098877 Jul 25 16:38:25.075098 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2702/5341] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:38:24 2022] DELETE /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:38:25.081827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:25.082472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 13effe71-08d1-4247-9629-26049806de8c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:25.096158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1c8bf2c9-dfb6-4c78-87d9-2531a7299054 req-2e11fd5b-dc78-4c4b-a714-b54109daede5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c78f7-ff6c-4810-be66-a3f323d53e64", "name": "network-vif-deleted", "tag": "413593f7-3566-422c-9be7-06ba68784b70"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:25.098901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.099355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.100132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.100630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.146667 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c HTTP/1.1 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '13effe71-08d1-4247-9629-26049806de8c'} Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:25.150334 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. Jul 25 16:38:25.155026 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:38:25.155496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1c8bf2c9-dfb6-4c78-87d9-2531a7299054 req-2e11fd5b-dc78-4c4b-a714-b54109daede5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.155496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1c8bf2c9-dfb6-4c78-87d9-2531a7299054 req-2e11fd5b-dc78-4c4b-a714-b54109daede5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.161773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 13effe71-08d1-4247-9629-26049806de8c could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:25.162788 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4bb8242-e21b-41aa-9b16-5206a62af8e9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c" status: 404 len: 111 microversion: 2.1 time: 0.086585 Jul 25 16:38:25.166616 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2640/5342] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:25 2022] GET /compute/v2.1/servers/13effe71-08d1-4247-9629-26049806de8c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:38:25.192213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1c8bf2c9-dfb6-4c78-87d9-2531a7299054 req-2e11fd5b-dc78-4c4b-a714-b54109daede5 service nova] Creating event network-vif-deleted:413593f7-3566-422c-9be7-06ba68784b70 for instance 039c78f7-ff6c-4810-be66-a3f323d53e64 on n-h1-846219-13 Jul 25 16:38:25.211971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1c8bf2c9-dfb6-4c78-87d9-2531a7299054 req-2e11fd5b-dc78-4c4b-a714-b54109daede5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130305 Jul 25 16:38:25.216366 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2703/5343] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:25.336761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:25.337409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:25.342537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:25.343271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:25.361730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.362193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.362977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.363405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.366641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.367097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.372117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:25.372588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:25.538075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:25.548574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:25.550146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:25.551398 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71672f77-142f-4f8e-994d-a02ef565fba1 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.219611 Jul 25 16:38:25.551982 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2704/5344] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:25 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:25.575150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a8fcfae-4f86-49ce-8aa2-ef21a5249a00 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: .version_select at 0x7f9d927bb310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-111214727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZ45e7Qs3SVkKZfly/GlPBI83Mtux4bPtd2H1AkiCX9AFBLSNVMflW4fLQL9u3RyyF4djEv3Ch0R0/hKoKEqZrr1Xk6rGupXb9g+1O+29WlzqkQDXu8jY72s1URI9QX5w=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:25.609360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0a8fcfae-4f86-49ce-8aa2-ef21a5249a00 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:38:25.622427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0a8fcfae-4f86-49ce-8aa2-ef21a5249a00 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:38:25.685301 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a8fcfae-4f86-49ce-8aa2-ef21a5249a00 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.124484 Jul 25 16:38:25.687093 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2705/5345] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:38:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:25.788897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:25.824445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43532a39-7edf-4146-ab59-c87d2cd4fe30 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1312 microversion: 2.1 time: 0.494000 Jul 25 16:38:25.825048 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2641/5346] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:25 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:26.593746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:26.597849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:26.628059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:26.638161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:26.639026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:26.639480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:26.678642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:26.853144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:26.853924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:26.868885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:26.879418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:26.880460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:26.899423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:26.967550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:26.979985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:27.002106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:27.003428 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b8d5b5b7-cb70-4595-a35b-d0d570a5be39 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.424156 Jul 25 16:38:27.017129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2706/5347] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:26 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:27.358898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:27.374495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-af84ec0c-cba7-4bb9-a242-aaee4739270b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1493 microversion: 2.1 time: 0.525724 Jul 25 16:38:27.375443 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2642/5348] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:26 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1493 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:27.402126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-642999094"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:27.406648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:27.416243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:27.417147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:27.422229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:27.424952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:27.621083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fdd58dea-b402-4359-92d7-e5ac21cc8e75 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "PUT /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1078 microversion: 2.1 time: 0.223018 Jul 25 16:38:27.622602 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2707/5349] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:38:27 2022] PUT /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1078 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:27.644743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:27.645840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:27.658870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:27.661547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:27.663199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:27.663969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:28.033175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:28.033992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:28.048548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:28.049065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:28.050002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:28.050375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:28.257052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:28.277083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:28.285422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:28.295984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:28.302366 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9350a85-d886-4e04-8338-31a173af71ea tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.274225 Jul 25 16:38:28.303177 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81c1b550-b04f-491f-988b-b6736c454c8a tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1504 microversion: 2.1 time: 0.662844 Jul 25 16:38:28.303811 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2643/5350] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:27 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1504 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:28.317589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2708/5351] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:28 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:28.331170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:28.333504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:28.357646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:28.358218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:28.359063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:28.359504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:29.333888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:29.336347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:29.378066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:29.387114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:29.390401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:29.397646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:29.683984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:29.694567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:29.708885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:29.710582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:29.715635 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-675e3f84-8b97-4269-ade9-669d4dcb4571 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.385137 Jul 25 16:38:29.718745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2709/5352] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:29 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:29.742240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4d73346b-8e48-4ac3-b0f1-f0daa245705c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1504 microversion: 2.1 time: 1.378916 Jul 25 16:38:29.742960 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2644/5353] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:28 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1504 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:29.768126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6a7a1ef4-d08e-4e9d-878f-ebcef4ef3aa2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:29.791793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a7a1ef4-d08e-4e9d-878f-ebcef4ef3aa2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:29.792762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a7a1ef4-d08e-4e9d-878f-ebcef4ef3aa2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:29.821390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6a7a1ef4-d08e-4e9d-878f-ebcef4ef3aa2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:38:29.911404 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6a7a1ef4-d08e-4e9d-878f-ebcef4ef3aa2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "POST /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd/action" status: 202 len: 0 microversion: 2.1 time: 0.144828 Jul 25 16:38:29.917080 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2710/5354] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:38:29 2022] POST /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:38:29.922140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:29.922979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:29.946410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:29.946781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:29.947364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:29.947955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:30.286416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:30.302396 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9462328f-7618-4eaf-9d81-2cab14661ab3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.379957 Jul 25 16:38:30.304034 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2645/5355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:29 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:30.752882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:30.754501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:30.780494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:30.783858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:30.787125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:30.787831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:30.985232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:31.005218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:31.009744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:31.013147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ce62d239-9f00-4895-9ce5-f4af40410e93 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.274802 Jul 25 16:38:31.031760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2711/5356] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:30 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:31.331983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:31.332647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:31.345055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:31.345563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:31.346314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:31.346726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:32.028827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:32.040288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:32.043611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:32.049832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:32.071976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d6dd43cf-68c6-4a39-a91d-28c096ee6ae3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.743464 Jul 25 16:38:32.073105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:32.075711 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2646/5357] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:31 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:32.084209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:32.095236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:32.096062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:32.649570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:32.696244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:32.733784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:32.743479 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5dbd7f1f-a2e4-4a59-ac06-934ad8ce7dd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.708360 Jul 25 16:38:32.749500 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2712/5358] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:32 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:33.099573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:33.101429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:33.116702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:33.117523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:33.119370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:33.128432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:33.652731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:33.674133 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7c0335a5-b220-449f-af8d-117864f3ce3d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.578741 Jul 25 16:38:33.674748 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2647/5359] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:33 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:33.774650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:33.775304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:33.788455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:33.789246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:33.790335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:33.790795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:33.932505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:33.946315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:33.948116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:33.950042 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6aefe96-6a56-4333-a433-587a0bec65a2 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.180179 Jul 25 16:38:33.964555 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2713/5360] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:33 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:34.721852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:34.722762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:34.738237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:34.738700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:34.741817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:34.745792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:34.976114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:34.977589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:34.992472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:34.992886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:34.993878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:34.996799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:35.110512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:35.127590 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e6e080d-c7d2-4640-bfb2-a4143d532bc2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.411817 Jul 25 16:38:35.148600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2648/5361] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:34 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:35.195303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:35.209345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:35.214402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:35.216461 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12df913c-844e-459a-b425-5168efd28a51 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.245875 Jul 25 16:38:35.231478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2714/5362] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:34 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:36.156473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:36.158476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:36.167429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:36.169172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:36.170283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:36.171056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:36.253000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:36.254515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:36.276412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:36.282637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:36.283676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:36.294772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:36.295727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:36.521795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:36.560601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:36.579562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:36.587674 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-020a0d7a-26dc-4c5b-a0d6-cca00384fd89 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.341235 Jul 25 16:38:36.593186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2715/5363] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:36 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:36.680976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:36.703314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-47bb1a9c-8544-4d9a-8ede-78d1c075d129 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.550315 Jul 25 16:38:36.706563 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2649/5364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:36 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:37.619247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:37.620684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:37.631257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:37.631935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:37.633339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:37.634291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:37.748023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:37.749207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:37.765324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:37.766133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:37.767120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:37.771736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:37.783085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:37.791570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:37.798825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:37.804712 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-616d5191-8879-4248-a42f-dc05b5f38f1c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.191990 Jul 25 16:38:37.805358 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2716/5365] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:37 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:38.009913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:38.020369 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-894b3115-9fa5-476e-8c13-16a0a4c39666 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.277351 Jul 25 16:38:38.023594 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2650/5366] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:37 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:38.832323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:38.832921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:38.848090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:38.850611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:38.859573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:38.860286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:39.008262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:39.023485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:39.027532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:39.033310 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-932a253a-67bf-4244-9e1b-1d3925ed8f53 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.203322 Jul 25 16:38:39.044118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:39.045367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:39.049559 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2717/5367] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:38 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:39.068201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:39.073980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:39.074799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:39.075233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:39.316700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:39.328637 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a39f333-3867-4bda-b080-abb783f643c2 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.287108 Jul 25 16:38:39.340761 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2651/5368] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:39 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:40.062213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:40.063098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:40.086153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:40.089705 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:40.093944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:40.094542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:40.272010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:40.291838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:40.294223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:40.295829 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1dd6e640-226e-4331-8e8c-7f7277108584 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.238138 Jul 25 16:38:40.297254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2718/5369] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:40 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:40.368205 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:40.369600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:40.380616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:40.381598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:40.383551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:40.384485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:40.784364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:40.823062 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33324522-4e21-42f7-af2b-8b729648e158 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.463114 Jul 25 16:38:40.824006 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2652/5370] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:40 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:41.325381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:41.326589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:41.366514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:41.368033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:41.371188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:41.372391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:41.538513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:41.558532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:41.560575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:41.561894 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab8b8483-9174-4773-ad1c-f77bceeeb2b6 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.245747 Jul 25 16:38:41.565179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2719/5371] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:41 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:41.846811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:41.848620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:41.872746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:41.873734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:41.876350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:41.878365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:42.191565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:42.233213 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-220d9e0c-452f-4896-a50e-a5d6f6237299 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.387465 Jul 25 16:38:42.247787 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2653/5372] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:41 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:42.589152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:42.590502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:42.600201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:42.605988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:42.607804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:42.613791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:42.792409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:42.818142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:42.819691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:42.833972 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-095b8b99-0be7-492d-a1ae-8737b9fe3410 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.248658 Jul 25 16:38:42.834650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2720/5373] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:42 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:43.257457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:43.258042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:43.275536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:43.285360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:43.286566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:43.289776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:43.765747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:43.774272 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6a5c7c0-7011-4f86-a1d0-c657e350ad2e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.521479 Jul 25 16:38:43.777834 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2654/5374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:43 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:43.857989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:43.859412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:43.871837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:43.872682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:43.877444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:43.878220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:43.937783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:44.050313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:44.071940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:44.076626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:44.080918 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fb3ca8f5-12e5-4e65-985e-495a24b056e5 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.227422 Jul 25 16:38:44.092136 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2721/5375] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:43 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:44.807957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:44.808566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:44.823218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:44.839019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:44.840323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:44.842454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:45.108310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:45.108855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:45.132479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:45.133981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:45.137002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:45.148093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:45.545444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:45.654110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:45.670618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:45.680651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7476064-8e60-45fc-a6bb-e8eb577c0e72 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.576200 Jul 25 16:38:45.694950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2722/5376] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:45 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:45.850952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:45.859959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f2cfb117-f984-4b4a-8cc4-15ac487424ac tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 1.055825 Jul 25 16:38:45.865752 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2655/5377] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:44 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:46.739758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:46.742811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:46.764009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:46.764560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:46.765412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:46.786732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:46.882601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:46.883285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:46.901001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:46.914368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:46.922873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:46.923677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:47.158663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:47.186225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:47.187887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:47.189897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fdacce15-4a2d-4b46-ba8b-cf682905346f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.454498 Jul 25 16:38:47.192666 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2723/5378] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:46 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:47.406669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:47.416146 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ecac018d-4c54-47ba-9ed7-8b7541e05886 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.538017 Jul 25 16:38:47.422586 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2656/5379] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:46 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:48.216153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:48.216759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:48.233130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:48.233583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:48.234808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:48.235258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:48.444743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:48.445932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:48.459462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=48 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:48.462491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:48.463309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:48.464397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:48.465523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:48.513051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:48.524966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:48.543608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:48.551025 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4463f2d-0451-42e6-bd85-01b090b02170 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.338889 Jul 25 16:38:48.551972 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2724/5380] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:48 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:49.186156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:49.206660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c534c7b4-6c83-49cb-bb30-db5420d17751 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.767598 Jul 25 16:38:49.209285 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2657/5381] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:48 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:49.578930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:49.579732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:49.600039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:49.600661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:49.605157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:49.605157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:49.799409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:49.817214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:49.819899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:49.826449 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36b49e5f-be8b-400e-9cbe-cbf3bc9e333f tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.252042 Jul 25 16:38:49.827487 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2725/5382] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:49 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:50.237260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:50.238669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:50.246786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:50.247609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:50.248575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:50.249223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:50.799547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:50.816531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d039e078-fc39-48ae-849d-0c5da1e9b93e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.590691 Jul 25 16:38:50.817531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2658/5383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:50 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:50.855184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:50.857732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:50.885186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:50.886321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:50.887402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:50.895362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:51.283249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:51.313692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:51.325086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:51.326966 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8503a5d6-3dad-4bcc-9c34-9ad1f2058887 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1607 microversion: 2.42 time: 0.479552 Jul 25 16:38:51.332459 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2726/5384] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:50 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1607 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:38:51.847441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:51.848266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:51.860786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:51.861327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:51.862191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:51.862643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:52.367521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:52.368179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:52.392880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:52.396223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:52.399925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:52.401238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:52.526042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:52.526905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:52.527809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lazy-loading 'fault' on Instance uuid 039c78f7-ff6c-4810-be66-a3f323d53e64 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:38:52.593576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:52.604142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-89d8d588-dbaa-4404-bfe6-5eda8b0bf27e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.760942 Jul 25 16:38:52.618727 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2659/5385] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:51 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:52.640425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:52.661343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:52.662885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f098d5d34404aa2907984bfe29910b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee5a12aa133d430189c82b17ade9ad92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:52.664128 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71c6ce09-0212-4de9-8789-c0422954cd4a tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 200 len: 1374 microversion: 2.42 time: 0.302093 Jul 25 16:38:52.664724 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2727/5386] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:52 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 1374 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:38:53.630859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:53.632233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:53.652390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:53.654284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:53.656678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:53.657945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:53.690571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:53.691223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:53.706455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:53.713513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:53.714403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:53.715725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:53.716382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:53.735107 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] HTTP exception thrown: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Request method failure captured: Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 HTTP/1.1 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVYnvyYR8CtJktHEDIzGOyL7xLEmhYi5fi5IWpr4PpbwnDG8VZNkVuNG2OT-O7ZvPHIR3OOe2jyw-_M1WjrwO-gDVFetH5XmYN0Iii1RNsBIvVYKsjkApO7jPGULDeCQqo1PcjFM6uCTkE2f8MK3dTZgcn9pPZUuEZiVApv0qPaoAY Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: ee5a12aa133d430189c82b17ade9ad92 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ee5a12aa133d430189c82b17ade9ad92"}]}] Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: ee5a12aa133d430189c82b17ade9ad92 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TaggedBootDevicesTest_v242-1818090392-project Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2f098d5d34404aa2907984bfe29910b8 Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1818090392-project Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '039c78f7-ff6c-4810-be66-a3f323d53e64'} Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:53.737171 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:38:53.741956 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:38:53.743503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Returning 404 to user: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:53.744660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-532857a5-f266-4fd1-a9c5-3d1c8864a64c tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 404 len: 111 microversion: 2.42 time: 0.060293 Jul 25 16:38:53.745836 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2728/5387] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:38:53 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:38:53.757221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-16dcd82f-04a8-4d0b-b632-df5ba5a4bf3b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '.version_select at 0x7f9d9023d790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:53.804484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-16dcd82f-04a8-4d0b-b632-df5ba5a4bf3b tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-167499711" status: 204 len: 0 microversion: 2.42 time: 0.051107 Jul 25 16:38:53.805774 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2729/5388] 10.222.0.105 () {60 vars in 1264 bytes} [Mon Jul 25 16:38:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-167499711 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:38:54.019704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:54.029209 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fecee58c-cd03-4400-9869-1d5b06fc8262 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.404039 Jul 25 16:38:54.030965 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2660/5389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:53 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:55.050268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:55.051537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:55.064167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:55.077912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:55.078786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:55.079409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:55.689904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:55.700642 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4481f75-6952-4ac3-94dd-822a4f0de3bf tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.653428 Jul 25 16:38:55.706512 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2730/5390] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:55 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:56.724412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:56.726393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:56.745284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:56.746706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:56.747839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:56.748775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:57.161150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:57.171871 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-989ad1ce-dff7-4937-aa7c-968a1fdde5f8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.451587 Jul 25 16:38:57.174066 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2661/5391] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:56 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:58.198768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:58.199424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:58.211261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:58.215576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:58.216883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:58.217851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:58.577426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:58.586416 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df3196a6-6edb-4e05-813f-11b31b8708ea tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.394113 Jul 25 16:38:58.587019 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2731/5392] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:58 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:59.610002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:59.611617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:59.634544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:59.635557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:59.638119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:59.640126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:59.991631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:00.001358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08f6e697-cb53-4f89-b62f-8cfad8dea6cc tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1514 microversion: 2.1 time: 0.397152 Jul 25 16:39:00.007669 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2662/5393] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:38:59 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:00.719748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:00.720332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:00.740870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:00.742270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:00.743587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:00.745392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:00.788596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] HTTP exception thrown: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Request method failure captured: Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 HTTP/1.1 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVYnvyYR8CtJktHEDIzGOyL7xLEmhYi5fi5IWpr4PpbwnDG8VZNkVuNG2OT-O7ZvPHIR3OOe2jyw-_M1WjrwO-gDVFetH5XmYN0Iii1RNsBIvVYKsjkApO7jPGULDeCQqo1PcjFM6uCTkE2f8MK3dTZgcn9pPZUuEZiVApv0qPaoAY Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: ee5a12aa133d430189c82b17ade9ad92 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ee5a12aa133d430189c82b17ade9ad92"}]}] Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: ee5a12aa133d430189c82b17ade9ad92 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TaggedBootDevicesTest_v242-1818090392-project Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2f098d5d34404aa2907984bfe29910b8 Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1818090392-project Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '039c78f7-ff6c-4810-be66-a3f323d53e64'} Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:00.794947 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Returning 404 to user: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:00.798814 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57b28c62-9882-4a8f-8f4a-e74a9c67fdd0 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "DELETE /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 404 len: 111 microversion: 2.42 time: 0.092982 Jul 25 16:39:00.807089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:00.807700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] [instance: 039c78f7-ff6c-4810-be66-a3f323d53e64] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:00.817651 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2732/5394] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:39:00 2022] DELETE /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:39:00.829159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:00.829717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:00.830967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:00.831608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:00.880914 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] HTTP exception thrown: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Request method failure captured: Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 HTTP/1.1 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVYnvyYR8CtJktHEDIzGOyL7xLEmhYi5fi5IWpr4PpbwnDG8VZNkVuNG2OT-O7ZvPHIR3OOe2jyw-_M1WjrwO-gDVFetH5XmYN0Iii1RNsBIvVYKsjkApO7jPGULDeCQqo1PcjFM6uCTkE2f8MK3dTZgcn9pPZUuEZiVApv0qPaoAY Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: ee5a12aa133d430189c82b17ade9ad92 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/ee5a12aa133d430189c82b17ade9ad92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_ee5a12aa133d430189c82b17ade9ad92"}]}] Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: ee5a12aa133d430189c82b17ade9ad92 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1818090392 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TaggedBootDevicesTest_v242-1818090392-project Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 2f098d5d34404aa2907984bfe29910b8 Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1818090392-project Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '039c78f7-ff6c-4810-be66-a3f323d53e64'} Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.888976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] Returning 404 to user: Instance 039c78f7-ff6c-4810-be66-a3f323d53e64 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:00.893606 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4eb0f842-dbd6-4ae8-9f76-f68178023330 tempest-TaggedBootDevicesTest_v242-1818090392 tempest-TaggedBootDevicesTest_v242-1818090392-project] 10.222.0.105 "GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64" status: 404 len: 111 microversion: 2.42 time: 0.087502 Jul 25 16:39:00.896073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2663/5395] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:39:00 2022] GET /compute/v2.1/servers/039c78f7-ff6c-4810-be66-a3f323d53e64 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:39:01.029530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:01.030302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:01.040864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.044356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.048790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.052062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.398629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:01.407895 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7aa8e52e-2de9-4bda-b4aa-fc7b0cde5264 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1491 microversion: 2.1 time: 0.384763 Jul 25 16:39:01.428847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2733/5396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:01 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1491 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:01.440042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-453327424"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:01.443698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:01.452724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.453723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.454825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.455452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.461049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:01.625862 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b617e23-c207-4332-9841-2bb6150ba8fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "PUT /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1064 microversion: 2.1 time: 0.191955 Jul 25 16:39:01.629787 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2664/5397] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:39:01 2022] PUT /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1064 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:01.650733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:01.651613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:01.662672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.669491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.671926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.672628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.344422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:02.366133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b47cbfb1-7c30-4fa4-a3fa-40ba6de35168 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1491 microversion: 2.1 time: 0.718833 Jul 25 16:39:02.366342 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2734/5398] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:01 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1491 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:02.394364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:02.395932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:02.419766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.420607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.421967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.422615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.700821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:02.716911 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-918e5bb7-6ba7-48a5-af24-4445dd3387e3 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1491 microversion: 2.1 time: 0.328349 Jul 25 16:39:02.742122 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2665/5399] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:02 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1491 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:02.761535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:02.762851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:02.784049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.785963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.787190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.788229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.849970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:39:03.051948 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-252cf46c-a583-48e3-95ed-8146b908d90d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 204 len: 0 microversion: 2.1 time: 0.310409 Jul 25 16:39:03.053308 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2735/5400] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:02 2022] DELETE /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:39:03.065455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:03.066637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:03.102231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.106125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.107702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.108785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.390307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:03.400170 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9849a4b6-fda1-4a7a-8a52-71956bfa9094 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1497 microversion: 2.1 time: 0.340548 Jul 25 16:39:03.401605 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2666/5401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:03 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1497 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:04.424847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:04.426991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:04.437006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:04.437647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:04.438548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:04.439143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:04.911605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:04.932475 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bdef0969-b261-4596-964a-52e0a1a16912 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1497 microversion: 2.1 time: 0.510241 Jul 25 16:39:04.933370 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2736/5402] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:04 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1497 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:05.396454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1670945652", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-111214727", "security_groups": [{"name": "tempest-secgroup-smoke-1809880973"}], "block_device_mapping_v2": [{"uuid": "fbd9c11e-7649-45e5-abed-97fcd1feac99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:05.811500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:39:05.956211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:05.958453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:05.968408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:05.977608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:05.978956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:05.982263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:06.340903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:06.350824 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de88e9e8-5083-4cba-8043-42f8097b4817 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1455 microversion: 2.1 time: 0.399780 Jul 25 16:39:06.356533 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2737/5403] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:05 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1455 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:39:07.011728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-0346ef7c-a1e4-45a6-b4ee-d17bf4f849a2 req-1eda4239-34f9-43a7-9cd7-d48eb5a80f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb484db-0999-46e2-83f6-cde5cd796ecd", "name": "network-vif-deleted", "tag": "8437627a-5003-4835-a642-c3f1fd6f923b"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:07.039827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0346ef7c-a1e4-45a6-b4ee-d17bf4f849a2 req-1eda4239-34f9-43a7-9cd7-d48eb5a80f11 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.040562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-0346ef7c-a1e4-45a6-b4ee-d17bf4f849a2 req-1eda4239-34f9-43a7-9cd7-d48eb5a80f11 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.071116 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-0346ef7c-a1e4-45a6-b4ee-d17bf4f849a2 req-1eda4239-34f9-43a7-9cd7-d48eb5a80f11 service nova] Creating event network-vif-deleted:8437627a-5003-4835-a642-c3f1fd6f923b for instance 8fb484db-0999-46e2-83f6-cde5cd796ecd on n-h1-846219-13 Jul 25 16:39:07.083601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-0346ef7c-a1e4-45a6-b4ee-d17bf4f849a2 req-1eda4239-34f9-43a7-9cd7-d48eb5a80f11 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474666 Jul 25 16:39:07.090004 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2738/5404] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:39:07.382951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:07.383925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:07.399234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.400230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.403862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.404662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.463014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:07.490113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.493358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.494809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lazy-loading 'fault' on Instance uuid 8fb484db-0999-46e2-83f6-cde5cd796ecd {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:39:07.499764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:39:07.500818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:39:07.501723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:39:07.502369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:39:07.502965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:39:07.549507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.554858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.558944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.562425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.672111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:39:07.683183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:39:07.906408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:39:07.908878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbd9c11e-7649-45e5-abed-97fcd1feac99',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:39:08.213505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:08.234923 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8db022af-68d9-458f-92e9-4f7a0edcdc35 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 200 len: 1313 microversion: 2.1 time: 0.857285 Jul 25 16:39:08.242228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2739/5405] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:07 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:39:08.626314 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9d11f97-6f03-4cbe-8032-2b336689de46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.233912 Jul 25 16:39:08.633517 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2667/5406] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:39:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 3242 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:39:08.646932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-377faf58-fa8f-4052-9cab-e62bb77b7a36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:08.647660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-377faf58-fa8f-4052-9cab-e62bb77b7a36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:08.797589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-377faf58-fa8f-4052-9cab-e62bb77b7a36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:08.805742 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-377faf58-fa8f-4052-9cab-e62bb77b7a36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1097 microversion: 2.1 time: 0.163506 Jul 25 16:39:08.809999 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2740/5407] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:08 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1097 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:09.263956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.264736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.280653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.281046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.281869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.282301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.374706 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd HTTP/1.1 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '8fb484db-0999-46e2-83f6-cde5cd796ecd'} Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.385498 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.392146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.392146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.392146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:09.392146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:09.392146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.392146 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.396093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:09.397282 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-729ea6aa-503c-4f93-ba11-2e1a13b66dfa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 404 len: 111 microversion: 2.1 time: 0.137825 Jul 25 16:39:09.399769 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2668/5408] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:09 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:09.418502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.419222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.448182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.453000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.453999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.454533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.523210 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd HTTP/1.1 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8fb484db-0999-46e2-83f6-cde5cd796ecd'} Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:09.529879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:09.534170 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31a3f960-70f4-4c45-a6dc-e267220a331f tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 404 len: 111 microversion: 2.1 time: 0.121006 Jul 25 16:39:09.537627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2741/5409] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:09 2022] DELETE /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:09.543963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.544592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8fb484db-0999-46e2-83f6-cde5cd796ecd] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.561898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.562358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.574820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.575406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.621916 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd HTTP/1.1 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '8fb484db-0999-46e2-83f6-cde5cd796ecd'} Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.623681 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 8fb484db-0999-46e2-83f6-cde5cd796ecd could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e550f1c7-c312-4396-914b-771dd2109f8c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd" status: 404 len: 111 microversion: 2.1 time: 0.085907 Jul 25 16:39:09.628175 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2669/5410] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:09 2022] GET /compute/v2.1/servers/8fb484db-0999-46e2-83f6-cde5cd796ecd => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:39:09.636349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.637385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.646445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.647096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.648237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.648858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.667213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e HTTP/1.1 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b949b311-45ce-41e2-a113-086f4317f49e'} Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:09.669352 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.674126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.675575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:09.676659 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2b59e04-1257-4d20-87f9-ee4c87f82a23 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 404 len: 111 microversion: 2.1 time: 0.046438 Jul 25 16:39:09.677752 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2742/5411] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:09 2022] DELETE /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:09.686608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.687629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: b949b311-45ce-41e2-a113-086f4317f49e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.699990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.706463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.707737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.708496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.753277 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e HTTP/1.1 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b949b311-45ce-41e2-a113-086f4317f49e'} Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.762183 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.766326 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.766326 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.766326 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:09.766326 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:09.766326 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. Jul 25 16:39:09.766326 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.770590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance b949b311-45ce-41e2-a113-086f4317f49e could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:09.771854 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-941af9a1-4095-4ce2-a4bf-9db7148fcc0b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e" status: 404 len: 111 microversion: 2.1 time: 0.090110 Jul 25 16:39:09.775081 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2670/5412] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:09 2022] GET /compute/v2.1/servers/b949b311-45ce-41e2-a113-086f4317f49e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:09.784995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.785697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.832767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.833709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.834797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.837349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.838075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.838463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.850018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.853435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.858661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.859533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.894534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 HTTP/1.1 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8508134d-5f56-430b-8edb-f60cc86979a6'} Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:09.904223 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:09.912532 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:09.918642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:09.919915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc565dec-bc4c-428e-b4bd-377639d02a0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 404 len: 111 microversion: 2.1 time: 0.140414 Jul 25 16:39:09.921116 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2743/5413] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:09 2022] DELETE /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:09.934147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:09.935596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 8508134d-5f56-430b-8edb-f60cc86979a6] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:09.950076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.953952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.956197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:09.959135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:09.998669 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 HTTP/1.1 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8508134d-5f56-430b-8edb-f60cc86979a6'} Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.028845 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.035733 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.035733 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.035733 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.035733 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.035733 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. Jul 25 16:39:10.035733 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.053761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 8508134d-5f56-430b-8edb-f60cc86979a6 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.055068 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b772961e-7886-4e9a-9702-bcc4f0ed5f0d tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6" status: 404 len: 111 microversion: 2.1 time: 0.129197 Jul 25 16:39:10.055940 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2744/5414] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:09 2022] GET /compute/v2.1/servers/8508134d-5f56-430b-8edb-f60cc86979a6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.080973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:10.096272 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53175649-e81b-45c4-8599-95cb3ea68eb2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1147 microversion: 2.1 time: 0.263599 Jul 25 16:39:10.100547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.101356 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2671/5415] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:09 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1147 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:10.105635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.124534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.134819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.135916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.136494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.187199 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d HTTP/1.1 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '43ac4660-7f69-4d6d-bdcf-e354b7187d9d'} Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.197268 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ad5b104-73a2-4db1-9f05-f9d8cecb28ff tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 404 len: 111 microversion: 2.1 time: 0.125688 Jul 25 16:39:10.202810 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2745/5416] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:10 2022] DELETE /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:39:10.211346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.212396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 43ac4660-7f69-4d6d-bdcf-e354b7187d9d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.256410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.268919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.275551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.285524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.333150 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d HTTP/1.1 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '43ac4660-7f69-4d6d-bdcf-e354b7187d9d'} Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.350907 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.355100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 43ac4660-7f69-4d6d-bdcf-e354b7187d9d could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.355550 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-366f7e58-0ab7-467a-94cd-a45fcebf3dc7 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d" status: 404 len: 111 microversion: 2.1 time: 0.149070 Jul 25 16:39:10.359739 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2672/5417] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:10 2022] GET /compute/v2.1/servers/43ac4660-7f69-4d6d-bdcf-e354b7187d9d => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.374021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.376277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.401344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.408893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.412149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.412889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.447252 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 HTTP/1.1 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '270fa225-551f-4c08-898c-38c61b255dd1'} Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.452879 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.456858 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-009f8f01-6cda-4d00-b207-459728b9de17 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 404 len: 111 microversion: 2.1 time: 0.093057 Jul 25 16:39:10.467462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.468250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 270fa225-551f-4c08-898c-38c61b255dd1] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.473677 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2746/5418] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:10 2022] DELETE /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.480345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.480793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.481616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.482365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.498228 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 HTTP/1.1 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '270fa225-551f-4c08-898c-38c61b255dd1'} Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.499887 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 270fa225-551f-4c08-898c-38c61b255dd1 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.504291 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91957026-267c-4c4e-8090-79d119f58b9b tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1" status: 404 len: 111 microversion: 2.1 time: 0.039578 Jul 25 16:39:10.510184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.510735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.513893 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2673/5419] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:10 2022] GET /compute/v2.1/servers/270fa225-551f-4c08-898c-38c61b255dd1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.526631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.527099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.528221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.528673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.562924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e HTTP/1.1 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '3c353791-3deb-4553-a794-649ac75c822e'} Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.564610 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.569126 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59bdcd4c-0beb-4904-826a-37fcbaad43fa tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 404 len: 111 microversion: 2.1 time: 0.060018 Jul 25 16:39:10.575147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.575762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 3c353791-3deb-4553-a794-649ac75c822e] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.592941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.593512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.594267 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2747/5420] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:10 2022] DELETE /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.594671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.595144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.626828 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e HTTP/1.1 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '3c353791-3deb-4553-a794-649ac75c822e'} Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.628324 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 3c353791-3deb-4553-a794-649ac75c822e could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.633052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c4822846-c8b9-46fa-8332-5fe7d66b2724 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e" status: 404 len: 111 microversion: 2.1 time: 0.058938 Jul 25 16:39:10.638681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df73feb2-57ee-4b7d-83de-a5a41ba4b691 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.639192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df73feb2-57ee-4b7d-83de-a5a41ba4b691 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.652845 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-df73feb2-57ee-4b7d-83de-a5a41ba4b691 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df73feb2-57ee-4b7d-83de-a5a41ba4b691 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf HTTP/1.1 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'de444616-4bc5-45fa-8c74-a43fa6bcf7cf'} Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.655007 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df73feb2-57ee-4b7d-83de-a5a41ba4b691 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.659549 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df73feb2-57ee-4b7d-83de-a5a41ba4b691 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf" status: 404 len: 111 microversion: 2.1 time: 0.021927 Jul 25 16:39:10.660088 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2674/5421] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:10 2022] GET /compute/v2.1/servers/3c353791-3deb-4553-a794-649ac75c822e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.669135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30e29971-f54f-435a-977b-e7b943d26ec8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.670136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30e29971-f54f-435a-977b-e7b943d26ec8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: de444616-4bc5-45fa-8c74-a43fa6bcf7cf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.672557 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2748/5422] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:10 2022] DELETE /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:39:10.678731 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-30e29971-f54f-435a-977b-e7b943d26ec8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30e29971-f54f-435a-977b-e7b943d26ec8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf HTTP/1.1 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'de444616-4bc5-45fa-8c74-a43fa6bcf7cf'} Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:10.680331 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30e29971-f54f-435a-977b-e7b943d26ec8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance de444616-4bc5-45fa-8c74-a43fa6bcf7cf could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:10.685464 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30e29971-f54f-435a-977b-e7b943d26ec8 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf" status: 404 len: 111 microversion: 2.1 time: 0.016632 Jul 25 16:39:10.690389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.690924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.713818 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2675/5423] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:10 2022] GET /compute/v2.1/servers/de444616-4bc5-45fa-8c74-a43fa6bcf7cf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:10.727894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.728439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.729392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.729850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.781481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:39:11.071076 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff10627c-f120-4608-ba7b-d34459d4bb68 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "DELETE /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 204 len: 0 microversion: 2.1 time: 0.384172 Jul 25 16:39:11.074929 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2749/5424] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:39:10 2022] DELETE /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:39:11.080655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:11.081737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:11.090533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:11.091374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:11.092411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:11.093081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:11.127971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:11.129187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:11.145745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:11.150037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:11.151333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:11.155616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:11.510745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:11.533975 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f1715f7-56c9-4a44-8e8f-34ac183ba358 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1203 microversion: 2.1 time: 0.414830 Jul 25 16:39:11.535013 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2750/5425] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:11 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1203 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:11.795144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:11.810880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d09a5703-525a-4155-acf2-35b2027f7eca tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1485 microversion: 2.1 time: 0.734169 Jul 25 16:39:11.814089 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2676/5426] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:11 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1485 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:12.555615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:12.556253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:12.573598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:12.583890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:12.584804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:12.589849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:12.850695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:12.853034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:12.877980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:12.879957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:12.881809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:12.884428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:13.086963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:13.102689 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f52871a-2ee0-447a-b9fb-752b196708e8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1213 microversion: 2.1 time: 0.545922 Jul 25 16:39:13.103845 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2751/5427] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:12 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1213 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:13.865654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:13.906447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-243eb9f8-71b9-4db1-a56c-a92705224e78 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1485 microversion: 2.1 time: 1.061709 Jul 25 16:39:13.910700 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2677/5428] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:12 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1485 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:14.134970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:14.135712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:14.182626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:14.193888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:14.200453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:14.209969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:14.504849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:14.513915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8e45089-b734-4dbf-a417-f7253523eb19 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1213 microversion: 2.1 time: 0.384084 Jul 25 16:39:14.531179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2752/5429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:14 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1213 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:14.946450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:14.949216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:14.981853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:14.983959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:14.986161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:14.986759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:15.538537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:15.539774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:15.557128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:15.557990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:15.560225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:15.566073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:16.015825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:16.024237 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea4f49a7-1743-483c-8dd6-89c0831eaf4c tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1485 microversion: 2.1 time: 1.091946 Jul 25 16:39:16.053506 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2678/5430] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:14 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1485 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:16.560448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:16.569585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b6636fd-be25-493b-8d8a-b717d912442f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1281 microversion: 2.1 time: 1.035622 Jul 25 16:39:16.596370 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2753/5431] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:15 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1281 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:39:16.605067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f02acd98-0441-45bd-a9ea-d9ba8b95841e req-808fcc11-4b38-47d1-9cbf-5fd6af075d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c149a3-992e-4f91-88b3-fe2921c835ec", "name": "network-vif-deleted", "tag": "c23ec48f-7d61-408c-9be4-75c9ee474253"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:16.629201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f02acd98-0441-45bd-a9ea-d9ba8b95841e req-808fcc11-4b38-47d1-9cbf-5fd6af075d00 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:16.629641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f02acd98-0441-45bd-a9ea-d9ba8b95841e req-808fcc11-4b38-47d1-9cbf-5fd6af075d00 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:16.683269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f02acd98-0441-45bd-a9ea-d9ba8b95841e req-808fcc11-4b38-47d1-9cbf-5fd6af075d00 service nova] Creating event network-vif-deleted:c23ec48f-7d61-408c-9be4-75c9ee474253 for instance 56c149a3-992e-4f91-88b3-fe2921c835ec on n-h2-846219-13 Jul 25 16:39:16.708956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f02acd98-0441-45bd-a9ea-d9ba8b95841e req-808fcc11-4b38-47d1-9cbf-5fd6af075d00 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108136 Jul 25 16:39:16.710143 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2679/5432] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:17.049141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:17.054499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:17.086465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.087644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.092126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.104449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.235693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.237465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.238034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lazy-loading 'fault' on Instance uuid 56c149a3-992e-4f91-88b3-fe2921c835ec {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:39:17.360912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bdc9f2fc6394e49995b1be6ff9c4915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826be553824b46c8bd1e43084477d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:17.369270 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7516908f-c749-4ddc-a19a-6a0449031b0e tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 200 len: 1287 microversion: 2.1 time: 0.324492 Jul 25 16:39:17.379334 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2754/5433] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:17 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 1287 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:17.602760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:17.604119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:17.623135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:17.629003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.629837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.638087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.644743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.720990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:18.135067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:18.154234 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7b376d69-0eca-4567-bd34-a7015d246d36 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1281 microversion: 2.1 time: 0.556691 Jul 25 16:39:18.174727 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2680/5434] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:17 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1281 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:18.402054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:18.403401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] [instance: 56c149a3-992e-4f91-88b3-fe2921c835ec] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:18.439155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:18.439885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:18.440967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:18.441772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:18.503271 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] HTTP exception thrown: Instance 56c149a3-992e-4f91-88b3-fe2921c835ec could not be found. Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Request method failure captured: Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec HTTP/1.1 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sYrOkxs4nnfgKfgU3xyp4PH8LI-X9NsjOoMS9xker54kSsUvSWIjFFLXVIByIUUnIlcPmSsAHL32diY7p1T_8p5kYEast3SR4nJ1P7MFDRmRXiyuPZU-QQ7RfX8YNoMrhbqZ9xZTuh_rOrp3DtBEyjT5--3L2fdQLk4UmDeOAANJlw Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/826be553824b46c8bd1e43084477d4f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_826be553824b46c8bd1e43084477d4f7"}]}] Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersTestJSON-778877844 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 826be553824b46c8bd1e43084477d4f7 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersTestJSON-778877844 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersTestJSON-778877844-project Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 9bdc9f2fc6394e49995b1be6ff9c4915 Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersTestJSON-778877844-project Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 56c149a3-992e-4f91-88b3-fe2921c835ec could not be found. Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '56c149a3-992e-4f91-88b3-fe2921c835ec'} Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c149a3-992e-4f91-88b3-fe2921c835ec could not be found. Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c149a3-992e-4f91-88b3-fe2921c835ec could not be found. Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:18.510355 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:18.514409 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:18.514409 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:18.514409 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:18.514409 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:18.514409 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c149a3-992e-4f91-88b3-fe2921c835ec could not be found. Jul 25 16:39:18.514409 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:39:18.526329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] Returning 404 to user: Instance 56c149a3-992e-4f91-88b3-fe2921c835ec could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:18.529132 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4dd9c14-35b8-4112-a606-61db49f4c961 tempest-ServersTestJSON-778877844 tempest-ServersTestJSON-778877844-project] 10.222.0.105 "GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec" status: 404 len: 111 microversion: 2.1 time: 0.132319 Jul 25 16:39:18.533440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2755/5435] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:18 2022] GET /compute/v2.1/servers/56c149a3-992e-4f91-88b3-fe2921c835ec => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:39:18.868970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-baf5b443-8018-4214-a9f4-360f1e87b420 req-9db9819e-fa6e-4ecf-bd69-0d51d9f342e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833fb3c7-7565-4610-8927-bfac1c9fc60b", "tag": "4319dbaa-01c6-4f4d-952f-0fb070fed2f9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:18.885698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:18.902824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-baf5b443-8018-4214-a9f4-360f1e87b420 req-9db9819e-fa6e-4ecf-bd69-0d51d9f342e9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:18.905720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-baf5b443-8018-4214-a9f4-360f1e87b420 req-9db9819e-fa6e-4ecf-bd69-0d51d9f342e9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:18.962291 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-baf5b443-8018-4214-a9f4-360f1e87b420 req-9db9819e-fa6e-4ecf-bd69-0d51d9f342e9 service nova] Creating event network-changed:4319dbaa-01c6-4f4d-952f-0fb070fed2f9 for instance 833fb3c7-7565-4610-8927-bfac1c9fc60b on n-h1-846219-13 Jul 25 16:39:18.983384 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-baf5b443-8018-4214-a9f4-360f1e87b420 req-9db9819e-fa6e-4ecf-bd69-0d51d9f342e9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116542 Jul 25 16:39:18.987977 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2681/5436] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:19.183310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:19.184258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:19.188151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:19.206871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:19.207782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:19.208810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:19.209561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:20.344544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:20.372075 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de1a7eed-3b8a-47a7-ab46-f2ebec06cf8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1281 microversion: 2.1 time: 1.195429 Jul 25 16:39:20.388761 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2756/5437] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:19 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1281 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:21.406955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:21.407872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:21.425629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:21.439889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:21.441299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:21.450394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:23.890318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:23.931412 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-853e8627-6f4d-4e6e-a46d-b3e4a2599e30 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1281 microversion: 2.1 time: 2.529007 Jul 25 16:39:23.936760 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2682/5438] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:21 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1281 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:24.144645 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:39:24.145285 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 16:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:39:24.958367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:24.959780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:24.978168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:24.984619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:24.985120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:24.986229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:24.986435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:25.545061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:25.561940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a32fdfbc-9e48-49ed-9072-21fb3d70d174 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1281 microversion: 2.1 time: 0.605830 Jul 25 16:39:25.577803 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2757/5439] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:24 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1281 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:26.585156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:26.585908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:26.623606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:26.623969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:26.625267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:26.625881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:27.653427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:27.675329 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-29347465-760d-4b51-a6b2-aa53011f9fec tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1281 microversion: 2.1 time: 1.090968 Jul 25 16:39:27.679267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2683/5440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:26 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1281 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:28.700176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:28.700814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:28.723148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:28.723627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:28.724434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:28.724890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:29.180636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:29.199947 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f932d1ca-0478-4554-870e-a4c328c6881c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.504623 Jul 25 16:39:29.216624 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2758/5441] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:28 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:30.228212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:30.228854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:30.240485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:30.241350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:30.242346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:30.243187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:30.532123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:30.550056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-93cb0e31-4db8-447b-9a77-027bde90c932 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.326765 Jul 25 16:39:30.551386 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2684/5442] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:30 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:31.573476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:31.574044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:31.595446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:31.595938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:31.599051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:31.599553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:31.922224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:31.940093 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c329609-d274-44b4-8c8e-76efe065ff46 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.367837 Jul 25 16:39:31.957452 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2759/5443] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:31 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:32.967520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:32.969038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:32.996728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:32.999775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:33.004203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:33.006334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:33.045470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:33.835217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:33.866352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-54c0960f-bb48-49ee-ab11-103c08f96d9e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.903475 Jul 25 16:39:33.868442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2685/5444] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:32 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:34.896712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:34.900540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:34.913549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:34.914040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:34.914855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:34.920713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:35.388899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:35.396930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:35.403380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d334f5bf-e936-4fb7-8351-34ef65c1294a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.510431 Jul 25 16:39:35.404022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2760/5445] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:34 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:36.427772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:36.428383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:36.442028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:36.447116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:36.448166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:36.448770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:37.572682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:37.614776 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd0da413-97c7-4135-8368-871f890016be tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 1.189778 Jul 25 16:39:37.617051 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2686/5446] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:36 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:38.636584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:38.637264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:38.660200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:38.660683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:38.661713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:38.673191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:39.193952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:39.202574 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ae4f8892-c9ee-4b62-86ba-a40a9d327742 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.570012 Jul 25 16:39:39.203185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2761/5447] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:38 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:40.227488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:40.228394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:40.239847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:40.244871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:40.245899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:40.246484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:41.081488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:41.089647 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5cbaefee-db7d-4099-803a-bfd6ff34e216 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.865972 Jul 25 16:39:41.091120 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2687/5448] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:40 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:41.881735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5d3855e6-2824-47c0-b95e-7f6f7d4e9329 req-ac241b0f-c9ef-4492-ab59-614bc49c8e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833fb3c7-7565-4610-8927-bfac1c9fc60b", "name": "network-vif-plugged", "status": "completed", "tag": "4319dbaa-01c6-4f4d-952f-0fb070fed2f9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:41.907496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5d3855e6-2824-47c0-b95e-7f6f7d4e9329 req-ac241b0f-c9ef-4492-ab59-614bc49c8e2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:41.907973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5d3855e6-2824-47c0-b95e-7f6f7d4e9329 req-ac241b0f-c9ef-4492-ab59-614bc49c8e2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:41.954159 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5d3855e6-2824-47c0-b95e-7f6f7d4e9329 req-ac241b0f-c9ef-4492-ab59-614bc49c8e2d service nova] Creating event network-vif-plugged:4319dbaa-01c6-4f4d-952f-0fb070fed2f9 for instance 833fb3c7-7565-4610-8927-bfac1c9fc60b on n-h1-846219-13 Jul 25 16:39:41.971944 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5d3855e6-2824-47c0-b95e-7f6f7d4e9329 req-ac241b0f-c9ef-4492-ab59-614bc49c8e2d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.366766 Jul 25 16:39:41.975875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2762/5449] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:42.112328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:42.112951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:42.140825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:42.141633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:42.146301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:42.146747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:43.060175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:43.077924 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5d035203-8c87-4d8c-9a9b-2d6c35dc6f54 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 0.966577 Jul 25 16:39:43.079230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2688/5450] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:42 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:44.109270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:44.110586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:44.174690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:44.177465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:44.186175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:44.186949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:45.393924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:45.404157 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-764a212d-621f-498a-a0c4-1a519d4d27fa tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1269 microversion: 2.1 time: 1.304696 Jul 25 16:39:45.407380 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2763/5451] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:44 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1269 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:46.279699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-335098771", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "11575a57-54ec-4822-bcf4-e4e8a0b187f9"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:46.383405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] validate_networks() for [('11575a57-54ec-4822-bcf4-e4e8a0b187f9', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:39:46.436748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:46.437561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:46.453676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:46.459753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:46.464430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:46.471788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:47.346555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:47.356293 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-54597c98-13fe-428e-8ef1-4c6e4c349a92 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1456 microversion: 2.1 time: 0.928465 Jul 25 16:39:47.356890 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2764/5452] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:46 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1456 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:47.378116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:47.379218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:47.395227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:47.396068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:47.397825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:47.401845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:47.765491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:39:47.766726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:39:47.767608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:39:47.768410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:39:47.769291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:39:47.783218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:47.786935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:47.790905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:47.794764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:47.866806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Getting quotas for project bd7efa344b1148078caf6a86686fc17d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:39:47.879560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Getting quotas for user 2bb45d576f014d1d8c1381aff09fce10 and project bd7efa344b1148078caf6a86686fc17d. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:39:47.900677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:39:47.906440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:39:48.029530 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b37cd021-2979-4622-b3cc-c774a451b7f5 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.987314 Jul 25 16:39:48.038736 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2689/5453] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:39:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:39:48.044665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6182b1d8-947e-46e0-8348-a005a0a4c9d7 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:48.045561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6182b1d8-947e-46e0-8348-a005a0a4c9d7 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:48.222931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6182b1d8-947e-46e0-8348-a005a0a4c9d7 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:48.231002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6182b1d8-947e-46e0-8348-a005a0a4c9d7 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1217 microversion: 2.1 time: 0.190660 Jul 25 16:39:48.248976 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2690/5454] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:48 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:48.300463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:48.310422 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7445df29-762e-4058-8c24-0f83a51b304d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1456 microversion: 2.1 time: 0.936164 Jul 25 16:39:48.331030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2765/5455] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:47 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1456 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:39:49.253114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-036a7fa3-a13a-43ce-85fc-cf0a1807e012 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:49.254554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-036a7fa3-a13a-43ce-85fc-cf0a1807e012 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:49.280872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:49.758564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-036a7fa3-a13a-43ce-85fc-cf0a1807e012 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:49.766946 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-036a7fa3-a13a-43ce-85fc-cf0a1807e012 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1217 microversion: 2.1 time: 0.518645 Jul 25 16:39:49.776459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2691/5456] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:49 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1217 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:50.795404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:50.796082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:50.809281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:50.809753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:50.810572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:50.811038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:51.661205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:51.684123 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7ba7668b-4f39-49de-88ef-78988b380133 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1275 microversion: 2.1 time: 0.884241 Jul 25 16:39:51.687673 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2766/5457] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:50 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1275 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:52.712678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:52.714119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:52.748520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:52.749292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:52.755474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:52.768031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:53.714921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:53.723687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-15a8c7bb-7027-4bc0-8791-e66128731851 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1275 microversion: 2.1 time: 1.019246 Jul 25 16:39:53.733815 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2692/5458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:52 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1275 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:54.745697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:54.747044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:54.779239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:54.780128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:54.783080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:54.783557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:55.960415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:55.974717 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f3d068b-f1db-47d9-904e-85cd139e2776 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1275 microversion: 2.1 time: 1.233576 Jul 25 16:39:55.975323 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2767/5459] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:54 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1275 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:57.003170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:57.004037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:57.053384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:57.054086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:57.072871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:57.073456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:57.519204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:57.560137 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10478593-07d6-4e24-a2bc-c6e76bccef22 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1275 microversion: 2.1 time: 0.555984 Jul 25 16:39:57.566764 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2693/5460] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:56 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1275 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:58.587719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:58.589248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:58.597190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=22 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:58.599673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:58.600666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:58.601855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:58.602645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:58.988898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:59.000911 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bad3a817-08e7-4608-bf4a-7aaf8d981667 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1275 microversion: 2.1 time: 0.418634 Jul 25 16:39:59.005773 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2768/5461] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:39:58 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1275 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:00.050224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:00.051427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:00.080503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:00.093692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:00.127408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:00.128252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:00.131727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:00.138931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:01.459470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:01.504978 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d79dbb2-e602-4291-8b65-982b2b0ad0d9 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.461453 Jul 25 16:40:01.510936 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2694/5462] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:00 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:02.112769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c5a6a5c7-f409-43e0-830e-9804ddc0e11e req-b181ca80-ed80-4972-b217-dd58c4fb8110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833fb3c7-7565-4610-8927-bfac1c9fc60b", "tag": "4319dbaa-01c6-4f4d-952f-0fb070fed2f9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:02.145484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c5a6a5c7-f409-43e0-830e-9804ddc0e11e req-b181ca80-ed80-4972-b217-dd58c4fb8110 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:02.146319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c5a6a5c7-f409-43e0-830e-9804ddc0e11e req-b181ca80-ed80-4972-b217-dd58c4fb8110 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:02.179879 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c5a6a5c7-f409-43e0-830e-9804ddc0e11e req-b181ca80-ed80-4972-b217-dd58c4fb8110 service nova] Creating event network-changed:4319dbaa-01c6-4f4d-952f-0fb070fed2f9 for instance 833fb3c7-7565-4610-8927-bfac1c9fc60b on n-h1-846219-13 Jul 25 16:40:02.199806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c5a6a5c7-f409-43e0-830e-9804ddc0e11e req-b181ca80-ed80-4972-b217-dd58c4fb8110 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090907 Jul 25 16:40:02.202264 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2769/5463] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:02.539884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:02.540512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:02.552451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:02.557372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:02.558733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:02.559364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:04.302353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:04.305472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=48 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:04.322863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e924893b-1c71-408b-8c76-851fbc13232f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.786827 Jul 25 16:40:04.325217 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2695/5464] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:02 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:05.365831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:05.367376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:05.382192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:05.383253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:05.384338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:05.385068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:06.585846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:06.623343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-23a05e3d-2c6d-4700-8f7f-3b6797f2cbb2 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.261876 Jul 25 16:40:06.635100 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2770/5465] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:05 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:07.513838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9c0709c7-5618-4877-9002-6faa303ea5bc req-445de1b0-3102-43c5-bf25-240f3a51c661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd1ca8b-344b-4058-926a-a93bf7adaee3", "tag": "f2a8d225-bf5b-41b1-8163-1ef00b545ccb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:07.597566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9c0709c7-5618-4877-9002-6faa303ea5bc req-445de1b0-3102-43c5-bf25-240f3a51c661 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.598051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9c0709c7-5618-4877-9002-6faa303ea5bc req-445de1b0-3102-43c5-bf25-240f3a51c661 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:07.631619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9c0709c7-5618-4877-9002-6faa303ea5bc req-445de1b0-3102-43c5-bf25-240f3a51c661 service nova] Creating event network-changed:f2a8d225-bf5b-41b1-8163-1ef00b545ccb for instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 on n-h2-846219-13 Jul 25 16:40:07.648752 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9c0709c7-5618-4877-9002-6faa303ea5bc req-445de1b0-3102-43c5-bf25-240f3a51c661 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167219 Jul 25 16:40:07.654344 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2696/5466] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:07.675965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:07.681749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:07.725676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.727159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:07.730572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.731439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:09.134726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:09.142743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=58 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:09.164869 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-70eda2e0-f81c-48a3-ac72-775f4fa2e494 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.503925 Jul 25 16:40:09.165891 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2771/5467] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:07 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:10.195009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:10.196302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:10.210256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:10.219683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:10.220734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:10.221375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:10.948691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-158466042", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "77f968c6-9138-4c45-8499-161a7654fbae"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:11.099576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] validate_networks() for [('77f968c6-9138-4c45-8499-161a7654fbae', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:40:11.446433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:11.502269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82b0ec58-75d9-4625-9622-c7493069b67f tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.303246 Jul 25 16:40:11.503981 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2697/5468] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:10 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:40:12.533300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:12.534934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:12.595411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:12.598355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:12.612259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:12.615505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:13.700980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:40:13.701875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:40:13.705282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:40:13.705282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:40:13.705282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:40:13.779721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:13.780543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:13.782364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:13.783189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:13.920231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Getting quotas for project 13fa057c5e4d4e7a9ab43159eb3cc405. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:40:13.944358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Getting quotas for user 47a2f08196294653bcf80e7014a6c4ef and project 13fa057c5e4d4e7a9ab43159eb3cc405. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:40:14.006802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:40:14.011956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:40:14.203440 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-88392897-0139-45fe-9395-1e17d4b43ac7 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.786007 Jul 25 16:40:14.204423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2772/5469] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:40:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 3788 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:40:14.224871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7acb4d06-0d16-443b-a812-4f21d270c825 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:14.226091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7acb4d06-0d16-443b-a812-4f21d270c825 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:15.014879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7acb4d06-0d16-443b-a812-4f21d270c825 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:15.040233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7acb4d06-0d16-443b-a812-4f21d270c825 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1231 microversion: 2.1 time: 0.813538 Jul 25 16:40:15.040233 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2773/5470] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:14 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1231 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:15.148357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:15.158004 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8e908a46-f810-46d1-93bb-8f7c44ab0b36 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 2.634215 Jul 25 16:40:15.172053 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2698/5471] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:12 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 2649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:40:16.058930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:16.060384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:16.078553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.081235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.082844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.084976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.186945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:16.189211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:16.231854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.233315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.238482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.239363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:17.343313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:17.383478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bffe3de1-4033-4a72-94ca-b1346ef867f6 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1283 microversion: 2.1 time: 1.325205 Jul 25 16:40:17.409532 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2774/5472] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:16 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1283 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:18.411716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:18.412432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:18.438541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:18.441451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:18.445034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:18.446046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:18.542234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:18.557150 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c363ca05-ab5d-4187-9c1f-b5dbb40ded72 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 2.376868 Jul 25 16:40:18.558014 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2699/5473] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:16 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:18.615275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:18.630071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6572a91-e4c7-4f70-a6f6-8168f2bb3249 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1289 microversion: 2.1 time: 0.222443 Jul 25 16:40:18.632719 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2775/5474] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:18 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1289 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:40:19.582830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:19.583700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:19.614687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=20 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:19.630001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:19.630518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:19.631194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:19.646475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:19.676963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:19.678065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:19.700805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:19.703611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:19.714791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:19.722196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:20.570211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:20.587523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c8346dac-ee96-413f-92d1-b360d1fbd0fe tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 0.915656 Jul 25 16:40:20.589140 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2776/5475] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:19 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:40:20.705250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d70341e6-19de-4d15-8785-899d95a21950 req-03953a55-f77b-43bc-bc61-937290e66d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd1ca8b-344b-4058-926a-a93bf7adaee3", "name": "network-vif-plugged", "status": "completed", "tag": "f2a8d225-bf5b-41b1-8163-1ef00b545ccb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:20.748922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d70341e6-19de-4d15-8785-899d95a21950 req-03953a55-f77b-43bc-bc61-937290e66d83 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:20.752109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d70341e6-19de-4d15-8785-899d95a21950 req-03953a55-f77b-43bc-bc61-937290e66d83 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:20.753859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:20.779175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1079722b-d990-4084-b1c0-a064c388cee3 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.201305 Jul 25 16:40:20.792499 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2700/5476] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:19 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:20.827538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d70341e6-19de-4d15-8785-899d95a21950 req-03953a55-f77b-43bc-bc61-937290e66d83 service nova] Creating event network-vif-plugged:f2a8d225-bf5b-41b1-8163-1ef00b545ccb for instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 on n-h2-846219-13 Jul 25 16:40:20.889701 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d70341e6-19de-4d15-8785-899d95a21950 req-03953a55-f77b-43bc-bc61-937290e66d83 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192860 Jul 25 16:40:20.899396 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2777/5477] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:21.617573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:21.619556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:21.641708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:21.642615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:21.643794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:21.644415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:21.818224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:21.820319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:21.861709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:21.862754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:21.867964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:21.868886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:23.366007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:23.426157 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08bb762b-7d87-4a98-9548-43cb0e77a40c tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 1.815324 Jul 25 16:40:23.426842 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2701/5478] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:21 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:23.445834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:23.455365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ae42902f-ad24-461a-90b4-0dcc3e14e7f5 req-6e56ead4-8916-4b2e-b015-7cb1fc00ae9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4476725b-5098-4c78-8b34-fafbbcbc425a", "tag": "4bfe934b-acbb-40a1-bd33-21302a8ff9a9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:23.469800 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99c6d89d-ab3a-47ed-94b3-449cf7d55985 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1317 microversion: 2.1 time: 1.657781 Jul 25 16:40:23.478800 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2778/5479] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:21 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1317 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:23.506191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ae42902f-ad24-461a-90b4-0dcc3e14e7f5 req-6e56ead4-8916-4b2e-b015-7cb1fc00ae9c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:23.506652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ae42902f-ad24-461a-90b4-0dcc3e14e7f5 req-6e56ead4-8916-4b2e-b015-7cb1fc00ae9c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:23.586474 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ae42902f-ad24-461a-90b4-0dcc3e14e7f5 req-6e56ead4-8916-4b2e-b015-7cb1fc00ae9c service nova] Creating event network-changed:4bfe934b-acbb-40a1-bd33-21302a8ff9a9 for instance 4476725b-5098-4c78-8b34-fafbbcbc425a on n-h1-846219-13 Jul 25 16:40:23.605240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ae42902f-ad24-461a-90b4-0dcc3e14e7f5 req-6e56ead4-8916-4b2e-b015-7cb1fc00ae9c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174328 Jul 25 16:40:23.606232 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2702/5480] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:24.463053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:24.465087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:24.487410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:24.497530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:24.498683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:24.502320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:24.504658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:24.505554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:24.506113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:24.532159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:24.533185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:24.534269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:24.537823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:25.033686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:25.711933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:25.737369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:25.747173 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5de0450f-8dae-47fd-8c29-a703c20e0642 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 1.294276 Jul 25 16:40:25.761398 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d0fcbd99-42de-4c65-8240-491a891a1f28 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1501 microversion: 2.1 time: 1.252068 Jul 25 16:40:25.762195 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2779/5481] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:24 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:25.765046 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2703/5482] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:24 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1501 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:26.059162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d410b0b-ec88-42b5-a845-1f2edaf4762f tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Action: 'create', calling method: .version_select at 0x7f9d901e7c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:26.100790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0d410b0b-ec88-42b5-a845-1f2edaf4762f tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Getting quotas for project d130a5a4cbd443739d0ffdcdfcf914d1. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:40:26.123192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0d410b0b-ec88-42b5-a845-1f2edaf4762f tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Getting quotas for user d8b9f366b68948efb4c5dc42747a9e88 and project d130a5a4cbd443739d0ffdcdfcf914d1. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:40:26.269180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0d410b0b-ec88-42b5-a845-1f2edaf4762f tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Getting quotas for project d130a5a4cbd443739d0ffdcdfcf914d1. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:40:26.297360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0d410b0b-ec88-42b5-a845-1f2edaf4762f tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Getting quotas for user d8b9f366b68948efb4c5dc42747a9e88 and project d130a5a4cbd443739d0ffdcdfcf914d1. Resources: {'server_groups'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:40:26.321935 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d410b0b-ec88-42b5-a845-1f2edaf4762f tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] 10.222.0.105 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.567481 Jul 25 16:40:26.326694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2780/5483] 10.222.0.105 () {62 vars in 1219 bytes} [Mon Jul 25 16:40:25 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:40:26.345596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bf5a0918-d87c-4067-96c4-6b9f866cdac3 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:26.427828 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bf5a0918-d87c-4067-96c4-6b9f866cdac3 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.086048 Jul 25 16:40:26.433784 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2704/5484] 10.222.0.105 () {60 vars in 1198 bytes} [Mon Jul 25 16:40:26 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:40:26.444838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e5f031c7-d294-4790-860e-28c52c713d01 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:26.466801 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e5f031c7-d294-4790-860e-28c52c713d01 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] 10.222.0.105 "GET /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43" status: 200 len: 235 microversion: 2.64 time: 0.019442 Jul 25 16:40:26.468080 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2781/5485] 10.222.0.105 () {60 vars in 1309 bytes} [Mon Jul 25 16:40:26 2022] GET /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43 => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:40:26.479818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34985b9f-8aca-402b-b253-44cb6fdb1851 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:26.592986 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34985b9f-8aca-402b-b253-44cb6fdb1851 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43" status: 204 len: 0 microversion: 2.64 time: 0.117077 Jul 25 16:40:26.594636 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2705/5486] 10.222.0.105 () {60 vars in 1312 bytes} [Mon Jul 25 16:40:26 2022] DELETE /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:40:26.607273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ca3deed-1186-4bff-9801-b3a0a201c0b8 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:26.618482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8ca3deed-1186-4bff-9801-b3a0a201c0b8 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] HTTP exception thrown: Instance group 676338c1-2594-4fb1-b29b-11e60b5aee43 could not be found. Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ca3deed-1186-4bff-9801-b3a0a201c0b8 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Request method failure captured: Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43 HTTP/1.1 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sd4_DWtVSphLK6HupQl6Lei6qFcJlPS2id33u6CIcJRmqWj3QI1uJFXj177KRcMep0pwOvN-aeZA37VrMY3sIZTufH8TQZpG7s2-ICunTbrsxuiR9E44z0Fcf2pogJ3ebExowtHMPz4ks2NrHeauDak-gw0JaULv2QizYZaqPWnFXg Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Openstack-Nova-Api-Version: 2.64 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: d130a5a4cbd443739d0ffdcdfcf914d1 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerGroup264TestJSON-438214367 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d130a5a4cbd443739d0ffdcdfcf914d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/d130a5a4cbd443739d0ffdcdfcf914d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/d130a5a4cbd443739d0ffdcdfcf914d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_d130a5a4cbd443739d0ffdcdfcf914d1"}]}] Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerGroup264TestJSON-438214367 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: d130a5a4cbd443739d0ffdcdfcf914d1 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerGroup264TestJSON-438214367 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerGroup264TestJSON-438214367-project Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d8b9f366b68948efb4c5dc42747a9e88 Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerGroup264TestJSON-438214367-project Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance group 676338c1-2594-4fb1-b29b-11e60b5aee43 could not be found. Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '676338c1-2594-4fb1-b29b-11e60b5aee43'} Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 676338c1-2594-4fb1-b29b-11e60b5aee43 could not be found. Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 676338c1-2594-4fb1-b29b-11e60b5aee43 could not be found. Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:26.624236 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:26.629684 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:26.629684 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:26.629684 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:26.629684 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:26.629684 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 676338c1-2594-4fb1-b29b-11e60b5aee43 could not be found. Jul 25 16:40:26.629684 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:26.637468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ca3deed-1186-4bff-9801-b3a0a201c0b8 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] Returning 404 to user: Instance group 676338c1-2594-4fb1-b29b-11e60b5aee43 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:26.638558 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ca3deed-1186-4bff-9801-b3a0a201c0b8 tempest-ServerGroup264TestJSON-438214367 tempest-ServerGroup264TestJSON-438214367-project] 10.222.0.105 "DELETE /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43" status: 404 len: 117 microversion: 2.64 time: 0.035970 Jul 25 16:40:26.646386 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2782/5487] 10.222.0.105 () {60 vars in 1312 bytes} [Mon Jul 25 16:40:26 2022] DELETE /compute/v2.1/os-server-groups/676338c1-2594-4fb1-b29b-11e60b5aee43 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:40:26.781329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:26.783050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:26.796360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:26.803607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:26.805204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:26.811688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:27.963757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:28.016707 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75e5ff0f-3900-4d9f-8c24-d330244d4c0e tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 1.228779 Jul 25 16:40:28.018566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2706/5488] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:26 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:29.082676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:29.087221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:29.114766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=5 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:29.116852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:29.130402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:29.131992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:29.132797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:29.703440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:29.720340 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-84e3b902-dbf9-4e5d-990f-7b962cbaf3c2 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 0.670109 Jul 25 16:40:29.721565 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2783/5489] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:29 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:30.755693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:30.756310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:30.772003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:30.772512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:30.773450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:30.795488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:31.726180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:31.739298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-717c01e4-804c-4b36-9fb5-80a5f149b688 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 0.988484 Jul 25 16:40:31.739984 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2707/5490] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:30 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:32.733352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:32.734202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:32.748287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:32.748748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:32.749658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:32.750239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:32.765367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:32.766966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:32.791953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:32.792918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:32.794122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:32.795030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:32.838316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:40:33.015555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0cd73b62-09e1-4240-80e4-8530a6371c18 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 204 len: 0 microversion: 2.1 time: 0.286938 Jul 25 16:40:33.016879 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2784/5491] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:40:32 2022] DELETE /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:40:33.037288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:33.037288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:33.053969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:33.054448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:33.065633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:33.066120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:33.711690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:33.761512 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a2b05a6-ad4f-4b56-8116-086afe832eb5 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 0.996846 Jul 25 16:40:33.764131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:33.766784 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2708/5492] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:32 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:33.778050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0996d2e2-c9af-4ee3-a909-6b83e1eceb79 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1507 microversion: 2.1 time: 0.750057 Jul 25 16:40:33.788888 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2785/5493] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:33 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1507 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:33.792534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-40a878a8-b798-4cb2-b414-daef3acca617 req-772eb92a-ef75-42af-98db-4959e1a8b86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4476725b-5098-4c78-8b34-fafbbcbc425a", "name": "network-vif-plugged", "status": "completed", "tag": "4bfe934b-acbb-40a1-bd33-21302a8ff9a9"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:33.840268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-40a878a8-b798-4cb2-b414-daef3acca617 req-772eb92a-ef75-42af-98db-4959e1a8b86c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:33.841028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-40a878a8-b798-4cb2-b414-daef3acca617 req-772eb92a-ef75-42af-98db-4959e1a8b86c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:33.886938 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-40a878a8-b798-4cb2-b414-daef3acca617 req-772eb92a-ef75-42af-98db-4959e1a8b86c service nova] Creating event network-vif-plugged:4bfe934b-acbb-40a1-bd33-21302a8ff9a9 for instance 4476725b-5098-4c78-8b34-fafbbcbc425a on n-h1-846219-13 Jul 25 16:40:33.905533 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-40a878a8-b798-4cb2-b414-daef3acca617 req-772eb92a-ef75-42af-98db-4959e1a8b86c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119426 Jul 25 16:40:33.908384 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2786/5494] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:34.812098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:34.814092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:34.823376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:34.824827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:34.825348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:34.825808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:34.826613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:34.844705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:34.866531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:34.874776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:34.876094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:34.878556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:34.944496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=60 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:35.455879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:35.473902 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-86637fe1-b5a1-4a2a-bcb6-9a694948133f tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1331 microversion: 2.1 time: 0.665862 Jul 25 16:40:35.481928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2709/5495] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:34 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1331 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:35.545444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:35.561786 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2027ceb-680b-4b59-a949-2d17432c7062 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1507 microversion: 2.1 time: 0.743354 Jul 25 16:40:35.562853 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2787/5496] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:34 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1507 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:36.139626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-111884a0-1edc-4d5a-914b-fd48b92b5589 req-d2ee45cb-cb45-4876-897a-9a38f8925bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd1ca8b-344b-4058-926a-a93bf7adaee3", "name": "network-vif-deleted", "tag": "f2a8d225-bf5b-41b1-8163-1ef00b545ccb"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:36.158670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-111884a0-1edc-4d5a-914b-fd48b92b5589 req-d2ee45cb-cb45-4876-897a-9a38f8925bb8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:36.159113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-111884a0-1edc-4d5a-914b-fd48b92b5589 req-d2ee45cb-cb45-4876-897a-9a38f8925bb8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:36.186863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-111884a0-1edc-4d5a-914b-fd48b92b5589 req-d2ee45cb-cb45-4876-897a-9a38f8925bb8 service nova] Creating event network-vif-deleted:f2a8d225-bf5b-41b1-8163-1ef00b545ccb for instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 on n-h2-846219-13 Jul 25 16:40:36.201934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-111884a0-1edc-4d5a-914b-fd48b92b5589 req-d2ee45cb-cb45-4876-897a-9a38f8925bb8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065670 Jul 25 16:40:36.203813 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2710/5497] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:36.514527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:36.516471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:36.533508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:36.560684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:36.564094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:36.565838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:36.566311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:36.586812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:36.587534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:36.607919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:36.611126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:36.612460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:36.617478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:36.719406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:36.723529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:36.724277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lazy-loading 'fault' on Instance uuid fdd1ca8b-344b-4058-926a-a93bf7adaee3 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:40:37.145383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb45d576f014d1d8c1381aff09fce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7efa344b1148078caf6a86686fc17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:37.154398 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-96b55219-a99f-4bd1-af7c-e1075e10b430 tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 200 len: 1307 microversion: 2.1 time: 0.572352 Jul 25 16:40:37.181528 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2711/5498] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:36 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 1307 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:37.571812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:37.589558 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1efd038-fcfb-4361-adcd-f932503cdf2d tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1531 microversion: 2.1 time: 1.086900 Jul 25 16:40:37.606165 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2788/5499] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:36 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1531 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:37.612709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:37.613643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:37.624378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:37.626602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:37.638856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:37.639663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:38.176849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:38.177942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] [instance: fdd1ca8b-344b-4058-926a-a93bf7adaee3] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:38.193008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:38.193762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:38.194766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:38.195397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:38.248467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] HTTP exception thrown: Instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 could not be found. Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Request method failure captured: Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 HTTP/1.1 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sdNHhar1578jKRMqMBwMxCFllv9dpSPqHJqe4TF_ir948vapuGVQKnxWurxCw5uYeTZZaHQ6pyfJx-tbd7zAqediDW7aum1hBT3qo8mE-8BqAM8B6QVlqKMgm8_3YeSMkndp46Bdc3xFVykQIUaDt4Mw1q5FZuh__svybjRP8xZfxA Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bd7efa344b1148078caf6a86686fc17d Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesActionsTest-66248070 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd7efa344b1148078caf6a86686fc17d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bd7efa344b1148078caf6a86686fc17d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bd7efa344b1148078caf6a86686fc17d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bd7efa344b1148078caf6a86686fc17d"}]}] Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesActionsTest-66248070 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bd7efa344b1148078caf6a86686fc17d Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesActionsTest-66248070 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesActionsTest-66248070-project Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 2bb45d576f014d1d8c1381aff09fce10 Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesActionsTest-66248070-project Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 could not be found. Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fdd1ca8b-344b-4058-926a-a93bf7adaee3'} Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 could not be found. Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 could not be found. Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:38.251328 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 could not be found. Jul 25 16:40:38.255968 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:38.258700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] Returning 404 to user: Instance fdd1ca8b-344b-4058-926a-a93bf7adaee3 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:38.261268 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-96aeda65-19fd-45e7-aa1c-0e2671c55fdf tempest-VolumesActionsTest-66248070 tempest-VolumesActionsTest-66248070-project] 10.222.0.105 "GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3" status: 404 len: 111 microversion: 2.1 time: 0.087579 Jul 25 16:40:38.262503 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2789/5500] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:38 2022] GET /compute/v2.1/servers/fdd1ca8b-344b-4058-926a-a93bf7adaee3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:40:38.438656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:38.450630 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8b35c47-4154-4023-9ce2-6fe7b8fc6194 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1531 microversion: 2.1 time: 0.841851 Jul 25 16:40:38.455013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2712/5501] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:37 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1531 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:39.157766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:39.158289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:39.175821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:39.176637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:39.177715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:39.178711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:39.195494 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] HTTP exception thrown: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Request method failure captured: Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a HTTP/1.1 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sdpHD_JTaFva1ZPHith3BGIF6ppZnODuPjwBX8H3p7eSRoIo4iTBFjPDNt1KFwPBdu6gHKEcKFrjNTSBVLH5j7bUElOqBRvSueOb0gNqAQCg7Vcy6BEDfVRr0X9OuaI3pOQfuBXdZ4hgFpEM74sJW7gqz8HpaNdl-Fj_W2Wg7trg_8 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfe2506b956f4bf1a5bacb7343e0d862 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-722466217 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfe2506b956f4bf1a5bacb7343e0d862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfe2506b956f4bf1a5bacb7343e0d862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfe2506b956f4bf1a5bacb7343e0d862"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfe2506b956f4bf1a5bacb7343e0d862"}]}] Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-722466217 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfe2506b956f4bf1a5bacb7343e0d862 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-722466217 Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestMultiTenantJSON-722466217-project Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 595b4f8d066b4beea343e4ecbf68b70c Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-722466217-project Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4476725b-5098-4c78-8b34-fafbbcbc425a'} Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:39.199270 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:39.203026 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:39.205492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Returning 404 to user: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:39.207471 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a0d1f1c-20e6-4039-a2d2-2222fcfd924f tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 404 len: 111 microversion: 2.1 time: 0.738183 Jul 25 16:40:39.213185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2790/5502] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:40:38 2022] DELETE /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 111 bytes in 745 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:39.222990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:39.223627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:39.240855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:39.241378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:39.242216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:39.242636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:40.380665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:40.397880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-167bd56e-2941-46df-88f3-545b45d62432 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1531 microversion: 2.1 time: 1.176136 Jul 25 16:40:40.399442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2713/5503] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:39 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1531 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:40.422667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Action: 'update', calling method: >, body: {"server": {"name": "4476725b-5098-4c78-8b34-fafbbcbc425a_new"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:40.428251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:40.445950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:40.447512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:40.452152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:40.471121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:40.492222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:40.531238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] HTTP exception thrown: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Request method failure captured: Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: request: PUT /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a HTTP/1.1 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 64 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sdpHD_JTaFva1ZPHith3BGIF6ppZnODuPjwBX8H3p7eSRoIo4iTBFjPDNt1KFwPBdu6gHKEcKFrjNTSBVLH5j7bUElOqBRvSueOb0gNqAQCg7Vcy6BEDfVRr0X9OuaI3pOQfuBXdZ4hgFpEM74sJW7gqz8HpaNdl-Fj_W2Wg7trg_8 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfe2506b956f4bf1a5bacb7343e0d862 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-722466217 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfe2506b956f4bf1a5bacb7343e0d862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfe2506b956f4bf1a5bacb7343e0d862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfe2506b956f4bf1a5bacb7343e0d862"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfe2506b956f4bf1a5bacb7343e0d862"}]}] Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-722466217 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfe2506b956f4bf1a5bacb7343e0d862 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-722466217 Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestMultiTenantJSON-722466217-project Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 595b4f8d066b4beea343e4ecbf68b70c Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-722466217-project Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: {"server": {"name": "4476725b-5098-4c78-8b34-fafbbcbc425a_new"}} Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4476725b-5098-4c78-8b34-fafbbcbc425a', 'body': {'server': {'name': '4476725b-5098-4c78-8b34-fafbbcbc425a_new'}}} Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:40:40.533921 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:40.538432 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:40.540549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] Returning 404 to user: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:40.541614 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-30b14316-ea17-4f78-971d-c3e568f156a6 tempest-ServersNegativeTestMultiTenantJSON-722466217 tempest-ServersNegativeTestMultiTenantJSON-722466217-project] 10.222.0.105 "PUT /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 404 len: 111 microversion: 2.1 time: 0.123882 Jul 25 16:40:40.548809 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2791/5504] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 16:40:40 2022] PUT /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:40.554201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:40.554777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:40.568339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:40.574200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:40.575298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:40.576102 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:40.664900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:40:40.828394 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b451616e-fb75-41f0-8dd7-9c1a2c7a9419 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 204 len: 0 microversion: 2.1 time: 0.277935 Jul 25 16:40:40.830690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2714/5505] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:40:40 2022] DELETE /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:40:40.876271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:40.877514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:40.885075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:40.889944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:40.902524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:40.903425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:41.242827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:41.257555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e747b7de-e16b-4efb-b249-a1523c37ad82 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1537 microversion: 2.1 time: 0.405630 Jul 25 16:40:41.259232 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2792/5506] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:40 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:42.282692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:42.283493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:42.304472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:42.304927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:42.316816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:42.317337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:42.693408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:42.701007 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22c1814c-f2ed-4f93-9c9b-29a6d58d8f07 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1537 microversion: 2.1 time: 0.424123 Jul 25 16:40:42.701634 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2715/5507] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:42 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1537 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:40:43.724580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:43.726198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:43.750218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:43.751310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:43.753479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:43.754883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:44.078099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:44.092118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff779913-9e4c-4449-a995-2dad854ec4a4 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1537 microversion: 2.1 time: 0.370656 Jul 25 16:40:44.094634 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2793/5508] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:43 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1537 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:45.118113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:45.120779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:45.162632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:45.164579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:45.166342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:45.168418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:45.300126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:45.300386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:45.302271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lazy-loading 'fault' on Instance uuid 4476725b-5098-4c78-8b34-fafbbcbc425a {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:40:45.496854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a2f08196294653bcf80e7014a6c4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13fa057c5e4d4e7a9ab43159eb3cc405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:45.520955 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aa033b31-3009-4cbb-8d50-b919ffff0325 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 200 len: 1321 microversion: 2.1 time: 0.409270 Jul 25 16:40:45.521616 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2794/5509] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:45 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:40:45.563974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-243bfbcd-a519-4adf-b75e-78775ddb1a71 req-5e41b478-449d-45e5-841f-10490c80d74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4476725b-5098-4c78-8b34-fafbbcbc425a", "name": "network-vif-deleted", "tag": "4bfe934b-acbb-40a1-bd33-21302a8ff9a9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:45.583507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-243bfbcd-a519-4adf-b75e-78775ddb1a71 req-5e41b478-449d-45e5-841f-10490c80d74a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:45.583964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-243bfbcd-a519-4adf-b75e-78775ddb1a71 req-5e41b478-449d-45e5-841f-10490c80d74a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:45.614370 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-243bfbcd-a519-4adf-b75e-78775ddb1a71 req-5e41b478-449d-45e5-841f-10490c80d74a service nova] Creating event network-vif-deleted:4bfe934b-acbb-40a1-bd33-21302a8ff9a9 for instance 4476725b-5098-4c78-8b34-fafbbcbc425a on n-h1-846219-13 Jul 25 16:40:45.628793 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-243bfbcd-a519-4adf-b75e-78775ddb1a71 req-5e41b478-449d-45e5-841f-10490c80d74a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.560458 Jul 25 16:40:45.630855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2716/5510] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:46.542157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:46.543709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] [instance: 4476725b-5098-4c78-8b34-fafbbcbc425a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:46.561830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:46.562651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:46.566207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:46.570330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:46.616516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] HTTP exception thrown: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Request method failure captured: Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a HTTP/1.1 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sdP-Tx7ECTrY4xsnBuNFBTwUF0Uss6YZ7TU2RYamvx_eT6UZ9LTAnXgkyugKvzhcHTafLxl-omvSe30L8wnJRxt6k-lcifpCIJgYpNIrJ8YloKYUEMprdyOEUvclMmWrjDjSSmJPxk4awGmiXYtcBWOHYnpdCv6W2Gcw9BH0k7uzLs Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 13fa057c5e4d4e7a9ab43159eb3cc405 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2035836933 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/13fa057c5e4d4e7a9ab43159eb3cc405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/13fa057c5e4d4e7a9ab43159eb3cc405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/13fa057c5e4d4e7a9ab43159eb3cc405"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_13fa057c5e4d4e7a9ab43159eb3cc405"}]}] Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2035836933 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 13fa057c5e4d4e7a9ab43159eb3cc405 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2035836933 Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2035836933-project Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 47a2f08196294653bcf80e7014a6c4ef Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2035836933-project Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4476725b-5098-4c78-8b34-fafbbcbc425a'} Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:46.635298 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] Returning 404 to user: Instance 4476725b-5098-4c78-8b34-fafbbcbc425a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:46.640248 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f0a3c07-fef8-41e9-906a-80cba0d1ad80 tempest-ServersNegativeTestMultiTenantJSON-2035836933 tempest-ServersNegativeTestMultiTenantJSON-2035836933-project] 10.222.0.105 "GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a" status: 404 len: 111 microversion: 2.1 time: 0.099164 Jul 25 16:40:46.643474 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2795/5511] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:46 2022] GET /compute/v2.1/servers/4476725b-5098-4c78-8b34-fafbbcbc425a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:53.411203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-288840362", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:53.425805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:53.510057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] validate_networks() for [('014bc4df-59f6-4d0d-8010-df8dbee1849a', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:40:54.511672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:40:54.513177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:40:54.513943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:40:54.514763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:40:54.515525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:40:54.544310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:54.544763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:54.545694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:54.546186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:54.588108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:40:54.602286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for user 549f6f9c38924ca3b49fc429838171ca and project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:40:54.636309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:40:54.648040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:40:54.738035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6f5c028-2b5e-4c88-99b8-79aef70dd791 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.613801 Jul 25 16:40:54.739412 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2717/5512] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:40:53 2022] POST /compute/v2.1/servers => generated 385 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:40:54.753335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-759b3a44-524b-49fc-bb88-6186f3efeed3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:54.754726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-759b3a44-524b-49fc-bb88-6186f3efeed3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:54.954114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-759b3a44-524b-49fc-bb88-6186f3efeed3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:54.967415 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-759b3a44-524b-49fc-bb88-6186f3efeed3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1225 microversion: 2.1 time: 0.218812 Jul 25 16:40:54.972640 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2796/5513] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:54 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1225 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:55.133481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-423870193", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:55.284666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] validate_networks() for [('014bc4df-59f6-4d0d-8010-df8dbee1849a', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:40:57.795775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:40:57.796438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:40:57.796700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:40:57.797454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:40:57.798024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:40:57.822835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:57.823282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:57.824083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:57.824518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:57.882241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:40:57.894018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for user 549f6f9c38924ca3b49fc429838171ca and project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:40:57.919920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:40:57.926979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:40:58.135131 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82789a74-dc83-4ac7-b059-4ba437309d1e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.007189 Jul 25 16:40:58.140539 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2718/5514] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:40:55 2022] POST /compute/v2.1/servers => generated 385 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:40:58.160535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7686b210-9e68-46ce-9420-7afadffad6a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:58.161210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7686b210-9e68-46ce-9420-7afadffad6a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:58.188711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=23 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:40:58.549941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7686b210-9e68-46ce-9420-7afadffad6a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:58.568397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7686b210-9e68-46ce-9420-7afadffad6a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1225 microversion: 2.1 time: 0.410762 Jul 25 16:40:58.573538 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2797/5515] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:58 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1225 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:59.598704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:59.601815 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:59.617458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:59.619492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:59.621784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:59.624107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:59.838516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:59.856605 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a46ff2b3-3cf5-4153-9d19-f0c2f55e2cbc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1277 microversion: 2.1 time: 0.263138 Jul 25 16:40:59.858894 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2719/5516] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:40:59 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:00.880689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:00.881510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:00.895925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:00.924370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:00.928985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:00.936883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:00.946501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:01.231885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:01.259744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-74f7dcbf-2ad6-4b77-b654-2068583d2683 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1283 microversion: 2.1 time: 0.373030 Jul 25 16:41:01.274447 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2798/5517] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:00 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1283 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:02.282413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:02.285134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:02.298320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:02.319906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:02.326190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:02.331851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:02.555148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:02.571014 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f36c4d56-53bc-44b0-a0e8-31f7b02467ea tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1283 microversion: 2.1 time: 0.294059 Jul 25 16:41:02.595001 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2720/5518] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:02 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1283 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:03.618124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:03.618906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:03.636569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:03.639777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:03.641158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:03.642100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:04.182800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:04.193183 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-05c93f75-7e8a-4d79-92d9-56ac45fda32b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.580681 Jul 25 16:41:04.211976 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2799/5519] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:03 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:04.817382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-594f4446-37c6-4174-960c-68e7bccc6cfe req-71766227-f8bf-45d0-b781-c9d6ac369998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9ab9536-3b94-42f7-bfd7-3d971f2078a9", "tag": "cbc02de0-195a-4a3e-b0f7-132a1241965f"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:04.835226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-594f4446-37c6-4174-960c-68e7bccc6cfe req-71766227-f8bf-45d0-b781-c9d6ac369998 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:04.837001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-594f4446-37c6-4174-960c-68e7bccc6cfe req-71766227-f8bf-45d0-b781-c9d6ac369998 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:04.887983 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-594f4446-37c6-4174-960c-68e7bccc6cfe req-71766227-f8bf-45d0-b781-c9d6ac369998 service nova] Creating event network-changed:cbc02de0-195a-4a3e-b0f7-132a1241965f for instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 on n-h2-846219-13 Jul 25 16:41:04.902933 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-594f4446-37c6-4174-960c-68e7bccc6cfe req-71766227-f8bf-45d0-b781-c9d6ac369998 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089283 Jul 25 16:41:04.903569 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2721/5520] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:05.216280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:05.216916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:05.236691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:05.237217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:05.238280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:05.240505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:06.035511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:06.049596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0f3cdac-9a22-4e20-8157-eb27116fdf33 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.838106 Jul 25 16:41:06.050828 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2800/5521] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:05 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:07.086275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:07.087000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:07.123888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:07.124432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:07.128721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:07.130380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:07.187860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:07.805862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:07.823302 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-32650389-941e-43d6-879d-6e1c358aa867 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.745541 Jul 25 16:41:07.843754 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2722/5522] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:07 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:07.894340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c6e16d5b-6f7f-4f26-8def-79ab38d79749 req-dc98a408-58f6-41d8-b4f8-68779886f3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6718d14b-2d80-44c5-b2ce-3adcd12f03e5", "tag": "db591b63-1eec-4eff-9676-59ee3389d58e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:07.925783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c6e16d5b-6f7f-4f26-8def-79ab38d79749 req-dc98a408-58f6-41d8-b4f8-68779886f3fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:07.926759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c6e16d5b-6f7f-4f26-8def-79ab38d79749 req-dc98a408-58f6-41d8-b4f8-68779886f3fa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:07.973928 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c6e16d5b-6f7f-4f26-8def-79ab38d79749 req-dc98a408-58f6-41d8-b4f8-68779886f3fa service nova] Creating event network-changed:db591b63-1eec-4eff-9676-59ee3389d58e for instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 on n-h1-846219-13 Jul 25 16:41:07.990168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c6e16d5b-6f7f-4f26-8def-79ab38d79749 req-dc98a408-58f6-41d8-b4f8-68779886f3fa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099306 Jul 25 16:41:07.994264 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2801/5523] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:08.850624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:08.851252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:08.853838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:08.857472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=12 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:08.872980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:08.873589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:08.881071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:08.881603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:09.391638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:09.408373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b691579-747a-4c69-a8c2-ea51b1fd447f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.561532 Jul 25 16:41:09.414850 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2723/5524] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:08 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:10.453947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:10.455660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:10.476210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:10.495483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:10.495956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:10.504990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:10.505884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:10.849836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:10.859506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c58fbca-7af7-4e65-b3eb-19b6ba253ecc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.423122 Jul 25 16:41:10.860119 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2802/5525] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:10 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:11.881554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:11.882872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:11.899341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:11.903070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:11.905362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:11.908752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:12.803790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:12.827231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8fccf5ce-4fbb-453b-ba84-ea8e7398ec80 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.948506 Jul 25 16:41:12.842548 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2724/5526] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:11 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:13.072407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3a4f3c14-e664-432f-8d39-d3eb38b4683f req-22c73fb3-2465-4a43-ab13-fcd990899291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ab9536-3b94-42f7-bfd7-3d971f2078a9", "name": "network-vif-plugged", "status": "completed", "tag": "cbc02de0-195a-4a3e-b0f7-132a1241965f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:13.111365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3a4f3c14-e664-432f-8d39-d3eb38b4683f req-22c73fb3-2465-4a43-ab13-fcd990899291 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:13.111843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3a4f3c14-e664-432f-8d39-d3eb38b4683f req-22c73fb3-2465-4a43-ab13-fcd990899291 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:13.161330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3a4f3c14-e664-432f-8d39-d3eb38b4683f req-22c73fb3-2465-4a43-ab13-fcd990899291 service nova] Creating event network-vif-plugged:cbc02de0-195a-4a3e-b0f7-132a1241965f for instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 on n-h2-846219-13 Jul 25 16:41:13.184161 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3a4f3c14-e664-432f-8d39-d3eb38b4683f req-22c73fb3-2465-4a43-ab13-fcd990899291 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120673 Jul 25 16:41:13.192148 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2803/5527] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:13.850838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:13.852095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:13.877382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:13.878456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:13.879824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:13.881530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:14.854482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:14.869724 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca9e5013-e0f1-45e7-9107-cb41ea842ba2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 1.024015 Jul 25 16:41:14.870793 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2725/5528] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:13 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:15.894931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:15.895743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:15.910718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:15.911192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:15.916299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:15.916299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:16.484307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:16.522423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c746d30-6f15-4542-96f5-c6901276a7cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.632989 Jul 25 16:41:16.525040 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2804/5529] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:15 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:17.548194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:17.549525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:17.556956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:17.569654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:17.570658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:17.571115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:17.907774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:17.915917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f419325-f7ab-4713-b1f7-6a229d4abff3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.371767 Jul 25 16:41:17.929319 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2726/5530] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:17 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:18.941720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:18.943090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:18.979443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:18.980215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:18.982237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:18.983998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:19.686928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-debe5cea-044c-4e5f-ad11-cfe31a574f44 req-98b4b7a4-c6cf-4b38-9710-a3d463e99108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d14b-2d80-44c5-b2ce-3adcd12f03e5", "name": "network-vif-plugged", "status": "completed", "tag": "db591b63-1eec-4eff-9676-59ee3389d58e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:19.699831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-debe5cea-044c-4e5f-ad11-cfe31a574f44 req-98b4b7a4-c6cf-4b38-9710-a3d463e99108 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:19.710027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-debe5cea-044c-4e5f-ad11-cfe31a574f44 req-98b4b7a4-c6cf-4b38-9710-a3d463e99108 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:19.754879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-debe5cea-044c-4e5f-ad11-cfe31a574f44 req-98b4b7a4-c6cf-4b38-9710-a3d463e99108 service nova] Creating event network-vif-plugged:db591b63-1eec-4eff-9676-59ee3389d58e for instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 on n-h1-846219-13 Jul 25 16:41:19.778246 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-debe5cea-044c-4e5f-ad11-cfe31a574f44 req-98b4b7a4-c6cf-4b38-9710-a3d463e99108 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086906 Jul 25 16:41:19.778246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2727/5531] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:41:19.799364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:19.829617 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1724ecf0-2fb6-43a1-a6d2-a697c1724a5d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.890151 Jul 25 16:41:19.830449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2805/5532] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:18 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:20.856565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:20.857331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:20.874192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:20.874777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:20.879173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:20.879847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:21.436799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:21.445349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6e3bfd92-4836-4c96-a5d3-e8bccd78eb0b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1325 microversion: 2.1 time: 0.593723 Jul 25 16:41:21.446611 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2728/5533] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:20 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1325 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:22.468206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:22.468894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:22.502279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:22.502514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:22.503276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:22.503721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:22.809910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:22.832029 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5355064e-d552-4e3e-8063-d531078fd6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1519 microversion: 2.1 time: 0.368222 Jul 25 16:41:22.852752 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2806/5534] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:22 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:22.863166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:22.873363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:22.897017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:22.897504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:22.898300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:22.898730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:22.981150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lazy-loading 'flavor' on Instance uuid 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:41:23.195877 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07aa933d-eefb-4c3f-aabd-bb4108348535 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action" status: 200 len: 32 microversion: 2.1 time: 0.340813 Jul 25 16:41:23.197261 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2729/5535] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:41:22 2022] POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action => generated 32 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:41:23.207410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:23.208047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:23.235880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:23.240306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:23.253376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:23.255143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:23.680455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:23.694317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-920b5d98-5d6b-450d-a97b-b784e29cb8c2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.490673 Jul 25 16:41:23.695128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2807/5536] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:23 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:24.718457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:24.719167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:24.728427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:24.733669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:24.734267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:24.741021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:24.741881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:25.316369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:25.344527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14529ec1-05ef-4fdf-bd4d-4506a55ee0de tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.630441 Jul 25 16:41:25.350758 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2730/5537] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:24 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:26.380676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:26.382006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:26.432675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:26.438225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:26.439724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:26.440516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:26.753501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:26.766031 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cdaa6ff7-508f-42c1-90b1-e8597e9f04fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.387030 Jul 25 16:41:26.767747 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2808/5538] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:26 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:27.792067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:27.792789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:27.816410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:27.818837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:27.821862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:27.823277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:28.378638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:28.388374 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3511af78-7720-490a-99c1-4d7f32a40ac8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.602500 Jul 25 16:41:28.405945 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2731/5539] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:27 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:29.420939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:29.421900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:29.445978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:29.450147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:29.452851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:29.453663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:29.483350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=59 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:29.802080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:29.815088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26a16d8e-3dda-42c7-86e4-07d5b915c150 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.400608 Jul 25 16:41:29.836519 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2809/5540] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:29 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:30.844329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:30.848566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:30.869536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:30.876297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:30.878747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:30.879434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:31.193554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:31.202587 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.362519 Jul 25 16:41:31.203283 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2732/5541] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:30 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:32.228806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:32.230791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:32.250278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=24 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:32.254002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:32.258068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:32.259443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:32.261287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:32.723931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:32.745919 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9cb4e267-7a6d-4f2d-9421-940e1561fcbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.521694 Jul 25 16:41:32.749438 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2810/5542] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:32 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:32.850856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:32.851901 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ad09a98e-6af3-4796-ad20-2e61ac317794 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001801 Jul 25 16:41:32.852253 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2733/5543] 10.222.0.105 () {56 vars in 891 bytes} [Mon Jul 25 16:41:32 2022] GET /compute/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 16:41:33.771207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:33.771949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:33.788524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:33.789165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:33.808027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:33.808626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:34.246141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:34.264284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-583fdb48-a9ee-43e4-83e9-a61f24a505f3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.497093 Jul 25 16:41:34.266679 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2811/5544] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:33 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:35.291060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:35.291683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:35.310405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:35.315296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:35.316405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:35.325890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:35.979604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:35.990847 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9990907-c3d2-437f-b29e-0e97ba602fbe tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.704282 Jul 25 16:41:35.995466 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2734/5545] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:35 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:36.866070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1681216429", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:36.938376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:41:37.022745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:37.024579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:37.036374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:37.043137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:37.045541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:37.046430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:37.496071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:41:37.496643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:41:37.497526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:41:37.498065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:41:37.498602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:41:37.511679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:37.512408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:37.513870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:37.515399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:37.544937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Getting quotas for project e63fd0b68e11471c858ac6183666be5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:41:37.552017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Getting quotas for user 370a926fabb74fba9b403ba22421e43a and project e63fd0b68e11471c858ac6183666be5e. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:41:37.571459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:41:37.574267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:41:37.584108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:37.587074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:37.594354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7891bb34-86a1-4017-b40c-4619c9fdbf70 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.575460 Jul 25 16:41:37.599554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2735/5546] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:37 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:37.642386 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b273c0cd-5aa1-4924-b592-ad042e8cdc1c tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.779658 Jul 25 16:41:37.644148 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2812/5547] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:41:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:41:37.656023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f681e758-f84d-4bd5-bc7e-f69d50c9cacb tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:37.656819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f681e758-f84d-4bd5-bc7e-f69d50c9cacb tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:37.755954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f681e758-f84d-4bd5-bc7e-f69d50c9cacb tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:37.763253 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f681e758-f84d-4bd5-bc7e-f69d50c9cacb tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1219 microversion: 2.1 time: 0.111829 Jul 25 16:41:37.766538 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2736/5548] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:37 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:38.627891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:38.632755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:38.673139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:38.683946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:38.685469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:38.686204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:38.806579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:38.808460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:38.833399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:38.853483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:38.854905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:38.855876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:39.029905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:39.032156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:39.043117 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bc8fb7bc-be2e-4344-803f-8794c3a5f828 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1271 microversion: 2.1 time: 0.260565 Jul 25 16:41:39.062045 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2737/5549] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:38 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:39.063529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d704582-f3fc-471c-8a97-0d705d85b047 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.446889 Jul 25 16:41:39.064502 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2813/5550] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:38 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:40.070380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:40.070990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:40.080537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:40.096498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:40.104122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:40.112893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:40.114027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:40.114479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:40.125635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:40.126129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:40.127020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:40.127396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:40.299623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:40.311550 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55510907-4e5e-4f89-918c-cfdfd4896136 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1277 microversion: 2.1 time: 0.247362 Jul 25 16:41:40.312558 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2738/5551] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:40 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:40.435017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:40.468393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.382701 Jul 25 16:41:40.474507 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2814/5552] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:40 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:41.351968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:41.353609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:41.386276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:41.387284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:41.388580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:41.389804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:41.477436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:41.478510 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001503 Jul 25 16:41:41.478854 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2815/5553] 10.222.0.105 () {56 vars in 891 bytes} [Mon Jul 25 16:41:41 2022] GET /compute/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 25 16:41:41.487203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:41.488623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34cac73f-3be8-421b-ad05-21c9fd4d5705 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2/" status: 200 len: 380 microversion: 2.1 time: 0.002080 Jul 25 16:41:41.489547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2816/5554] 10.222.0.105 () {54 vars in 1040 bytes} [Mon Jul 25 16:41:41 2022] GET /compute/v2/ => generated 380 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 25 16:41:41.497212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:41.499221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:41.507546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:41.508322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:41.512711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:41.513662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:41.884104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:41.897672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:41.910454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1319 microversion: 2.1 time: 0.580993 Jul 25 16:41:41.911625 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.416358 Jul 25 16:41:41.912809 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2739/5555] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:41 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:41.914746 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2817/5556] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:41 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:41.915860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:41.917221 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed1d9294-cca8-47ce-9d72-43ff67898869 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.002617 Jul 25 16:41:41.918535 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2740/5557] 10.222.0.105 () {54 vars in 1046 bytes} [Mon Jul 25 16:41:41 2022] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:41.926933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:41.928978 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b0427ee-d778-4489-a51a-a4a84e0f7cd4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute//" status: 200 len: 379 microversion: - time: 0.002050 Jul 25 16:41:41.929917 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2818/5558] 10.222.0.105 () {56 vars in 891 bytes} [Mon Jul 25 16:41:41 2022] GET /compute/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 16:41:42.072256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ca1cd068-6f2f-4e08-8c63-7e818a2027cd req-e8f13fbb-fa45-493a-ac8c-d6e8fb382bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94100cb-a932-45d6-8028-07e119cd94ae", "tag": "f726022a-bbad-4d0d-88e4-6c2a84d11425"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:42.092265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ca1cd068-6f2f-4e08-8c63-7e818a2027cd req-e8f13fbb-fa45-493a-ac8c-d6e8fb382bb4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:42.093403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ca1cd068-6f2f-4e08-8c63-7e818a2027cd req-e8f13fbb-fa45-493a-ac8c-d6e8fb382bb4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:42.119697 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ca1cd068-6f2f-4e08-8c63-7e818a2027cd req-e8f13fbb-fa45-493a-ac8c-d6e8fb382bb4 service nova] Creating event network-changed:f726022a-bbad-4d0d-88e4-6c2a84d11425 for instance f94100cb-a932-45d6-8028-07e119cd94ae on n-h2-846219-13 Jul 25 16:41:42.142765 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ca1cd068-6f2f-4e08-8c63-7e818a2027cd req-e8f13fbb-fa45-493a-ac8c-d6e8fb382bb4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076814 Jul 25 16:41:42.143433 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2741/5559] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:41:42.968435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:42.969067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:42.980269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:42.981677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:42.991075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:42.991588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:42.992314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:42.992748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:42.995811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:42.996274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:42.997066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:42.997729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:43.375943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:43.382476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:43.386640 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b02c2fb4-154c-4324-9757-6e7f35e3d61b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.422127 Jul 25 16:41:43.398023 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2819/5560] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:42 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:43.405402 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48971274-8d4e-4ca9-b751-50061f0d8851 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1319 microversion: 2.1 time: 0.429313 Jul 25 16:41:43.406026 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2742/5561] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:42 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:44.410859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:44.411541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:44.427641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:44.428651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:44.444992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:44.445512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:44.446322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:44.451778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:44.454159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:44.457426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:44.458381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:44.460164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:45.714042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:45.725793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:45.728316 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90f30fab-ef8a-4235-91d4-c9619b5c3d64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 1.323054 Jul 25 16:41:45.728931 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2820/5562] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:44 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:45.740654 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-911e07b0-d947-4b9c-9d5c-a4b34f5c90e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1319 microversion: 2.1 time: 1.316990 Jul 25 16:41:45.750338 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2743/5563] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:44 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1319 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:46.493842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:46.494623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:46.509823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:46.511780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:46.516742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:46.521674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:46.595493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:41:46.752821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:46.753991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:46.777734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:46.779132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:46.783619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:46.788035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:46.789939 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e772a27-4f86-4759-8e5a-d7ec24743b17 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 204 len: 0 microversion: 2.1 time: 0.299497 Jul 25 16:41:46.791621 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2821/5564] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:41:46 2022] DELETE /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:41:46.803635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:46.807193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:46.827068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:46.827538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:46.828350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:46.828800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:47.337929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:47.338969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:47.351044 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a6dcd10-7706-43d2-be1c-347bbbcbb2e2 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1319 microversion: 2.1 time: 0.556218 Jul 25 16:41:47.351743 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2822/5565] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:46 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:47.366676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:47.366676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:47.380820 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-085fecf7-3b9e-4c28-a098-416bffcc919d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.632705 Jul 25 16:41:47.397700 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2744/5566] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:46 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:47.404349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:47.404833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:47.406581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:47.407333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:47.527617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:47.565642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:48.007818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:48.023545 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-376f1497-d95b-42b1-b56b-5d593f61ff5c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1581 microversion: 2.1 time: 0.664474 Jul 25 16:41:48.027820 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2823/5567] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:47 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1581 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:48.132618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-71834b40-8061-4f61-b681-4c266c966424 req-8a30437c-f960-4b61-982f-9722b975e8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94100cb-a932-45d6-8028-07e119cd94ae", "name": "network-vif-plugged", "status": "completed", "tag": "f726022a-bbad-4d0d-88e4-6c2a84d11425"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:48.142746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:48.166159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-71834b40-8061-4f61-b681-4c266c966424 req-8a30437c-f960-4b61-982f-9722b975e8f2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:48.167120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-71834b40-8061-4f61-b681-4c266c966424 req-8a30437c-f960-4b61-982f-9722b975e8f2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:48.200156 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-71834b40-8061-4f61-b681-4c266c966424 req-8a30437c-f960-4b61-982f-9722b975e8f2 service nova] Creating event network-vif-plugged:f726022a-bbad-4d0d-88e4-6c2a84d11425 for instance f94100cb-a932-45d6-8028-07e119cd94ae on n-h2-846219-13 Jul 25 16:41:48.213802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-71834b40-8061-4f61-b681-4c266c966424 req-8a30437c-f960-4b61-982f-9722b975e8f2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084771 Jul 25 16:41:48.219432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2745/5568] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:48.379548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:48.380181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:48.394734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:48.395457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:48.396612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:48.397247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:48.404699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:48.405763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:48.415699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:48.417615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:48.418597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:48.425478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:48.919975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:48.931619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-298938f8-b557-4111-8c58-57ae6c91d4ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.531080 Jul 25 16:41:48.938262 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2746/5569] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:48 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:48.997974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:49.018158 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6cb4a651-8aec-475d-9871-21e3e0fc61f7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1319 microversion: 2.1 time: 0.644305 Jul 25 16:41:49.019840 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2824/5570] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:48 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:49.047493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:49.048369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:49.055304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:49.056032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:49.063320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:49.064049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:49.479010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:49.494068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-091af256-9384-4fed-ac29-db1c52a9edf2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1581 microversion: 2.1 time: 0.450487 Jul 25 16:41:49.512897 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2747/5571] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:49 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1581 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:49.968089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:49.969710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:49.978836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:49.980506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:49.982192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:49.983952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:50.041598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:50.042693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:50.062657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:50.063410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:50.066307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:50.067935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:52.089471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:52.122447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30a140c5-a87d-458a-9c8d-3015f030731d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1319 microversion: 2.1 time: 2.078113 Jul 25 16:41:52.140504 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2748/5572] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:50 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1319 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:41:52.149603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:52.151723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:52.159891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:52.160775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:52.167324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:52.168070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:52.418844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:52.432068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-412d8a25-2fa1-40b4-9bde-ba41fd95aaf9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1513 microversion: 2.1 time: 0.289881 Jul 25 16:41:52.432997 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2749/5573] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:52 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:52.463424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:52.478800 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ff2a5a2-21ee-4925-bca0-bb1ec9ca4edd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 2.521418 Jul 25 16:41:52.488979 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2825/5574] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:49 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:53.144600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:53.144779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9ddcf7a9-6fa9-441f-9044-c42448826db7 req-defbc7f3-6fff-4288-914c-0c08de098f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833fb3c7-7565-4610-8927-bfac1c9fc60b", "name": "network-vif-deleted", "tag": "4319dbaa-01c6-4f4d-952f-0fb070fed2f9"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:53.145320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:53.156683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.164986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:53.166163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.173474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9ddcf7a9-6fa9-441f-9044-c42448826db7 req-defbc7f3-6fff-4288-914c-0c08de098f92 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.174618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:53.175266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9ddcf7a9-6fa9-441f-9044-c42448826db7 req-defbc7f3-6fff-4288-914c-0c08de098f92 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:53.215615 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9ddcf7a9-6fa9-441f-9044-c42448826db7 req-defbc7f3-6fff-4288-914c-0c08de098f92 service nova] Creating event network-vif-deleted:4319dbaa-01c6-4f4d-952f-0fb070fed2f9 for instance 833fb3c7-7565-4610-8927-bfac1c9fc60b on n-h1-846219-13 Jul 25 16:41:53.230298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9ddcf7a9-6fa9-441f-9044-c42448826db7 req-defbc7f3-6fff-4288-914c-0c08de098f92 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089490 Jul 25 16:41:53.236554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2750/5575] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:53.827667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:53.842029 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a4dad7a-ae92-4dcc-a704-59c11933b5d7 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1469 microversion: 2.1 time: 0.700292 Jul 25 16:41:53.845329 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2826/5576] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:53 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1469 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:53.853013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:53.859967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:53.880983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.886147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:53.887214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.889769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:53.935869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:53.936796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:53.963272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.963967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:53.965236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:53.965895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:54.654359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:54.667116 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b42aee1-eb53-4cc0-a8f8-481aa94b2717 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 1.216959 Jul 25 16:41:54.695816 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2751/5577] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:53 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:54.721454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:54.725330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:54.740029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:54.742555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:54.743316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:54.744410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:54.745088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:54.781383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:54.800695 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a31c68aa-7c2a-4545-9481-6826a8e5cc49 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.952385 Jul 25 16:41:54.804260 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2827/5578] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:53 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:54.834014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:41:55.031563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=44 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:55.054313 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f1bba1b7-4bc9-4a67-a7d8-29854ba4f720 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "DELETE /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 204 len: 0 microversion: 2.1 time: 0.356826 Jul 25 16:41:55.057796 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2752/5579] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:41:54 2022] DELETE /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:41:55.074191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:55.074969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:55.089020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:55.091170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:55.092279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:55.095010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:55.697641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:55.700816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:55.723500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:55.728531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:55.729504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:55.729977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:55.840688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:55.865251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d422b10-636e-4b7e-bf09-02f57414f3d1 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1475 microversion: 2.1 time: 0.799933 Jul 25 16:41:55.885829 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2828/5580] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:55 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1475 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:55.898098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:55.901572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:55.913211 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f0bd735-6f06-4a82-bce0-adcfd03f7476 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.219300 Jul 25 16:41:55.916007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:55.926857 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2753/5581] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:55 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:41:55.956107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:55.960172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:55.966717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:55.968590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:56.726044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:56.753226 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-74d7ad7a-df1a-48da-a117-2bafe1265a0c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 0.861996 Jul 25 16:41:56.753858 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2829/5582] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:55 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:56.896648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:56.897492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:56.910416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:56.911854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:56.913721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:56.916420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:56.944107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:56.944939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:56.962859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:56.970000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:56.971829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:56.975214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:57.206504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:57.229902 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f92b3a6-dd35-4581-86f0-29a7eccc408d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.289728 Jul 25 16:41:57.246086 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2830/5583] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:56 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:57.442822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0db8e09e-8f3d-4f58-885f-b6b15d55d3f0 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: .version_select at 0x7f9d901e99d0>, body: {"keypair": {"name": "tempest-keypair-1983952529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyJgug83sqxDaf0u/kHehDD2rN3g8l4/IFZ76eAqjymx0DchZ5O2EnlWIoUCVBUvF1uG54Y+0DbPeU0CwD7tkM0tfrIRbp0WvjSwfCYymGoHLXM/oZ3PlYHC+yTGjVesg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:57.499514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0db8e09e-8f3d-4f58-885f-b6b15d55d3f0 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:41:57.517670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0db8e09e-8f3d-4f58-885f-b6b15d55d3f0 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for user c2ece84b0a554ada93232d551fa5f50c and project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:41:57.563827 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0db8e09e-8f3d-4f58-885f-b6b15d55d3f0 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315619 Jul 25 16:41:57.565950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2831/5584] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:41:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:57.780327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:57.782708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:57.821690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:57.826128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:57.828019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:57.830740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:58.271155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:58.278648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:41:58.347852 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11910bce-d997-4dd3-9a4c-a4f1710a05b6 tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1475 microversion: 2.1 time: 1.454901 Jul 25 16:41:58.365212 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2754/5585] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:56 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1475 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:41:58.375034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:58.376111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:58.389648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:58.390895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:58.392231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:58.393053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:58.843201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:58.854467 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e8753b3-74ec-44c0-9c23-1ee6f888466f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.487424 Jul 25 16:41:58.866298 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2755/5586] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:58 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:59.391635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:59.395956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:59.438620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:59.439563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:59.440644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:59.441285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:59.844950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370a926fabb74fba9b403ba22421e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63fd0b68e11471c858ac6183666be5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:41:59.856105 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba9d6bed-5720-47c1-97d7-2baf0f76b93d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 200 len: 1433 microversion: 2.1 time: 0.471811 Jul 25 16:41:59.856723 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2756/5587] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:59 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 1433 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:41:59.866419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3135aed0-e833-43f1-8296-131271e843a8 req-ac3d5866-7c0c-41b5-8496-6e7cd49dde15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94100cb-a932-45d6-8028-07e119cd94ae", "name": "network-vif-deleted", "tag": "f726022a-bbad-4d0d-88e4-6c2a84d11425"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:41:59.899176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3135aed0-e833-43f1-8296-131271e843a8 req-ac3d5866-7c0c-41b5-8496-6e7cd49dde15 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:59.902679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3135aed0-e833-43f1-8296-131271e843a8 req-ac3d5866-7c0c-41b5-8496-6e7cd49dde15 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:59.935293 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3135aed0-e833-43f1-8296-131271e843a8 req-ac3d5866-7c0c-41b5-8496-6e7cd49dde15 service nova] Creating event network-vif-deleted:f726022a-bbad-4d0d-88e4-6c2a84d11425 for instance f94100cb-a932-45d6-8028-07e119cd94ae on n-h2-846219-13 Jul 25 16:41:59.942797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3135aed0-e833-43f1-8296-131271e843a8 req-ac3d5866-7c0c-41b5-8496-6e7cd49dde15 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080004 Jul 25 16:41:59.948052 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2757/5588] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:41:59.962529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:41:59.963762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:41:59.981071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:59.981980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:41:59.983524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:41:59.984621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:00.038691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:00.059440 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93492868-da1b-4206-9722-409bfe0717ad tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1525 microversion: 2.1 time: 2.286358 Jul 25 16:42:00.072252 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2832/5589] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:57 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1525 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:00.331694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:00.353416 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-384b4915-b7b5-490b-abc8-7f2ac2d57a72 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.402506 Jul 25 16:42:00.356548 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2758/5590] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:41:59 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:00.880926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:00.881978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] [instance: f94100cb-a932-45d6-8028-07e119cd94ae] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:00.910051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:00.917744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:00.931382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:00.934039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:00.971649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] HTTP exception thrown: Instance f94100cb-a932-45d6-8028-07e119cd94ae could not be found. Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Request method failure captured: Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae HTTP/1.1 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3se9J6hOpfTM4KgTVRX89Gjtbd3hjABvRnJokpEtOEUx6U7mTBbQHcQyK1CT6SRBzuGVRR7X1oZkQ2zP9hS3ytDet3R8bQBX2s12AbqC7gH9uxGS626wUNLTvaYQdDDVm2ETGsDwrzL0PHS1YLiU_feZyVTpWo9HHumNwW2jffdyRm4 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: e63fd0b68e11471c858ac6183666be5e Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1683766824 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e63fd0b68e11471c858ac6183666be5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/e63fd0b68e11471c858ac6183666be5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/e63fd0b68e11471c858ac6183666be5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_e63fd0b68e11471c858ac6183666be5e"}]}] Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1683766824 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: e63fd0b68e11471c858ac6183666be5e Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1683766824 Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1683766824-project Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 370a926fabb74fba9b403ba22421e43a Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1683766824-project Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance f94100cb-a932-45d6-8028-07e119cd94ae could not be found. Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'f94100cb-a932-45d6-8028-07e119cd94ae'} Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94100cb-a932-45d6-8028-07e119cd94ae could not be found. Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94100cb-a932-45d6-8028-07e119cd94ae could not be found. Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:00.974231 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94100cb-a932-45d6-8028-07e119cd94ae could not be found. Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] Returning 404 to user: Instance f94100cb-a932-45d6-8028-07e119cd94ae could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-87bf3163-c20b-4327-aa05-6b2ac56fed6d tempest-VolumesNegativeTest-1683766824 tempest-VolumesNegativeTest-1683766824-project] 10.222.0.105 "GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae" status: 404 len: 111 microversion: 2.1 time: 0.100523 Jul 25 16:42:00.984282 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2833/5591] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:00 2022] GET /compute/v2.1/servers/f94100cb-a932-45d6-8028-07e119cd94ae => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:42:01.103280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:01.105040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:01.120516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:01.124067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:01.130843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:01.132232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:01.230006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-766707076", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fb0dda0-2bc7-458c-9ced-c45af22c7d79"}], "security_groups": [{"name": "tempest-securitygroup--428923050"}], "key_name": "tempest-keypair-1983952529", "user_data": "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:01.721817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] validate_networks() for [('3fb0dda0-2bc7-458c-9ced-c45af22c7d79', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:42:01.977729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:01.990402 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97f365f5-623b-4605-999c-cd08e5788e64 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1505 microversion: 2.1 time: 0.898083 Jul 25 16:42:01.998216 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2759/5592] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:01 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1505 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:02.004580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:02.005217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:02.040908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:02.041391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:02.042177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:02.042608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:02.272367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:02.297565 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-687cf631-557f-4869-8a2a-b5b52587c03d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.292747 Jul 25 16:42:02.299478 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2760/5593] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:01 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:02.327269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:02.328912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:02.340261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:02.342950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:02.344660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:02.345826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:02.440034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:02.681289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:02.692461 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b75d9654-0f7a-4c0c-a08d-fb1103f86d6f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1519 microversion: 2.1 time: 0.373634 Jul 25 16:42:02.693795 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2761/5594] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:02 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1519 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:02.748312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd2614c2-b8aa-4661-a355-afa8029ba6b9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:02.757610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd2614c2-b8aa-4661-a355-afa8029ba6b9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 3db239f3-7882-4801-977a-085cafad6711] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:02.770087 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-bd2614c2-b8aa-4661-a355-afa8029ba6b9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Instance 3db239f3-7882-4801-977a-085cafad6711 could not be found. Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd2614c2-b8aa-4661-a355-afa8029ba6b9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/3db239f3-7882-4801-977a-085cafad6711/action HTTP/1.1 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 14 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: {"rescue": {}} Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 3db239f3-7882-4801-977a-085cafad6711 could not be found. Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '3db239f3-7882-4801-977a-085cafad6711', 'body': {'rescue': {}}} Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db239f3-7882-4801-977a-085cafad6711 could not be found. Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db239f3-7882-4801-977a-085cafad6711 could not be found. Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:02.789976 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:02.795005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:02.795005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:02.795005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:42:02.795005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:42:02.795005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db239f3-7882-4801-977a-085cafad6711 could not be found. Jul 25 16:42:02.795005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:02.796436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd2614c2-b8aa-4661-a355-afa8029ba6b9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 404 to user: Instance 3db239f3-7882-4801-977a-085cafad6711 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:42:02.803563 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd2614c2-b8aa-4661-a355-afa8029ba6b9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/3db239f3-7882-4801-977a-085cafad6711/action" status: 404 len: 111 microversion: 2.1 time: 0.062695 Jul 25 16:42:02.806615 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2762/5595] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:42:02 2022] POST /compute/v2.1/servers/3db239f3-7882-4801-977a-085cafad6711/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:42:02.830624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:02.831303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:02.853360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:02.853926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:02.854924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:02.855458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.053451 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-789287ac-76bd-44d3-8c44-998ee1c0650b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action" status: 202 len: 0 microversion: 2.1 time: 0.231175 Jul 25 16:42:03.069943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2763/5596] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:42:02 2022] POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:42:03.095870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:03.095870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:03.118162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:03.118615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.119400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:03.119861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.207036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:42:03.207620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:42:03.208227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:42:03.208752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:42:03.210049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:42:03.228455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:03.228926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.235992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:03.237003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.280458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:42:03.291829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for user c2ece84b0a554ada93232d551fa5f50c and project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:42:03.320093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:42:03.323244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:42:03.427880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a994b66a-3efd-4547-985d-59e45ba045f6 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.206506 Jul 25 16:42:03.432694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2834/5597] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:42:01 2022] POST /compute/v2.1/servers => generated 403 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:42:03.455497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:03.461447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:03.488373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:03.491199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.493067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:03.496101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:03.808606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:03.809296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:03.831233 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-500106b9-eb15-4b65-ad7f-51baa27baf29 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.391880 Jul 25 16:42:03.841401 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03d970da-ebf0-4019-9a30-94f5b347b6cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1524 microversion: 2.1 time: 0.766998 Jul 25 16:42:03.845654 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2835/5599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:03 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:03.845889 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2764/5599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:03 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1524 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:03.862514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56ce4dcc-4eee-498b-92b6-5a4a57719714 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:03.869346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56ce4dcc-4eee-498b-92b6-5a4a57719714 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:04.010057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56ce4dcc-4eee-498b-92b6-5a4a57719714 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:04.024319 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56ce4dcc-4eee-498b-92b6-5a4a57719714 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1241 microversion: 2.1 time: 0.177325 Jul 25 16:42:04.027027 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2765/5600] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:03 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:04.855726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:04.856468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:04.867895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:04.868529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:04.875744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:04.891073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:04.893116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:04.895245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:04.895724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:04.905307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:04.909202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:04.910438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:05.152060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:05.190522 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab1f4160-c9a7-4b54-be44-7357da2c0a9d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 200 len: 1228 microversion: 2.1 time: 0.338905 Jul 25 16:42:05.194535 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2836/5601] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:04 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 1228 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:05.215022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:05.221812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:05.247461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:05.248836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:05.253270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:05.254190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:05.471481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:05.489260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:05.502559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-187d634c-fb3b-4eab-ab9e-4b1979017bdb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1237 microversion: 2.1 time: 0.305503 Jul 25 16:42:05.503961 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2837/5602] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:05 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1237 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:05.504534 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10fbf30e-80ba-4a4d-830c-14582e6284e5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1504 microversion: 2.1 time: 0.633113 Jul 25 16:42:05.517980 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2766/5603] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:04 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:05.530558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:05.542759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:05.559879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:05.564071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:05.565037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:05.570033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:05.666450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lazy-loading 'flavor' on Instance uuid f9ab9536-3b94-42f7-bfd7-3d971f2078a9 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:42:05.739493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Cannot 'rescue' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state paused Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action HTTP/1.1 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 14 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: {"rescue": {}} Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'rescue' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state paused Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'f9ab9536-3b94-42f7-bfd7-3d971f2078a9', 'body': {'rescue': {}}} Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 in vm_state paused. Cannot rescue while the instance is in this state. Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state paused Jul 25 16:42:05.759212 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state paused Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 409 to user: Cannot 'rescue' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state paused {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:42:05.767367 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fa56766-21e1-4e46-835b-805d7008424e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action" status: 409 len: 144 microversion: 2.1 time: 0.237060 Jul 25 16:42:05.771890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:05.772809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:05.787925 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2838/5604] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:42:05 2022] POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action => generated 144 bytes in 263 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:42:05.810073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:05.810543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:05.811415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:05.811865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:06.089267 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-136cf732-ac54-4c3d-8682-0fcc1e606707 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action" status: 202 len: 0 microversion: 2.1 time: 0.322028 Jul 25 16:42:06.107451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:06.109055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:06.112762 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2767/5605] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:42:05 2022] POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:42:06.127913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:06.128643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:06.129766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:06.130441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:06.216170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:06.217467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:06.244027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:06.244949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:06.246015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:06.248495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:06.353037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b HTTP/1.1 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '833fb3c7-7565-4610-8927-bfac1c9fc60b'} Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:06.355222 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:42:06.360429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-923fa4bf-d32a-4d16-a2d9-646d5c421499 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 404 len: 111 microversion: 2.1 time: 0.148561 Jul 25 16:42:06.382505 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2768/5606] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:06 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:42:06.528870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:06.531180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:06.554597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:06.555758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:06.587651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:06.589739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:07.118929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:07.132940 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a4bdc74-196e-48a3-aeb0-7293ecdae8c3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1301 microversion: 2.1 time: 0.609388 Jul 25 16:42:07.148820 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2769/5607] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:06 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1301 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:07.148820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571419687", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-111214727", "security_groups": [{"name": "tempest-secgroup-smoke-1809880973"}], "block_device_mapping_v2": [{"uuid": "fbd9c11e-7649-45e5-abed-97fcd1feac99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:07.274876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:07.284509 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7c92595f-6bc6-4082-a58e-303e85223dcb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1511 microversion: 2.1 time: 1.188045 Jul 25 16:42:07.311948 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2839/5608] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:06 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1511 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:07.766138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:42:08.162320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:08.163776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:08.177632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:08.178295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:08.179401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:08.180064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:08.520917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:08.531304 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c0630a1-11b2-42b0-83d4-a32589098012 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1299 microversion: 2.1 time: 0.374970 Jul 25 16:42:08.537186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2840/5609] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:08 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1299 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:08.555029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:08.560465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:08.582118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:08.583324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:08.584925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:08.588896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:09.102079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:09.160577 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4aa9d34-0d3a-49f1-b08e-b5233aed5ffb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1519 microversion: 2.1 time: 0.621871 Jul 25 16:42:09.164972 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2841/5610] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:08 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1519 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:09.560651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:09.561895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:09.583513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:09.584004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:09.585800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:09.586943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:09.636416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:42:09.638188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:42:09.639044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:42:09.639688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:42:09.640348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:42:09.674159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:09.674979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:09.676249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:09.676959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:09.731780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:42:09.746765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:42:09.753119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:09.773448 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-664d3e3d-02de-487d-9033-1d6be81a41e1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1299 microversion: 2.1 time: 0.218162 Jul 25 16:42:09.776814 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2842/5611] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:09 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:09.890059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:42:09.892518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbd9c11e-7649-45e5-abed-97fcd1feac99',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:42:10.420048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c766388-0283-4e64-81bb-064c4cff9190 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.281887 Jul 25 16:42:10.429323 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2770/5612] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:42:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 3292 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:42:10.438388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6509e382-9356-4d3a-af1e-ac440e65d61d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:10.439558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6509e382-9356-4d3a-af1e-ac440e65d61d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:10.676825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6509e382-9356-4d3a-af1e-ac440e65d61d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:10.694697 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6509e382-9356-4d3a-af1e-ac440e65d61d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1096 microversion: 2.1 time: 0.263536 Jul 25 16:42:10.695694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2843/5613] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:10 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1096 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:10.808336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:10.809465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:10.821477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:10.824049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:10.826797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:10.828082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:11.342394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:11.355346 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-58dd65ce-7235-4bf6-a275-80c23f0c0df7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 0.551748 Jul 25 16:42:11.358937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2771/5614] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:10 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:11.722069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:11.729087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:11.773724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:11.779081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:11.782582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:11.794308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:12.135518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:12.176567 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-25391246-43c8-4a7d-a5a9-15613f5f2713 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1138 microversion: 2.1 time: 0.461946 Jul 25 16:42:12.198172 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2844/5615] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:11 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1138 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:12.392385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:12.394341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:12.426000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:12.434680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:12.441416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:12.442054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:13.056440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:13.091196 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c8b4cc64-a9f3-486a-b0de-922743993741 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 0.702600 Jul 25 16:42:13.092529 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2772/5616] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:12 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:13.156359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-00822485-b5e2-4bcc-bce9-411314f3405e req-b83a9b4c-5a12-4055-9c31-a124219ddf9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b10353-c91a-415a-8d62-d1bd2bf31947", "tag": "f09c13f1-1781-4c99-ab34-41efa0551c0c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:13.176542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-00822485-b5e2-4bcc-bce9-411314f3405e req-b83a9b4c-5a12-4055-9c31-a124219ddf9f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:13.178329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-00822485-b5e2-4bcc-bce9-411314f3405e req-b83a9b4c-5a12-4055-9c31-a124219ddf9f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:13.210175 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-00822485-b5e2-4bcc-bce9-411314f3405e req-b83a9b4c-5a12-4055-9c31-a124219ddf9f service nova] Creating event network-changed:f09c13f1-1781-4c99-ab34-41efa0551c0c for instance b7b10353-c91a-415a-8d62-d1bd2bf31947 on n-h2-846219-13 Jul 25 16:42:13.217520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:13.218483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:13.242170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:13.243720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:13.244983 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-00822485-b5e2-4bcc-bce9-411314f3405e req-b83a9b4c-5a12-4055-9c31-a124219ddf9f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092260 Jul 25 16:42:13.247272 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2845/5617] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:42:13.247679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:13.248404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:13.326041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:13.460232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:13.493989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:13.500090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:13.553974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:13.562910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:13.568539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:13.569735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:13.681012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lazy-loading 'flavor' on Instance uuid f9ab9536-3b94-42f7-bfd7-3d971f2078a9 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:42:14.516508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:14.541319 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e55e4d7c-6151-4a6f-93d3-5df022eb7b27 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1212 microversion: 2.1 time: 1.327571 Jul 25 16:42:14.554985 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2773/5618] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:13 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1212 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:14.556774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:14.558543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:14.578930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:14.586148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:14.586992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:14.587449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:14.605080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:14.650748 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7b5ff04b-d078-4ff0-adbd-98de464a99a8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action" status: 200 len: 32 microversion: 2.1 time: 1.190467 Jul 25 16:42:14.653252 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2846/5619] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:42:13 2022] POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action => generated 32 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:42:14.668975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:14.671925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:14.693827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:14.707365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:14.713076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:14.714082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:15.588023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:15.601353 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55ca0766-c558-45ed-9003-4ac764ef2386 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 1.049998 Jul 25 16:42:15.610370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2774/5620] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:14 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:15.623905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:15.625545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:15.650549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:15.651491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:15.653240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:15.654369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:15.924130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:15.988066 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b0166d4-dd0c-4347-9c7e-2ea7d8b55457 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 1.326813 Jul 25 16:42:15.990219 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2847/5621] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:14 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:16.320276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:16.342961 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3aa1fa9d-bbd7-4ec2-ab51-be03d7b972ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1280 microversion: 2.1 time: 0.730589 Jul 25 16:42:16.347074 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2775/5622] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:15 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1280 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:16.651146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:16.652311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:16.665877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:16.673935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:16.675561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:16.676228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:17.017055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:17.020710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:17.045044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:17.046071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:17.046551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:17.047012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:17.085900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:17.109235 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e7bd39ff-77e7-4405-bf2c-599c17f0e669 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 0.453075 Jul 25 16:42:17.110508 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2848/5623] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:16 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:17.376781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:17.377636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:17.390776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:17.392038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:17.395200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:17.398376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:17.720458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:17.736345 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8180b9a5-dbc0-47e4-ac4c-a40484357789 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.723940 Jul 25 16:42:17.745598 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2776/5624] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:17 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:17.754573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f1bc7ab5-5c31-44f6-9dc9-e6882b3e7834 req-344fde4f-1484-4d14-9c20-662b87bea630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5de2559-3b78-4425-aab9-0eb446ef4a53", "tag": "649e540e-b2f4-452a-b859-ffb89a3d6b80"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:17.802514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f1bc7ab5-5c31-44f6-9dc9-e6882b3e7834 req-344fde4f-1484-4d14-9c20-662b87bea630 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:17.803015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f1bc7ab5-5c31-44f6-9dc9-e6882b3e7834 req-344fde4f-1484-4d14-9c20-662b87bea630 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:17.842526 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f1bc7ab5-5c31-44f6-9dc9-e6882b3e7834 req-344fde4f-1484-4d14-9c20-662b87bea630 service nova] Creating event network-changed:649e540e-b2f4-452a-b859-ffb89a3d6b80 for instance f5de2559-3b78-4425-aab9-0eb446ef4a53 on n-h1-846219-13 Jul 25 16:42:17.863016 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f1bc7ab5-5c31-44f6-9dc9-e6882b3e7834 req-344fde4f-1484-4d14-9c20-662b87bea630 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115581 Jul 25 16:42:17.863650 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2777/5625] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:42:18.132420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:18.133409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:18.153826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:18.154704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:18.155713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:18.156368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:18.741454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:18.755382 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0449f90-c847-4570-80be-c99b9938bf74 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1280 microversion: 2.1 time: 1.385013 Jul 25 16:42:18.764068 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2849/5626] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:17 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1280 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:18.776067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:18.777300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:18.822422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:18.825892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:18.840221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:18.843691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:19.496608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:19.514215 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e500f3a1-5a71-46e1-a60c-2550158426b4 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 1.385996 Jul 25 16:42:19.515206 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2778/5627] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:18 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:19.777152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:19.777971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:19.791127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:19.792731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:19.799161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:19.800046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:19.801956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:19.806693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:19.907917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:19.934048 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ef5e453-f825-4c1c-8190-c1c59f3abcfa tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 1.165426 Jul 25 16:42:19.945464 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2850/5628] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:18 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:20.539557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:20.550712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:20.561588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:20.573355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:20.575133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:20.576277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:20.693507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:21.122720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:21.132167 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f94602f9-c955-4d3a-b0e7-0f005c3b186e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1280 microversion: 2.1 time: 1.359050 Jul 25 16:42:21.145691 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2779/5629] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:19 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1280 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:21.151843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:21.152462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:21.171521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:21.172238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:21.173451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:21.173909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:21.413879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:21.441196 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f539e51a-d517-4f5f-bf24-e3d93e1c0edd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 0.908950 Jul 25 16:42:21.442094 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2851/5630] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:20 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:21.671378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2198e186-3eaa-4ffb-a0f8-ab32f02bc7ae req-36b8e4b1-bbbe-4b24-b8e9-ffbb7a57ef53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b10353-c91a-415a-8d62-d1bd2bf31947", "name": "network-vif-plugged", "status": "completed", "tag": "f09c13f1-1781-4c99-ab34-41efa0551c0c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:21.691942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2198e186-3eaa-4ffb-a0f8-ab32f02bc7ae req-36b8e4b1-bbbe-4b24-b8e9-ffbb7a57ef53 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:21.692367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2198e186-3eaa-4ffb-a0f8-ab32f02bc7ae req-36b8e4b1-bbbe-4b24-b8e9-ffbb7a57ef53 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:21.720002 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2198e186-3eaa-4ffb-a0f8-ab32f02bc7ae req-36b8e4b1-bbbe-4b24-b8e9-ffbb7a57ef53 service nova] Creating event network-vif-plugged:f09c13f1-1781-4c99-ab34-41efa0551c0c for instance b7b10353-c91a-415a-8d62-d1bd2bf31947 on n-h2-846219-13 Jul 25 16:42:21.731280 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2198e186-3eaa-4ffb-a0f8-ab32f02bc7ae req-36b8e4b1-bbbe-4b24-b8e9-ffbb7a57ef53 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065906 Jul 25 16:42:21.735311 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2852/5631] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:42:21.939291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:21.952787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e24a4a5-f503-467e-a4c1-e83d9ab2c441 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.805552 Jul 25 16:42:21.954044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2780/5632] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:21 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:22.154107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:22.155146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:22.184369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:22.185831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:22.186906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:22.188736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:22.465599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:22.467002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:22.504848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:22.508236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:22.517534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:22.518387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:22.692854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:22.712588 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-057a6e6f-f346-48bd-89bc-384d3ee09468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1280 microversion: 2.1 time: 0.562954 Jul 25 16:42:22.713271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2853/5633] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:22 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1280 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:22.995242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:22.995896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:23.008699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:23.020426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:23.021631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:23.022256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:23.033182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:23.047047 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2e32460f-198d-4eb2-a6a3-3fba09605cbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1366 microversion: 2.1 time: 0.586468 Jul 25 16:42:23.052280 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2781/5634] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:22 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1366 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:23.665721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:23.682154 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2804631-afb0-41e2-b9a9-47a32f59895e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.693034 Jul 25 16:42:23.683656 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2854/5635] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:22 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:23.743180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:23.744532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:23.764472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:23.764983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:23.772639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:23.773139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:24.089947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:24.091598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:24.106031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:24.106706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:24.115393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:24.116116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:24.203640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:24.224078 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-972c2b31-d829-4eb9-a77b-b75a8b9ce92f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1280 microversion: 2.1 time: 0.487491 Jul 25 16:42:24.225074 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2782/5636] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:23 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1280 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:24.560497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:24.577140 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89292411-6961-4922-8239-d47021a0dfc2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1553 microversion: 2.1 time: 0.490675 Jul 25 16:42:24.578794 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2855/5637] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:24 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1553 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:24.598902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:24.599430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:24.606650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:24.607299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:24.608717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:24.609549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:24.736310 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-116ef69d-71e3-41c2-acda-15b379fa85c2 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141570 Jul 25 16:42:24.736994 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2783/5638] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:42:24 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:42:24.753260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:24.753260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:24.756137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:24.756636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:24.757520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:24.758090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:25.133886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:25.151372 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-45b797ff-979f-4f73-9582-fa2f4eb0e824 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.409774 Jul 25 16:42:25.155126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2856/5639] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:24 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:25.249607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:25.251170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:25.258908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:25.260991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:25.262112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:25.263148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:25.264274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:25.571795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:25.584864 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b3cd8c1-97e2-480f-a59d-e5fde66ee4a8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.342377 Jul 25 16:42:25.590937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2784/5640] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:25 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:26.187703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:26.188693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:26.202384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:26.202890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:26.203756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:26.211497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:26.616693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:26.617357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:26.636942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:26.651699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:26.652556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:26.652995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:26.805363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:26.823191 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cecbfdb1-f462-4365-baee-1cb930335946 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.640243 Jul 25 16:42:26.823805 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2857/5641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:26 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:26.842511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-35012d5b-5f1a-42f5-a679-b0a1f60ed5aa req-9231ddc1-aa6f-4673-87b9-32ac2cd77f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b10353-c91a-415a-8d62-d1bd2bf31947", "tag": "f09c13f1-1781-4c99-ab34-41efa0551c0c"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:26.853938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-35012d5b-5f1a-42f5-a679-b0a1f60ed5aa req-9231ddc1-aa6f-4673-87b9-32ac2cd77f6a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:26.854657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-35012d5b-5f1a-42f5-a679-b0a1f60ed5aa req-9231ddc1-aa6f-4673-87b9-32ac2cd77f6a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:26.868749 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-35012d5b-5f1a-42f5-a679-b0a1f60ed5aa req-9231ddc1-aa6f-4673-87b9-32ac2cd77f6a service nova] Creating event network-changed:f09c13f1-1781-4c99-ab34-41efa0551c0c for instance b7b10353-c91a-415a-8d62-d1bd2bf31947 on n-h2-846219-13 Jul 25 16:42:26.882489 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-35012d5b-5f1a-42f5-a679-b0a1f60ed5aa req-9231ddc1-aa6f-4673-87b9-32ac2cd77f6a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041277 Jul 25 16:42:26.886281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2858/5642] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:42:27.442502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:27.462478 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-efacbe7c-df88-4a4a-8628-f6915d347111 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.854015 Jul 25 16:42:27.463015 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2785/5643] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:26 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:27.849559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:27.850488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:27.869302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:27.869786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:27.870763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:27.871399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:28.155767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:28.164955 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e482375-4a57-4a63-81c4-4363a1cfc46d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.324600 Jul 25 16:42:28.179285 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2859/5644] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:27 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:28.495527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:28.496753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:28.510897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:28.512322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:28.513749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:28.514450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:28.744017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:28.752913 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34ddd415-f82a-44dd-b308-f9e8bcfee3a3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.262469 Jul 25 16:42:28.767215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2786/5645] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:28 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:29.189858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:29.192560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:29.208764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:29.209988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:29.211246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:29.211910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:29.409767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:29.422496 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bfa006d3-697b-47f7-b65b-0e62cb9fabd5 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.239299 Jul 25 16:42:29.423255 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2860/5646] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:29 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:29.778284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:29.779108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:29.789821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:29.790779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:29.792159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:29.793009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:30.127137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:30.139797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2eb7e252-cd2b-40c1-b1c4-89b6dd4727df tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.367309 Jul 25 16:42:30.140857 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2787/5647] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:29 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:30.444438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:30.445260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:30.452838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:30.453501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:30.454441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:30.455168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:30.686873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:30.696850 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe417ceb-f7ef-494c-9708-98b4eabbc0df tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.256675 Jul 25 16:42:30.717219 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2861/5648] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:30 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:31.164660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:31.166406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:31.177416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:31.178250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:31.179724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:31.180374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:31.392892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:31.402516 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98683676-7d8b-478e-87b4-a285cf4e62a7 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.242557 Jul 25 16:42:31.407937 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2788/5649] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:31 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:31.727808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:31.728813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:31.746366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:31.747191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:31.749075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:31.750008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:32.117034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:32.141617 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de9763b0-7a6f-4232-b775-fd620234c62d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.420155 Jul 25 16:42:32.157690 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2862/5650] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:31 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:32.432076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:32.432722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:32.443938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:32.443938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:32.449759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:32.450926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:32.753163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:32.765206 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-daf0d083-d07d-45df-812a-b159895130de tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.339138 Jul 25 16:42:32.766351 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2789/5651] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:32 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:33.186849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:33.188118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:33.195749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:33.197673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:33.198472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:33.199978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:33.200915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:33.482046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:33.499800 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2adae1f7-3ebb-44db-b60a-82a749f3cd7d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.321125 Jul 25 16:42:33.501889 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2863/5652] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:33 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:42:33.801783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:33.802452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:33.822208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:33.823155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:33.824219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:33.825029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:34.442866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:34.485682 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba95173a-1664-4fe8-9ee7-6d2cecad28ed tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.689711 Jul 25 16:42:34.502628 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2790/5653] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:33 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:34.526951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:34.528313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:34.547324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:34.552495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:34.554597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:34.555100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:34.623688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:35.006288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:35.037992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5cc8a894-eea3-4f1e-8518-17fad04c69fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.518087 Jul 25 16:42:35.053755 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2864/5654] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:34 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:35.511775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:35.512460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:35.520585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:35.521320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:35.522980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:35.523709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:35.551638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:35.864338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:35.874581 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b193872d-d3f6-48c1-a371-50445a4a836a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.368794 Jul 25 16:42:35.880179 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2791/5655] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:35 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:36.073939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:36.074676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:36.085287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:36.086947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:36.088090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:36.088567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:36.359689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:36.380499 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d84b51c0-25ec-4816-aadf-d857223dcecf tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.320011 Jul 25 16:42:36.381453 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2865/5656] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:36 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:36.914836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:36.916255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:36.925135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:36.925924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:36.926951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:36.927606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:37.208171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:37.229262 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c2f01f9-ad91-461f-9448-c304e86a0a58 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.326188 Jul 25 16:42:37.230662 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2792/5657] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:36 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:37.405028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:37.407048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:37.415548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:37.416391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:37.417451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:37.418486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:37.546719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4421cea1-e687-4dc2-ab9e-bc9a1118a5b2 req-edd012bc-9316-4cbc-b8bf-346f8275454e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5de2559-3b78-4425-aab9-0eb446ef4a53", "name": "network-vif-plugged", "status": "completed", "tag": "649e540e-b2f4-452a-b859-ffb89a3d6b80"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:37.572873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4421cea1-e687-4dc2-ab9e-bc9a1118a5b2 req-edd012bc-9316-4cbc-b8bf-346f8275454e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:37.573806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4421cea1-e687-4dc2-ab9e-bc9a1118a5b2 req-edd012bc-9316-4cbc-b8bf-346f8275454e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:37.604804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4421cea1-e687-4dc2-ab9e-bc9a1118a5b2 req-edd012bc-9316-4cbc-b8bf-346f8275454e service nova] Creating event network-vif-plugged:649e540e-b2f4-452a-b859-ffb89a3d6b80 for instance f5de2559-3b78-4425-aab9-0eb446ef4a53 on n-h1-846219-13 Jul 25 16:42:37.618655 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4421cea1-e687-4dc2-ab9e-bc9a1118a5b2 req-edd012bc-9316-4cbc-b8bf-346f8275454e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076000 Jul 25 16:42:37.622586 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2793/5658] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:42:37.806903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:37.820627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b78f2b48-050a-47ff-91e9-83988cc143db tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.420467 Jul 25 16:42:37.822320 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2866/5659] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:37 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:38.253321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:38.254044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:38.270421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:38.270882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:38.271768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:38.272206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:38.541455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:38.553660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fd782ff-e245-4396-8f4e-d1ae0e6e7d60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1268 microversion: 2.1 time: 0.305321 Jul 25 16:42:38.560532 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2794/5660] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:38 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1268 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:38.847649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:38.848909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:38.856819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:38.857749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:38.859133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:38.860288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:39.029111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:39.047365 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f22f3dd3-1d4d-4837-8276-66768f30fcd9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.204302 Jul 25 16:42:39.048329 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2867/5661] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:38 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:39.577790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:39.579076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:39.589113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:39.589884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:39.590919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:39.591620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:39.775188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:39.783728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee5e3d5e-49db-4d36-b762-4c0d0832d262 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1455 microversion: 2.1 time: 0.210164 Jul 25 16:42:39.784958 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2795/5662] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:39 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1455 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:39.805729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:39.806696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:39.813589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:39.814218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:39.815029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:39.815195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:40.040165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:40.068567 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be2798ae-fe4c-40fb-879b-c747837fa280 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1455 microversion: 2.1 time: 0.266252 Jul 25 16:42:40.074259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:40.075064 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2868/5663] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:39 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1455 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:40.078432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:40.107456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:40.108525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:40.116773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:40.117619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:40.428068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:40.466292 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-63be89da-fc67-46eb-bb5f-50028e1b23cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.398279 Jul 25 16:42:40.485305 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2796/5664] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:40 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:41.513444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:41.516841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:41.538311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:41.539914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:41.554641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:41.557041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:41.832183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:41.844980 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-66069b06-4a9b-41dc-94a4-f9f32787c73e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.340776 Jul 25 16:42:41.846476 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2869/5665] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:41 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:42.704379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2732a8b3-3bb4-4ab4-9edd-8a1fe10dd9f4 req-a6b450ad-62c4-443c-be2a-98c7483e12e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5de2559-3b78-4425-aab9-0eb446ef4a53", "tag": "649e540e-b2f4-452a-b859-ffb89a3d6b80"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:42.729928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2732a8b3-3bb4-4ab4-9edd-8a1fe10dd9f4 req-a6b450ad-62c4-443c-be2a-98c7483e12e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:42.730506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2732a8b3-3bb4-4ab4-9edd-8a1fe10dd9f4 req-a6b450ad-62c4-443c-be2a-98c7483e12e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:42.753197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2732a8b3-3bb4-4ab4-9edd-8a1fe10dd9f4 req-a6b450ad-62c4-443c-be2a-98c7483e12e0 service nova] Creating event network-changed:649e540e-b2f4-452a-b859-ffb89a3d6b80 for instance f5de2559-3b78-4425-aab9-0eb446ef4a53 on n-h1-846219-13 Jul 25 16:42:42.763957 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2732a8b3-3bb4-4ab4-9edd-8a1fe10dd9f4 req-a6b450ad-62c4-443c-be2a-98c7483e12e0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067874 Jul 25 16:42:42.765049 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2797/5666] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:42:42.868449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:42.870182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:42.901385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:42.906267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:42.907271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:42.907917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:43.186779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:43.196700 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cd3e1891-59eb-4da5-aec0-7fe3fa5e8fd2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.332358 Jul 25 16:42:43.200152 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2870/5667] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:42 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:44.226740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:44.228577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:44.240180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:44.241227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:44.244073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:44.253833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:44.457835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:44.473545 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ada64596-031a-42b9-bda7-92826803294e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.252150 Jul 25 16:42:44.482484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2798/5668] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:44 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:45.500613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:45.502130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:45.510694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:45.511606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:45.512840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:45.513504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:45.681864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:45.691239 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a940e067-080e-473e-bc60-95c79d248be2 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.198804 Jul 25 16:42:45.692451 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2871/5669] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:45 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:46.717246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:46.718404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:46.727365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:46.728208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:46.732696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:46.737080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:46.941596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:46.951748 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60d0c1b8-0b5d-4b96-be63-757ea9242287 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.242115 Jul 25 16:42:46.953892 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2799/5670] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:46 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:47.976065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:47.977029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:47.985609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:47.986337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:47.987140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:47.987596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:48.482589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:48.490644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2b436845-a571-4218-9a62-0b9c7239f0a4 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.518844 Jul 25 16:42:48.491240 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2872/5671] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:47 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:49.512843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:49.513804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:49.525535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:49.526370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:49.527677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:49.528341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:49.802453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:49.829571 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59a17680-9b9f-4886-89e3-dc02fc436ec1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.321513 Jul 25 16:42:49.830188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2800/5672] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:49 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:50.853232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:50.854114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:50.867785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:50.870336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:50.871574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:50.872551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:51.128540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:51.150569 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6719e9a1-5200-43c6-a929-f62341d0e651 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.301780 Jul 25 16:42:51.152384 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2873/5673] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:50 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:52.172706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:52.174005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:52.197281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.202911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.204518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.205145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.414556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:52.423607 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7a69edcc-f46d-4dfc-beb0-ea55144a4c41 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1505 microversion: 2.1 time: 0.254781 Jul 25 16:42:52.424708 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2801/5674] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:52 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:52.451004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5ac96e5-ed40-4fa8-8d5c-b809cbf8899d"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:52.454430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:52.462629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.463465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.464755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.465464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.498583 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Cannot 'attach_volume' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state rescued Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/os-volume_attachments HTTP/1.1 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 74 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: {"volumeAttachment": {"volumeId": "d5ac96e5-ed40-4fa8-8d5c-b809cbf8899d"}} Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'attach_volume' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state rescued Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': 'f9ab9536-3b94-42f7-bfd7-3d971f2078a9', 'body': {'volumeAttachment': {'volumeId': 'd5ac96e5-ed40-4fa8-8d5c-b809cbf8899d'}}} Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 16:42:52.500433 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state rescued Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state rescued Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 409 to user: Cannot 'attach_volume' instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 while it is in vm_state rescued {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab717b01-cd28-48de-b154-13b8a6170a42 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057096 Jul 25 16:42:52.508738 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2874/5675] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:42:52 2022] POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:42:52.512091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:52.512641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:52.528668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.529301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.530628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.530775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.614617 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-670a73f7-7898-4cda-812a-70723d20422b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action" status: 202 len: 0 microversion: 2.1 time: 0.107121 Jul 25 16:42:52.625313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:52.626431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:52.631459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2802/5676] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:42:52 2022] POST /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:42:52.635219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.636127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:52.637399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:52.638755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:53.088553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:53.098013 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90b80d58-1008-486b-9300-4c397f12bf1f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1513 microversion: 2.1 time: 0.477354 Jul 25 16:42:53.098631 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2875/5677] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:52 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1513 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:54.124985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:54.125995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:54.133689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:54.134304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:54.135281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:54.135718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:54.309953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:54.318446 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-def82336-7479-4aad-bf62-bbaf482eecce tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1513 microversion: 2.1 time: 0.198703 Jul 25 16:42:54.333703 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2803/5678] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:54 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:55.350333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:42:55.351842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:42:55.361036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:55.361950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:55.363138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:42:55.364267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:42:55.558749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:42:55.567810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1edd8f80-b907-4cd6-b036-f198732db465 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1519 microversion: 2.1 time: 0.228874 Jul 25 16:42:55.569176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2876/5679] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:42:55 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:42:58.278334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-04ad6d2f-2a75-4ba0-b29e-125190c2bc0a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'create', calling method: .version_select at 0x7f9d93f26af0>, body: {"keypair": {"name": "tempest-keypair-333305381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg6Hm9pud+LeEjWGExdwE6vlRaNC1TppcRSeAaco8tyUf/KoBAY5Gk+SaMR31O/+HmBldiIN5oRWzX6bKHGmL9EslS0XMkAEpPKLzd8kk07IT/tfDGx9u26Nl3zfHS26g=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:42:58.287443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=40 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:42:58.306444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-04ad6d2f-2a75-4ba0-b29e-125190c2bc0a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:42:58.314069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-04ad6d2f-2a75-4ba0-b29e-125190c2bc0a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for user 549f6f9c38924ca3b49fc429838171ca and project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:42:58.350294 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-04ad6d2f-2a75-4ba0-b29e-125190c2bc0a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078877 Jul 25 16:42:58.351574 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2804/5680] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:42:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:00.564637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-152715038", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "014bc4df-59f6-4d0d-8010-df8dbee1849a"}], "security_groups": [{"name": "tempest-securitygroup--933071825"}], "key_name": "tempest-keypair-333305381", "user_data": "}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:00.731368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] validate_networks() for [('014bc4df-59f6-4d0d-8010-df8dbee1849a', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:43:01.220118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:43:01.220553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:43:01.221043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:43:01.221493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:43:01.221922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:43:01.233386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:01.234182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:01.235340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:01.236179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:01.285149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:43:01.291117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Getting quotas for user 549f6f9c38924ca3b49fc429838171ca and project 44b6b1d3d4564bcd9018b3936eefd796. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:43:01.316221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:43:01.319416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:43:01.377534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c67fcabd-53b4-488f-b2ad-ea5745b28bae tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 0.817776 Jul 25 16:43:01.378564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2877/5681] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:43:00 2022] POST /compute/v2.1/servers => generated 410 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:43:01.390203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2059e5e9-f203-4da4-bc90-841b22cdf5cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:01.391632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2059e5e9-f203-4da4-bc90-841b22cdf5cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:01.927203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2059e5e9-f203-4da4-bc90-841b22cdf5cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:01.944023 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2059e5e9-f203-4da4-bc90-841b22cdf5cc tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1248 microversion: 2.1 time: 0.557845 Jul 25 16:43:01.945243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2805/5682] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:01 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1248 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:03.001429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:03.002746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:03.026979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:03.040950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:03.042356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:03.043060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:03.282366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:03.300401 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7a3a923-3131-441f-932a-569faa6b6171 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1318 microversion: 2.1 time: 0.310003 Jul 25 16:43:03.301905 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2878/5683] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:02 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:03.514057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:03.515201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:03.529366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:03.529771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:03.532819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:03.533740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:03.572869 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-904bf6a3-cc0b-4d9f-97be-cbda3b9db26b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/ips" status: 200 len: 147 microversion: 2.1 time: 0.063759 Jul 25 16:43:03.574171 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2806/5684] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:43:03 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/ips => generated 147 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:04.326695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:04.327624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:04.333717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:04.348592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:04.351360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:04.354913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:04.358143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:04.672317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:04.688519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=86 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:04.703705 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ba135952-68f0-4427-b87a-cd0df7c458c0 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1373 microversion: 2.1 time: 0.385304 Jul 25 16:43:04.707329 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2879/5685] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:04 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1373 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:05.726628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:05.729341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:05.743469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:05.743932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:05.744744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:05.745380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:05.796084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4fc5be75-08f0-493d-b000-2eabee50a397 req-d5e4d3c8-c30e-4ef1-994c-554b639e9260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a043831-f5ee-417d-84e8-0198fb3d6956", "tag": "9c602b39-e53f-42a4-99d4-89527bd83269"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:05.818441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:05.831770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4fc5be75-08f0-493d-b000-2eabee50a397 req-d5e4d3c8-c30e-4ef1-994c-554b639e9260 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:05.832270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4fc5be75-08f0-493d-b000-2eabee50a397 req-d5e4d3c8-c30e-4ef1-994c-554b639e9260 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:05.858632 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4fc5be75-08f0-493d-b000-2eabee50a397 req-d5e4d3c8-c30e-4ef1-994c-554b639e9260 service nova] Creating event network-changed:9c602b39-e53f-42a4-99d4-89527bd83269 for instance 2a043831-f5ee-417d-84e8-0198fb3d6956 on n-h2-846219-13 Jul 25 16:43:05.907112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4fc5be75-08f0-493d-b000-2eabee50a397 req-d5e4d3c8-c30e-4ef1-994c-554b639e9260 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114774 Jul 25 16:43:05.908027 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2880/5686] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:43:06.547347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:06.555587 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57963f89-3f3b-4d96-8446-302a14d3ecb9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1373 microversion: 2.1 time: 0.833338 Jul 25 16:43:06.575066 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2807/5687] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:05 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1373 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:07.587589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:07.599355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:07.606737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:07.607509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:07.608897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:07.609542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:07.812253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be9daf9a-640e-4cc0-b5b4-058699a5e038"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:07.814874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:07.823884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:07.824448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:07.825376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:07.826188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:07.865246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:07.886966 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b572bed0-c63a-4aaa-a94c-dd806dbe1d58 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1373 microversion: 2.1 time: 0.307547 Jul 25 16:43:07.887969 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2881/5688] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:07 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1373 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:08.183857 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef6b0365-c0e2-4cf6-8fc4-e5b2f8e7fc87 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376018 Jul 25 16:43:08.190173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2808/5689] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:43:07 2022] POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:08.923378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:08.924071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:08.944270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:08.944872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:08.947250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:08.947786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:09.251993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:09.262668 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7fb14b3-e8ef-45b0-8d9b-c5ec4904979f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1373 microversion: 2.1 time: 0.352696 Jul 25 16:43:09.272111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2882/5690] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:08 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1373 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:10.292326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:10.294204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:10.302439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:10.303274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:10.305064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:10.305753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:10.568273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:10.579306 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-856e7787-feb8-40a8-ad06-5e7ef0bd8d28 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1373 microversion: 2.1 time: 0.298340 Jul 25 16:43:10.580645 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2809/5691] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:10 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1373 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:11.052081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fee8f3b7-3d9c-4e44-8dcc-ee377510d9e3 req-56e23596-d3b0-449e-9655-0d158a334ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a043831-f5ee-417d-84e8-0198fb3d6956", "name": "network-vif-plugged", "status": "completed", "tag": "9c602b39-e53f-42a4-99d4-89527bd83269"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:11.077926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fee8f3b7-3d9c-4e44-8dcc-ee377510d9e3 req-56e23596-d3b0-449e-9655-0d158a334ae4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:11.078703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fee8f3b7-3d9c-4e44-8dcc-ee377510d9e3 req-56e23596-d3b0-449e-9655-0d158a334ae4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:11.094681 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fee8f3b7-3d9c-4e44-8dcc-ee377510d9e3 req-56e23596-d3b0-449e-9655-0d158a334ae4 service nova] Creating event network-vif-plugged:9c602b39-e53f-42a4-99d4-89527bd83269 for instance 2a043831-f5ee-417d-84e8-0198fb3d6956 on n-h2-846219-13 Jul 25 16:43:11.109476 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fee8f3b7-3d9c-4e44-8dcc-ee377510d9e3 req-56e23596-d3b0-449e-9655-0d158a334ae4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059448 Jul 25 16:43:11.110598 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2883/5692] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:11.606888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:11.608120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:11.631977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:11.632108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:11.642125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:11.642581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:11.872229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:11.888623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a94a57dd-d454-4763-914c-b659b8c1c954 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1373 microversion: 2.1 time: 0.287546 Jul 25 16:43:11.889748 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2810/5693] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:11 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1373 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:12.911682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:12.914267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:12.936320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:12.938206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:12.940332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:12.940804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:12.941877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:12.942836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:13.220671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:13.230548 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18edd9e8-6c01-4f99-b9a3-48e577a518fd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1566 microversion: 2.1 time: 0.324165 Jul 25 16:43:13.231491 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2884/5694] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:12 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1566 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:13.253899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:13.262746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:13.265056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:13.273467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:13.274070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:13.275018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:13.275745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:13.408126 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b59a3b6-71a6-4b34-98d0-02a8504a8416 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157655 Jul 25 16:43:13.408987 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2811/5695] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:43:13 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:15.682350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4ce4972d-aaba-4f0d-8693-955836100df1 req-857ce767-f8cd-417b-8efe-a81c5c3b4f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a043831-f5ee-417d-84e8-0198fb3d6956", "tag": "9c602b39-e53f-42a4-99d4-89527bd83269"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:15.718325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4ce4972d-aaba-4f0d-8693-955836100df1 req-857ce767-f8cd-417b-8efe-a81c5c3b4f6c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:15.718795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4ce4972d-aaba-4f0d-8693-955836100df1 req-857ce767-f8cd-417b-8efe-a81c5c3b4f6c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:15.735549 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4ce4972d-aaba-4f0d-8693-955836100df1 req-857ce767-f8cd-417b-8efe-a81c5c3b4f6c service nova] Creating event network-changed:9c602b39-e53f-42a4-99d4-89527bd83269 for instance 2a043831-f5ee-417d-84e8-0198fb3d6956 on n-h2-846219-13 Jul 25 16:43:15.745172 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4ce4972d-aaba-4f0d-8693-955836100df1 req-857ce767-f8cd-417b-8efe-a81c5c3b4f6c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065354 Jul 25 16:43:15.745172 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2885/5696] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:20.860259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7298c13-3127-4bfa-9c09-029c3cd16d11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: .version_select at 0x7f9d93f26670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-875281474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXflPNNCnT381EDEYJt0LH64+AVjaFZLhykTGkQIoQX/WePoypzkz/1FkKV/LVeSPiYocEsEwQbXe7Cc2X15h8tlNdSyYZX3Uyqxrbnvl1FnblbnUozjlAFwbohZp8D3Q=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:20.883913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f7298c13-3127-4bfa-9c09-029c3cd16d11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:43:20.890345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f7298c13-3127-4bfa-9c09-029c3cd16d11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:43:20.921691 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7298c13-3127-4bfa-9c09-029c3cd16d11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.269915 Jul 25 16:43:20.922441 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2812/5697] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:43:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:43:22.630830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3645d735-814d-4a25-bffb-0e7e50e3c711 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:22.639433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3645d735-814d-4a25-bffb-0e7e50e3c711 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:22.640229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3645d735-814d-4a25-bffb-0e7e50e3c711 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:22.688720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3645d735-814d-4a25-bffb-0e7e50e3c711 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:43:22.754674 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3645d735-814d-4a25-bffb-0e7e50e3c711 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action" status: 202 len: 0 microversion: 2.1 time: 0.128776 Jul 25 16:43:22.756441 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2886/5698] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:43:22 2022] POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:43:22.767213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:22.770087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:22.786808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:22.796287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:22.797242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:22.797682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:23.187190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:23.213871 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-135a437c-beb4-4b0e-893a-25ae25c9c659 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.444084 Jul 25 16:43:23.217686 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2813/5699] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:22 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:24.250125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:24.251590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:24.260854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:24.261543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:24.262593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:24.263098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:24.473871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:24.484148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-16bfb40a-0e0f-4ef0-85dd-72f171d20a0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.243810 Jul 25 16:43:24.490016 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2887/5700] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:24 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:25.513997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:25.515178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:25.528617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:25.529467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:25.530763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:25.531533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:25.910110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:25.927293 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c841700-3f4b-42c6-9b60-3b622a0a0913 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.419647 Jul 25 16:43:25.941959 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2814/5701] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:25 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:26.951345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:26.953007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:26.969783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:26.971213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:26.972351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:26.976749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:27.263900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:27.280868 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4e407ae0-dbec-4376-9a64-8e150cfd939b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.334681 Jul 25 16:43:27.286403 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2888/5702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:26 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:28.307769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:28.309404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:28.313469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:28.318551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:28.319310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:28.321942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:28.322616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:28.599694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:28.610895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0cedc0ca-c812-4c15-94a6-b47c49449cbf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.307081 Jul 25 16:43:28.614263 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2815/5703] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:28 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:29.397330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1819768089", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "f6166b3f-77f4-4fc0-acba-b6ecdbe32426"}], "key_name": "tempest-TestNetworkAdvancedServerOps-875281474", "security_groups": [{"name": "tempest-secgroup-smoke-747643159"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:29.582448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] validate_networks() for [('f6166b3f-77f4-4fc0-acba-b6ecdbe32426', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:43:29.643107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:29.644123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:29.708355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:29.709117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:29.710467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:29.711179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:30.124968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:30.145036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-114bb0d4-2dca-4223-aa4d-668d26e60306 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.511018 Jul 25 16:43:30.147611 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2816/5704] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:29 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:43:30.348578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:43:30.351507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:43:30.352170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:43:30.352710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:43:30.354310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:43:30.383176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:30.388860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:30.390180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:30.391262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:30.447978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:43:30.467801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:43:30.502972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:43:30.505597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:43:30.631379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f66f898a-ec42-419f-93cc-84f72de4eafd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.251825 Jul 25 16:43:30.642432 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2889/5705] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:43:29 2022] POST /compute/v2.1/servers => generated 407 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:43:30.647544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d0b28b50-3783-4cdb-b53b-8ac74e5b6091 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:30.648801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d0b28b50-3783-4cdb-b53b-8ac74e5b6091 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:30.786635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d0b28b50-3783-4cdb-b53b-8ac74e5b6091 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:30.794560 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d0b28b50-3783-4cdb-b53b-8ac74e5b6091 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1270 microversion: 2.1 time: 0.151172 Jul 25 16:43:30.795169 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2817/5706] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:30 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:31.170209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:31.172019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:31.182669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:31.183406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:31.184752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:31.185519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:31.414507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:31.425644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e733df5-3747-403d-a6fd-41a323b18bbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.260723 Jul 25 16:43:31.439249 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2890/5707] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:31 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:31.819945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:31.822909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:31.854085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:31.854650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:31.858077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:31.858697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:32.044277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:32.069538 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37412c7b-fd90-4726-a0f1-10a734ab5a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1266 microversion: 2.1 time: 0.257535 Jul 25 16:43:32.078167 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2818/5708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:31 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:32.452260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:32.453188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:32.481412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:32.487714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:32.489932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:32.490726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:32.819386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:32.862073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f80adbbf-b8d5-4b45-b3d2-cb31bebb3213 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1728 microversion: 2.1 time: 0.418644 Jul 25 16:43:32.869317 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2891/5709] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:32 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1728 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:43:33.099131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:33.102794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:33.119435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:33.120270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:33.121839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:33.122638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:33.251458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:33.260743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9c8da270-c52f-4320-bb68-db83180feda0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1328 microversion: 2.1 time: 0.165902 Jul 25 16:43:33.261889 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2819/5710] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:33 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:33.885760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:33.887512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:33.928647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:33.929219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:33.942984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:33.943460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:34.283252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:34.284559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:34.292905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:34.293856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:34.294968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:34.295758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:34.611281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:34.620984 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b859a7db-d4ad-4d57-b496-e5353c9d3597 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.341559 Jul 25 16:43:34.633411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:34.633543 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2820/5711] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:34 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:43:34.650976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fd27ef5-35b2-453f-9a5d-9d4c90e9fa3d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1705 microversion: 2.1 time: 0.770318 Jul 25 16:43:34.665496 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2892/5712] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:33 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1705 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:34.676544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81335b29-e2e4-424f-9ef2-6be584b07bd5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:34.684612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81335b29-e2e4-424f-9ef2-6be584b07bd5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:34.685812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81335b29-e2e4-424f-9ef2-6be584b07bd5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:34.713672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81335b29-e2e4-424f-9ef2-6be584b07bd5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Going to try to start instance {{(pid=119598) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:43:34.773413 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81335b29-e2e4-424f-9ef2-6be584b07bd5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action" status: 202 len: 0 microversion: 2.1 time: 0.102698 Jul 25 16:43:34.774355 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2821/5713] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:43:34 2022] POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:43:34.783659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:34.784293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:34.790136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:34.795238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:34.795698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:34.796482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:34.796963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:34.802738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:35.216659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:35.234807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51e48901-7dd5-473d-8d14-947df35bef43 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1714 microversion: 2.1 time: 0.455176 Jul 25 16:43:35.249036 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2893/5714] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:34 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1714 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:35.645382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:35.646090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:35.665720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:35.666169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:35.667203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:35.667524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:36.104616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:36.108150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:36.120702 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33d13f7a-6875-4499-9fc5-de8b81ae4d98 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.480224 Jul 25 16:43:36.122347 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2822/5715] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:35 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:36.256128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:36.258723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:36.267035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:36.268000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:36.269231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:36.269902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:36.535068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e2ab21ea-39aa-4a0d-be96-68931fb5e578 req-3a9cc9f3-7500-4379-a92e-ec0b254ca75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:36.573423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e2ab21ea-39aa-4a0d-be96-68931fb5e578 req-3a9cc9f3-7500-4379-a92e-ec0b254ca75e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:36.576035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e2ab21ea-39aa-4a0d-be96-68931fb5e578 req-3a9cc9f3-7500-4379-a92e-ec0b254ca75e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:36.602488 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e2ab21ea-39aa-4a0d-be96-68931fb5e578 req-3a9cc9f3-7500-4379-a92e-ec0b254ca75e service nova] Creating event network-changed:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h1-846219-13 Jul 25 16:43:36.611889 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e2ab21ea-39aa-4a0d-be96-68931fb5e578 req-3a9cc9f3-7500-4379-a92e-ec0b254ca75e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092882 Jul 25 16:43:36.613348 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2823/5716] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:43:36.615778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:36.625564 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-103ba7e5-c9c3-4934-a789-4cd566ca1320 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1714 microversion: 2.1 time: 0.373359 Jul 25 16:43:36.626282 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2894/5717] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:36 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1714 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:37.149036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:37.150012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:37.157996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:37.158704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:37.159667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:37.160468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:37.387758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:37.400126 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c58ff505-ff2d-4119-984d-47368e19b775 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.261046 Jul 25 16:43:37.414395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2824/5718] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:37 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:37.647799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:37.648488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:37.656546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:37.657028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:37.657833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:37.658334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:37.859955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:37.871689 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0789a333-01e7-4e80-b220-2b5e3a05a30b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1718 microversion: 2.1 time: 0.227556 Jul 25 16:43:37.873021 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2895/5719] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:37 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1718 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:38.423035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:38.423699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:38.431634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:38.432085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:38.432853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:38.433286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:38.589286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:38.597687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4f4238aa-6bbc-451d-a556-d5d873785105 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.178795 Jul 25 16:43:38.598290 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2825/5720] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:38 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:39.421598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-821347144", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "c8eb4dbb-cc89-42d4-b5f7-3c07f1bb5cc0"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:39.493059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] validate_networks() for [('c8eb4dbb-cc89-42d4-b5f7-3c07f1bb5cc0', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:43:39.621149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:39.621780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:39.629386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:39.629839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:39.630624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:39.631203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:39.860152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:39.868133 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5657e72d-0f20-46b4-b038-ac5fbd0d8f6d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.251157 Jul 25 16:43:39.868717 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2826/5721] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:39 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:39.987524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:43:39.987925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:43:39.988414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:43:39.988838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:43:39.989307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:43:39.999505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:39.999965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:40.000786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:40.001292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:40.023532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Getting quotas for project 0fe9042d3082446bb8a2c5183a33c145. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:43:40.029072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Getting quotas for user 3f1959c851bf495fbf1ac8aa646c84d6 and project 0fe9042d3082446bb8a2c5183a33c145. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:43:40.042183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:43:40.044372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:43:40.097592 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b602acb-3916-4222-a95b-04d51ce27020 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.681822 Jul 25 16:43:40.098670 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2896/5722] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:43:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:43:40.116918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2153200f-fe8f-4872-851c-7d6ec34db829 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:40.117586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2153200f-fe8f-4872-851c-7d6ec34db829 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:40.250265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2153200f-fe8f-4872-851c-7d6ec34db829 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:40.262993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2153200f-fe8f-4872-851c-7d6ec34db829 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1222 microversion: 2.1 time: 0.154963 Jul 25 16:43:40.265199 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2827/5723] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:40 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:40.890361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:40.891004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:40.898295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:40.898781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:40.899556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:40.900205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:41.044531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:41.053249 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c111430f-b7a3-4354-90cf-507a1fb3efdf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.167717 Jul 25 16:43:41.053869 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2897/5724] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:40 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:41.287499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:41.288760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:41.304382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:41.305612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:41.307271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:41.308564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:41.453998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:41.470399 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-216a20b4-5e0b-4700-9f5a-21f65920be36 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1282 microversion: 2.1 time: 0.188860 Jul 25 16:43:41.471020 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2828/5725] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:41 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:42.076472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:42.077262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:42.085254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:42.085821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:42.086902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:42.087596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:42.328820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:42.343378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a03a7007-5d5f-4180-8479-929fa5777e3d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.270630 Jul 25 16:43:42.355692 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2898/5726] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:42 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:42.492645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:42.494086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:42.501748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:42.502423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:42.503604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:42.504184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:42.741571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:42.752375 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b79c1522-d646-42e2-8df7-f5026716e97e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.263437 Jul 25 16:43:42.753904 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2829/5727] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:42 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:43.000497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4db46675-0efb-40ea-98dd-bb22c369d168 req-3acbf22c-12b8-4bd6-8685-caf9f876f090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05dddd20-f90b-4c5a-951d-6572b1bfc888", "tag": "f128a255-af32-4d63-ad3f-9be51b9f938a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:43.011903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4db46675-0efb-40ea-98dd-bb22c369d168 req-3acbf22c-12b8-4bd6-8685-caf9f876f090 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:43.012372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4db46675-0efb-40ea-98dd-bb22c369d168 req-3acbf22c-12b8-4bd6-8685-caf9f876f090 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:43.025981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4db46675-0efb-40ea-98dd-bb22c369d168 req-3acbf22c-12b8-4bd6-8685-caf9f876f090 service nova] Creating event network-changed:f128a255-af32-4d63-ad3f-9be51b9f938a for instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 on n-h1-846219-13 Jul 25 16:43:43.031489 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4db46675-0efb-40ea-98dd-bb22c369d168 req-3acbf22c-12b8-4bd6-8685-caf9f876f090 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035182 Jul 25 16:43:43.032075 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2899/5728] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:43.366622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:43.367243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:43.373997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:43.374448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:43.375235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:43.375682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:43.551693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:43.561140 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bbc268ad-9929-4b54-9b1c-cd851034e516 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.198498 Jul 25 16:43:43.562497 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2830/5729] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:43 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:43.732702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-88c5922d-b048-4ce4-9347-72bd6402747d req-c0855488-c195-41d2-9f87-de7ccad75097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "name": "network-vif-plugged", "status": "completed", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:43.747293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-88c5922d-b048-4ce4-9347-72bd6402747d req-c0855488-c195-41d2-9f87-de7ccad75097 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:43.747293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-88c5922d-b048-4ce4-9347-72bd6402747d req-c0855488-c195-41d2-9f87-de7ccad75097 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:43.760615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-88c5922d-b048-4ce4-9347-72bd6402747d req-c0855488-c195-41d2-9f87-de7ccad75097 service nova] Creating event network-vif-plugged:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h1-846219-13 Jul 25 16:43:43.765734 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-88c5922d-b048-4ce4-9347-72bd6402747d req-c0855488-c195-41d2-9f87-de7ccad75097 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038362 Jul 25 16:43:43.766563 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2900/5730] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:43:43.774397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:43.775019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:43.781752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:43.782204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:43.783152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:43.783766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:43.926199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:43.934001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-309325c1-af54-4f8e-9dc0-04ac59a8f57a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.163509 Jul 25 16:43:43.934574 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2831/5731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:43 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:43:44.584288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:44.584986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:44.592364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:44.592863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:44.593659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:44.594107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:44.739891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:44.748388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2674bea1-bd82-42d2-926d-9107948e86ac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.169934 Jul 25 16:43:44.748914 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2901/5732] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:44 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:44.955911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:44.957653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:44.963726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:44.964177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:44.965082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:44.965559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:45.107071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:45.118019 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6d4395d-b4c4-410c-b65a-17b87ca8009c tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.166145 Jul 25 16:43:45.118711 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2832/5733] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:44 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:45.771355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:45.772358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:45.779098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:45.779465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:45.780267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:45.780716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:45.933344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:45.942542 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb0325f8-cf51-45e3-8969-3501c2badcaa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.176384 Jul 25 16:43:45.943161 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2902/5734] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:45 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:46.140314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:46.142502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:46.150520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:46.151036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:46.152034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:46.152740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:46.757174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:46.765246 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40b8f47f-fed9-48d7-b82d-20018f10e50f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.628951 Jul 25 16:43:46.778722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2833/5735] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:46 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:46.965220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:46.965915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:46.973635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:46.974129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:46.974939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:46.975398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:47.123634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:47.131430 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-487a6d0c-4718-4679-bf49-1816305f134b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1395 microversion: 2.1 time: 0.170290 Jul 25 16:43:47.132058 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2903/5736] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:46 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1395 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:47.789177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:47.790811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:47.802636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:47.803303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:47.804161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:47.804597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:47.968210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:47.980391 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eee56702-74b8-43d8-83d8-d1b570985a29 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.197060 Jul 25 16:43:47.981356 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2834/5737] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:47 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:48.154242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:48.154993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:48.163298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:48.164226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:48.165566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:48.166305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:48.323752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:48.333015 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d82cfaa6-407c-404d-b2fb-433196379bc0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1566 microversion: 2.1 time: 0.184053 Jul 25 16:43:48.333650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2904/5738] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:48 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:48.354649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:48.355410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:48.362644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:48.363206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:48.363886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:48.364323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:48.509412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:48.517401 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-51a5542d-c5c5-4aa1-9895-55a059b38609 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1566 microversion: 2.1 time: 0.167390 Jul 25 16:43:48.518076 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2835/5739] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:48 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:49.002698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:49.003332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:49.010193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:49.010660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:49.011726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:49.012181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:49.179124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:49.189152 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f7745eb1-b152-48e7-9b1f-d0c3c4418552 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.190329 Jul 25 16:43:49.189752 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2905/5740] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:48 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:49.804446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b4e5e926-511c-4efc-8d19-2d4df1637920 req-0f0e01c1-f3cc-4e91-b917-a41a4c18a675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05dddd20-f90b-4c5a-951d-6572b1bfc888", "name": "network-vif-plugged", "status": "completed", "tag": "f128a255-af32-4d63-ad3f-9be51b9f938a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:49.820468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b4e5e926-511c-4efc-8d19-2d4df1637920 req-0f0e01c1-f3cc-4e91-b917-a41a4c18a675 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:49.821269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b4e5e926-511c-4efc-8d19-2d4df1637920 req-0f0e01c1-f3cc-4e91-b917-a41a4c18a675 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:49.834673 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b4e5e926-511c-4efc-8d19-2d4df1637920 req-0f0e01c1-f3cc-4e91-b917-a41a4c18a675 service nova] Creating event network-vif-plugged:f128a255-af32-4d63-ad3f-9be51b9f938a for instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 on n-h1-846219-13 Jul 25 16:43:49.841052 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b4e5e926-511c-4efc-8d19-2d4df1637920 req-0f0e01c1-f3cc-4e91-b917-a41a4c18a675 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040715 Jul 25 16:43:49.842289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2836/5741] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:50.210597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:50.211175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:50.213502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:50.214610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:50.222724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:50.223184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:50.223993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:50.224447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:50.338739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:50.339699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:50.347876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:43:50.351888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:50.353039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:50.354080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:50.354734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:50.425348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:50.439803 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a37bd83-609e-4a06-a1fd-8ea71703cafd tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.233808 Jul 25 16:43:50.440788 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2906/5742] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:50 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:50.445730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-31ea576f-ab2e-495c-a9db-dbc1d102efcf req-0d851258-fed9-4d77-86fa-a502e015179b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:50.457359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-31ea576f-ab2e-495c-a9db-dbc1d102efcf req-0d851258-fed9-4d77-86fa-a502e015179b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:50.458006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-31ea576f-ab2e-495c-a9db-dbc1d102efcf req-0d851258-fed9-4d77-86fa-a502e015179b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:50.474441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-31ea576f-ab2e-495c-a9db-dbc1d102efcf req-0d851258-fed9-4d77-86fa-a502e015179b service nova] Creating event network-changed:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h1-846219-13 Jul 25 16:43:50.480559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-31ea576f-ab2e-495c-a9db-dbc1d102efcf req-0d851258-fed9-4d77-86fa-a502e015179b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038199 Jul 25 16:43:50.481458 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2907/5743] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:43:50.543012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:50.551109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9d3d0fd-5542-45bf-b247-74ad0d2dcea7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1566 microversion: 2.1 time: 0.217580 Jul 25 16:43:50.551906 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2837/5744] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:50 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:51.463082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:51.464471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:51.471838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:51.472235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:51.473298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:51.473934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:51.644524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:51.654794 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36bd0d59-a1f1-4907-bc5b-e31d725c6444 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1322 microversion: 2.1 time: 0.196838 Jul 25 16:43:51.668864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2908/5745] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:51 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:52.596224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd5d782b-41e8-449f-bcd2-761bf74daf20"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:43:52.599256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:52.606760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:52.607207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:52.608289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:52.608714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:52.676173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:43:52.676832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:43:52.684359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:52.684835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:52.685831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:43:52.686282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:43:52.879368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:43:52.887887 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3af87ff8-1bdd-4b59-b6e6-a60939bc9751 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1512 microversion: 2.1 time: 0.215435 Jul 25 16:43:52.888892 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2909/5746] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:43:52 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:43:52.951611 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f2456e6-f7ad-4f23-a68a-9aca20e4b636 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359235 Jul 25 16:43:52.953364 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2838/5747] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:43:52 2022] POST /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:44:04.320053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:04.322562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:04.325647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:04.326592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=85 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:04.334049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:04.334529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:04.335365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:04.335819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:04.366994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lazy-loading 'flavor' on Instance uuid 2a043831-f5ee-417d-84e8-0198fb3d6956 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:44:04.544218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8c962549-08c7-4bce-88a2-936de91094ee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/action" status: 200 len: 32 microversion: 2.1 time: 0.230258 Jul 25 16:44:04.545400 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2910/5748] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:44:04 2022] POST /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:44:04.553834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=51 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:04.555297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:04.561189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:04.561926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:04.574363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:04.575214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:04.576587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:04.577279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:04.909512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:04.918895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b0ef6d92-facb-4df5-9a35-1875869505da tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.367190 Jul 25 16:44:04.920118 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2839/5749] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:04 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:05.944081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:05.945261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:05.952151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:05.952637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:05.953522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:05.954051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:06.145005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:06.154140 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8df4d132-f181-4345-8730-609488b093d1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.215921 Jul 25 16:44:06.155109 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2911/5750] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:05 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:07.176766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:07.177556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:07.185019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:07.185885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:07.186727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:07.187232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:07.368353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:07.378273 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-afe76a91-892d-48ec-8741-5d21f25171c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.206045 Jul 25 16:44:07.384515 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2840/5751] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:07 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:08.400340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:08.400977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:08.409584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:08.410454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:08.411246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:08.411835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:08.574177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:08.588849 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6bfd6c28-5b87-41c3-9549-a52cdad04e03 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.192827 Jul 25 16:44:08.589703 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2912/5752] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:08 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:09.611963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:09.612593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:09.632892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:09.633418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:09.634296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:09.634609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:09.815881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:09.826907 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-63dfb510-ba43-48f5-b9e6-a36911508860 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.219109 Jul 25 16:44:09.827730 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2841/5753] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:09 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:10.865976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:10.866847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:10.878235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:10.878773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:10.880231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:10.881054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:11.052234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:11.064357 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aeef29d6-363b-4f66-82c7-8784b74a9cee tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.203113 Jul 25 16:44:11.066998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2913/5754] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:10 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:44:11.602145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f27afb4b-fe72-4697-a516-2684f7ad8a6f", "device": "/dev/sdb"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:11.604944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:11.611882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:11.612415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:11.613298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:11.613804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:11.910689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a55c1474-2389-4a9a-b275-610f7dd08cbf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "POST /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313364 Jul 25 16:44:11.911336 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2842/5755] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:44:11 2022] POST /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:12.090649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:12.091245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:12.112140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:12.112619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:12.113470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:12.113947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:12.271902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:12.281017 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2ae4044-c12b-4678-a217-8600c6229bcd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.194259 Jul 25 16:44:12.281647 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2914/5756] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:12 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:13.304588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:13.305956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:13.313025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:13.313399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:13.314154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:13.314780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:13.479014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:13.488777 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3fd3a307-af07-4af4-bbb4-2bc03944352b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.189331 Jul 25 16:44:13.489531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2843/5757] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:13 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:14.511919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:14.512580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:14.525377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:14.526324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:14.527389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:14.528048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:14.694445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:14.703732 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bd64da5c-5bc3-4fbb-98f4-735968c8a869 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.196096 Jul 25 16:44:14.704614 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2915/5758] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:14 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:14.828824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:14.830491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:14.844479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:14.845027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:14.846821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:14.847533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:14.960525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lazy-loading 'services' on Instance uuid b7b10353-c91a-415a-8d62-d1bd2bf31947 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:44:15.076454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49280fdb-99ce-4f1b-98a3-b1bf8ef1636f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-volume_attachments/be9daf9a-640e-4cc0-b5b4-058699a5e038" status: 202 len: 0 microversion: 2.1 time: 0.252668 Jul 25 16:44:15.077078 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2844/5759] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:44:14 2022] DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-volume_attachments/be9daf9a-640e-4cc0-b5b4-058699a5e038 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:44:15.726648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:15.727926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:15.736693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:15.737478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:15.738474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:15.739596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:15.904614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:15.914049 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8f3dcbb-97c5-4f8f-b721-bddea602dfda tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.191918 Jul 25 16:44:15.914664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2916/5760] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:15 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:16.941493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:16.942275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:16.950590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:16.951054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:16.951873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:16.952313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:17.102898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:17.112837 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e81232ff-8c75-4eff-87f3-aabbabfbd060 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1737 microversion: 2.1 time: 0.180568 Jul 25 16:44:17.113485 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2845/5761] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:16 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:18.135599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:18.136289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:18.143756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.144218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.145131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.145540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.285151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:18.294000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2963d5b5-f29b-4aae-9652-6033c6d49de9 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1717 microversion: 2.1 time: 0.162440 Jul 25 16:44:18.294772 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2917/5762] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:18 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:18.442850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:18.443681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:18.456244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.457013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.458455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.459223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.549406 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Cannot 'detach_volume' instance 2a043831-f5ee-417d-84e8-0198fb3d6956 while it is in vm_state rescued Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments/cd5d782b-41e8-449f-bcd2-761bf74daf20 HTTP/1.1 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'detach_volume' instance 2a043831-f5ee-417d-84e8-0198fb3d6956 while it is in vm_state rescued Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '2a043831-f5ee-417d-84e8-0198fb3d6956', 'id': 'cd5d782b-41e8-449f-bcd2-761bf74daf20'} Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2a043831-f5ee-417d-84e8-0198fb3d6956 while it is in vm_state rescued Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:18.551260 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2a043831-f5ee-417d-84e8-0198fb3d6956 while it is in vm_state rescued Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 409 to user: Cannot 'detach_volume' instance 2a043831-f5ee-417d-84e8-0198fb3d6956 while it is in vm_state rescued {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d34c4962-3d87-4e76-85c0-4d949bfc2b46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments/cd5d782b-41e8-449f-bcd2-761bf74daf20" status: 409 len: 152 microversion: 2.1 time: 0.118588 Jul 25 16:44:18.556367 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2846/5763] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:44:18 2022] DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments/cd5d782b-41e8-449f-bcd2-761bf74daf20 => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:44:18.563507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:18.564078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:18.571301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.571782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.572616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.573064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.643023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4c6f4bf-528e-4ae5-86c1-5f3f509a2f66 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/action" status: 202 len: 0 microversion: 2.1 time: 0.083414 Jul 25 16:44:18.643819 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2918/5764] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:44:18 2022] POST /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:44:18.652147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:18.652765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:18.659278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.659735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.660515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:18.660943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:18.879169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:18.890750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24bc22b0-7ff1-459b-b656-dccd237491b1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1725 microversion: 2.1 time: 0.242559 Jul 25 16:44:18.891644 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2847/5765] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:18 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:19.914330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:19.918166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:19.922941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:19.923417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:19.924220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:19.924674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:20.087353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:20.105463 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-892a8917-cdc2-4b01-8f46-c4f0445048e8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1725 microversion: 2.1 time: 0.189877 Jul 25 16:44:20.106836 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2919/5766] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:19 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:21.128265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:21.128862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:21.138080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:21.138529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:21.139316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:21.139773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:21.284983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:21.294226 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7eeb541d-9d85-462a-b962-ae08b587ef46 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1731 microversion: 2.1 time: 0.169957 Jul 25 16:44:21.294927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2848/5767] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:21 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:21.317976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:21.318541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:21.325889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:21.326636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:21.327550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:21.328004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:21.421128 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a41dc840-4396-4c36-a4f9-0e9ad3b008b6 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106922 Jul 25 16:44:21.428586 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2920/5768] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:44:21 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:23.143121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2cefd203-6069-4e20-bdf9-10a0d31f25d8 req-10936cd2-5f89-4de0-a4b4-9cd5548f6393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a043831-f5ee-417d-84e8-0198fb3d6956", "tag": "9c602b39-e53f-42a4-99d4-89527bd83269"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:23.177568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2cefd203-6069-4e20-bdf9-10a0d31f25d8 req-10936cd2-5f89-4de0-a4b4-9cd5548f6393 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:23.178560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2cefd203-6069-4e20-bdf9-10a0d31f25d8 req-10936cd2-5f89-4de0-a4b4-9cd5548f6393 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:23.283556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2cefd203-6069-4e20-bdf9-10a0d31f25d8 req-10936cd2-5f89-4de0-a4b4-9cd5548f6393 service nova] Creating event network-changed:9c602b39-e53f-42a4-99d4-89527bd83269 for instance 2a043831-f5ee-417d-84e8-0198fb3d6956 on n-h2-846219-13 Jul 25 16:44:23.298318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2cefd203-6069-4e20-bdf9-10a0d31f25d8 req-10936cd2-5f89-4de0-a4b4-9cd5548f6393 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168442 Jul 25 16:44:23.299606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2849/5769] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:44:23.727981 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:44:23.728599 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:44:23.889238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-212bda4e-ca61-4c94-80c4-ce450406a77c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:23.897284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-212bda4e-ca61-4c94-80c4-ce450406a77c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:23.898119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-212bda4e-ca61-4c94-80c4-ce450406a77c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:23.932841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-212bda4e-ca61-4c94-80c4-ce450406a77c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:44:24.054479 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-212bda4e-ca61-4c94-80c4-ce450406a77c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action" status: 202 len: 0 microversion: 2.1 time: 0.168860 Jul 25 16:44:24.056324 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2921/5770] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:44:23 2022] POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:44:24.074637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:24.075378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:24.086765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:24.087214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:24.088758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:24.089397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:24.345895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:24.356458 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fd88322-661a-4e69-b0f0-f0fe0c201a91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.289312 Jul 25 16:44:24.358649 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2850/5771] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:24 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:25.320915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-90e0f741-169c-4fe5-b454-dd6c71765f4c req-b02c6a90-0fa8-497e-9f77-adf57bc84cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a043831-f5ee-417d-84e8-0198fb3d6956", "tag": "9c602b39-e53f-42a4-99d4-89527bd83269"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:25.332081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-90e0f741-169c-4fe5-b454-dd6c71765f4c req-b02c6a90-0fa8-497e-9f77-adf57bc84cb5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:25.332592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-90e0f741-169c-4fe5-b454-dd6c71765f4c req-b02c6a90-0fa8-497e-9f77-adf57bc84cb5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:25.346190 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-90e0f741-169c-4fe5-b454-dd6c71765f4c req-b02c6a90-0fa8-497e-9f77-adf57bc84cb5 service nova] Creating event network-changed:9c602b39-e53f-42a4-99d4-89527bd83269 for instance 2a043831-f5ee-417d-84e8-0198fb3d6956 on n-h2-846219-13 Jul 25 16:44:25.352061 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-90e0f741-169c-4fe5-b454-dd6c71765f4c req-b02c6a90-0fa8-497e-9f77-adf57bc84cb5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036539 Jul 25 16:44:25.353065 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2922/5772] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:25.380340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:25.380942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:25.390409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:25.391288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:25.393020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:25.393777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:25.691862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:25.702093 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38e80284-3837-4e15-a0dd-af2ed244d0a5 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.326226 Jul 25 16:44:25.703565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2851/5773] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:25 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:26.730847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:26.732198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:26.761969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:26.762911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:26.765628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:26.767091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:26.798182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:26.937198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:26.945714 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6577ac19-14bd-4c3d-87a8-244710e24639 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.220920 Jul 25 16:44:26.946321 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2923/5774] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:26 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:27.976247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:27.976856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:27.994269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:27.995161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:27.996585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:27.997298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:28.270858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:28.289518 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b47b8752-c32f-4426-b027-03266fa2394d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.324538 Jul 25 16:44:28.290246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2852/5775] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:27 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:29.318337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:29.319413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:29.354942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:29.356043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:29.358741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:29.363522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:29.628899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:29.644712 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-589e4ebc-6502-459b-aff0-4ee8224187b3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.331424 Jul 25 16:44:29.647247 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2924/5776] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:29 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:44:30.676252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:30.681200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:30.704095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:30.705201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:30.706261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:30.706936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:31.028455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:31.040177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:31.097340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:31.116783 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a163b6b-fab1-4502-885b-131ace6245bd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.448343 Jul 25 16:44:31.118188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:31.119347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:31.133445 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2853/5777] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:30 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:31.134010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:31.134010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:31.260000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3aa7ac22-fe0b-49e6-9ad9-171e09b7515a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action" status: 200 len: 24549 microversion: 2.1 time: 0.239749 Jul 25 16:44:31.269567 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2925/5778] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:44:31 2022] POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action => generated 24549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:44:32.149549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:32.154224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:32.172977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:32.174115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:32.176026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:32.177088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:32.196504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:32.459338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:32.469344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-024551a2-407b-4484-ab2c-46af475efc65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.327831 Jul 25 16:44:32.470359 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2854/5779] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:32 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:33.523573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:33.524798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:33.539450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:33.540516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:33.541968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:33.542672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:33.782899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:33.792962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9c79457c-607e-46e2-9b19-aca1ed4d5c0c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1682 microversion: 2.1 time: 0.291074 Jul 25 16:44:33.809522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2926/5780] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:33 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:44:34.823778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:34.825115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:34.830743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=33 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:34.840189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:34.841001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:34.845615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:34.846342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:35.170279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:35.178937 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec46c796-e42b-4ee6-bdee-e7d7e39cb991 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1659 microversion: 2.1 time: 0.366100 Jul 25 16:44:35.181254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2855/5781] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:34 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1659 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:44:35.203632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1231169d-7e69-4f42-b302-323250ff7e6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:35.211540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=35 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:35.215845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1231169d-7e69-4f42-b302-323250ff7e6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:35.216539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1231169d-7e69-4f42-b302-323250ff7e6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:35.260635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1231169d-7e69-4f42-b302-323250ff7e6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Going to try to start instance {{(pid=119599) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:44:35.387390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1231169d-7e69-4f42-b302-323250ff7e6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action" status: 202 len: 0 microversion: 2.1 time: 0.185599 Jul 25 16:44:35.402170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:35.402805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:35.413710 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2927/5782] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:44:35 2022] POST /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:44:35.419326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:35.419781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:35.420544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:35.420988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:35.721385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:35.731750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0fc15036-0e49-4f4d-a447-bae83d5a59ca tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1668 microversion: 2.1 time: 0.335839 Jul 25 16:44:35.740526 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2856/5783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:35 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1668 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:36.755181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:36.756018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:36.765847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:36.766407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:36.767444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:36.768104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:36.839696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-988615125", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-111214727", "security_groups": [{"name": "tempest-secgroup-smoke-1809880973"}], "block_device_mapping_v2": [{"uuid": "ca92cf1f-3a83-48a0-9943-6998fa3b0515", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc788ab0-5ac2-412f-86ef-5e560086352f"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:37.033794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:37.045835 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-909cdb39-2265-486a-a809-576e9851cb85 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1672 microversion: 2.1 time: 0.295366 Jul 25 16:44:37.047478 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2928/5784] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:36 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:37.078780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] validate_networks() for [('fc788ab0-5ac2-412f-86ef-5e560086352f', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:44:37.646844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:44:37.647370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:44:37.647988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:44:37.648490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:44:37.648998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:44:37.659290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:37.660395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:37.661290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:37.661549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:37.688110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:44:37.694617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Getting quotas for user 15c1c3b273ae4900a79380c83cbd79b9 and project 28f5c9cfc65b4073a33618fffad118df. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:44:37.763507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:44:37.765865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca92cf1f-3a83-48a0-9943-6998fa3b0515',volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:44:37.930237 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2e09548-7462-4132-8379-37be01379d2c tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.095411 Jul 25 16:44:37.937668 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2857/5785] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:44:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 16:44:37.943296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df09c740-a8e0-4652-ac72-73fd880fd2cd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:37.944201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df09c740-a8e0-4652-ac72-73fd880fd2cd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:38.033771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-df09c740-a8e0-4652-ac72-73fd880fd2cd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:38.044023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df09c740-a8e0-4652-ac72-73fd880fd2cd tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1096 microversion: 2.1 time: 0.103115 Jul 25 16:44:38.045271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2929/5786] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:37 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1096 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:39.051241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:39.051956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:39.071690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:39.072309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:39.073323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:39.073927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:39.076001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:39.076839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:39.086547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:39.087662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:39.089927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:39.090652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:39.179692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lazy-loading 'services' on Instance uuid 05dddd20-f90b-4c5a-951d-6572b1bfc888 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:44:39.272782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc16c29a-438b-4962-a0aa-1091e9631eef tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "DELETE /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888/os-volume_attachments/f27afb4b-fe72-4697-a516-2684f7ad8a6f" status: 202 len: 0 microversion: 2.1 time: 0.226192 Jul 25 16:44:39.273776 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2858/5787] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:44:39 2022] DELETE /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888/os-volume_attachments/f27afb4b-fe72-4697-a516-2684f7ad8a6f => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:44:39.302085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:39.310693 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0245757f-04c7-4a27-a094-49b8aebbb7b5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1194 microversion: 2.1 time: 0.239721 Jul 25 16:44:39.313841 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2930/5788] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:39 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:44:40.342658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:40.343369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:40.354852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:40.354852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:40.355636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:40.356033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:40.606307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:40.616555 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f29762e5-6614-4e74-bcbb-2e27a710c43e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.283406 Jul 25 16:44:40.618069 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2859/5789] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:40 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:41.135725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-900aa33b-78c0-43d4-aacc-83ccf1f2486d req-b662a000-ebe2-4bc0-bbd8-3c971eb4e729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6fef0c-bee3-47c6-b352-590acd7cc13d", "tag": "fd364454-8de1-4f0f-9003-89f86c205c0e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:41.146385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-900aa33b-78c0-43d4-aacc-83ccf1f2486d req-b662a000-ebe2-4bc0-bbd8-3c971eb4e729 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:41.146836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-900aa33b-78c0-43d4-aacc-83ccf1f2486d req-b662a000-ebe2-4bc0-bbd8-3c971eb4e729 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:41.159409 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-900aa33b-78c0-43d4-aacc-83ccf1f2486d req-b662a000-ebe2-4bc0-bbd8-3c971eb4e729 service nova] Creating event network-changed:fd364454-8de1-4f0f-9003-89f86c205c0e for instance ca6fef0c-bee3-47c6-b352-590acd7cc13d on n-h2-846219-13 Jul 25 16:44:41.166169 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-900aa33b-78c0-43d4-aacc-83ccf1f2486d req-b662a000-ebe2-4bc0-bbd8-3c971eb4e729 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156184 Jul 25 16:44:41.167334 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2931/5790] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:44:41.643522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:41.644095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:41.651626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:41.652100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:41.652952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:41.653495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:41.910632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:41.921708 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0b33a06c-212f-42a2-a21e-2e9d220004d3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.281807 Jul 25 16:44:41.922322 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2860/5791] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:41 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:42.944765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:42.945574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:42.952329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:42.952791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:42.953833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:42.954470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:43.104096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:43.112834 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-961a4206-76fd-4c74-8f87-9ff3d8a00f8d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.173203 Jul 25 16:44:43.113455 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2932/5792] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:42 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:44.137234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:44.138079 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:44.149233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:44.149997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:44.151148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:44.151622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:44.290713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:44.299160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30687c21-78c4-4df6-86c6-af00eef17ba6 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.168374 Jul 25 16:44:44.299803 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2861/5793] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:44 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:44.964979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:44.965525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:44.981574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:44.982038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:44.983259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:44.983706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:45.011676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:44:45.100339 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ec7c4559-3dc7-4c8f-a21c-6ae2e5c06b79 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "DELETE /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 204 len: 0 microversion: 2.1 time: 0.138943 Jul 25 16:44:45.101311 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2933/5794] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:44:44 2022] DELETE /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:44:45.110623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:45.111333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:45.117754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:45.118307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:45.119172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:45.119673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:45.263685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:45.271768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08144efe-415a-4dd9-b9bf-8aa999ee4650 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1518 microversion: 2.1 time: 0.165812 Jul 25 16:44:45.272355 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2862/5795] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:45 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:44:45.320713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:45.321453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:45.328113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:45.328572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:45.329379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:45.329847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:45.470766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:45.478988 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-547fe20f-5872-4ca0-80a3-fc9173b85dd3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.162629 Jul 25 16:44:45.479603 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2934/5796] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:45 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:46.295173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:46.295768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:46.303357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:46.303814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:46.304581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:46.305015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:46.450916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:46.459626 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26cb753c-ef98-47c3-85c7-ca99d200f8ce tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1518 microversion: 2.1 time: 0.169034 Jul 25 16:44:46.460267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2863/5797] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:46 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:46.501703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:46.502416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:46.511301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:46.511772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:46.512900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:46.513006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:46.659678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:46.668337 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-efbbb87e-3e1c-4905-976e-8711081d75d8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.171071 Jul 25 16:44:46.668900 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2935/5798] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:46 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:47.482867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:47.483631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:47.490920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:47.491661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:47.492427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:47.492873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:47.676265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:47.691219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:47.691828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:47.702397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:47.703332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:47.703649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:47.704105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:47.704355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:47.780440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:47.794159 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1f26490-5064-462c-8787-0dd992227013 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 200 len: 1518 microversion: 2.1 time: 0.315365 Jul 25 16:44:47.795186 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2864/5799] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:47 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 1518 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:47.801863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fac6499d-91be-45b3-8420-a39c1a7b041c req-3ebd919e-3486-4b77-86fb-b94b69758603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05dddd20-f90b-4c5a-951d-6572b1bfc888", "name": "network-vif-deleted", "tag": "f128a255-af32-4d63-ad3f-9be51b9f938a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:47.814861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fac6499d-91be-45b3-8420-a39c1a7b041c req-3ebd919e-3486-4b77-86fb-b94b69758603 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:47.815661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fac6499d-91be-45b3-8420-a39c1a7b041c req-3ebd919e-3486-4b77-86fb-b94b69758603 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:47.828656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fac6499d-91be-45b3-8420-a39c1a7b041c req-3ebd919e-3486-4b77-86fb-b94b69758603 service nova] Creating event network-vif-deleted:f128a255-af32-4d63-ad3f-9be51b9f938a for instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 on n-h1-846219-13 Jul 25 16:44:47.835221 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fac6499d-91be-45b3-8420-a39c1a7b041c req-3ebd919e-3486-4b77-86fb-b94b69758603 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037951 Jul 25 16:44:47.835852 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2865/5800] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:47.894184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:47.902109 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3e4d8a5-b32b-48d8-a7f0-b10138d0671e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.215602 Jul 25 16:44:47.902705 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2936/5801] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:47 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:48.818071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:48.818798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 05dddd20-f90b-4c5a-951d-6572b1bfc888] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:48.826748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:48.827196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:48.827969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:48.828418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:48.842520 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] HTTP exception thrown: Instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 could not be found. Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Request method failure captured: Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 HTTP/1.1 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sft_alPSVLP9Q7sRf58FhiGftMLxJZCPRhHGPEvO6rQDooUtXALV9OZ4_bjnqG-uixB0BjW9pvuSR-e34RCkfMuKI3_ssVLOA0l79X3YWfE_wJE8cKwXIG7Zy7ielVVqMZb6GGULhnNUc3jp2-t8yOaw9XeYVNZn2_ycEOTLpLINYE Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0fe9042d3082446bb8a2c5183a33c145 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1849910181 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0fe9042d3082446bb8a2c5183a33c145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0fe9042d3082446bb8a2c5183a33c145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0fe9042d3082446bb8a2c5183a33c145"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0fe9042d3082446bb8a2c5183a33c145"}]}] Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesSnapshotTestJSON-1849910181 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0fe9042d3082446bb8a2c5183a33c145 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1849910181 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesSnapshotTestJSON-1849910181-project Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 3f1959c851bf495fbf1ac8aa646c84d6 Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesSnapshotTestJSON-1849910181-project Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 could not be found. Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '05dddd20-f90b-4c5a-951d-6572b1bfc888'} Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 could not be found. Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 could not be found. Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:44:48.844341 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 could not be found. Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Returning 404 to user: Instance 05dddd20-f90b-4c5a-951d-6572b1bfc888 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5dad537c-dc3c-4148-bf3b-54f1aca5724f tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888" status: 404 len: 111 microversion: 2.1 time: 0.032356 Jul 25 16:44:48.854002 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2866/5802] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:48 2022] GET /compute/v2.1/servers/05dddd20-f90b-4c5a-951d-6572b1bfc888 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:44:48.924046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:48.924895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:48.927258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:48.934690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:48.935755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:48.937288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:48.937811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:49.122189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:49.133521 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13e720e1-fa13-4a42-98e5-811df3fb2463 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.213676 Jul 25 16:44:49.134812 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2937/5803] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:48 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:50.155398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:50.156211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:50.164529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:50.165212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:50.166157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:50.166811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:50.316585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:50.326467 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d847875-1112-42ae-a2e3-bcfe369f3adb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1280 microversion: 2.1 time: 0.174987 Jul 25 16:44:50.327990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2867/5804] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:50 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:51.348375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:51.349183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:51.358012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:51.358598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:51.359485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:51.360067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:51.516525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:51.528085 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-de600ebf-3c80-43b1-a7a3-6f9d4708a62f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.183790 Jul 25 16:44:51.528934 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2938/5805] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:51 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:52.550899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:52.551530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:52.559399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:52.559876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:52.560653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:52.561089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:52.761542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:52.770715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3447b6ff-6783-4a4b-996c-93e0d3a0acbb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.224151 Jul 25 16:44:52.773056 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2868/5806] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:52 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:53.793960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:53.795296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:53.803543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:53.803983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:53.805034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:53.805519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:53.830894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:53.966859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:53.979384 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4d8a801-ec16-407b-8683-9c98b6e5c3e0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.189444 Jul 25 16:44:53.979981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2939/5807] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:53 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:55.000485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:55.001130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:55.014161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:55.014621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:55.018432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:55.018432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:55.185562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:55.194020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0484a52e-55c5-4a60-8964-9d652672235a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.197789 Jul 25 16:44:55.194875 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2869/5808] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:54 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:55.433794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:55.434386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:55.441911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:55.442379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:55.443162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:55.443607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:55.543928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lazy-loading 'services' on Instance uuid 2a043831-f5ee-417d-84e8-0198fb3d6956 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:44:55.627874 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fca19da5-ca56-43f1-bae1-c40e50cb9056 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments/cd5d782b-41e8-449f-bcd2-761bf74daf20" status: 202 len: 0 microversion: 2.1 time: 0.198148 Jul 25 16:44:55.628828 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2940/5809] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:44:55 2022] DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments/cd5d782b-41e8-449f-bcd2-761bf74daf20 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:44:55.641375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:55.644046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:55.651866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:55.653865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:55.654691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:55.655133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:55.691538 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ef83b54-2c91-407b-8ea3-f89b6529568f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057792 Jul 25 16:44:55.692142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2870/5810] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:44:55 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:55.728940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1140006275", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "c8eb4dbb-cc89-42d4-b5f7-3c07f1bb5cc0"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:44:55.787616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] validate_networks() for [('c8eb4dbb-cc89-42d4-b5f7-3c07f1bb5cc0', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:44:56.182526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:44:56.182526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:44:56.183204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:44:56.183575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:44:56.184205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:44:56.194780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:56.195864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:56.196687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:56.197135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:56.215630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Getting quotas for project 0fe9042d3082446bb8a2c5183a33c145. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:44:56.217384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:56.218796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:56.221455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Getting quotas for user 3f1959c851bf495fbf1ac8aa646c84d6 and project 0fe9042d3082446bb8a2c5183a33c145. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:44:56.227542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:56.228394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:56.230113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:56.230796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:56.241502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:44:56.244229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:44:56.301669 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9d8d632-705d-4aaf-93f5-b23e5f1bc810 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.578255 Jul 25 16:44:56.303986 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2941/5811] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:44:55 2022] POST /compute/v2.1/servers => generated 382 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:44:56.322327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6d445c7-5c26-4716-87c9-1a60bbc7ef01 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:56.323403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6d445c7-5c26-4716-87c9-1a60bbc7ef01 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:56.420969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6d445c7-5c26-4716-87c9-1a60bbc7ef01 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:56.430861 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6d445c7-5c26-4716-87c9-1a60bbc7ef01 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1223 microversion: 2.1 time: 0.117645 Jul 25 16:44:56.431753 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2942/5812] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:56 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:56.471614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:56.481923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-009f873f-e323-4a47-8cc8-8c3ca7995582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.269700 Jul 25 16:44:56.500778 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2871/5813] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:56 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:56.704671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:56.707295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:56.715193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:56.715679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:56.716665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:56.717354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:56.753016 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe580e1d-d475-4bbf-a889-3628c4b5d369 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052832 Jul 25 16:44:56.754313 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2943/5814] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:44:56 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:57.452847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:57.453692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:57.462688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:57.463396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:57.464395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:57.465151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:57.470342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:44:57.509466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:57.510292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:57.520457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:57.521375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:57.522896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:57.523584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:57.591700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:57.600934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23b79646-1d83-44df-a09a-7f57e4fba675 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1275 microversion: 2.1 time: 0.152671 Jul 25 16:44:57.613491 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2872/5815] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:57 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:57.767466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:57.770033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:57.779599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:57.780504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:57.781525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:57.782110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:57.827445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0263369f-af53-4182-b0af-e83d87a229cd tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064605 Jul 25 16:44:57.828553 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2873/5816] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:44:57 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:44:57.885079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:57.896796 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9589fc71-1be4-47fb-968c-f0ffd4322468 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.392124 Jul 25 16:44:57.899229 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2944/5817] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:57 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:58.626083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:58.627374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:58.635595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:58.636371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:58.637375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:58.638138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:58.729481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:58.741450 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-47163874-1cd9-430c-837f-80c3435ed7c4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1281 microversion: 2.1 time: 0.121810 Jul 25 16:44:58.746427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2874/5818] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:58 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:58.841267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:58.843572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:58.851253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:58.852109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:58.853626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:58.854669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:58.897406 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-985a6df5-95f5-4a2f-ac26-d6e2c94ba9c7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060304 Jul 25 16:44:58.899199 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2945/5819] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:44:58 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:44:58.924319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:58.925882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:58.931753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:58.932497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:58.937314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:58.938066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:59.231182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:44:59.244912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fc566bd-021a-4334-8a21-62c4780d20da tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.325177 Jul 25 16:44:59.252023 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2875/5820] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:58 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:44:59.773014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:59.774058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:59.781443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:59.782465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:59.783421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:59.784085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:59.911319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:44:59.921748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:44:59.932597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:59.933401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:59.934382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:44:59.935147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:44:59.984335 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d009ddff-8fc5-4d46-89aa-45f2088b16cb tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074019 Jul 25 16:44:59.987947 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2876/5821] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:44:59 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:00.062251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:00.072400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2fc8d29-d4f4-48dd-8454-5fc16df9d7a3 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.304489 Jul 25 16:45:00.086981 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2946/5822] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:44:59 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:00.272649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:00.273312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:00.286435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:00.287290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:00.303851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:00.304766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:00.623531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:00.636017 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-779de839-cf1a-4678-bbb7-d35278a08ae5 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.367587 Jul 25 16:45:00.637284 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2877/5823] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:00 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:00.706567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-21e70965-a55a-40fc-869b-02f511391244 req-e53257c6-48ca-427d-96fe-4f84e6533a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6f958b-6052-4c83-b99e-5b8a75054922", "tag": "2c8aaf02-064d-4a12-a553-f424d4291818"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:00.721990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-21e70965-a55a-40fc-869b-02f511391244 req-e53257c6-48ca-427d-96fe-4f84e6533a28 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:00.722838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-21e70965-a55a-40fc-869b-02f511391244 req-e53257c6-48ca-427d-96fe-4f84e6533a28 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:00.738119 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-21e70965-a55a-40fc-869b-02f511391244 req-e53257c6-48ca-427d-96fe-4f84e6533a28 service nova] Creating event network-changed:2c8aaf02-064d-4a12-a553-f424d4291818 for instance 4b6f958b-6052-4c83-b99e-5b8a75054922 on n-h1-846219-13 Jul 25 16:45:00.744217 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-21e70965-a55a-40fc-869b-02f511391244 req-e53257c6-48ca-427d-96fe-4f84e6533a28 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041530 Jul 25 16:45:00.745674 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2947/5824] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:00.999845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:01.003729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:01.011578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.012317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.013162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.013768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.069007 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3107dc74-a474-4d2a-8d5b-4df8521e3185 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073186 Jul 25 16:45:01.074093 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2878/5825] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:45:00 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:01.096446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:01.097330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:01.104006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.104552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.105381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.105821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.331352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:01.340055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-09e204c3-3d99-4860-8284-0fbc15ceb024 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.248801 Jul 25 16:45:01.341078 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2948/5826] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:01 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:01.646183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e9173c4a-978c-4841-a66a-444748358715 req-52017c7d-9223-40ff-b75e-3960965daa64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6fef0c-bee3-47c6-b352-590acd7cc13d", "name": "network-vif-plugged", "status": "completed", "tag": "fd364454-8de1-4f0f-9003-89f86c205c0e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:01.657985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:01.658237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e9173c4a-978c-4841-a66a-444748358715 req-52017c7d-9223-40ff-b75e-3960965daa64 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.658494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e9173c4a-978c-4841-a66a-444748358715 req-52017c7d-9223-40ff-b75e-3960965daa64 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.658644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:01.664999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.665869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.666668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:01.667112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:01.671287 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e9173c4a-978c-4841-a66a-444748358715 req-52017c7d-9223-40ff-b75e-3960965daa64 service nova] Creating event network-vif-plugged:fd364454-8de1-4f0f-9003-89f86c205c0e for instance ca6fef0c-bee3-47c6-b352-590acd7cc13d on n-h2-846219-13 Jul 25 16:45:01.676750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e9173c4a-978c-4841-a66a-444748358715 req-52017c7d-9223-40ff-b75e-3960965daa64 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116243 Jul 25 16:45:01.677971 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2879/5827] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:01.835496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:01.846826 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-83fef58a-28ab-46c8-8e98-efd4f39ff9c9 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.193012 Jul 25 16:45:01.850204 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2949/5828] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:01 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:02.083199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:02.085787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.092979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.093458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.094418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.094780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.127762 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17b9ae24-1cac-46cf-a87e-eb65009c866e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049898 Jul 25 16:45:02.128355 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2880/5829] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:45:02 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:45:02.206769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:02.209265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.217382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.217849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.218638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.219083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.252528 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Cannot 'reboot' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action HTTP/1.1 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 28 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: {"reboot": {"type": "HARD"}} Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: exception: Cannot 'reboot' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '6718d14b-2d80-44c5-b2ce-3adcd12f03e5', 'body': {'reboot': {'type': 'HARD'}}} Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:45:02.254402 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 409 to user: Cannot 'reboot' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41c2ecee-9331-42fd-94cf-283f23d303af tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action" status: 409 len: 145 microversion: 2.1 time: 0.053626 Jul 25 16:45:02.259111 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2950/5830] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:45:02 2022] POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action => generated 145 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:45:02.266560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:02.269541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.276402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.276944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.278052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.278488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.305522 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Cannot 'rebuild' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action HTTP/1.1 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 65 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: exception: Cannot 'rebuild' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6718d14b-2d80-44c5-b2ce-3adcd12f03e5', 'body': {'rebuild': {'imageRef': '984a5010-f259-40b9-952b-c497908cc5d8'}}} Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:45:02.307245 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 409 to user: Cannot 'rebuild' instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 while it is in vm_state rescued {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6ccc59fd-9f01-4e34-8f66-1efcc838b373 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action" status: 409 len: 146 microversion: 2.1 time: 0.046220 Jul 25 16:45:02.315360 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2881/5831] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:45:02 2022] POST /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5/action => generated 146 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 16:45:02.319215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:02.319737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.326302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.326737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.327550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.327991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.356610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:45:02.362268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:02.362897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.370361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.370819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.371783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.372076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.458756 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b528e85a-dd2b-4114-9a9a-ec7fc3891f37 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 204 len: 0 microversion: 2.1 time: 0.143134 Jul 25 16:45:02.459364 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2951/5832] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:45:02 2022] DELETE /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:45:02.468113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:02.468843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.481045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.481850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.483085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.484063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.543973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:02.552200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-be0aa2e3-1b4e-46e4-a140-6ecd190d189e tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.194406 Jul 25 16:45:02.553377 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2882/5833] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:02 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:02.638044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:02.647520 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ad76dae-34e8-4904-b7db-26d118b6b20d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1691 microversion: 2.1 time: 0.183691 Jul 25 16:45:02.648126 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2952/5834] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:02 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:02.872071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:02.872700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:02.880469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.880916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:02.881855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:02.882127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:03.037132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:03.045674 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4bc4f21f-7af1-4ae3-ac62-5d4dae2e497e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.177712 Jul 25 16:45:03.046276 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2883/5835] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:02 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:03.575167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:03.575951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:03.583640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:03.584296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:03.585654 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:03.586324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:03.671601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:03.673518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:03.686459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:03.687288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:03.688082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:03.688735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:03.731594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:03.740909 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-565ccb0e-1128-458d-8eda-b36c5c36489d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.170232 Jul 25 16:45:03.741960 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2953/5836] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:03 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:03.889581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:03.897675 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09038cf5-244f-4387-a4be-3c9559269736 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1691 microversion: 2.1 time: 0.230367 Jul 25 16:45:03.911636 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2884/5837] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:03 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:04.068903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:04.069867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:04.076495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:04.076959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:04.077766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:04.078275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:04.303612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:04.313922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0f2b8934-566a-4719-92db-5fbc5be8e135 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.250196 Jul 25 16:45:04.314591 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2954/5838] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:04 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:04.771517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:04.772310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:04.782375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:04.782906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:04.783636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:04.784070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:04.929919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:04.930558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:04.937611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:04.937800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:04.938084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:04.939096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:04.939730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:04.947976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e729fbf-dd75-4144-9c43-2d12f3bf28b1 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.182900 Jul 25 16:45:04.948706 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2885/5839] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:04 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:05.084875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:05.093682 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-79a81393-f3b4-4285-b6b4-13af64fe4497 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1691 microversion: 2.1 time: 0.177890 Jul 25 16:45:05.094287 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2955/5840] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:04 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:05.335955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:05.336638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:05.338853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:05.346175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:05.346782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:05.347716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:05.348164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:05.485134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:05.493339 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eaaeb484-5f63-4dfb-b4a8-f69c8c634b2d tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1268 microversion: 2.1 time: 0.161777 Jul 25 16:45:05.493956 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2886/5841] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:05 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:05.969293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:05.970752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:05.974298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:05.982842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:05.983685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:05.984906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:05.986750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:06.011288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:06.116491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:06.117751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:06.128846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:06.129863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:06.130913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:06.131584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:06.156183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:06.168405 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-189c8566-2e77-4395-b9a2-11fc721b7314 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.202651 Jul 25 16:45:06.169507 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2956/5842] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:05 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:06.401172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:06.410633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-338e0eae-8a17-497b-9acb-b581f6928290 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1691 microversion: 2.1 time: 0.298268 Jul 25 16:45:06.411266 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2887/5843] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:06 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1691 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:06.515574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:06.516492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:06.518570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:06.520166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:06.527603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:06.528533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:06.529017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:06.529563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:06.830273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:06.839230 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eec9ffa4-7478-4644-a504-c71b0c0f5b6a tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1455 microversion: 2.1 time: 0.327502 Jul 25 16:45:06.840144 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2957/5844] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:06 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1455 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:06.864666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:06.865322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:06.872039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:06.872812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:06.873964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:06.874717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:07.105512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:07.117018 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10a63a19-c772-4841-9e10-93cdc46d098e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1455 microversion: 2.1 time: 0.257228 Jul 25 16:45:07.118965 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2888/5845] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:06 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1455 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:07.198813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:07.199582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:07.211388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:07.214205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:07.215032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:07.215492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:07.426760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:07.432125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:07.432668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:07.438131 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5c3d7d9-f7ab-479e-956a-ad94998453ae tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.251341 Jul 25 16:45:07.451125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:07.452002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:07.452959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:07.453560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:07.455134 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2958/5846] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:07 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:07.973841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:07.978096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:07.984035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7d40477-0891-4cb6-a59b-a0546a2d6479 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 200 len: 1624 microversion: 2.1 time: 0.555870 Jul 25 16:45:07.997765 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2889/5847] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:07 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 1624 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:08.109374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c66e87c7-fe77-4ad9-bef8-1073d4e317d7 req-95c625a3-8fee-4c74-bb12-8b1c38e988d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a043831-f5ee-417d-84e8-0198fb3d6956", "name": "network-vif-deleted", "tag": "9c602b39-e53f-42a4-99d4-89527bd83269"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:08.135371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c66e87c7-fe77-4ad9-bef8-1073d4e317d7 req-95c625a3-8fee-4c74-bb12-8b1c38e988d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:08.136187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c66e87c7-fe77-4ad9-bef8-1073d4e317d7 req-95c625a3-8fee-4c74-bb12-8b1c38e988d4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:08.152215 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c66e87c7-fe77-4ad9-bef8-1073d4e317d7 req-95c625a3-8fee-4c74-bb12-8b1c38e988d4 service nova] Creating event network-vif-deleted:9c602b39-e53f-42a4-99d4-89527bd83269 for instance 2a043831-f5ee-417d-84e8-0198fb3d6956 on n-h2-846219-13 Jul 25 16:45:08.158099 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c66e87c7-fe77-4ad9-bef8-1073d4e317d7 req-95c625a3-8fee-4c74-bb12-8b1c38e988d4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053182 Jul 25 16:45:08.162440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2959/5848] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:08.294702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f2bb85cc-ad28-474f-92ed-be42716077d7 req-fc7dea7f-fe7b-4599-86f9-7c25c629d4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f958b-6052-4c83-b99e-5b8a75054922", "name": "network-vif-plugged", "status": "completed", "tag": "2c8aaf02-064d-4a12-a553-f424d4291818"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:08.314261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f2bb85cc-ad28-474f-92ed-be42716077d7 req-fc7dea7f-fe7b-4599-86f9-7c25c629d4de service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:08.314583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f2bb85cc-ad28-474f-92ed-be42716077d7 req-fc7dea7f-fe7b-4599-86f9-7c25c629d4de service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:08.340556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f2bb85cc-ad28-474f-92ed-be42716077d7 req-fc7dea7f-fe7b-4599-86f9-7c25c629d4de service nova] Creating event network-vif-plugged:2c8aaf02-064d-4a12-a553-f424d4291818 for instance 4b6f958b-6052-4c83-b99e-5b8a75054922 on n-h1-846219-13 Jul 25 16:45:08.354930 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f2bb85cc-ad28-474f-92ed-be42716077d7 req-fc7dea7f-fe7b-4599-86f9-7c25c629d4de service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064668 Jul 25 16:45:08.358196 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2890/5849] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:08.464412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:08.465899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:08.478616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:08.479693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:08.481675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:08.482874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:08.793578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:08.817149 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c172c97f-f496-4fca-ad34-60507ecd5f70 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.358924 Jul 25 16:45:08.818292 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2960/5850] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:08 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:09.009976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:09.010696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 2a043831-f5ee-417d-84e8-0198fb3d6956] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:09.018054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:09.030291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:09.031643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:09.031643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:09.076750 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 could not be found. Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 HTTP/1.1 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 could not be found. Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '2a043831-f5ee-417d-84e8-0198fb3d6956'} Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 could not be found. Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 could not be found. Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:09.079745 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 could not be found. Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 404 to user: Instance 2a043831-f5ee-417d-84e8-0198fb3d6956 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4d18c046-61d1-4dd1-a868-48ec8b04274a tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956" status: 404 len: 111 microversion: 2.1 time: 0.078415 Jul 25 16:45:09.085571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2891/5851] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:09 2022] GET /compute/v2.1/servers/2a043831-f5ee-417d-84e8-0198fb3d6956 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:45:09.090986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b097a790-b808-4e99-9422-ba0d24c91ac1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '.version_select at 0x7f9d9027d670>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:09.150629 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b097a790-b808-4e99-9422-ba0d24c91ac1 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333305381" status: 202 len: 0 microversion: 2.1 time: 0.063461 Jul 25 16:45:09.152128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2961/5852] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 16:45:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333305381 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:45:09.765213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5e50c1a3-92f3-4b1c-be75-593f0daa4e4a req-e5c38722-043e-4089-9f46-993f0feef63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6fef0c-bee3-47c6-b352-590acd7cc13d", "tag": "fd364454-8de1-4f0f-9003-89f86c205c0e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:09.776596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5e50c1a3-92f3-4b1c-be75-593f0daa4e4a req-e5c38722-043e-4089-9f46-993f0feef63c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:09.777036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5e50c1a3-92f3-4b1c-be75-593f0daa4e4a req-e5c38722-043e-4089-9f46-993f0feef63c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:09.789473 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5e50c1a3-92f3-4b1c-be75-593f0daa4e4a req-e5c38722-043e-4089-9f46-993f0feef63c service nova] Creating event network-changed:fd364454-8de1-4f0f-9003-89f86c205c0e for instance ca6fef0c-bee3-47c6-b352-590acd7cc13d on n-h2-846219-13 Jul 25 16:45:09.798496 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5e50c1a3-92f3-4b1c-be75-593f0daa4e4a req-e5c38722-043e-4089-9f46-993f0feef63c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037524 Jul 25 16:45:09.799384 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2892/5853] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:45:09.840519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:09.841188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:09.851078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:09.851854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:09.852721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:09.853264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:10.214710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:10.225072 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1fa1474a-e26f-47d3-98fc-a1318109569b tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1323 microversion: 2.1 time: 0.389017 Jul 25 16:45:10.226385 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2962/5854] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:09 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:11.248021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:11.248855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:11.256368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:11.256812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:11.257830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:11.258311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:11.414137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:11.422975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc922879-2d16-400b-9542-a0ad8b4782fa tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1513 microversion: 2.1 time: 0.179757 Jul 25 16:45:11.423884 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2893/5855] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:11 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:11.444587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d156c223-2cd8-413b-b805-250e43bd0d34", "device": "/dev/sdb"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:11.448028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:11.459020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:11.459499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:11.460318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:11.460766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:11.788713 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0a72043-bbbd-4c8b-8879-3e66c362d3cf tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "POST /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347983 Jul 25 16:45:11.789461 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2963/5856] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:45:11 2022] POST /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:15.115301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:15.120423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:15.129330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:15.130055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:15.131052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:15.131655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:15.183700 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72804e90-71b5-445b-b700-e02ba05d0cce tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072747 Jul 25 16:45:15.184870 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2894/5857] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:45:15 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:45:15.277261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:15.279571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:15.287539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:15.288105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:15.290434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:15.290692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:15.327218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:45:15.452969 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a721a73-1af5-4b8d-988b-07c47c8d16f9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 204 len: 0 microversion: 2.1 time: 0.181775 Jul 25 16:45:15.454387 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2964/5858] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:45:15 2022] DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:45:15.473979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:15.474612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:15.493014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:15.495950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:15.498561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:15.501936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:15.772598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:15.784298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97918620-0f8f-414b-af98-6051685df938 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1678 microversion: 2.1 time: 0.324069 Jul 25 16:45:15.798490 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2895/5859] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:15 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1678 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:16.810200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:16.810955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:16.828930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:16.829759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:16.830793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:16.831448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:16.994812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:16.995411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:17.008051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:17.008589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:17.009461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:17.009900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:17.020611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:17.031446 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ce7067eb-42b1-45bd-9bc8-f55651228ec1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1678 microversion: 2.1 time: 0.225561 Jul 25 16:45:17.032061 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2965/5860] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:16 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:17.066584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:45:17.169908 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d72321b3-b87f-4361-bd84-6a56cb110f68 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "DELETE /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 204 len: 0 microversion: 2.1 time: 0.178745 Jul 25 16:45:17.180048 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2896/5861] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:45:16 2022] DELETE /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:45:17.188272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:17.191540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:17.203916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:17.204292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:17.205144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:17.205591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:17.402366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:17.410327 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9bc0057c-ed58-44d3-8b4f-6f9701dfb50c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1511 microversion: 2.1 time: 0.226172 Jul 25 16:45:17.410900 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2966/5862] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:17 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:18.064513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:18.066632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:18.087255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:18.087939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:18.088914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:18.089428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:18.326252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:18.361029 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7b4e334b-6322-4c01-bbfe-ab255e251bc1 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 200 len: 1678 microversion: 2.1 time: 0.303194 Jul 25 16:45:18.362907 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2897/5863] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:18 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:18.438244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:18.438883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:18.447857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:18.448989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:18.450205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:18.450655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:18.710996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:18.724586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b719af12-9d69-47fc-aab9-91744cb22777 req-05809587-ae1c-4bc7-a73c-011aac11906e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b10353-c91a-415a-8d62-d1bd2bf31947", "name": "network-vif-deleted", "tag": "f09c13f1-1781-4c99-ab34-41efa0551c0c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:18.728110 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92064670-1feb-463a-bde9-ed0646c48a5f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1511 microversion: 2.1 time: 0.296854 Jul 25 16:45:18.729417 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2967/5864] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:18 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:18.774487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b719af12-9d69-47fc-aab9-91744cb22777 req-05809587-ae1c-4bc7-a73c-011aac11906e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:18.776442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b719af12-9d69-47fc-aab9-91744cb22777 req-05809587-ae1c-4bc7-a73c-011aac11906e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:18.791290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b719af12-9d69-47fc-aab9-91744cb22777 req-05809587-ae1c-4bc7-a73c-011aac11906e service nova] Creating event network-vif-deleted:f09c13f1-1781-4c99-ab34-41efa0551c0c for instance b7b10353-c91a-415a-8d62-d1bd2bf31947 on n-h2-846219-13 Jul 25 16:45:18.798653 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b719af12-9d69-47fc-aab9-91744cb22777 req-05809587-ae1c-4bc7-a73c-011aac11906e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077624 Jul 25 16:45:18.799301 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2898/5865] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:19.384422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:19.385436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:19.392965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:19.393800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:19.395009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:19.395596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:19.413608 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] HTTP exception thrown: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Request method failure captured: Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 HTTP/1.1 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sfUCGl-QCi64JZPCv6omj2uF4l_Td5LaOjibIrA7yaNiJK9Egn9DckkTc8ZbrfM3_ApOV9Ofc7jnxke9ZUVdU3EOcMU4Kk1ieMfE0iI_6HjuMJzf_b4BdJsO3xTKKBcy_R9ah0EC_AxkMw7BBc_tS7CT54jFgf7fMzi3qXGXK9WSoQ Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}] Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c2ece84b0a554ada93232d551fa5f50c Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b7b10353-c91a-415a-8d62-d1bd2bf31947'} Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:19.416797 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:45:19.425030 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:19.427626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Returning 404 to user: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:19.428645 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fd50106-a18a-4c63-aa0b-f2c77b325e3a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 404 len: 111 microversion: 2.1 time: 0.048542 Jul 25 16:45:19.433233 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2968/5866] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:19 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:45:19.443535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d3dbec6a-dc01-40f9-bf07-8d889174ab6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '.version_select at 0x7f9d93d1f1f0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:19.478128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d3dbec6a-dc01-40f9-bf07-8d889174ab6a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983952529" status: 202 len: 0 microversion: 2.1 time: 0.043212 Jul 25 16:45:19.478932 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2899/5867] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983952529 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:45:19.563140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:19.563919 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:19.574284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:19.575925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:19.577527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:19.578531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:19.756361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:19.758514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:19.776305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:19.777060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:19.778414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:19.779080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:20.022310 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31e318fb-b048-4349-9986-a760e206bddf tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1838 microversion: 2.1 time: 0.462780 Jul 25 16:45:20.023845 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2969/5868] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:19 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1838 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:20.048123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:20.048829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:20.060093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:20.064383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:20.066070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:20.076679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:20.173787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:20.183737 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f5936b7-af78-4a8b-8cb9-0eec213f808b tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1511 microversion: 2.1 time: 0.436993 Jul 25 16:45:20.184374 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2900/5869] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:19 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:20.440986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:20.462334 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d286d248-d7e3-4db1-9229-6f963122d4db tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1685 microversion: 2.1 time: 0.417028 Jul 25 16:45:20.463524 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2970/5870] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:20 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1685 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:20.624241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7cab1a23-694d-4372-8dc6-83e27d7b4c1b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: .version_select at 0x7f9da06b4e50>, body: {"keypair": {"name": "tempest-keypair-1013463532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeoRRTtg/WBtPcPjgU45aCSIi2/1UFTmKeEGRqBr8Fnf9UJkgM6KYzek3yRDCC5H0CKifv0ZpdsfYbTMplsVn5x7loSjx5gEeoUvnWnvIF7TtbFOG/uuKiExtpNHBqSjg=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:20.656551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7cab1a23-694d-4372-8dc6-83e27d7b4c1b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:45:20.662140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:20.665430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7cab1a23-694d-4372-8dc6-83e27d7b4c1b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for user c2ece84b0a554ada93232d551fa5f50c and project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:45:20.665667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:20.677708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:20.689026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:20.690590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:20.691322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:20.717915 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7cab1a23-694d-4372-8dc6-83e27d7b4c1b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095764 Jul 25 16:45:20.722579 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2901/5871] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:45:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:20.777116 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fade9ff9-21c3-4974-a5af-5b0e042980f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action" status: 200 len: 32618 microversion: 2.1 time: 0.119413 Jul 25 16:45:20.777994 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2971/5872] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:45:20 2022] POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action => generated 32618 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:45:20.925322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:20.926069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:20.933313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:20.934140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:20.935206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:20.935909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:21.085352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b299b2f7-d41a-4a45-af9c-ef0bfee56810 req-732e8357-4197-417f-b237-f62bc0cae67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d14b-2d80-44c5-b2ce-3adcd12f03e5", "name": "network-vif-deleted", "tag": "db591b63-1eec-4eff-9676-59ee3389d58e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:21.121697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b299b2f7-d41a-4a45-af9c-ef0bfee56810 req-732e8357-4197-417f-b237-f62bc0cae67a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:21.122239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b299b2f7-d41a-4a45-af9c-ef0bfee56810 req-732e8357-4197-417f-b237-f62bc0cae67a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:21.169113 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b299b2f7-d41a-4a45-af9c-ef0bfee56810 req-732e8357-4197-417f-b237-f62bc0cae67a service nova] Creating event network-vif-deleted:db591b63-1eec-4eff-9676-59ee3389d58e for instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 on n-h1-846219-13 Jul 25 16:45:21.183719 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b299b2f7-d41a-4a45-af9c-ef0bfee56810 req-732e8357-4197-417f-b237-f62bc0cae67a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106541 Jul 25 16:45:21.188164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2972/5873] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:21.207917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:21.208592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:21.215997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0bdbdce9011d4fb1b7e01780f4cb27c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e3b86883049fc8acabccf29d9e901', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:21.218998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] flavor_id is None. Assuming migration. {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 16:45:21.219643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 16:45:21.225399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:21.225872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:21.226680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:21.227365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:21.261246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:21.296121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:21.301238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:21.301238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lazy-loading 'fault' on Instance uuid 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:45:21.410943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:21.419359 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d15e27f-2abf-4cc0-860b-24df54ae3cd7 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 200 len: 1315 microversion: 2.1 time: 0.218514 Jul 25 16:45:21.432984 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2973/5874] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:21 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:21.762701 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f6ed159f-8632-4dba-bfe0-20fb24153da2 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action" status: 202 len: 0 microversion: 2.1 time: 0.841778 Jul 25 16:45:21.776382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:21.778820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:21.782742 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2902/5875] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:45:20 2022] POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:45:21.790956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:21.791753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:21.792774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:21.793482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:22.219145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:22.241680 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f9ad6ab5-9af2-42f7-9ac5-faaac38f6015 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1694 microversion: 2.1 time: 0.471764 Jul 25 16:45:22.242768 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2974/5876] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:21 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1694 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:22.443489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:22.444493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: 6718d14b-2d80-44c5-b2ce-3adcd12f03e5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:22.467220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:22.468470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:22.469498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:22.470103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:22.488612 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 could not be found. Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 HTTP/1.1 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 could not be found. Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '6718d14b-2d80-44c5-b2ce-3adcd12f03e5'} Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 could not be found. Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 could not be found. Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:22.490560 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 could not be found. Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:22.495842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 404 to user: Instance 6718d14b-2d80-44c5-b2ce-3adcd12f03e5 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:22.497427 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ab7f613f-9f3a-4df4-8ca7-507a305add02 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5" status: 404 len: 111 microversion: 2.1 time: 0.060482 Jul 25 16:45:22.498567 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2903/5877] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:22 2022] GET /compute/v2.1/servers/6718d14b-2d80-44c5-b2ce-3adcd12f03e5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:45:22.506732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:22.507428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:22.521405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:22.522138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:22.523349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:22.527795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:22.595190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:45:22.716167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe4ee171-2917-4543-8563-ad3c304fa099 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "DELETE /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 204 len: 0 microversion: 2.1 time: 0.212178 Jul 25 16:45:22.718328 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2975/5878] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:45:22 2022] DELETE /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:45:22.726321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:22.727008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:22.736369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:22.741183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:22.742387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:22.743053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:23.026238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:23.054310 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4bbe12e-f675-4a76-a609-f4b47d59558e tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.321637 Jul 25 16:45:23.057552 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2904/5879] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:22 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:23.286250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:23.287005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:23.293889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1120925645", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fb0dda0-2bc7-458c-9ced-c45af22c7d79"}], "security_groups": [{"name": "tempest-securitygroup--1117177108"}], "key_name": "tempest-keypair-1013463532", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:23.301331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:23.301804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:23.302852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:23.303663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:23.483713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] validate_networks() for [('3fb0dda0-2bc7-458c-9ced-c45af22c7d79', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:45:23.566519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:23.578243 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dd2c8500-e272-46a0-b1cd-a95144dd6a19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1694 microversion: 2.1 time: 0.296690 Jul 25 16:45:23.580166 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2976/5880] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:23 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1694 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:24.000293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:45:24.000724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:45:24.001208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:45:24.001852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:45:24.002246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:45:24.011673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:24.012120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:24.012910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:24.013383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:24.032503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:45:24.040322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Getting quotas for user c2ece84b0a554ada93232d551fa5f50c and project 62fbe4bbf91949c8b9e7b6eea1acbf0a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:45:24.055543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:45:24.058211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:45:24.078770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:24.079667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:24.091022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:24.092206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:24.094554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:24.095249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:24.114754 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82296277-c2d0-4a07-a72e-27fb776ebfbb tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.825524 Jul 25 16:45:24.115845 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2905/5881] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:45:23 2022] POST /compute/v2.1/servers => generated 404 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:45:24.128287 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c8ead13-042a-41b9-94a8-7f42ba19403a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:24.130807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c8ead13-042a-41b9-94a8-7f42ba19403a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:24.229723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c8ead13-042a-41b9-94a8-7f42ba19403a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:24.243023 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c8ead13-042a-41b9-94a8-7f42ba19403a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1242 microversion: 2.1 time: 0.119950 Jul 25 16:45:24.245742 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2906/5882] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:24 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:24.304269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:24.316756 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2f717bde-7afd-4fc3-98b3-b9e36189cd6c tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.241561 Jul 25 16:45:24.317382 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2977/5883] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:24 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:24.602493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:24.602855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:24.609732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:24.610214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:24.610975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:24.611401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:24.763062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:24.772028 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8fba3621-6e97-4261-aa69-30cfec5bea46 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1694 microversion: 2.1 time: 0.174556 Jul 25 16:45:24.772998 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2907/5884] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:24 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:25.266897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:25.267528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:25.275206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:25.275656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:25.276480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:25.276929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:25.340066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:25.341092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:25.346103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:25.348375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:25.349169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:25.350042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:25.350707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:25.355006 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68cb506f-f100-40c4-8675-a8752f45e7b8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1246 microversion: 2.1 time: 0.092302 Jul 25 16:45:25.356371 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2978/5885] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:25 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:25.522230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:25.531056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce05601a-925c-475f-9989-b6f2618502c3 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.196028 Jul 25 16:45:25.531701 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2908/5886] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:25 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:25.794227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:25.794787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:25.801324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:25.801645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:25.802432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:25.802874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:25.947893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:25.957124 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-87383251-bb45-45ec-a64a-11683c072c5f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1694 microversion: 2.1 time: 0.166935 Jul 25 16:45:25.957740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2979/5887] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:25 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:26.380903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:26.381778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:26.394972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:26.395599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:26.396537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:26.397116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:26.470189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:26.479914 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fdae2e17-40fd-44c4-9efe-363f73ffdb91 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1238 microversion: 2.1 time: 0.104582 Jul 25 16:45:26.480756 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2909/5888] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:26 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:26.553237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:26.555150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:26.570560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:26.573081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:26.591701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:26.592222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:26.979011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:26.980089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:26.988625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:26.989435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:26.990425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:26.991083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:26.996976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:27.472297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:27.483751 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f704b5e-d014-4994-a6d7-b65e96eb2ec8 tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1525 microversion: 2.1 time: 0.935606 Jul 25 16:45:27.498322 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2980/5889] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:26 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1525 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:27.512047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:27.518859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:27.550726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:27.551249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:27.552104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:27.552564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:27.796246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:27.838488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-505cdc8c-41f0-41fe-9735-279276dca800 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1312 microversion: 2.1 time: 0.332333 Jul 25 16:45:27.847471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2981/5890] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:27 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:28.076796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:28.091278 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a855690f-2017-488f-be6b-3048138c3210 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1694 microversion: 2.1 time: 1.116137 Jul 25 16:45:28.103247 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2910/5891] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:26 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1694 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:28.458661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1885b020-8eb3-472d-8558-c32b7d552a25 req-e877a2f8-5571-453b-913d-e17f61f18623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9ab9536-3b94-42f7-bfd7-3d971f2078a9", "name": "network-vif-deleted", "tag": "cbc02de0-195a-4a3e-b0f7-132a1241965f"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:28.504927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1885b020-8eb3-472d-8558-c32b7d552a25 req-e877a2f8-5571-453b-913d-e17f61f18623 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:28.505763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1885b020-8eb3-472d-8558-c32b7d552a25 req-e877a2f8-5571-453b-913d-e17f61f18623 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:28.513520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:28.514960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:28.532437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:28.533598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:28.535273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:28.535940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:28.536610 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1885b020-8eb3-472d-8558-c32b7d552a25 req-e877a2f8-5571-453b-913d-e17f61f18623 service nova] Creating event network-vif-deleted:cbc02de0-195a-4a3e-b0f7-132a1241965f for instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 on n-h2-846219-13 Jul 25 16:45:28.555663 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1885b020-8eb3-472d-8558-c32b7d552a25 req-e877a2f8-5571-453b-913d-e17f61f18623 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100966 Jul 25 16:45:28.556994 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2982/5892] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:28.657560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549f6f9c38924ca3b49fc429838171ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b6b1d3d4564bcd9018b3936eefd796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:28.671264 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97b52927-bd88-4929-ba6c-38bbfdb7379d tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 200 len: 1483 microversion: 2.1 time: 0.163124 Jul 25 16:45:28.672467 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2911/5893] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:28 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 1483 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:28.889521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:28.891436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:28.905380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:28.906346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:28.913274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:28.913929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:29.058795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:29.075498 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fd229da3-a11e-49c2-bfc1-59c8fa84028f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1300 microversion: 2.1 time: 0.196814 Jul 25 16:45:29.077541 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2983/5894] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:28 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:29.123192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:29.124167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:29.159669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:29.161122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:29.167272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:29.168808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:29.590006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:29.648130 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ebb6cd22-dcd4-49b0-92bb-13f9f197e2fa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.534076 Jul 25 16:45:29.652104 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2912/5895] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:29 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:29.699966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:29.700846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] [instance: f9ab9536-3b94-42f7-bfd7-3d971f2078a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:29.718083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:29.718559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:29.719681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:29.720338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:29.751729 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] HTTP exception thrown: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 could not be found. Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Request method failure captured: Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 HTTP/1.1 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3seU_21WprtBhNhlOYl0nBEqq2nFOBtIJ8lL5gvhr25Yup7fHzWqp1eHmFQ-uW86HWKzHJs35Cm9qI7CT7DaG9KMe2OttMAnMIBg34vRRtLhsMH1WB9Y__ahKK8QGKP8CmAtUOfDS377yBUjnZrhHYfba5i4I1G0e3eo7JfnxXP4o58 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/44b6b1d3d4564bcd9018b3936eefd796"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_44b6b1d3d4564bcd9018b3936eefd796"}]}] Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 44b6b1d3d4564bcd9018b3936eefd796 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1403083458 Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 549f6f9c38924ca3b49fc429838171ca Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1403083458-project Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 could not be found. Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'f9ab9536-3b94-42f7-bfd7-3d971f2078a9'} Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 could not be found. Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 could not be found. Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:29.755443 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 could not be found. Jul 25 16:45:29.762144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:45:29.763679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] Returning 404 to user: Instance f9ab9536-3b94-42f7-bfd7-3d971f2078a9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:29.764615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3378b15-c89e-42ce-a3ec-558d83afc04f tempest-ServerRescueNegativeTestJSON-1403083458 tempest-ServerRescueNegativeTestJSON-1403083458-project] 10.222.0.105 "GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9" status: 404 len: 111 microversion: 2.1 time: 0.069988 Jul 25 16:45:29.765430 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2984/5896] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:29 2022] GET /compute/v2.1/servers/f9ab9536-3b94-42f7-bfd7-3d971f2078a9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:45:30.110414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:30.111469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:30.124937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:30.127135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:30.128277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:30.129271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:30.685589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:30.687579 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:30.708688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:30.709682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:30.711349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:30.712389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:30.922902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:30.943851 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cc1d9806-5fb0-41d8-b70d-4ba69caef44c tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1368 microversion: 2.1 time: 0.839789 Jul 25 16:45:30.945140 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2913/5897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:30 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1368 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:31.125193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:31.143681 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71ee1fcc-1118-481c-96ff-9baf9d6a9735 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.469281 Jul 25 16:45:31.145234 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2985/5898] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:30 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:31.188066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-12962ed2-21a8-4a7b-af9c-6b1d4fad6944 req-7c421d3b-9d4b-4360-b6ff-b1754f1bf914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8405cf4-ea08-4fde-9763-ca09eefa3679", "tag": "088a867a-5ee1-45be-86d4-213456e59b7a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:31.205277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-12962ed2-21a8-4a7b-af9c-6b1d4fad6944 req-7c421d3b-9d4b-4360-b6ff-b1754f1bf914 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:31.208066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-12962ed2-21a8-4a7b-af9c-6b1d4fad6944 req-7c421d3b-9d4b-4360-b6ff-b1754f1bf914 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:31.233557 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-12962ed2-21a8-4a7b-af9c-6b1d4fad6944 req-7c421d3b-9d4b-4360-b6ff-b1754f1bf914 service nova] Creating event network-changed:088a867a-5ee1-45be-86d4-213456e59b7a for instance d8405cf4-ea08-4fde-9763-ca09eefa3679 on n-h2-846219-13 Jul 25 16:45:31.239883 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-12962ed2-21a8-4a7b-af9c-6b1d4fad6944 req-7c421d3b-9d4b-4360-b6ff-b1754f1bf914 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057189 Jul 25 16:45:31.242394 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2914/5899] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:31.981389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:31.985026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:32.026652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:32.027538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:32.037595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:32.038866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:32.191174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:32.192519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:32.208997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:32.210445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:32.213793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:32.216022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:32.482720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:32.500621 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4422d8ed-063b-4b05-a5e7-f32721d0fe65 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1368 microversion: 2.1 time: 0.532181 Jul 25 16:45:32.501327 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2986/5900] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:31 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1368 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:32.533241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:32.545772 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a395a975-cf5d-45c2-b06e-0e475e0fc037 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.370433 Jul 25 16:45:32.546667 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2915/5901] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:32 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:33.534244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:33.535424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:33.551626 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:33.553457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:33.555602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:33.556658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:33.592076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:33.599160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:33.631596 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:33.632048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:33.632847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:33.648622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:34.019992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:34.238727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=12 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:34.455366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:34.479400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:34.498867 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-21072b32-bd6f-41eb-9d46-e2da17fb976f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1368 microversion: 2.1 time: 0.968705 Jul 25 16:45:34.501039 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2987/5902] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:33 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1368 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:34.542745 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe1482be-f8dc-4584-9149-6f18461214ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.969063 Jul 25 16:45:34.546334 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2916/5903] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:33 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:35.537958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:35.540430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:35.555306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:35.556683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:35.558629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:35.559928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:35.571339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:35.572594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:35.576243 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:35.598790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:35.600947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:35.604000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:35.617669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:36.129451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:36.161488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41c31a32-db0b-4719-a775-0e6ea2ef2a66 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1368 microversion: 2.1 time: 0.631686 Jul 25 16:45:36.164063 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2988/5904] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:35 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1368 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:36.166462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:36.188566 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4db99fce-a6ed-4f02-8e7c-303fa6706b6e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.621937 Jul 25 16:45:36.197614 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2917/5905] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:35 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:37.206413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:37.207226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:37.211886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:37.252351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:37.252891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:37.264998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:37.271598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:37.272743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:37.273300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:37.309390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:37.310633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:37.316406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:37.322506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:37.384908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:37.797799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:37.831297 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-121761fb-d9e4-41c0-b90d-40c5d56e779a tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1368 microversion: 2.1 time: 0.630262 Jul 25 16:45:37.835004 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2989/5906] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:37 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1368 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:37.866577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:37.883520 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5868b33a-ea59-41c0-b4a0-b1260758a9cc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.636694 Jul 25 16:45:37.886517 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2918/5907] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:37 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:38.126846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-2237a48d-f412-458f-aeb7-e7cea6c176eb req-5e29e514-8074-4adc-9809-6caf4837780f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8405cf4-ea08-4fde-9763-ca09eefa3679", "name": "network-vif-plugged", "status": "completed", "tag": "088a867a-5ee1-45be-86d4-213456e59b7a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:38.157889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2237a48d-f412-458f-aeb7-e7cea6c176eb req-5e29e514-8074-4adc-9809-6caf4837780f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:38.159708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-2237a48d-f412-458f-aeb7-e7cea6c176eb req-5e29e514-8074-4adc-9809-6caf4837780f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:38.195130 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-2237a48d-f412-458f-aeb7-e7cea6c176eb req-5e29e514-8074-4adc-9809-6caf4837780f service nova] Creating event network-vif-plugged:088a867a-5ee1-45be-86d4-213456e59b7a for instance d8405cf4-ea08-4fde-9763-ca09eefa3679 on n-h2-846219-13 Jul 25 16:45:38.210539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-2237a48d-f412-458f-aeb7-e7cea6c176eb req-5e29e514-8074-4adc-9809-6caf4837780f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091096 Jul 25 16:45:38.218338 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2990/5908] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:38.873007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:38.873983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:38.881229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:38.881967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:38.883068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:38.883738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:38.939180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:38.940802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:38.956934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:38.959864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:38.962822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:38.964299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:39.221703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:39.233802 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7e2526fc-1991-4d67-a949-96716c65e9ac tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1368 microversion: 2.1 time: 0.365233 Jul 25 16:45:39.238794 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2919/5909] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:38 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:39.329897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:39.340526 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-58b272ea-57da-48b8-b9c0-0caae6b937f3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.428124 Jul 25 16:45:39.341627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2991/5910] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:38 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:40.259623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:40.260251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:40.270066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.271184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.272690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.273351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.377983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:40.378907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:40.393633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.397619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.398928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.399837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.709813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:40.757865 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a02a99a3-9ad5-4354-a973-5600547c4f73 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1554 microversion: 2.1 time: 0.501614 Jul 25 16:45:40.770228 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2920/5911] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:40 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1554 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:40.793265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:40.794387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:40.804457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.805457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.806641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.807286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.825993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:40.840812 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4b97c12b-3919-477d-b80c-012f1d5f7b17 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.467178 Jul 25 16:45:40.860301 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2992/5912] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:40 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:40.867965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:40.868651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:40.878216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.878811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:40.880429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:40.881129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:41.052605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lazy-loading 'services' on Instance uuid 4b6f958b-6052-4c83-b99e-5b8a75054922 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:45:41.077297 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2f8a628d-08f9-4509-8f51-88642e5a4f0d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215395 Jul 25 16:45:41.078143 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2993/5913] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 16:45:40 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:41.174001 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7f625e0e-0333-4635-a270-19d403ffa97a tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922/os-volume_attachments/d156c223-2cd8-413b-b805-250e43bd0d34" status: 202 len: 0 microversion: 2.1 time: 0.387647 Jul 25 16:45:41.175418 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2921/5914] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:45:40 2022] DELETE /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922/os-volume_attachments/d156c223-2cd8-413b-b805-250e43bd0d34 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:45:41.875299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:41.875299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:41.877483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:41.878269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:41.879331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:41.880015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:42.940133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:42.950789 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a6d09fe1-0e17-45a3-b868-bac6ca3c3b82 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 1.088348 Jul 25 16:45:42.954247 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2994/5915] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:41 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:43.980006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:43.981582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:43.999900 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:44.000723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:44.014542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:44.015054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:44.718173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a7d20e6a-33e1-46f4-aad6-0fcb58df8858 req-d69bced3-5631-468d-906d-6fec82f6aa93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8405cf4-ea08-4fde-9763-ca09eefa3679", "tag": "088a867a-5ee1-45be-86d4-213456e59b7a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:44.754050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a7d20e6a-33e1-46f4-aad6-0fcb58df8858 req-d69bced3-5631-468d-906d-6fec82f6aa93 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:44.754893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a7d20e6a-33e1-46f4-aad6-0fcb58df8858 req-d69bced3-5631-468d-906d-6fec82f6aa93 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:44.776997 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a7d20e6a-33e1-46f4-aad6-0fcb58df8858 req-d69bced3-5631-468d-906d-6fec82f6aa93 service nova] Creating event network-changed:088a867a-5ee1-45be-86d4-213456e59b7a for instance d8405cf4-ea08-4fde-9763-ca09eefa3679 on n-h2-846219-13 Jul 25 16:45:44.785522 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a7d20e6a-33e1-46f4-aad6-0fcb58df8858 req-d69bced3-5631-468d-906d-6fec82f6aa93 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070856 Jul 25 16:45:44.786522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2995/5916] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:45:45.051521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:45.083858 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-755f37e1-8592-45bc-b6cc-e93d23e212c2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 1.108472 Jul 25 16:45:45.087731 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2922/5917] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:43 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:46.118438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:46.119359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:46.140898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:46.141401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:46.142236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:46.142692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:46.866518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:46.875189 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ac2202b-4441-421c-8d5e-25925124edf3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.764256 Jul 25 16:45:46.881547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2996/5918] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:46 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:47.922303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:47.923170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:47.943353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:47.944043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:47.945626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:47.946330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:48.510083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:48.519485 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e33e8ff5-1062-4d65-8fe9-36e60fc0d3c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.601854 Jul 25 16:45:48.536634 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2923/5919] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:47 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:49.272504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1416810223", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "454f97b8-e710-4216-ac35-270d09956fc1"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:49.360197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] validate_networks() for [('454f97b8-e710-4216-ac35-270d09956fc1', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:45:49.543845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:49.543845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:49.563903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:49.564434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:49.566299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:49.566740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:49.973672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:49.990220 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8c143f76-ddf6-4049-9a3c-7c5144c15695 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.451661 Jul 25 16:45:50.010142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2924/5920] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:49 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:50.045146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:45:50.046068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:45:50.046766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:45:50.047376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:45:50.048223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:45:50.069271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:50.070105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:50.071448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:50.072157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:50.098365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Getting quotas for project a14fa1a53d4f4c34872ad31687576878. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:45:50.106883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Getting quotas for user 8dc589e89b1c4fcbaf10443e2f40a9da and project a14fa1a53d4f4c34872ad31687576878. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:45:50.127610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:45:50.130834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:45:50.194869 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4b51b64a-c243-406d-b85d-413619c02235 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.26 time: 1.303164 Jul 25 16:45:50.196454 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2997/5921] 10.222.0.105 () {62 vars in 1193 bytes} [Mon Jul 25 16:45:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 25 16:45:50.218987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6710d1f1-d9b1-44ef-8f4d-2357cb4090dc tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:50.220051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6710d1f1-d9b1-44ef-8f4d-2357cb4090dc tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:50.371941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6710d1f1-d9b1-44ef-8f4d-2357cb4090dc tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:50.388821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6710d1f1-d9b1-44ef-8f4d-2357cb4090dc tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:50.392414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6710d1f1-d9b1-44ef-8f4d-2357cb4090dc tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:50.393824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:50.395036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6710d1f1-d9b1-44ef-8f4d-2357cb4090dc tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1266 microversion: 2.26 time: 0.183249 Jul 25 16:45:50.397501 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2925/5922] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:50 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:45:50.398230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:50.411138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:50.412680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:50.415442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:50.416788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:50.485081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:45:50.669478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff4c972d-a83a-48e1-b8ee-306d81a09b12 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 204 len: 0 microversion: 2.1 time: 0.281797 Jul 25 16:45:50.673422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2998/5923] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:45:50 2022] DELETE /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:45:50.681176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:50.682676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:50.703630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:50.704249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:50.705907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:50.705907 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:50.974684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:50.986922 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fd4e0c4-fa30-4e9e-addf-0828784ccbc4 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1519 microversion: 2.1 time: 0.310522 Jul 25 16:45:50.987635 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2926/5924] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:50 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:51.029627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:51.030686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:51.038931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:51.040109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:51.041207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:51.041860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:51.270602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:51.294324 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69035646-2027-40a8-aa9c-4fac065f6c2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.268973 Jul 25 16:45:51.303783 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 2999/5925] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:51 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:51.434783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:51.436012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:51.452047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:51.453283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:51.454591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:51.458396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:51.566817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:51.571494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:51.580765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:51.583216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:51.585159 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b23b5aa1-2c8d-457c-887d-6228fdfd7d5a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1270 microversion: 2.26 time: 0.155398 Jul 25 16:45:51.586785 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2927/5926] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:51 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:45:52.011010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:52.012516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:52.021509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:52.022355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:52.023219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:52.023730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:52.228952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:52.239042 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-92bd48bf-a242-4775-a02b-d4b9fea80a35 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1519 microversion: 2.1 time: 0.233153 Jul 25 16:45:52.240688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3000/5927] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:52 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:52.347708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:52.348928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:52.370202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:52.371020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:52.372621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:52.373359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:52.615236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:52.616391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:52.636281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:52.637225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:52.638697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:52.639492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:52.667238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:52.678401 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c92f81f4-37b9-454a-aabe-bbda824bc258 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1699 microversion: 2.1 time: 0.348278 Jul 25 16:45:52.679325 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2928/5928] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:52 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1699 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:52.805908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:52.824904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:52.827820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:52.829305 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc1e06ca-20f8-473d-a28d-8720e6fde560 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1262 microversion: 2.26 time: 0.221953 Jul 25 16:45:52.830496 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3001/5929] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:52 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1262 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:45:53.268328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:53.269995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:53.281769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:53.283161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:53.285152 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:53.286209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:53.710027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:53.711030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:53.721941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:53.722882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:53.724692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:53.725684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:54.405719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1959c851bf495fbf1ac8aa646c84d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe9042d3082446bb8a2c5183a33c145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:54.413851 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f97228d-8a92-4823-8d4e-96a48382cf3d tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 200 len: 1519 microversion: 2.1 time: 1.154251 Jul 25 16:45:54.414502 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2929/5930] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:53 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 1519 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:54.418973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9982e89e-ca90-483a-85d8-d7a10b3ab5f9 req-1f124586-f51c-41e0-972b-b1e637fbb4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "name": "network-vif-unplugged", "status": "completed", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:54.430271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9982e89e-ca90-483a-85d8-d7a10b3ab5f9 req-1f124586-f51c-41e0-972b-b1e637fbb4ca service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:54.430711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9982e89e-ca90-483a-85d8-d7a10b3ab5f9 req-1f124586-f51c-41e0-972b-b1e637fbb4ca service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:54.445270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9982e89e-ca90-483a-85d8-d7a10b3ab5f9 req-1f124586-f51c-41e0-972b-b1e637fbb4ca service nova] Creating event network-vif-unplugged:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h2-846219-13 Jul 25 16:45:54.451936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-9982e89e-ca90-483a-85d8-d7a10b3ab5f9 req-1f124586-f51c-41e0-972b-b1e637fbb4ca service nova] Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:45:54.466267 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9982e89e-ca90-483a-85d8-d7a10b3ab5f9 req-1f124586-f51c-41e0-972b-b1e637fbb4ca service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050520 Jul 25 16:45:54.467606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2930/5931] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:54.474832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:54.475778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:54.488087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:54.488745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:54.490661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:54.492045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:54.525038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:54.534167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c97e8095-6a34-4841-89b8-dc5f7e0627c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1698 microversion: 2.1 time: 0.836919 Jul 25 16:45:54.535203 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3002/5932] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:53 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1698 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:45:54.624984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:54.638414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:54.640247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:54.641673 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bd5d51e7-7c38-48a5-ae03-b5e64e363f9c tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1324 microversion: 2.26 time: 0.172890 Jul 25 16:45:54.642638 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2931/5933] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:54 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:45:54.705717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b257c767-b99d-4ec7-a0eb-a53a35ccd7f3 req-129a4ef9-5767-44ba-8a8c-5d2000c8fc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f958b-6052-4c83-b99e-5b8a75054922", "name": "network-vif-deleted", "tag": "2c8aaf02-064d-4a12-a553-f424d4291818"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:54.721219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b257c767-b99d-4ec7-a0eb-a53a35ccd7f3 req-129a4ef9-5767-44ba-8a8c-5d2000c8fc63 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:54.721826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b257c767-b99d-4ec7-a0eb-a53a35ccd7f3 req-129a4ef9-5767-44ba-8a8c-5d2000c8fc63 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:54.736379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b257c767-b99d-4ec7-a0eb-a53a35ccd7f3 req-129a4ef9-5767-44ba-8a8c-5d2000c8fc63 service nova] Creating event network-vif-deleted:2c8aaf02-064d-4a12-a553-f424d4291818 for instance 4b6f958b-6052-4c83-b99e-5b8a75054922 on n-h1-846219-13 Jul 25 16:45:54.742665 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b257c767-b99d-4ec7-a0eb-a53a35ccd7f3 req-129a4ef9-5767-44ba-8a8c-5d2000c8fc63 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205674 Jul 25 16:45:54.743263 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3003/5934] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:55.437840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:55.439922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] [instance: 4b6f958b-6052-4c83-b99e-5b8a75054922] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:55.456657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:55.457412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:55.459077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:55.460349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:55.487513 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] HTTP exception thrown: Instance 4b6f958b-6052-4c83-b99e-5b8a75054922 could not be found. Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Request method failure captured: Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 HTTP/1.1 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sft_alPSVLP9Q7sRf58FhiGftMLxJZCPRhHGPEvO6rQDooUtXALV9OZ4_bjnqG-uixB0BjW9pvuSR-e34RCkfMuKI3_ssVLOA0l79X3YWfE_wJE8cKwXIG7Zy7ielVVqMZb6GGULhnNUc3jp2-t8yOaw9XeYVNZn2_ycEOTLpLINYE Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0fe9042d3082446bb8a2c5183a33c145 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1849910181 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0fe9042d3082446bb8a2c5183a33c145"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0fe9042d3082446bb8a2c5183a33c145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0fe9042d3082446bb8a2c5183a33c145"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0fe9042d3082446bb8a2c5183a33c145"}]}] Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesSnapshotTestJSON-1849910181 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0fe9042d3082446bb8a2c5183a33c145 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1849910181 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesSnapshotTestJSON-1849910181-project Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 3f1959c851bf495fbf1ac8aa646c84d6 Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesSnapshotTestJSON-1849910181-project Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 4b6f958b-6052-4c83-b99e-5b8a75054922 could not be found. Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4b6f958b-6052-4c83-b99e-5b8a75054922'} Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b6f958b-6052-4c83-b99e-5b8a75054922 could not be found. Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b6f958b-6052-4c83-b99e-5b8a75054922 could not be found. Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:45:55.491305 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b6f958b-6052-4c83-b99e-5b8a75054922 could not be found. Jul 25 16:45:55.496413 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:45:55.499043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] Returning 404 to user: Instance 4b6f958b-6052-4c83-b99e-5b8a75054922 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:45:55.500340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1f340702-d685-45a0-a282-e5b03a4f2473 tempest-VolumesSnapshotTestJSON-1849910181 tempest-VolumesSnapshotTestJSON-1849910181-project] 10.222.0.105 "GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922" status: 404 len: 111 microversion: 2.1 time: 0.067752 Jul 25 16:45:55.504821 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2932/5935] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:55 2022] GET /compute/v2.1/servers/4b6f958b-6052-4c83-b99e-5b8a75054922 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:45:55.560714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:55.561785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:55.600900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:55.602038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:55.606122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:55.606587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:55.667249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:55.668062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:55.680229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:55.681204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:55.683867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:55.684717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:56.205239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:56.237197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53e50b0e-43b2-43da-8739-d064fc114cad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1698 microversion: 2.1 time: 0.682489 Jul 25 16:45:56.243895 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3004/5936] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:55 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1698 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:56.263315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:56.277322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:56.280441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:56.283857 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e67d7b74-0804-4bb9-88a9-5c0e7d82fd26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.620358 Jul 25 16:45:56.288697 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2933/5937] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:55 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:45:56.520382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-75a32e54-2de9-4db0-979e-ea10330f8185 req-b8e89c2c-f950-4d2a-9e87-93bf04bb385d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:56.535842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-75a32e54-2de9-4db0-979e-ea10330f8185 req-b8e89c2c-f950-4d2a-9e87-93bf04bb385d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:56.536382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-75a32e54-2de9-4db0-979e-ea10330f8185 req-b8e89c2c-f950-4d2a-9e87-93bf04bb385d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:56.555380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-75a32e54-2de9-4db0-979e-ea10330f8185 req-b8e89c2c-f950-4d2a-9e87-93bf04bb385d service nova] Creating event network-changed:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h2-846219-13 Jul 25 16:45:56.583707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-75a32e54-2de9-4db0-979e-ea10330f8185 req-b8e89c2c-f950-4d2a-9e87-93bf04bb385d service nova] Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:45:56.622073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-75a32e54-2de9-4db0-979e-ea10330f8185 req-b8e89c2c-f950-4d2a-9e87-93bf04bb385d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107972 Jul 25 16:45:56.623984 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3005/5938] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:57.271303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:57.272229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:57.288135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:57.291247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:57.292717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:57.294207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:57.317058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:57.318707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:57.327341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:57.328117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:57.329079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:57.329752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:57.719006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:57.732881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:57.736395 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-172bf7f5-f298-4d38-ab29-2e23b7f99115 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1696 microversion: 2.1 time: 0.469876 Jul 25 16:45:57.737005 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2934/5939] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:57 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1696 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:57.751257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:57.754323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:57.756391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24d05b8d-2fb1-4341-a8b9-4f3559bd9dc7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.444975 Jul 25 16:45:57.757864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3006/5940] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:57 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:45:58.643795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-179bded7-c2fe-4511-a5d9-eab79aa07292 req-35d2c990-ce99-452d-b6a0-c3078fcc6040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ca19cf-3ba8-40e5-af11-7a5a8a0ea153", "tag": "4b64b538-df61-4a44-ac29-45e38f446939"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:45:58.656159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-179bded7-c2fe-4511-a5d9-eab79aa07292 req-35d2c990-ce99-452d-b6a0-c3078fcc6040 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:58.656716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-179bded7-c2fe-4511-a5d9-eab79aa07292 req-35d2c990-ce99-452d-b6a0-c3078fcc6040 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:58.669494 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-179bded7-c2fe-4511-a5d9-eab79aa07292 req-35d2c990-ce99-452d-b6a0-c3078fcc6040 service nova] Creating event network-changed:4b64b538-df61-4a44-ac29-45e38f446939 for instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 on n-h1-846219-13 Jul 25 16:45:58.674594 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-179bded7-c2fe-4511-a5d9-eab79aa07292 req-35d2c990-ce99-452d-b6a0-c3078fcc6040 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 Jul 25 16:45:58.675481 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2935/5941] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:45:58.759546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:58.760358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:58.769251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:58.770048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:58.771014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:58.771642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:58.807101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:45:58.808932 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:45:58.821509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:58.822450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:58.824057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:45:58.824885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:45:59.260788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:59.264976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:45:59.270763 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a1e46b3e-79b0-4a0e-b8b8-25b029fa138b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1696 microversion: 2.1 time: 0.515483 Jul 25 16:45:59.271795 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3007/5942] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:45:58 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1696 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:45:59.280479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:59.290550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:59.293232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:45:59.296252 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ed94c090-9350-4c83-8188-e7e4da0698ec tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.515586 Jul 25 16:45:59.296866 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2936/5943] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:45:58 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:00.294901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:00.296591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:00.306353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:00.307685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:00.318008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.318869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.320002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.320914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.325374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:00.326055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:00.340052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.340766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.341834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.343273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.394620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:00.626421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:00.654580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:00.656065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:00.660671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:00.665772 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c897bfb9-ae51-410c-8e62-299106a25387 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1693 microversion: 2.1 time: 0.377748 Jul 25 16:46:00.666592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23ea59dd-a975-45b0-9f06-ace21574b09f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.350299 Jul 25 16:46:00.667381 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3008/5944] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:00 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1693 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:00.670735 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2937/5945] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:00 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:00.695513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:00.696484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:00.703830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.704787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.705849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.707134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.803927 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b6b31e3-5f7b-411e-a06e-9bba54d1c068 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action" status: 204 len: 0 microversion: 2.1 time: 0.116701 Jul 25 16:46:00.804903 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3009/5946] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:46:00 2022] POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:46:00.816971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:00.817861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:00.828107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.829022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:00.830187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:00.830867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:01.326653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:01.354325 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba3c8201-b086-41b1-98c4-5b967b81275d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1693 microversion: 2.1 time: 0.544503 Jul 25 16:46:01.356943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2938/5947] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:00 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1693 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:01.701369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:01.702208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:01.713645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:01.714079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:01.714938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:01.715404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:02.021054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:02.047239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:02.065057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:02.079965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f87a0e07-e1a1-4296-9a90-e9a9bfa10386 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.384124 Jul 25 16:46:02.082944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3010/5948] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:01 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:02.394609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:02.395889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:02.404125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:02.404931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:02.406009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:02.406615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:02.765570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:02.781565 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-301f2da0-533b-4d16-9579-eeb73c5d759f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1693 microversion: 2.1 time: 0.390745 Jul 25 16:46:02.786678 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2939/5949] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:02 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1693 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:03.108675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:03.109470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:03.122879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:03.124320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:03.125365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:03.126525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:03.331525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:03.341160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:03.343068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:03.344478 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c46b237c-dfdd-4b17-9f31-f98b1a92de2d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.242793 Jul 25 16:46:03.345028 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3011/5950] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:03 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:03.809903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:03.810523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:03.825675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:03.826452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:03.827452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:03.828109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:04.002505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:04.011392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a820da2e-8b0a-495b-834f-9849bd19106f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1685 microversion: 2.1 time: 0.205418 Jul 25 16:46:04.012663 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2940/5951] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:03 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:04.085080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9fa4884c-c731-416f-aa37-fdec572ad7f1 req-583ed7b5-a5a8-4421-863c-ddcee80f2f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "name": "network-vif-plugged", "status": "completed", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:04.111681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9fa4884c-c731-416f-aa37-fdec572ad7f1 req-583ed7b5-a5a8-4421-863c-ddcee80f2f38 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:04.113177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9fa4884c-c731-416f-aa37-fdec572ad7f1 req-583ed7b5-a5a8-4421-863c-ddcee80f2f38 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:04.131308 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9fa4884c-c731-416f-aa37-fdec572ad7f1 req-583ed7b5-a5a8-4421-863c-ddcee80f2f38 service nova] Creating event network-vif-plugged:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h2-846219-13 Jul 25 16:46:04.146820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9fa4884c-c731-416f-aa37-fdec572ad7f1 req-583ed7b5-a5a8-4421-863c-ddcee80f2f38 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065385 Jul 25 16:46:04.147782 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3012/5952] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:46:04.375015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:04.375663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:04.384512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:04.385078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:04.385956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:04.386390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:04.591434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:04.601311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:04.603492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:04.604848 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17c86dc5-e584-434d-8bc2-af31872019bd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.235390 Jul 25 16:46:04.616605 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2941/5953] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:04 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:05.633574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:05.634979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:05.649668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:05.650301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:05.652279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:05.653278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:05.839815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:05.851904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:05.853896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:05.855304 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f90795b4-3214-4f1d-929b-e8a4c2cf37c8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.228068 Jul 25 16:46:05.869217 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3013/5954] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:05 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:06.174320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-830fec30-2e5c-4dbe-8990-ed78fcdbf8e4 req-67b3a49c-c74e-4755-a125-ebfd126b7559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ca19cf-3ba8-40e5-af11-7a5a8a0ea153", "name": "network-vif-plugged", "status": "completed", "tag": "4b64b538-df61-4a44-ac29-45e38f446939"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:06.184368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=52 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:06.186465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-830fec30-2e5c-4dbe-8990-ed78fcdbf8e4 req-67b3a49c-c74e-4755-a125-ebfd126b7559 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:06.187268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-830fec30-2e5c-4dbe-8990-ed78fcdbf8e4 req-67b3a49c-c74e-4755-a125-ebfd126b7559 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:06.201239 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-830fec30-2e5c-4dbe-8990-ed78fcdbf8e4 req-67b3a49c-c74e-4755-a125-ebfd126b7559 service nova] Creating event network-vif-plugged:4b64b538-df61-4a44-ac29-45e38f446939 for instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 on n-h1-846219-13 Jul 25 16:46:06.207541 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-830fec30-2e5c-4dbe-8990-ed78fcdbf8e4 req-67b3a49c-c74e-4755-a125-ebfd126b7559 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037087 Jul 25 16:46:06.213503 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2942/5955] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:06.880828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:06.881628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:06.891287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:06.892388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:06.893479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:06.894172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:07.106319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:07.118549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:07.120893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:07.122367 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0e8e069-240c-405f-81b7-3067404bb2f0 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1366 microversion: 2.26 time: 0.246056 Jul 25 16:46:07.123183 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3014/5956] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:06 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:46:08.156500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.158222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:08.172185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.173253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.175198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.175984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.427997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:08.442926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:08.444690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:08.446673 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3b7ff5ea-9f77-4d6c-9c01-bd0b32dd570e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1550 microversion: 2.26 time: 0.303160 Jul 25 16:46:08.459860 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2943/5957] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:08 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1550 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:08.480370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d92fe5f70>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.487366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:08.498988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.499996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.500674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:08.511804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.512299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.515386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.515386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.546282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.547189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.562461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.562966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.594516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:08.618517 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1f49c9d-f3c7-46b3-b240-c5e4530bbf4a tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-162554590" status: 201 len: 0 microversion: 2.26 time: 0.143434 Jul 25 16:46:08.624616 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3015/5958] 10.222.0.105 () {62 vars in 1382 bytes} [Mon Jul 25 16:46:08 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-162554590 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 16:46:08.631364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d6d070ea-3c7d-4b73-80b9-e2de805f45f2 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93a8ad30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.640751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6d070ea-3c7d-4b73-80b9-e2de805f45f2 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.641298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d6d070ea-3c7d-4b73-80b9-e2de805f45f2 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.661136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d6d070ea-3c7d-4b73-80b9-e2de805f45f2 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-162554590" status: 204 len: 0 microversion: 2.26 time: 0.034812 Jul 25 16:46:08.662058 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2944/5959] 10.222.0.105 () {60 vars in 1363 bytes} [Mon Jul 25 16:46:08 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-162554590 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:08.674066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93d869d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.684639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.685632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.686435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:08.696983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.697810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.698977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.699398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.732542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.733619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.757580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:08.780110 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cbb2b807-416d-4c9a-abb9-eb0aea50faf6 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 204 len: 0 microversion: 2.26 time: 0.111166 Jul 25 16:46:08.780915 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3016/5960] 10.222.0.105 () {60 vars in 1300 bytes} [Mon Jul 25 16:46:08 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:08.792998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c486ba14-a727-4130-a9b2-50fe03e1ab08 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9da05bdc10>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.807018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c486ba14-a727-4130-a9b2-50fe03e1ab08 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.807685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c486ba14-a727-4130-a9b2-50fe03e1ab08 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.823078 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c486ba14-a727-4130-a9b2-50fe03e1ab08 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 200 len: 12 microversion: 2.26 time: 0.035581 Jul 25 16:46:08.823709 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2945/5961] 10.222.0.105 () {60 vars in 1297 bytes} [Mon Jul 25 16:46:08 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:08.835974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d9288bc10>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.849063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.850082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.850778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:08.859116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.860002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.860981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.861650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.899199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.899668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.917249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.917249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:08.948199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:08.971147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-382e9cb8-7c88-4563-90ad-03ccdfb943fd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1519606950" status: 201 len: 0 microversion: 2.26 time: 0.140299 Jul 25 16:46:08.972639 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3017/5962] 10.222.0.105 () {62 vars in 1385 bytes} [Mon Jul 25 16:46:08 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1519606950 => generated 0 bytes in 143 msecs (HTTP/1.1 201) 10 headers in 487 bytes (1 switches on core 0) Jul 25 16:46:08.983160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e23b5ac5-46b5-4f85-b3f3-50af8841877f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93d01d30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:08.995451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e23b5ac5-46b5-4f85-b3f3-50af8841877f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:08.998278 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e23b5ac5-46b5-4f85-b3f3-50af8841877f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.007536 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e23b5ac5-46b5-4f85-b3f3-50af8841877f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 200 len: 36 microversion: 2.26 time: 0.029286 Jul 25 16:46:09.009075 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2946/5963] 10.222.0.105 () {60 vars in 1297 bytes} [Mon Jul 25 16:46:08 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 36 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:09.024496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9da4aea700>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.079815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.080324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.080951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.089337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.090278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.091033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.091814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.132068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.133793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.168166 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:09.172082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:09.190949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f04ac7c7-7c6e-46a6-aa4b-3959e248f8eb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1519606950" status: 204 len: 0 microversion: 2.26 time: 0.172148 Jul 25 16:46:09.195741 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3018/5964] 10.222.0.105 () {60 vars in 1369 bytes} [Mon Jul 25 16:46:09 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1519606950 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:09.203814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-75771f40-a76e-4b3e-b459-5f1ff6d6caa7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d9383c280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.214387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75771f40-a76e-4b3e-b459-5f1ff6d6caa7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.214641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-75771f40-a76e-4b3e-b459-5f1ff6d6caa7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.227063 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-75771f40-a76e-4b3e-b459-5f1ff6d6caa7 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 200 len: 12 microversion: 2.26 time: 0.028207 Jul 25 16:46:09.233578 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2947/5965] 10.222.0.105 () {60 vars in 1297 bytes} [Mon Jul 25 16:46:09 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:09.241295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d9351a5e0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.258967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.260572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.261802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.276314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.277606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.278565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.279105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.314653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.315245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.331169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:09.350930 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08c90df3-0534-488e-ab23-1a86ad8bbad1 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 204 len: 0 microversion: 2.26 time: 0.115662 Jul 25 16:46:09.352054 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3019/5966] 10.222.0.105 () {60 vars in 1300 bytes} [Mon Jul 25 16:46:09 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:09.363491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93961dc0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.374729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.375511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.376302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.383998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.384394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.385172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.385689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.416396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.417039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.421173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:09.430153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.430944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.465893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:09.494365 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-916ea98d-573e-4333-838f-31c350c0da26 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-417009020" status: 201 len: 0 microversion: 2.26 time: 0.135492 Jul 25 16:46:09.495195 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2948/5967] 10.222.0.105 () {62 vars in 1382 bytes} [Mon Jul 25 16:46:09 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-417009020 => generated 0 bytes in 138 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 16:46:09.506637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d92762430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.517345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.518334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.519277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.526319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.526992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.528038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.528780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.574269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.575009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.589749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.590537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.626653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:09.656335 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2879d20f-6dc4-4cd4-a1f4-59df2a0d5178 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1408686210" status: 201 len: 0 microversion: 2.26 time: 0.155047 Jul 25 16:46:09.662740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3020/5968] 10.222.0.105 () {62 vars in 1385 bytes} [Mon Jul 25 16:46:09 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1408686210 => generated 0 bytes in 157 msecs (HTTP/1.1 201) 10 headers in 487 bytes (1 switches on core 0) Jul 25 16:46:09.668761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9da05568b0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.677742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.678265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.678816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.690011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.690011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.690011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.690011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.721305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.721758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.740086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:09.756625 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-154581da-d738-46f5-9f7d-4dfd9bd78cfd tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 204 len: 0 microversion: 2.26 time: 0.092189 Jul 25 16:46:09.757777 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2949/5969] 10.222.0.105 () {60 vars in 1300 bytes} [Mon Jul 25 16:46:09 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:09.768259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c6d8f8d-8f0d-4dd3-9d87-f832ccdff5cb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d935ed550>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.778267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f8d-8f0d-4dd3-9d87-f832ccdff5cb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.779012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f8d-8f0d-4dd3-9d87-f832ccdff5cb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.794771 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c6d8f8d-8f0d-4dd3-9d87-f832ccdff5cb tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 200 len: 12 microversion: 2.26 time: 0.032082 Jul 25 16:46:09.796241 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3021/5970] 10.222.0.105 () {60 vars in 1297 bytes} [Mon Jul 25 16:46:09 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:09.808974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93961430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.818717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.819637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.820363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.827536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.827989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.828852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.829494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.858223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.859088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.875216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:09.892649 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d1d9aca-3471-4220-8d66-33b1b1084879 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 204 len: 0 microversion: 2.26 time: 0.089751 Jul 25 16:46:09.897840 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2950/5971] 10.222.0.105 () {60 vars in 1300 bytes} [Mon Jul 25 16:46:09 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 16:46:09.904052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9da4aea310>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:09.915920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.916665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.917378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:09.938029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.948178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.949367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.949985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.981231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.981673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:09.992427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:09.993217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.025206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:10.049289 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26b4e4ef-3d9b-47cb-b9ae-28a44a858d94 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1771558152" status: 201 len: 0 microversion: 2.26 time: 0.147114 Jul 25 16:46:10.050650 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3022/5972] 10.222.0.105 () {62 vars in 1385 bytes} [Mon Jul 25 16:46:09 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-1771558152 => generated 0 bytes in 152 msecs (HTTP/1.1 201) 10 headers in 487 bytes (2 switches on core 0) Jul 25 16:46:10.073042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9da4a74940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:10.099780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.100167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.100659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:10.113224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.114264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.115503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.116103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.154614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.155371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.165624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.166076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.190939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:10.212072 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f0cc45b-f718-4cfd-8b1e-9ed03717ed0b tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-132172102" status: 201 len: 0 microversion: 2.26 time: 0.145032 Jul 25 16:46:10.216324 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2951/5973] 10.222.0.105 () {62 vars in 1382 bytes} [Mon Jul 25 16:46:10 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags/tempest-tag-132172102 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 16:46:10.224587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Action: 'update_all', calling method: .version_select at 0x7f9d935eda60>, body: {"tags": ["tempest-tag-739232080", "tempest-tag-1903417345"]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:10.237275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.237474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.237973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:10.250145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.250541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.251394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.251863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.279385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.280195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.301809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:10.322983 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8ef4c48-3a11-44c5-8ecd-f507038e656d tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 200 len: 61 microversion: 2.26 time: 0.103611 Jul 25 16:46:10.323625 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3023/5974] 10.222.0.105 () {62 vars in 1317 bytes} [Mon Jul 25 16:46:10 2022] PUT /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 61 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:10.335590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8fc9a0c9-737d-4494-bff4-8d27c940524f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93a51a60>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:10.344119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fc9a0c9-737d-4494-bff4-8d27c940524f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.344554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8fc9a0c9-737d-4494-bff4-8d27c940524f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.354103 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8fc9a0c9-737d-4494-bff4-8d27c940524f tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 200 len: 61 microversion: 2.26 time: 0.023481 Jul 25 16:46:10.354768 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2952/5975] 10.222.0.105 () {60 vars in 1297 bytes} [Mon Jul 25 16:46:10 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 61 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:10.366715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '.version_select at 0x7f9d93521160>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:10.377545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.378101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.378951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:10.387098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.387869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.388899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.389532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.419538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.420175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.439658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lazy-loading 'flavor' on Instance uuid 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:10.458358 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-06320925-3584-4bac-8641-c6d65b0b09e3 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags" status: 204 len: 0 microversion: 2.26 time: 0.096604 Jul 25 16:46:10.459154 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3024/5976] 10.222.0.105 () {60 vars in 1300 bytes} [Mon Jul 25 16:46:10 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153/tags => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:10.470820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:10.471355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:10.478888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.479339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.480130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.480569 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.508023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:46:10.597120 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ad3f550-71b5-4843-b5ed-8195455c5763 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 204 len: 0 microversion: 2.26 time: 0.130111 Jul 25 16:46:10.598230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2953/5977] 10.222.0.105 () {60 vars in 1285 bytes} [Mon Jul 25 16:46:10 2022] DELETE /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:46:10.609341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:10.610143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:10.617657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.618129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.618929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:10.619380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:10.783447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:10.793916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:10.795552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:10.796866 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-180d4289-5ccb-488a-bf43-b4379a27aebf tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1556 microversion: 2.26 time: 0.193784 Jul 25 16:46:10.797895 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3025/5978] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:10 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:11.823589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:11.824367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:11.831913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:11.832356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:11.833162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:11.833791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:11.979675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:11.991307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:11.993389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:11.994768 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-01d16fbe-200c-4c22-83d0-022466555ea8 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1556 microversion: 2.26 time: 0.175672 Jul 25 16:46:12.001141 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2954/5979] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:11 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:12.016818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-370964246", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:12.076983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:46:12.392447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:46:12.392894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:46:12.393437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:46:12.393865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:46:12.394302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:46:12.405040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:12.405536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:12.406385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:12.406842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:12.426054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Getting quotas for project 43d586a9537d41118bed26fb7083ccbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:46:12.432090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Getting quotas for user 0f046647e4264121a3c9ecbb9e3c4518 and project 43d586a9537d41118bed26fb7083ccbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:46:12.450032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:46:12.452412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:46:12.503613 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc57ad05-76b4-4c1d-a208-ea5b9a396a9a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.490857 Jul 25 16:46:12.504382 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3026/5980] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:46:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:46:12.515219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65251833-d608-4e48-af9d-0bf17778378b tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:12.515868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-65251833-d608-4e48-af9d-0bf17778378b tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:12.594436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65251833-d608-4e48-af9d-0bf17778378b tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:12.604739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65251833-d608-4e48-af9d-0bf17778378b tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1217 microversion: 2.1 time: 0.093616 Jul 25 16:46:12.609420 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2955/5981] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:12 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:13.020343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:13.021237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:13.035447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:13.036112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:13.037329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:13.055439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:13.176093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:13.176369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0a6a9ec9-a673-4579-a607-a1d232dcf1a2 req-3fc6b602-f483-4c74-b6f3-ed02f420e6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ca19cf-3ba8-40e5-af11-7a5a8a0ea153", "name": "network-vif-deleted", "tag": "4b64b538-df61-4a44-ac29-45e38f446939"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:13.188809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:13.192098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a6a9ec9-a673-4579-a607-a1d232dcf1a2 req-3fc6b602-f483-4c74-b6f3-ed02f420e6b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:13.192583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0a6a9ec9-a673-4579-a607-a1d232dcf1a2 req-3fc6b602-f483-4c74-b6f3-ed02f420e6b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:13.194468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dc589e89b1c4fcbaf10443e2f40a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14fa1a53d4f4c34872ad31687576878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:13.195978 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-61e01f9e-8687-4ef9-8b8a-743aa943c95e tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 200 len: 1514 microversion: 2.26 time: 0.180483 Jul 25 16:46:13.196684 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3027/5982] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:13 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:46:13.209057 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0a6a9ec9-a673-4579-a607-a1d232dcf1a2 req-3fc6b602-f483-4c74-b6f3-ed02f420e6b4 service nova] Creating event network-vif-deleted:4b64b538-df61-4a44-ac29-45e38f446939 for instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 on n-h1-846219-13 Jul 25 16:46:13.216175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0a6a9ec9-a673-4579-a607-a1d232dcf1a2 req-3fc6b602-f483-4c74-b6f3-ed02f420e6b4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043384 Jul 25 16:46:13.217201 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2956/5983] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:46:13.629065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:13.629641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:13.637346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:13.637968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:13.638745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:13.639221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:13.711847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:13.719801 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ea1e4f5-23d7-4985-beed-5268c0b79dbc tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1269 microversion: 2.1 time: 0.095301 Jul 25 16:46:13.720401 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3028/5984] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:13 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:14.221294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:14.222018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] [instance: 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:14.231606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:14.232794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:14.233674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:14.234208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:14.249238 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] HTTP exception thrown: Instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 could not be found. Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Request method failure captured: Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 HTTP/1.1 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3si8lJ1wyO11eHJmrzZftnPL9CZYHIMG9gWyIS9AfzVNFy0v_xskOXYG3wDlsHw6mxqG9YYd0JUksX93gswFrK88mn1qoEYWDTWRpA33mR9iRg5s4TkWrKlZW0dg5nQ01WQrEsmRhfmRk7g_iulR-2ZWZiTUSD5V41RgNdy7-bNADNU Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Openstack-Nova-Api-Version: 2.26 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: a14fa1a53d4f4c34872ad31687576878 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerTagsTestJSON-109323613 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a14fa1a53d4f4c34872ad31687576878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/a14fa1a53d4f4c34872ad31687576878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/a14fa1a53d4f4c34872ad31687576878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_a14fa1a53d4f4c34872ad31687576878"}]}] Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerTagsTestJSON-109323613 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: a14fa1a53d4f4c34872ad31687576878 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerTagsTestJSON-109323613 Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerTagsTestJSON-109323613-project Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 8dc589e89b1c4fcbaf10443e2f40a9da Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerTagsTestJSON-109323613-project Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 could not be found. Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '67ca19cf-3ba8-40e5-af11-7a5a8a0ea153'} Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 could not be found. Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 could not be found. Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:14.251122 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 could not be found. Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] Returning 404 to user: Instance 67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3dbadd64-ffb3-4d17-81f5-b834c3817b21 tempest-ServerTagsTestJSON-109323613 tempest-ServerTagsTestJSON-109323613-project] 10.222.0.105 "GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153" status: 404 len: 111 microversion: 2.26 time: 0.036424 Jul 25 16:46:14.257725 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2957/5985] 10.222.0.105 () {60 vars in 1282 bytes} [Mon Jul 25 16:46:14 2022] GET /compute/v2.1/servers/67ca19cf-3ba8-40e5-af11-7a5a8a0ea153 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:46:14.742200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:14.743653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:14.758821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:14.761280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:14.763944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:14.764768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:14.852371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:14.863071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3929c869-de15-436e-b186-c17b0cd110c6 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1275 microversion: 2.1 time: 0.125376 Jul 25 16:46:14.863920 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3029/5986] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:14 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:15.887535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:15.888778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:15.902607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:15.903750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:15.906695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:15.908494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:16.174155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1bc7cc70-bb8c-4eab-91fd-047a3f10f136 req-3ed8a235-542a-4774-9866-3eb52bc10ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37807b6d-be00-474f-aba3-1afe42ed4df2", "tag": "1bd51b82-d284-47b6-8463-05682330ecf6"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:16.191186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:16.195924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1bc7cc70-bb8c-4eab-91fd-047a3f10f136 req-3ed8a235-542a-4774-9866-3eb52bc10ff1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:16.196855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1bc7cc70-bb8c-4eab-91fd-047a3f10f136 req-3ed8a235-542a-4774-9866-3eb52bc10ff1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:16.206056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e9addc01-5dc0-4ef3-90b5-d67d83c4df78 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.323920 Jul 25 16:46:16.211005 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2958/5987] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:15 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:16.226000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1bc7cc70-bb8c-4eab-91fd-047a3f10f136 req-3ed8a235-542a-4774-9866-3eb52bc10ff1 service nova] Creating event network-changed:1bd51b82-d284-47b6-8463-05682330ecf6 for instance 37807b6d-be00-474f-aba3-1afe42ed4df2 on n-h1-846219-13 Jul 25 16:46:16.251207 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1bc7cc70-bb8c-4eab-91fd-047a3f10f136 req-3ed8a235-542a-4774-9866-3eb52bc10ff1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082839 Jul 25 16:46:16.252940 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3030/5988] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:17.231874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:17.233839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:17.250059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:17.250701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:17.254409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:17.255254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:17.584331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:17.594090 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61ee407a-12f7-4f74-be59-c2381e5a8d41 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.367702 Jul 25 16:46:17.594830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2959/5989] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:17 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:18.617270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:18.622351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:18.637601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:18.638065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:18.638866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:18.639933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:18.885547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:18.889800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:18.895907 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0107336-ca7d-48da-90e1-9c87e377037a tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.284130 Jul 25 16:46:18.907048 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3031/5990] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:18 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:19.312673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:19.313273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:19.323878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:19.325595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:19.327589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:19.329074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:19.361961 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/ips" status: 200 len: 146 microversion: 2.1 time: 0.053227 Jul 25 16:46:19.363420 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2960/5991] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:46:19 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:19.917596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:19.918828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:19.927021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:19.927704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:19.928700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:19.929649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:20.125136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:20.138717 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc6a7599-4b7d-422a-8c3e-8c97c2d49584 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.225225 Jul 25 16:46:20.139551 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3032/5992] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:19 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:20.300722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:20.301787 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-516820c2-6593-423e-b4ef-2bc7ff780fd7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001431 Jul 25 16:46:20.308755 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2961/5993] 10.222.0.105 () {56 vars in 891 bytes} [Mon Jul 25 16:46:20 2022] GET /compute/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 16:46:21.161587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:21.162392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:21.170380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:21.171132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:21.172243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:21.172856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:21.362905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:21.370815 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-33bc568b-163d-4d73-81b3-4fb9485f3967 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.213890 Jul 25 16:46:21.371423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3033/5994] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:21 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:21.934213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "856a752f-7267-460b-a726-0336530cccc7"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:21.936707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:21.945204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:21.945895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:21.946894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:21.947335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:22.138382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:22.208484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e6d3f67-f6c6-4990-a80e-e32c309f99d0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Action: 'create', calling method: .version_select at 0x7f9da4a5b9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2036379010", "metadata": {"Type": "work"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e6d3f67-f6c6-4990-a80e-e32c309f99d0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Request method failure captured: Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 122 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjdBq5cot08UxWy-qf9td847vYe0V6jUsFW4bgMQARMJazM-DRdEnoG321TlttxxBkQTBuUF6UKdBDr0_cy33oDg3J0CjILuZ_LC4Z5vUtaDWo0iw0vtSYZxagaQm13hw9P4phg0_t30458VJlmwHVHzpQcwfHdR_23RGiQPh_n2LE Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfdd150470bf49558ab9b59cab371668"}]}] Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d29845fdad6146af8b8342480d7c2237 Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2036379010", "metadata": {"Type": "work"}}} Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2036379010', 'metadata': {'Type': 'work'}}}} Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:46:22.233024 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 16:46:22.242512 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.247095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e6d3f67-f6c6-4990-a80e-e32c309f99d0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:22.248800 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e6d3f67-f6c6-4990-a80e-e32c309f99d0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.235581 Jul 25 16:46:22.250433 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3034/5995] 10.222.0.105 () {60 vars in 1161 bytes} [Mon Jul 25 16:46:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:46:22.261005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6afbcf4a-f3dd-4fe0-84be-06ac243ebb07 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Action: 'create', calling method: .version_select at 0x7f9d92e82160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1643617670", "metadata": {"Type": "work"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6afbcf4a-f3dd-4fe0-84be-06ac243ebb07 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Request method failure captured: Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 120 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjdBq5cot08UxWy-qf9td847vYe0V6jUsFW4bgMQARMJazM-DRdEnoG321TlttxxBkQTBuUF6UKdBDr0_cy33oDg3J0CjILuZ_LC4Z5vUtaDWo0iw0vtSYZxagaQm13hw9P4phg0_t30458VJlmwHVHzpQcwfHdR_23RGiQPh_n2LE Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfdd150470bf49558ab9b59cab371668"}]}] Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d29845fdad6146af8b8342480d7c2237 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1643617670", "metadata": {"Type": "work"}}} Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1643617670', 'metadata': {'Type': 'work'}}}} Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '0' Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:46:22.267978 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 16:46:22.273796 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.276648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6afbcf4a-f3dd-4fe0-84be-06ac243ebb07 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:22.282577 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6afbcf4a-f3dd-4fe0-84be-06ac243ebb07 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025784 Jul 25 16:46:22.284574 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3035/5996] 10.222.0.105 () {60 vars in 1161 bytes} [Mon Jul 25 16:46:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:46:22.313979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6a584a7-fcb0-4764-8947-4fcd01f1f9ae tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Action: 'create', calling method: .version_select at 0x7f9da4a5b790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1372519115", "metadata": {"Type": "work"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6a584a7-fcb0-4764-8947-4fcd01f1f9ae tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Request method failure captured: Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 119 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjdBq5cot08UxWy-qf9td847vYe0V6jUsFW4bgMQARMJazM-DRdEnoG321TlttxxBkQTBuUF6UKdBDr0_cy33oDg3J0CjILuZ_LC4Z5vUtaDWo0iw0vtSYZxagaQm13hw9P4phg0_t30458VJlmwHVHzpQcwfHdR_23RGiQPh_n2LE Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfdd150470bf49558ab9b59cab371668"}]}] Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d29845fdad6146af8b8342480d7c2237 Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1372519115", "metadata": {"Type": "work"}}} Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1372519115', 'metadata': {'Type': 'work'}}}} Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi '' Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:46:22.319234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6a584a7-fcb0-4764-8947-4fcd01f1f9ae tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:22.324633 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6a584a7-fcb0-4764-8947-4fcd01f1f9ae tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025617 Jul 25 16:46:22.329112 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3036/5997] 10.222.0.105 () {60 vars in 1161 bytes} [Mon Jul 25 16:46:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:46:22.335724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bba2a454-ff20-4650-aa54-113df64dbebc tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Calling method '.version_select at 0x7f9d9277b040>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:22.336949 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a36d3f1-9f4e-4612-a2fe-f3ccbe52174d tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406787 Jul 25 16:46:22.337916 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2962/5998] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:46:21 2022] POST /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:22.395578 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-bba2a454-ff20-4650-aa54-113df64dbebc tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] HTTP exception thrown: Volume tempest-invalid-555091644 could not be found. Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bba2a454-ff20-4650-aa54-113df64dbebc tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Request method failure captured: Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-555091644 HTTP/1.1 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjdBq5cot08UxWy-qf9td847vYe0V6jUsFW4bgMQARMJazM-DRdEnoG321TlttxxBkQTBuUF6UKdBDr0_cy33oDg3J0CjILuZ_LC4Z5vUtaDWo0iw0vtSYZxagaQm13hw9P4phg0_t30458VJlmwHVHzpQcwfHdR_23RGiQPh_n2LE Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfdd150470bf49558ab9b59cab371668"}]}] Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d29845fdad6146af8b8342480d7c2237 Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume tempest-invalid-555091644 could not be found. Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'tempest-invalid-555091644'} Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-555091644 could not be found. (HTTP 404) (Request-ID: req-1cd0c0da-9100-4d6b-8b49-7ee969dd2bc4) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:46:22.397955 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-555091644 could not be found. Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-555091644 could not be found. Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-555091644 could not be found. Jul 25 16:46:22.403384 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.407120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:22.407239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bba2a454-ff20-4650-aa54-113df64dbebc tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Returning 404 to user: Volume tempest-invalid-555091644 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:22.407342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:22.407449 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bba2a454-ff20-4650-aa54-113df64dbebc tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/tempest-invalid-555091644" status: 404 len: 98 microversion: 2.1 time: 0.071126 Jul 25 16:46:22.407449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3037/5999] 10.222.0.105 () {58 vars in 1220 bytes} [Mon Jul 25 16:46:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-555091644 => generated 98 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:46:22.414396 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-262b0969-0b4c-4fe0-aef3-e8711684b138 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008368 Jul 25 16:46:22.419289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:22.419721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:22.419960 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3038/6000] 10.222.0.105 () {58 vars in 1145 bytes} [Mon Jul 25 16:46:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:46:22.420552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:22.423392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:22.424966 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dd37d504-d831-4661-ad81-a5126c8ed7e0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003639 Jul 25 16:46:22.429990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3039/6001] 10.222.0.105 () {58 vars in 1142 bytes} [Mon Jul 25 16:46:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:46:22.436026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-701dfd66-083d-4916-a7cc-48ff4f0aaee0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Calling method '.version_select at 0x7f9da4b6fb80>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:22.442797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:22.443890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:22.507415 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-701dfd66-083d-4916-a7cc-48ff4f0aaee0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] HTTP exception thrown: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-701dfd66-083d-4916-a7cc-48ff4f0aaee0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Request method failure captured: Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/os-volumes/ce68a6c7-78ee-429e-a64c-3d763381286b HTTP/1.1 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjdBq5cot08UxWy-qf9td847vYe0V6jUsFW4bgMQARMJazM-DRdEnoG321TlttxxBkQTBuUF6UKdBDr0_cy33oDg3J0CjILuZ_LC4Z5vUtaDWo0iw0vtSYZxagaQm13hw9P4phg0_t30458VJlmwHVHzpQcwfHdR_23RGiQPh_n2LE Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfdd150470bf49558ab9b59cab371668"}]}] Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d29845fdad6146af8b8342480d7c2237 Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'ce68a6c7-78ee-429e-a64c-3d763381286b'} Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. (HTTP 404) (Request-ID: req-410fc4c3-89d3-41a6-9e39-1bdd7ae948eb) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:46:22.509410 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. Jul 25 16:46:22.513908 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.518938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-701dfd66-083d-4916-a7cc-48ff4f0aaee0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Returning 404 to user: Volume ce68a6c7-78ee-429e-a64c-3d763381286b could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:22.520279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-701dfd66-083d-4916-a7cc-48ff4f0aaee0 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "DELETE /compute/v2.1/os-volumes/ce68a6c7-78ee-429e-a64c-3d763381286b" status: 404 len: 109 microversion: 2.1 time: 0.088806 Jul 25 16:46:22.521458 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3040/6002] 10.222.0.105 () {58 vars in 1253 bytes} [Mon Jul 25 16:46:22 2022] DELETE /compute/v2.1/os-volumes/ce68a6c7-78ee-429e-a64c-3d763381286b => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:46:22.532354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2936f72e-c1fa-4258-9b99-bb4c970ec859 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Calling method '.version_select at 0x7f9d92eb3a60>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:22.589060 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-2936f72e-c1fa-4258-9b99-bb4c970ec859 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] HTTP exception thrown: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2936f72e-c1fa-4258-9b99-bb4c970ec859 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Request method failure captured: Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/os-volumes/8166538b-6349-48d8-83cf-1da61a71448f HTTP/1.1 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjdBq5cot08UxWy-qf9td847vYe0V6jUsFW4bgMQARMJazM-DRdEnoG321TlttxxBkQTBuUF6UKdBDr0_cy33oDg3J0CjILuZ_LC4Z5vUtaDWo0iw0vtSYZxagaQm13hw9P4phg0_t30458VJlmwHVHzpQcwfHdR_23RGiQPh_n2LE Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bfdd150470bf49558ab9b59cab371668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bfdd150470bf49558ab9b59cab371668"}]}] Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bfdd150470bf49558ab9b59cab371668 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesNegativeTest-1693315616 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d29845fdad6146af8b8342480d7c2237 Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesNegativeTest-1693315616-project Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: method: Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: exception: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8166538b-6349-48d8-83cf-1da61a71448f'} Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. (HTTP 404) (Request-ID: req-67eafd8c-acf1-472d-b327-63a2a66a629d) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:46:22.591679 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2936f72e-c1fa-4258-9b99-bb4c970ec859 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] Returning 404 to user: Volume 8166538b-6349-48d8-83cf-1da61a71448f could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2936f72e-c1fa-4258-9b99-bb4c970ec859 tempest-VolumesNegativeTest-1693315616 tempest-VolumesNegativeTest-1693315616-project] 10.222.0.105 "GET /compute/v2.1/os-volumes/8166538b-6349-48d8-83cf-1da61a71448f" status: 404 len: 109 microversion: 2.1 time: 0.067893 Jul 25 16:46:22.596717 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3041/6003] 10.222.0.105 () {58 vars in 1250 bytes} [Mon Jul 25 16:46:22 2022] GET /compute/v2.1/os-volumes/8166538b-6349-48d8-83cf-1da61a71448f => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:46:22.604446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:22.742319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-30f6d368-54e5-443c-9d26-42d11c25e995 req-cde10493-e280-467f-84cb-aae5812a5722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37807b6d-be00-474f-aba3-1afe42ed4df2", "name": "network-vif-plugged", "status": "completed", "tag": "1bd51b82-d284-47b6-8463-05682330ecf6"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:22.768164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:22.780017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-30f6d368-54e5-443c-9d26-42d11c25e995 req-cde10493-e280-467f-84cb-aae5812a5722 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:22.783139 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-31d5e2da-c4a2-4867-a564-9a965389fc4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.391036 Jul 25 16:46:22.784112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-30f6d368-54e5-443c-9d26-42d11c25e995 req-cde10493-e280-467f-84cb-aae5812a5722 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:22.800138 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2963/6004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:22 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:22.824237 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-30f6d368-54e5-443c-9d26-42d11c25e995 req-cde10493-e280-467f-84cb-aae5812a5722 service nova] Creating event network-vif-plugged:1bd51b82-d284-47b6-8463-05682330ecf6 for instance 37807b6d-be00-474f-aba3-1afe42ed4df2 on n-h1-846219-13 Jul 25 16:46:22.838040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-30f6d368-54e5-443c-9d26-42d11c25e995 req-cde10493-e280-467f-84cb-aae5812a5722 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099501 Jul 25 16:46:22.841168 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3042/6005] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:23.806653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:23.808031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:23.824107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:23.825051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:23.825901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:23.830215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:23.998460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:24.007495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b82e839-1e74-4766-b8e0-0fce90698cf8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1317 microversion: 2.1 time: 0.206269 Jul 25 16:46:24.017709 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2964/6006] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:23 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:25.033082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:25.034633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:25.051900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:25.052906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:25.053999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:25.055274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:25.245533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:25.253791 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9239dfc7-7d19-4bfe-8a00-312c005fe79d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1466 microversion: 2.1 time: 0.228966 Jul 25 16:46:25.255468 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3043/6007] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:25 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1466 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:25.279015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5797acb-dd56-40ba-98ca-7e4149498abb", "device": "/dev/sdb"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:25.282910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:25.291120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:25.291800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:25.292779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:25.293280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:25.741732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5083711a-352f-43c6-9627-4b00c60e5a4d tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "POST /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466300 Jul 25 16:46:25.743101 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2965/6008] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:46:25 2022] POST /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:26.354437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:26.357952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:26.385126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:26.391129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:26.392508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:26.394391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:26.507824 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41bc2d74-7390-4923-a936-152b90b74f1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action" status: 200 len: 24570 microversion: 2.1 time: 0.155857 Jul 25 16:46:26.510588 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3044/6009] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:46:26 2022] POST /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7/action => generated 24570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:46:32.870863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:32.871668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:32.886899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:32.887348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:32.888141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:32.888574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:33.111020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-59d47130-781b-4932-bab2-8dd149397b5c tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1838 microversion: 2.1 time: 0.243953 Jul 25 16:46:33.112303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2966/6010] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:32 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1838 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:34.539650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:34.545646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:34.555013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.555916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.556843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.557415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.602593 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e144ca67-d7c7-4041-a7bc-5cfe076e1624 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069333 Jul 25 16:46:34.603694 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3045/6011] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:46:34 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:34.617727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:34.619108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:34.627942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.628801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.630227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.630953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.701926 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b8b7f92a-d5c6-4779-9609-83b79a543cb7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/856a752f-7267-460b-a726-0336530cccc7" status: 200 len: 194 microversion: 2.1 time: 0.091090 Jul 25 16:46:34.702600 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2967/6012] 10.222.0.105 () {58 vars in 1418 bytes} [Mon Jul 25 16:46:34 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/856a752f-7267-460b-a726-0336530cccc7 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:34.744298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:34.744885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:34.757910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.758401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.759259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.759724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.769564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8e4dda1b-a636-4b8f-8b99-c561ab75b720 req-2a4f1927-551b-4d71-ab5c-042ffae9cdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:34.800184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8e4dda1b-a636-4b8f-8b99-c561ab75b720 req-2a4f1927-551b-4d71-ab5c-042ffae9cdd7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:34.800788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8e4dda1b-a636-4b8f-8b99-c561ab75b720 req-2a4f1927-551b-4d71-ab5c-042ffae9cdd7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:34.829620 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8e4dda1b-a636-4b8f-8b99-c561ab75b720 req-2a4f1927-551b-4d71-ab5c-042ffae9cdd7 service nova] Creating event network-changed:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h2-846219-13 Jul 25 16:46:34.844024 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8e4dda1b-a636-4b8f-8b99-c561ab75b720 req-2a4f1927-551b-4d71-ab5c-042ffae9cdd7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076935 Jul 25 16:46:34.845171 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2968/6013] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:34.880400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:46:35.032999 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c32fa50-281b-47ef-8885-64adad7dc123 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 204 len: 0 microversion: 2.1 time: 0.293238 Jul 25 16:46:35.041973 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3046/6014] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:46:34 2022] DELETE /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:46:35.050950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:35.051674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:35.070186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:35.070951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:35.072395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:35.073578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:35.369811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:35.382329 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11422287-23fd-45ed-bb42-2713937c51d2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1691 microversion: 2.1 time: 0.335368 Jul 25 16:46:35.382938 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2969/6015] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:35 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:36.407283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:36.408060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:36.436706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:36.437204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:36.441434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:36.441981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:36.914868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:36.927685 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-636403c0-ebb6-463e-8f89-c077237501f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 200 len: 1691 microversion: 2.1 time: 0.525468 Jul 25 16:46:36.929226 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3047/6016] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:36 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 1691 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:37.344123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a03a3f93-7dfe-4f7c-9f15-961fe7172699 req-73e7ce21-494c-4f79-a75d-8e7187207911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19141d9a-efaa-47b9-8b22-f077435b98a7", "name": "network-vif-deleted", "tag": "560abfb9-741e-42eb-8319-ea6d5fdc83b8"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:37.354319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:37.362660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a03a3f93-7dfe-4f7c-9f15-961fe7172699 req-73e7ce21-494c-4f79-a75d-8e7187207911 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:37.363036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a03a3f93-7dfe-4f7c-9f15-961fe7172699 req-73e7ce21-494c-4f79-a75d-8e7187207911 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:37.376798 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a03a3f93-7dfe-4f7c-9f15-961fe7172699 req-73e7ce21-494c-4f79-a75d-8e7187207911 service nova] Creating event network-vif-deleted:560abfb9-741e-42eb-8319-ea6d5fdc83b8 for instance 19141d9a-efaa-47b9-8b22-f077435b98a7 on n-h2-846219-13 Jul 25 16:46:37.385531 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a03a3f93-7dfe-4f7c-9f15-961fe7172699 req-73e7ce21-494c-4f79-a75d-8e7187207911 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044900 Jul 25 16:46:37.386531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2970/6017] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:37.621034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20f9c46-63da-45d6-bac5-39ef4153fa38"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:37.624298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:37.636596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:37.637498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:37.640291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:37.642502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:37.954138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:37.954892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: 19141d9a-efaa-47b9-8b22-f077435b98a7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:37.963100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:37.963753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:37.964664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:37.965325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:37.985671 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] HTTP exception thrown: Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 could not be found. Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Request method failure captured: Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 HTTP/1.1 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sgn4YkBMyCEyyAORyVf9SZjBBvuh81o-VzVNz2F1wNAr5HF5-hD4odv0heMCsEXrqL-2lCux1tP7m0PYr-vigSzzpDCzlqczfxYfRCOzVsm3BERebJbVFwnSoZ5CkBkCCaojMxgj5pmTX5yzsQVNJ7JSEUQ6hfrXXue07rD9iWFdyo Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cd51658ef95d4f69b50b94f0ebfc4205"}]}] Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: edc280fc36f7440a957c6856dd0877a3 Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 could not be found. Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '19141d9a-efaa-47b9-8b22-f077435b98a7'} Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 could not be found. Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 could not be found. Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:37.989286 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 could not be found. Jul 25 16:46:37.992759 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:46:37.995194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Returning 404 to user: Instance 19141d9a-efaa-47b9-8b22-f077435b98a7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:46:37.996455 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ab92afd-1c0c-4b77-a301-980fef261a11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7" status: 404 len: 111 microversion: 2.1 time: 0.050328 Jul 25 16:46:37.997504 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2971/6018] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:37 2022] GET /compute/v2.1/servers/19141d9a-efaa-47b9-8b22-f077435b98a7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:46:38.168896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9d5c7c6c-9e83-4e3b-b22c-d7300071caee tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "POST /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552663 Jul 25 16:46:38.169676 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3048/6019] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 16:46:37 2022] POST /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:43.709743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8d868f4-da0f-4f0d-9b54-9d619d2547ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '.version_select at 0x7f9da49a2430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:43.766188 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8d868f4-da0f-4f0d-9b54-9d619d2547ad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-875281474" status: 202 len: 0 microversion: 2.1 time: 0.061279 Jul 25 16:46:43.766802 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2972/6020] 10.222.0.105 () {58 vars in 1286 bytes} [Mon Jul 25 16:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-875281474 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:46:43.815197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be2a8289-f543-40eb-b6ee-c1319f21b48f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: .version_select at 0x7f9d92eb30d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1437113524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJW+FMso3fMWzHbpa14c79Cl9YYcw7sIElMvbxzdeLgt8x93M7HxkpE1SydPVGtY07tAWZCZxcQGV/s7cb7V0lJTuT7wsnyBJ5XYw/Wwl6u8Wznh93HqO69BYtpuNpbyA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:43.841501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:43.868944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-be2a8289-f543-40eb-b6ee-c1319f21b48f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:46:43.903686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-be2a8289-f543-40eb-b6ee-c1319f21b48f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:46:43.954038 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be2a8289-f543-40eb-b6ee-c1319f21b48f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.146825 Jul 25 16:46:43.955038 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3049/6021] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:46:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:52.617991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:52.619047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:52.640149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:52.645854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7b3b6fb6-4c45-4b56-a952-8293036ff244 req-61b3b716-b879-416d-aab3-cf86d9426c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6fef0c-bee3-47c6-b352-590acd7cc13d", "tag": "fd364454-8de1-4f0f-9003-89f86c205c0e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:52.652039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:52.655062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:52.667284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:52.669211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:52.672016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:52.679735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7b3b6fb6-4c45-4b56-a952-8293036ff244 req-61b3b716-b879-416d-aab3-cf86d9426c8c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:52.696689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7b3b6fb6-4c45-4b56-a952-8293036ff244 req-61b3b716-b879-416d-aab3-cf86d9426c8c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:52.753508 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7b3b6fb6-4c45-4b56-a952-8293036ff244 req-61b3b716-b879-416d-aab3-cf86d9426c8c service nova] Creating event network-changed:fd364454-8de1-4f0f-9003-89f86c205c0e for instance ca6fef0c-bee3-47c6-b352-590acd7cc13d on n-h2-846219-13 Jul 25 16:46:52.781068 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7b3b6fb6-4c45-4b56-a952-8293036ff244 req-61b3b716-b879-416d-aab3-cf86d9426c8c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137512 Jul 25 16:46:52.784061 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3050/6022] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:46:52.835490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:46:53.162696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fbcf1606-e633-4d93-bb7f-273b1c9b1961 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 204 len: 0 microversion: 2.1 time: 0.548579 Jul 25 16:46:53.171629 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2973/6023] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:46:52 2022] DELETE /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:46:53.185956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:53.187507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:53.210616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.213538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.218534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.219080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.276456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:53.280352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:53.300253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.300954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.301923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.302491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.393863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0d58da15-33a4-45b2-905d-b2966bc019d3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.123072 Jul 25 16:46:53.401381 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2974/6024] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:46:53 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:46:53.549357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:53.549859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:53.580586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.590322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.592780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.613915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.669701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:53.682702 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64e77df7-0b76-41ca-afc2-2388d2f584c8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1580 microversion: 2.1 time: 0.506002 Jul 25 16:46:53.684449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3051/6025] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:53 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1580 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:53.748037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-276e258b-3006-4e91-a987-73a749dac8a7 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/856a752f-7267-460b-a726-0336530cccc7" status: 200 len: 194 microversion: 2.1 time: 0.204013 Jul 25 16:46:53.751660 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2975/6026] 10.222.0.105 () {58 vars in 1418 bytes} [Mon Jul 25 16:46:53 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/856a752f-7267-460b-a726-0336530cccc7 => generated 194 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:46:53.762137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:53.762940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:53.778742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.783438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.787813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:53.788969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:53.928447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:46:54.037475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lazy-loading 'services' on Instance uuid d8405cf4-ea08-4fde-9763-ca09eefa3679 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:46:54.271281 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a949ab6-0b1e-4b88-95c7-60c9a6501c63 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/856a752f-7267-460b-a726-0336530cccc7" status: 202 len: 0 microversion: 2.1 time: 0.515017 Jul 25 16:46:54.272654 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3052/6027] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:46:53 2022] DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/856a752f-7267-460b-a726-0336530cccc7 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:46:55.259463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:55.260938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:55.272446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:55.278633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:55.284490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:55.284956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:56.358334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:56.381207 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-70860631-9d65-4cc4-9331-46ccd1a5316e tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1580 microversion: 2.1 time: 1.669674 Jul 25 16:46:56.400414 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2976/6028] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:54 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1580 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:57.034373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e2d6f6b3-226c-4888-a31d-fac7ee97ed98 req-6bf2de95-71fa-4c6e-bd34-3d2a2d2d9d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6fef0c-bee3-47c6-b352-590acd7cc13d", "name": "network-vif-deleted", "tag": "fd364454-8de1-4f0f-9003-89f86c205c0e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:57.046591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e2d6f6b3-226c-4888-a31d-fac7ee97ed98 req-6bf2de95-71fa-4c6e-bd34-3d2a2d2d9d69 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:57.047327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e2d6f6b3-226c-4888-a31d-fac7ee97ed98 req-6bf2de95-71fa-4c6e-bd34-3d2a2d2d9d69 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:57.069482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e2d6f6b3-226c-4888-a31d-fac7ee97ed98 req-6bf2de95-71fa-4c6e-bd34-3d2a2d2d9d69 service nova] Creating event network-vif-deleted:fd364454-8de1-4f0f-9003-89f86c205c0e for instance ca6fef0c-bee3-47c6-b352-590acd7cc13d on n-h2-846219-13 Jul 25 16:46:57.089083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e2d6f6b3-226c-4888-a31d-fac7ee97ed98 req-6bf2de95-71fa-4c6e-bd34-3d2a2d2d9d69 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075913 Jul 25 16:46:57.090467 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3053/6029] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:46:57.409354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:57.410968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:57.429308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:57.430215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:57.436777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:57.437279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:57.809455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:57.819258 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bfa84905-1adc-4db0-ad7f-bcec7b9b8c13 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.413963 Jul 25 16:46:57.826918 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2977/6030] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:57 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:46:57.880559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-940776783", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "2d594572-bacd-4cfd-b982-e04d756cd4d2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1437113524", "security_groups": [{"name": "tempest-secgroup-smoke-874911321"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:46:58.188538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] validate_networks() for [('2d594572-bacd-4cfd-b982-e04d756cd4d2', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:46:58.851952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:46:58.852634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:46:58.887015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:58.887015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:58.887015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:58.887264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:59.171726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:46:59.180155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a3570cad-0af5-46df-8a94-1c3fc4ea4252 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.332347 Jul 25 16:46:59.190053 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2978/6031] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:46:58 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:46:59.810914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:46:59.811927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:46:59.812562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:46:59.813369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:46:59.813878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:46:59.835034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:59.835513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:59.836360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:46:59.836929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:46:59.901782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:46:59.920901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:46:59.948507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:46:59.950992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:47:00.069550 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6319cc7c-c97d-4a21-ab30-d0c077f3e20b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.192317 Jul 25 16:47:00.070835 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3054/6032] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:46:57 2022] POST /compute/v2.1/servers => generated 407 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:47:00.083945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef90a849-e946-4b39-ba9b-2939ca582eee tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:00.086006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef90a849-e946-4b39-ba9b-2939ca582eee tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:00.210497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:00.211049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:00.238543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:00.239257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:00.240916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:00.241565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:00.298462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ef90a849-e946-4b39-ba9b-2939ca582eee tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:00.311020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef90a849-e946-4b39-ba9b-2939ca582eee tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1270 microversion: 2.1 time: 0.233107 Jul 25 16:47:00.326465 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2979/6033] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:00 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:00.347361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:00.359947 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6dd53ad-c34e-4ed3-b41e-a1ef638fd653 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.153837 Jul 25 16:47:00.360946 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3055/6034] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:00 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:01.339637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:01.340812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:01.360349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:01.360795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:01.361622 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:01.370420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:01.384547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:01.385685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:01.414625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:01.416135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:01.417291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:01.420761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:01.566266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:01.567393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:01.576078 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71dbb0eb-f8f4-460c-a0ee-df30707e9582 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.197206 Jul 25 16:47:01.577330 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3056/6035] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:01 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:01.580170 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-33c3817d-25c9-4d00-aba2-56c4873680ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1266 microversion: 2.1 time: 0.245316 Jul 25 16:47:01.580905 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2980/6036] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:01 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:02.600504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:02.602127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:02.602392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:02.603429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:02.619428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:02.620173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:02.621159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:02.622504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:02.623383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:02.624162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:02.626095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:02.633057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:03.078087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:03.083184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:03.090630 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc0bd894-2e5d-4ae7-b68f-ac6b95090f5f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.495325 Jul 25 16:47:03.101136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c432457-27da-4db2-bf76-af15a92854cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1328 microversion: 2.1 time: 0.493967 Jul 25 16:47:03.101522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3057/6037] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:02 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:03.124426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2981/6038] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:02 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1328 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:47:03.733087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:03.733701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:03.748097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:03.748561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:03.750390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:03.750853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:03.834688 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cb44c59d-ab54-4b53-93e5-973d57881a6b tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/b20f9c46-63da-45d6-bac5-39ef4153fa38" status: 200 len: 194 microversion: 2.1 time: 0.107815 Jul 25 16:47:03.835644 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3058/6039] 10.222.0.105 () {58 vars in 1418 bytes} [Mon Jul 25 16:47:03 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/b20f9c46-63da-45d6-bac5-39ef4153fa38 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:47:03.855571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:03.856409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:03.888363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:03.889061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:03.890227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:03.890808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:04.006458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lazy-loading 'services' on Instance uuid d8405cf4-ea08-4fde-9763-ca09eefa3679 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:47:04.113726 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-85dad9f2-69a5-48b5-a1fd-5eb104a6b3d8 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/b20f9c46-63da-45d6-bac5-39ef4153fa38" status: 202 len: 0 microversion: 2.1 time: 0.264463 Jul 25 16:47:04.114892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:04.115795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:04.135700 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2982/6040] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:47:03 2022] DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments/b20f9c46-63da-45d6-bac5-39ef4153fa38 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:47:04.136220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:04.136756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:04.139897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:04.140767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:04.156748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:04.157935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:04.174944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:04.180184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:04.181264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:04.181789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:04.343081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:04.354203 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-72341a1d-9170-431d-b1c4-2443126cb2a0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.244053 Jul 25 16:47:04.356090 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3059/6041] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:04 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:04.454079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-77a80e6e-ef90-4f2c-b662-d88fbd1bb285 req-1e5d19e0-b21a-486d-a5a6-72b1eb1e47ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:04.477567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-77a80e6e-ef90-4f2c-b662-d88fbd1bb285 req-1e5d19e0-b21a-486d-a5a6-72b1eb1e47ae service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:04.478025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-77a80e6e-ef90-4f2c-b662-d88fbd1bb285 req-1e5d19e0-b21a-486d-a5a6-72b1eb1e47ae service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:04.511557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-77a80e6e-ef90-4f2c-b662-d88fbd1bb285 req-1e5d19e0-b21a-486d-a5a6-72b1eb1e47ae service nova] Creating event network-changed:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:47:04.532343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-77a80e6e-ef90-4f2c-b662-d88fbd1bb285 req-1e5d19e0-b21a-486d-a5a6-72b1eb1e47ae service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081911 Jul 25 16:47:04.537489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3060/6042] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:47:04.636132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:04.645583 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-31c5bfdf-61a9-4355-b314-0e7e89138799 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.504458 Jul 25 16:47:04.653354 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2983/6043] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:04 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:05.378320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:05.379453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:05.387663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:05.388120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:05.389856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:05.390501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:05.512474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:05.525144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb748128-8c94-4680-9221-17701265c1d0 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.152379 Jul 25 16:47:05.526045 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3061/6044] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:05 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:47:05.682208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:05.683814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:05.694112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:05.695156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:05.698565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:05.699381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:05.896694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:05.908130 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99b2a80c-ea51-487c-80aa-4ee92d80152d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.237675 Jul 25 16:47:05.909215 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2984/6045] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:05 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:06.550805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:06.551697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:06.559810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:06.560598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:06.561974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:06.562612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:06.637552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:06.646272 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-533e50a6-4536-4a0d-acfb-93657189c7e2 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.099183 Jul 25 16:47:06.659754 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3062/6046] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:06 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:06.935009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:06.936358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:06.943469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:06.944138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:06.945089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:06.945540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:07.259240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:07.268298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1d4f20f-7576-403f-89e2-445bbea6305c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.337193 Jul 25 16:47:07.269083 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2985/6047] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:06 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:47:07.668235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:07.670842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:07.680060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:07.680877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:07.681846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:07.682336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:07.787230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:07.800063 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b3ddec84-20e6-44dd-84a3-b3c0904a7ebc tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1227 microversion: 2.1 time: 0.135759 Jul 25 16:47:07.820693 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3063/6048] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:07 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1227 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:08.294215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:08.296517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:08.301116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:08.305920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:08.306660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:08.307614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:08.308403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:08.761902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:08.783651 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56557533-fd12-4671-96e3-6eab81140cdc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.496105 Jul 25 16:47:08.785911 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2986/6049] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:08 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:08.826786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:08.827403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:08.842854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:08.843330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:08.844479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:08.845046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:08.889885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:08.890372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:08.890857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lazy-loading 'fault' on Instance uuid ca6fef0c-bee3-47c6-b352-590acd7cc13d {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:47:08.965298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:08.975243 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ae6094f8-d44d-41e4-88c7-0c73826da88f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 200 len: 1186 microversion: 2.1 time: 0.155068 Jul 25 16:47:08.975846 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3064/6050] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:08 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 1186 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:09.806284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:09.806958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:09.814819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:09.815292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:09.816192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:09.816811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:09.986064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:09.997671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:09.998856 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e051eeab-eb86-4ded-9c6e-1a1d8d9d66a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.196905 Jul 25 16:47:09.999383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: ca6fef0c-bee3-47c6-b352-590acd7cc13d] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:10.010682 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2987/6051] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:09 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:10.015072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:10.016448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:10.023848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:10.024320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:10.025475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:10.026123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:10.052482 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance ca6fef0c-bee3-47c6-b352-590acd7cc13d could not be found. Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d HTTP/1.1 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance ca6fef0c-bee3-47c6-b352-590acd7cc13d could not be found. Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'ca6fef0c-bee3-47c6-b352-590acd7cc13d'} Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6fef0c-bee3-47c6-b352-590acd7cc13d could not be found. Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6fef0c-bee3-47c6-b352-590acd7cc13d could not be found. Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:10.054215 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6fef0c-bee3-47c6-b352-590acd7cc13d could not be found. Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance ca6fef0c-bee3-47c6-b352-590acd7cc13d could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-58bd8e65-3705-4261-98ef-077cb40d7749 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d" status: 404 len: 111 microversion: 2.1 time: 0.063512 Jul 25 16:47:10.059348 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3065/6052] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:09 2022] GET /compute/v2.1/servers/ca6fef0c-bee3-47c6-b352-590acd7cc13d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:10.693727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ee75228e-5498-4631-ba65-9026e64ab2c6 req-7db9a42f-f0bb-4258-a1c8-2428e237853c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "name": "network-vif-plugged", "status": "completed", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:10.709129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:10.711461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ee75228e-5498-4631-ba65-9026e64ab2c6 req-7db9a42f-f0bb-4258-a1c8-2428e237853c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:10.712077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ee75228e-5498-4631-ba65-9026e64ab2c6 req-7db9a42f-f0bb-4258-a1c8-2428e237853c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:10.717919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:10.726899 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ee75228e-5498-4631-ba65-9026e64ab2c6 req-7db9a42f-f0bb-4258-a1c8-2428e237853c service nova] Creating event network-vif-plugged:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:47:10.733073 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ee75228e-5498-4631-ba65-9026e64ab2c6 req-7db9a42f-f0bb-4258-a1c8-2428e237853c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043657 Jul 25 16:47:10.734282 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2988/6053] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:47:11.022126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:11.023396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:11.030343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:11.031161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:11.032170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:11.032835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:11.318437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:11.328309 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df20e427-eea0-462a-9c62-40aa4ec15d78 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.311539 Jul 25 16:47:11.329203 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3066/6054] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:11 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:12.352061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:12.356188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:12.388673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:12.389477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:12.390779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:12.392275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:13.241661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:13.252362 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c172cfe5-96d7-4473-873b-3ac6f103aa7c tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1395 microversion: 2.1 time: 0.905750 Jul 25 16:47:13.255274 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2989/6055] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:12 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1395 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:14.280339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:14.281823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:14.290108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:14.294174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:14.294660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:14.295498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:14.296326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:14.552231 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:14.575608 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-54860f32-5b2c-452f-8850-79a998a7a661 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1568 microversion: 2.1 time: 0.297731 Jul 25 16:47:14.580537 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3067/6056] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:14 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:14.602572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:14.603290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:14.613531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:14.617690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:14.618805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:14.621208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:14.971489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:14.983979 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-963684a1-74a6-4d6d-ad1e-c4576acee51f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1568 microversion: 2.1 time: 0.385649 Jul 25 16:47:14.997478 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2990/6057] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:14 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:18.332471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:18.333855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:18.340052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2e0855de-8f63-4c40-91f7-8416a13cf2fb req-9715bf65-ee8f-4891-8782-6443fc765d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:18.358146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:18.370692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2e0855de-8f63-4c40-91f7-8416a13cf2fb req-9715bf65-ee8f-4891-8782-6443fc765d0a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:18.371135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2e0855de-8f63-4c40-91f7-8416a13cf2fb req-9715bf65-ee8f-4891-8782-6443fc765d0a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:18.373940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:18.376117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:18.376775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:18.413756 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2e0855de-8f63-4c40-91f7-8416a13cf2fb req-9715bf65-ee8f-4891-8782-6443fc765d0a service nova] Creating event network-changed:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:47:18.430135 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2e0855de-8f63-4c40-91f7-8416a13cf2fb req-9715bf65-ee8f-4891-8782-6443fc765d0a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093650 Jul 25 16:47:18.431137 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2991/6058] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:47:18.725601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:18.738860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:18.761498 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aac87213-22b2-4c1e-8b16-124f0434a96a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1568 microversion: 2.1 time: 0.433347 Jul 25 16:47:18.762444 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3068/6059] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:18 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1568 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:19.608923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:19.612011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:19.622227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:19.622850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:19.623870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:19.624404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:19.665782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d8c0091b-3d7c-41d7-97a3-bda94fea9a72 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064600 Jul 25 16:47:19.666530 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2992/6060] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:47:19 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:47:19.862386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:19.864747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:19.873149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:19.873901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:19.875225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:19.876361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:19.957303 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9bf26ad7-dc2f-4d1c-8597-d7fc339e9760 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099795 Jul 25 16:47:19.957911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3069/6061] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 16:47:19 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:47:20.144705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:20.145714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:20.155505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:20.156273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:20.157508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:20.158248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:20.212937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:47:20.366005 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-712a991a-aa70-417c-acfe-f0eb828665ab tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 204 len: 0 microversion: 2.1 time: 0.224768 Jul 25 16:47:20.367426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2993/6062] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:47:20 2022] DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:47:20.376852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:20.379629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:20.404936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:20.405457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:20.406357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:20.407234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:20.652399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:20.679719 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c63c98d2-e25f-447f-a351-ad4e40eddc84 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1679 microversion: 2.1 time: 0.307852 Jul 25 16:47:20.703288 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3070/6063] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:20 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1679 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:21.715387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:21.716910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:21.744284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:21.746989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:21.748694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:21.751740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:22.578603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:22.600742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d60b6a1-5050-443e-80b9-fa2bc4215648 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1679 microversion: 2.1 time: 0.900278 Jul 25 16:47:22.610328 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2994/6064] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:21 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1679 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:23.640617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:23.641303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:23.649167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:23.649637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:23.650428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:23.650894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:24.025576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:24.057109 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-959840cc-10e4-4815-baa0-2fd9018b29c9 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1679 microversion: 2.1 time: 0.420357 Jul 25 16:47:24.068038 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3071/6065] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:23 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1679 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:25.100976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:25.101635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:25.115126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:25.115794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:25.116727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:25.117337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:25.261677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3dedce3a-077c-4fba-bbb5-343fa1e59791 req-a58befed-ebfc-464a-a8a0-f8eb68efb0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8405cf4-ea08-4fde-9763-ca09eefa3679", "name": "network-vif-deleted", "tag": "088a867a-5ee1-45be-86d4-213456e59b7a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:25.277826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ece84b0a554ada93232d551fa5f50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbe4bbf91949c8b9e7b6eea1acbf0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:25.299850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3dedce3a-077c-4fba-bbb5-343fa1e59791 req-a58befed-ebfc-464a-a8a0-f8eb68efb0f6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:25.301177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3dedce3a-077c-4fba-bbb5-343fa1e59791 req-a58befed-ebfc-464a-a8a0-f8eb68efb0f6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:25.303445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba47cc56-3f0a-47da-8c72-150ac5813ccf tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 200 len: 1611 microversion: 2.1 time: 0.205967 Jul 25 16:47:25.306200 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2995/6066] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:25 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 1611 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:25.331960 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3dedce3a-077c-4fba-bbb5-343fa1e59791 req-a58befed-ebfc-464a-a8a0-f8eb68efb0f6 service nova] Creating event network-vif-deleted:088a867a-5ee1-45be-86d4-213456e59b7a for instance d8405cf4-ea08-4fde-9763-ca09eefa3679 on n-h2-846219-13 Jul 25 16:47:25.338280 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3dedce3a-077c-4fba-bbb5-343fa1e59791 req-a58befed-ebfc-464a-a8a0-f8eb68efb0f6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080201 Jul 25 16:47:25.340328 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3072/6067] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:47:26.329611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:26.331049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:26.346705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:26.348139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:26.349326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:26.350469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:26.377273 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] HTTP exception thrown: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Request method failure captured: Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 HTTP/1.1 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sfUCGl-QCi64JZPCv6omj2uF4l_Td5LaOjibIrA7yaNiJK9Egn9DckkTc8ZbrfM3_ApOV9Ofc7jnxke9ZUVdU3EOcMU4Kk1ieMfE0iI_6HjuMJzf_b4BdJsO3xTKKBcy_R9ah0EC_AxkMw7BBc_tS7CT54jFgf7fMzi3qXGXK9WSoQ Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}] Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c2ece84b0a554ada93232d551fa5f50c Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd8405cf4-ea08-4fde-9763-ca09eefa3679'} Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:26.378984 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:26.383045 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:26.384364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Returning 404 to user: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:26.385829 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ec37426-08c4-4228-8bda-843fb0aed116 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 404 len: 111 microversion: 2.1 time: 0.062347 Jul 25 16:47:26.386910 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2996/6068] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:26 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:26.401600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3dcbdcbf-4cec-46aa-bc2e-8fd2e007e6e0 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '.version_select at 0x7f9da494c0d0>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:26.434197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3dcbdcbf-4cec-46aa-bc2e-8fd2e007e6e0 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013463532" status: 202 len: 0 microversion: 2.1 time: 0.041749 Jul 25 16:47:26.434804 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3073/6069] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 16:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013463532 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:47:29.093155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:29.093904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:29.094650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ea3d2efb-53c9-4498-96a4-f75edaba457e req-282819dc-5d64-4fc2-9f85-e9ee494f3769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5de2559-3b78-4425-aab9-0eb446ef4a53", "tag": "649e540e-b2f4-452a-b859-ffb89a3d6b80"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:29.108804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:29.109275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:29.110206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:29.110776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:29.111158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ea3d2efb-53c9-4498-96a4-f75edaba457e req-282819dc-5d64-4fc2-9f85-e9ee494f3769 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:29.112714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ea3d2efb-53c9-4498-96a4-f75edaba457e req-282819dc-5d64-4fc2-9f85-e9ee494f3769 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:29.128922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ea3d2efb-53c9-4498-96a4-f75edaba457e req-282819dc-5d64-4fc2-9f85-e9ee494f3769 service nova] Creating event network-changed:649e540e-b2f4-452a-b859-ffb89a3d6b80 for instance f5de2559-3b78-4425-aab9-0eb446ef4a53 on n-h1-846219-13 Jul 25 16:47:29.135322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ea3d2efb-53c9-4498-96a4-f75edaba457e req-282819dc-5d64-4fc2-9f85-e9ee494f3769 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047504 Jul 25 16:47:29.136547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3074/6070] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:47:29.184689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:47:29.336736 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4bc38b4-bdfc-40b9-a558-10fb37069fe3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 204 len: 0 microversion: 2.1 time: 0.260571 Jul 25 16:47:29.339484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2997/6071] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:47:29 2022] DELETE /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:47:29.350205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:29.351175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:29.359086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:29.360137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:29.361132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:29.361740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:29.588682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:29.621677 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a0938db2-0a0d-4ce9-ad55-830789cb3abb tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1579 microversion: 2.1 time: 0.276769 Jul 25 16:47:29.622792 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3075/6072] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:29 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1579 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:30.643530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:30.644504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:30.654338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:30.654799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:30.655713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:30.656021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:31.056157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:31.078300 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b7e01dee-58d1-498c-83d9-5d7390f27c69 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1579 microversion: 2.1 time: 0.438904 Jul 25 16:47:31.078936 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2998/6073] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:30 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1579 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:32.063196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9364893a-958f-4571-a4b2-b8b2dff9e4b5 req-1d2fb68f-f344-4000-b6a9-727a2289890a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5de2559-3b78-4425-aab9-0eb446ef4a53", "name": "network-vif-deleted", "tag": "649e540e-b2f4-452a-b859-ffb89a3d6b80"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:32.085081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9364893a-958f-4571-a4b2-b8b2dff9e4b5 req-1d2fb68f-f344-4000-b6a9-727a2289890a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:32.085611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9364893a-958f-4571-a4b2-b8b2dff9e4b5 req-1d2fb68f-f344-4000-b6a9-727a2289890a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:32.108493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:32.109285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:32.133705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:32.133892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:32.136138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:32.136138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:32.155963 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9364893a-958f-4571-a4b2-b8b2dff9e4b5 req-1d2fb68f-f344-4000-b6a9-727a2289890a service nova] Creating event network-vif-deleted:649e540e-b2f4-452a-b859-ffb89a3d6b80 for instance f5de2559-3b78-4425-aab9-0eb446ef4a53 on n-h1-846219-13 Jul 25 16:47:32.177147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9364893a-958f-4571-a4b2-b8b2dff9e4b5 req-1d2fb68f-f344-4000-b6a9-727a2289890a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118547 Jul 25 16:47:32.177838 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3076/6074] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:47:32.515199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:32.539192 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0770df6c-5e81-46b1-8cbe-f6d94399c8fe tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1227 microversion: 2.1 time: 0.436295 Jul 25 16:47:32.547500 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 2999/6075] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:32 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1227 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:33.578322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:33.582947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:33.597917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:33.598798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:33.599795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:33.600434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:33.702648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:33.718529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b71c988a-4679-4405-8009-fbc122afdb40 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1227 microversion: 2.1 time: 0.147801 Jul 25 16:47:33.720873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3077/6076] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:33 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1227 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:34.743438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:34.745945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:34.762744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:34.765361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:34.768828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:34.771630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:34.916960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:34.933537 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6253a04-f9da-4ab6-a736-48d75c2cf445 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1227 microversion: 2.1 time: 0.194055 Jul 25 16:47:34.949301 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3000/6077] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:34 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1227 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:35.211001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:35.211588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:35.229077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:35.233803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:35.233803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:35.233803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:35.263877 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] HTTP exception thrown: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Request method failure captured: Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 HTTP/1.1 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sfUCGl-QCi64JZPCv6omj2uF4l_Td5LaOjibIrA7yaNiJK9Egn9DckkTc8ZbrfM3_ApOV9Ofc7jnxke9ZUVdU3EOcMU4Kk1ieMfE0iI_6HjuMJzf_b4BdJsO3xTKKBcy_R9ah0EC_AxkMw7BBc_tS7CT54jFgf7fMzi3qXGXK9WSoQ Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}] Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c2ece84b0a554ada93232d551fa5f50c Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd8405cf4-ea08-4fde-9763-ca09eefa3679'} Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:35.273874 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Returning 404 to user: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:35.277868 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dec292e0-7e8f-423a-806f-6e426f273cfd tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 404 len: 111 microversion: 2.1 time: 0.069411 Jul 25 16:47:35.282762 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3078/6078] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:47:35 2022] DELETE /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:35.289934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:35.290566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: d8405cf4-ea08-4fde-9763-ca09eefa3679] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:35.299041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:35.299481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:35.300271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:35.300712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:35.335234 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] HTTP exception thrown: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Request method failure captured: Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 HTTP/1.1 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sfUCGl-QCi64JZPCv6omj2uF4l_Td5LaOjibIrA7yaNiJK9Egn9DckkTc8ZbrfM3_ApOV9Ofc7jnxke9ZUVdU3EOcMU4Kk1ieMfE0iI_6HjuMJzf_b4BdJsO3xTKKBcy_R9ah0EC_AxkMw7BBc_tS7CT54jFgf7fMzi3qXGXK9WSoQ Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}] Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c2ece84b0a554ada93232d551fa5f50c Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd8405cf4-ea08-4fde-9763-ca09eefa3679'} Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:35.337221 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. Jul 25 16:47:35.341278 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:35.345500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Returning 404 to user: Instance d8405cf4-ea08-4fde-9763-ca09eefa3679 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:35.346519 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-78e39bba-9878-4e85-ad41-1a922f519d0f tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679" status: 404 len: 111 microversion: 2.1 time: 0.062398 Jul 25 16:47:35.350243 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3001/6079] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:35 2022] GET /compute/v2.1/servers/d8405cf4-ea08-4fde-9763-ca09eefa3679 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:35.957939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:35.958832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:35.969167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:35.970002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:35.971316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:35.971916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:36.096511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:36.108241 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-12d7eaa7-65fe-4072-b1d3-2b9453f69e60 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1227 microversion: 2.1 time: 0.154193 Jul 25 16:47:36.113692 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3079/6080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:35 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1227 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:37.136137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:37.137479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:37.147918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:37.148588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:37.149559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:37.150375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:37.235155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c1c3b273ae4900a79380c83cbd79b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f5c9cfc65b4073a33618fffad118df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:47:37.249659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81c98eec-08f0-4b4a-a092-82716bd8a85f tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 200 len: 1227 microversion: 2.1 time: 0.116460 Jul 25 16:47:37.249659 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3002/6081] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:37 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 1227 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:47:38.268451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:38.269004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: f5de2559-3b78-4425-aab9-0eb446ef4a53] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:38.281204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:38.282057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:38.296734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:38.299255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:38.320447 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance f5de2559-3b78-4425-aab9-0eb446ef4a53 could not be found. Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 HTTP/1.1 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance f5de2559-3b78-4425-aab9-0eb446ef4a53 could not be found. Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'f5de2559-3b78-4425-aab9-0eb446ef4a53'} Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5de2559-3b78-4425-aab9-0eb446ef4a53 could not be found. Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5de2559-3b78-4425-aab9-0eb446ef4a53 could not be found. Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:38.322303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5de2559-3b78-4425-aab9-0eb446ef4a53 could not be found. Jul 25 16:47:38.326339 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:38.327490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance f5de2559-3b78-4425-aab9-0eb446ef4a53 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:38.328534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9f81727-15c5-4eb3-b768-460b95c0d103 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53" status: 404 len: 111 microversion: 2.1 time: 0.064220 Jul 25 16:47:38.329685 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3080/6082] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:38 2022] GET /compute/v2.1/servers/f5de2559-3b78-4425-aab9-0eb446ef4a53 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:39.155304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:39.157998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:39.163444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:39.180089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:39.180537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:39.181352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:39.181941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:39.211121 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b HTTP/1.1 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '833fb3c7-7565-4610-8927-bfac1c9fc60b'} Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:39.213429 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c71280e1-3835-4b7e-bd7c-d43d948f1bf8 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 404 len: 111 microversion: 2.1 time: 0.064207 Jul 25 16:47:39.217339 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3003/6083] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:47:39 2022] DELETE /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:39.224233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:39.224881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] [instance: 833fb3c7-7565-4610-8927-bfac1c9fc60b] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:39.233199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:39.233777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:39.237205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:39.237205 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:39.251312 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] HTTP exception thrown: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Request method failure captured: Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b HTTP/1.1 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sVrOjUWaLYv0eDTM9_kPFOZJbjGEMbmIuf4-OXvmi0ylGKlDnriO8G9gJk-N4OjOocl0KTUF43Hn8TcU8zA1mcEdHa8JXD0BSlCigzhv6X7o20f5DqD8NZPITpCmZXRCUw8Dp6_gJxmzld3Fw-VY9BChWt8LJYkb0tFDqDMQiAJ7W8 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/28f5c9cfc65b4073a33618fffad118df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_28f5c9cfc65b4073a33618fffad118df"}]}] Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 28f5c9cfc65b4073a33618fffad118df Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1793477668 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 15c1c3b273ae4900a79380c83cbd79b9 Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBootPattern-1793477668-project Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '833fb3c7-7565-4610-8927-bfac1c9fc60b'} Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:39.252951 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Returning 404 to user: Instance 833fb3c7-7565-4610-8927-bfac1c9fc60b could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:39.257516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d392ca27-e165-4c0c-96b3-555280f93dc3 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b" status: 404 len: 111 microversion: 2.1 time: 0.034569 Jul 25 16:47:39.264628 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3081/6084] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:39 2022] GET /compute/v2.1/servers/833fb3c7-7565-4610-8927-bfac1c9fc60b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:41.961588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:41.962692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:41.972109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:41.972747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:41.973789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:41.974379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:41.992773 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] HTTP exception thrown: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Request method failure captured: Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 HTTP/1.1 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sfUCGl-QCi64JZPCv6omj2uF4l_Td5LaOjibIrA7yaNiJK9Egn9DckkTc8ZbrfM3_ApOV9Ofc7jnxke9ZUVdU3EOcMU4Kk1ieMfE0iI_6HjuMJzf_b4BdJsO3xTKKBcy_R9ah0EC_AxkMw7BBc_tS7CT54jFgf7fMzi3qXGXK9WSoQ Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}] Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: c2ece84b0a554ada93232d551fa5f50c Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b7b10353-c91a-415a-8d62-d1bd2bf31947'} Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:41.994694 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:41.998676 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:47:42.000888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Returning 404 to user: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:42.002009 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e74b3124-981c-4431-be9f-a245e312e3e3 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 404 len: 111 microversion: 2.1 time: 0.044906 Jul 25 16:47:42.012699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:42.021542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] [instance: b7b10353-c91a-415a-8d62-d1bd2bf31947] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:42.032303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3004/6085] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:47:41 2022] DELETE /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:42.036503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:42.044646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:42.045882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:42.046551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:42.072615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] HTTP exception thrown: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Request method failure captured: Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 HTTP/1.1 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sfUCGl-QCi64JZPCv6omj2uF4l_Td5LaOjibIrA7yaNiJK9Egn9DckkTc8ZbrfM3_ApOV9Ofc7jnxke9ZUVdU3EOcMU4Kk1ieMfE0iI_6HjuMJzf_b4BdJsO3xTKKBcy_R9ah0EC_AxkMw7BBc_tS7CT54jFgf7fMzi3qXGXK9WSoQ Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_62fbe4bbf91949c8b9e7b6eea1acbf0a"}]}] Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 62fbe4bbf91949c8b9e7b6eea1acbf0a Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21855694 Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: c2ece84b0a554ada93232d551fa5f50c Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-AttachVolumeTestJSON-21855694-project Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b7b10353-c91a-415a-8d62-d1bd2bf31947'} Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:47:42.105502 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:47:42.109573 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] Returning 404 to user: Instance b7b10353-c91a-415a-8d62-d1bd2bf31947 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:47:42.114827 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1d8e286a-be22-4606-a9ad-aad87d9c3f28 tempest-AttachVolumeTestJSON-21855694 tempest-AttachVolumeTestJSON-21855694-project] 10.222.0.105 "GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947" status: 404 len: 111 microversion: 2.1 time: 0.100994 Jul 25 16:47:42.114827 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3082/6086] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:47:42 2022] GET /compute/v2.1/servers/b7b10353-c91a-415a-8d62-d1bd2bf31947 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:47:44.235641 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:47:44.236444 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 16:47:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:47:44.635939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72e79dba-4108-4b87-ba77-8e75b3c97f32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] Calling method '.version_select at 0x7f9d93d79f70>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:47:44.729454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72e79dba-4108-4b87-ba77-8e75b3c97f32 tempest-TestVolumeBootPattern-1793477668 tempest-TestVolumeBootPattern-1793477668-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-111214727" status: 202 len: 0 microversion: 2.1 time: 0.097940 Jul 25 16:47:44.730060 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3005/6087] 10.222.0.105 () {58 vars in 1265 bytes} [Mon Jul 25 16:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-111214727 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:47:57.569891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:47:57.575463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:47:57.642374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:57.643373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=50 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:47:57.645380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:57.648281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:57.654039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:47:57.654719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:47:57.760197 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-aa33f607-a365-47d9-9c0b-1736a502776d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action" status: 200 len: 24559 microversion: 2.1 time: 0.204295 Jul 25 16:47:57.762157 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3083/6088] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:47:57 2022] POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action => generated 24559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:48:14.224030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:14.226357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:14.235429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:14.236268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:14.260681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:14.262022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:14.264770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:14.266014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:14.867793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lazy-loading 'services' on Instance uuid 37807b6d-be00-474f-aba3-1afe42ed4df2 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:48:14.969282 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-871764f8-3fb4-414c-810e-5ade1c65bbac tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "DELETE /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2/os-volume_attachments/c5797acb-dd56-40ba-98ca-7e4149498abb" status: 202 len: 0 microversion: 2.1 time: 0.747516 Jul 25 16:48:14.970267 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3006/6089] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 16:48:14 2022] DELETE /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2/os-volume_attachments/c5797acb-dd56-40ba-98ca-7e4149498abb => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:48:21.667601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:21.669404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:21.673294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:21.673875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:21.680837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:21.681737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:21.682853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:21.683329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:21.713543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:48:21.827322 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b9e6f61-062b-43b8-b498-36a1f8b182c8 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "DELETE /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 204 len: 0 microversion: 2.1 time: 0.162476 Jul 25 16:48:21.828740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3084/6090] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:48:21 2022] DELETE /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:48:21.844185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:21.845537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:21.878475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:21.879459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:21.880437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:21.881036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:22.107911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:22.115872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f135cb31-84a8-4fd4-a613-a5ec6c6a8ea2 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1472 microversion: 2.1 time: 0.282279 Jul 25 16:48:22.124456 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3007/6091] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:21 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:23.139807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:23.141932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:23.153892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:23.155479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:23.156842 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:23.157551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:24.139564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:24.153738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c5be610-2f3e-4a78-a181-55f94301c579 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1472 microversion: 2.1 time: 1.019612 Jul 25 16:48:24.154787 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3085/6092] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:23 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1472 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:25.179191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:25.181773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:25.198265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:25.199203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:25.200018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:25.200647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:25.234355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-98d1b465-cf5a-4a9e-b8a7-dd70600a2c12 req-215cf957-2ff7-422b-964e-c687a715ee2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37807b6d-be00-474f-aba3-1afe42ed4df2", "name": "network-vif-deleted", "tag": "1bd51b82-d284-47b6-8463-05682330ecf6"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:48:25.254580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-98d1b465-cf5a-4a9e-b8a7-dd70600a2c12 req-215cf957-2ff7-422b-964e-c687a715ee2c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:25.255078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-98d1b465-cf5a-4a9e-b8a7-dd70600a2c12 req-215cf957-2ff7-422b-964e-c687a715ee2c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:25.268167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-98d1b465-cf5a-4a9e-b8a7-dd70600a2c12 req-215cf957-2ff7-422b-964e-c687a715ee2c service nova] Creating event network-vif-deleted:1bd51b82-d284-47b6-8463-05682330ecf6 for instance 37807b6d-be00-474f-aba3-1afe42ed4df2 on n-h1-846219-13 Jul 25 16:48:25.274290 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-98d1b465-cf5a-4a9e-b8a7-dd70600a2c12 req-215cf957-2ff7-422b-964e-c687a715ee2c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050313 Jul 25 16:48:25.275688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3086/6093] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:48:25.331929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f046647e4264121a3c9ecbb9e3c4518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d586a9537d41118bed26fb7083ccbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:25.347794 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef3e5932-d95b-488d-859b-1c797c440113 tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 200 len: 1430 microversion: 2.1 time: 0.172715 Jul 25 16:48:25.370883 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3008/6094] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:25 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 1430 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:26.379286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:26.379908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] [instance: 37807b6d-be00-474f-aba3-1afe42ed4df2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:26.389398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:26.389931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:26.391204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:26.391700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:26.410489 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] HTTP exception thrown: Instance 37807b6d-be00-474f-aba3-1afe42ed4df2 could not be found. Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Request method failure captured: Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 HTTP/1.1 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sjSe7lC58kP0oJJq_Nr8Vr2j66ZgAaglpXHIOcoiCIvsCzBY_UjmY8TsupjS9p4mHAcWu0IiEbMMXf8xYaN78arFAkAyMAYyHcwjWoxreXb_jGVwqsW_nmWKhukg2VguXNDPB1niBb6jyCH8lSFJAxqnNFdQ1BbY5abku8Dx_GrEv8 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 43d586a9537d41118bed26fb7083ccbf Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesBackupsTest-147309107 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/43d586a9537d41118bed26fb7083ccbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/43d586a9537d41118bed26fb7083ccbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/43d586a9537d41118bed26fb7083ccbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_43d586a9537d41118bed26fb7083ccbf"}]}] Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesBackupsTest-147309107 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 43d586a9537d41118bed26fb7083ccbf Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesBackupsTest-147309107 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesBackupsTest-147309107-project Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 0f046647e4264121a3c9ecbb9e3c4518 Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesBackupsTest-147309107-project Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 37807b6d-be00-474f-aba3-1afe42ed4df2 could not be found. Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '37807b6d-be00-474f-aba3-1afe42ed4df2'} Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37807b6d-be00-474f-aba3-1afe42ed4df2 could not be found. Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37807b6d-be00-474f-aba3-1afe42ed4df2 could not be found. Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:48:26.412438 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37807b6d-be00-474f-aba3-1afe42ed4df2 could not be found. Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] Returning 404 to user: Instance 37807b6d-be00-474f-aba3-1afe42ed4df2 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6463ef4-c9b3-4622-aaee-b39dba18bd6e tempest-VolumesBackupsTest-147309107 tempest-VolumesBackupsTest-147309107-project] 10.222.0.105 "GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2" status: 404 len: 111 microversion: 2.1 time: 0.039425 Jul 25 16:48:26.416971 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3087/6095] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:26 2022] GET /compute/v2.1/servers/37807b6d-be00-474f-aba3-1afe42ed4df2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:48:36.644341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:36.645119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:37.028044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:37.030226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:37.043136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:37.044328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:37.046232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:37.047313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:37.279444 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e7175f32-c1ca-4a17-8dff-dfc07e32e555 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1840 microversion: 2.1 time: 0.640518 Jul 25 16:48:37.286887 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3009/6096] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:36 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1840 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:37.319340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:37.322240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:48:37.658514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:37.659210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:37.681197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:37.683495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:37.686989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:37.687470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:37.937918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:37.949484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-163db871-57bb-4710-b62a-d6c693666394 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1687 microversion: 2.1 time: 0.637533 Jul 25 16:48:37.950796 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3088/6097] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:37 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1687 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:48:38.122674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:48:38.125843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:38.142231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:38.142683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:38.143524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:38.143947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:38.228448 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-db7a68cf-67e9-4e56-b6a9-46343a7d7e0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action" status: 200 len: 32632 microversion: 2.1 time: 0.110192 Jul 25 16:48:38.229310 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3010/6098] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:48:38 2022] POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action => generated 32632 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:48:38.386488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:48:38.387131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:38.400289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:38.400764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:38.420089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:38.429469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:38.744730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0bdbdce9011d4fb1b7e01780f4cb27c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43e3b86883049fc8acabccf29d9e901', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:38.746536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] flavor_id is None. Assuming migration. {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 16:48:38.747236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 16:48:39.108686 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e05f2b04-d9a3-4cbc-9b2b-d07551f3de6b tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action" status: 202 len: 0 microversion: 2.1 time: 0.726404 Jul 25 16:48:39.110047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3089/6099] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:48:38 2022] POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:48:39.119215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:39.119910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:39.133791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:39.134489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:39.135000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:39.135432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:39.549386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:39.561740 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-84f5a7ae-4656-4941-a8c4-128107ff56c6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1696 microversion: 2.1 time: 0.446823 Jul 25 16:48:39.562588 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3011/6100] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:39 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1696 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:40.595301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:40.596963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:40.621635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:40.623789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:40.624647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:40.625121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:41.004937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:41.020315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-683e1538-f365-4c9a-b59f-4f9bf21d4019 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1696 microversion: 2.1 time: 0.436173 Jul 25 16:48:41.022229 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3090/6101] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:40 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1696 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:42.048700 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:42.049353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:42.066594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:42.073018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:42.075202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:42.077757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:42.418749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:42.427548 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a30fb108-9f60-4d7a-9b0b-c94b75ed6dfb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1696 microversion: 2.1 time: 0.385007 Jul 25 16:48:42.432030 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3012/6102] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:42 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1696 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:43.458267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:43.459533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:43.476585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:43.477057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:43.480109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:43.480905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:43.736047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:43.748104 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b09cf2a4-9ccb-4519-92a4-f9ebbedd7483 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.293791 Jul 25 16:48:43.749164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3091/6103] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:43 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:44.771250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:44.771896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:44.783967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:44.784768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:44.785877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:44.786457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:45.103383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:45.112555 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20cf4451-300f-497f-a37d-2150a5cf5b8d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.345135 Jul 25 16:48:45.127459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3013/6104] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:44 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:46.140588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:46.141820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:46.157942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:46.163936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:46.165044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:46.165911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:46.435021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:46.446381 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49dc6c4c-b1ea-4991-90dd-b9a09c09923d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.313923 Jul 25 16:48:46.464251 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3092/6105] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:46 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:47.471266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:47.471896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:47.486355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:47.487759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:47.490740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:47.491537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:48.200616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:48.208973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74fda058-6a79-49a6-8441-355e96407dc5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.741947 Jul 25 16:48:48.212481 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3014/6106] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:47 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:49.236084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:49.236904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:49.246616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:49.247182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:49.248054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:49.248731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:49.457257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:49.467295 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fc6ebf9-a756-4adc-be98-ade65da04bec tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.237191 Jul 25 16:48:49.468368 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3093/6107] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:49 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:50.495503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:50.496123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:50.514403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:50.514403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:50.514830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:50.515254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:50.801227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:50.811812 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1eb684f9-48d9-4366-a98d-3e392a2e26f0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.321949 Jul 25 16:48:50.812432 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3015/6108] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:50 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:48:51.838245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:51.840246 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:51.849667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:51.850398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:51.851408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:51.852076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:52.260883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:52.275593 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e770fb46-1ce2-48f8-95d8-06251246f4d8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.444108 Jul 25 16:48:52.278312 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3094/6109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:51 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:53.301055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:53.301826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:53.310186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:53.311034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:53.312818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:53.313343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:53.570626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:53.583124 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c260c0ad-8433-4af3-b8eb-726d3013ad63 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1701 microversion: 2.1 time: 0.286653 Jul 25 16:48:53.593868 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3016/6110] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:53 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1701 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:48:54.606716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:54.607328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:54.614727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:54.615325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:54.616219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:54.616881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:55.014918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:55.028257 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0306b3db-f3dd-4c61-9e2e-1650e747f720 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1700 microversion: 2.1 time: 0.425760 Jul 25 16:48:55.030456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3095/6111] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:54 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1700 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:56.052272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:56.052957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:56.068979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:56.070657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:56.071683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:56.072285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:56.349227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-42ff11ad-20ca-49cf-b80f-1e82d3927bf6 req-d6617df9-3d28-46ce-a7b2-6f936f5f480e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "name": "network-vif-unplugged", "status": "completed", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:48:56.377945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-42ff11ad-20ca-49cf-b80f-1e82d3927bf6 req-d6617df9-3d28-46ce-a7b2-6f936f5f480e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:56.378407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-42ff11ad-20ca-49cf-b80f-1e82d3927bf6 req-d6617df9-3d28-46ce-a7b2-6f936f5f480e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:56.406480 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-42ff11ad-20ca-49cf-b80f-1e82d3927bf6 req-d6617df9-3d28-46ce-a7b2-6f936f5f480e service nova] Creating event network-vif-unplugged:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h2-846219-13 Jul 25 16:48:56.425790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-42ff11ad-20ca-49cf-b80f-1e82d3927bf6 req-d6617df9-3d28-46ce-a7b2-6f936f5f480e service nova] Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:48:56.445880 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-42ff11ad-20ca-49cf-b80f-1e82d3927bf6 req-d6617df9-3d28-46ce-a7b2-6f936f5f480e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100682 Jul 25 16:48:56.446916 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3096/6112] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:48:56.610117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:56.623478 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8626f0f8-0d05-467d-9b0e-8d699190ce62 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1700 microversion: 2.1 time: 0.575237 Jul 25 16:48:56.642852 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3017/6113] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:56 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1700 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:57.652904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:57.654418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:57.662002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:57.662949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:57.663955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:57.664590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:58.192686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:58.224504 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fdc2423f-578a-446e-baf4-461fb714d839 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1700 microversion: 2.1 time: 0.575470 Jul 25 16:48:58.229022 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3097/6114] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:57 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1700 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:48:58.497145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-2b4ac12c-0349-4f9a-ba0f-63ec3e5f2647 req-bc01da6f-abe1-4bfd-a7ef-4e1f9dae0c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:48:58.513007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2b4ac12c-0349-4f9a-ba0f-63ec3e5f2647 req-bc01da6f-abe1-4bfd-a7ef-4e1f9dae0c77 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:58.513517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-2b4ac12c-0349-4f9a-ba0f-63ec3e5f2647 req-bc01da6f-abe1-4bfd-a7ef-4e1f9dae0c77 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:58.529032 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-2b4ac12c-0349-4f9a-ba0f-63ec3e5f2647 req-bc01da6f-abe1-4bfd-a7ef-4e1f9dae0c77 service nova] Creating event network-changed:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h2-846219-13 Jul 25 16:48:58.547859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-2b4ac12c-0349-4f9a-ba0f-63ec3e5f2647 req-bc01da6f-abe1-4bfd-a7ef-4e1f9dae0c77 service nova] Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:48:58.564891 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-2b4ac12c-0349-4f9a-ba0f-63ec3e5f2647 req-bc01da6f-abe1-4bfd-a7ef-4e1f9dae0c77 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071857 Jul 25 16:48:58.566246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3018/6115] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:48:59.252759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:48:59.253625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:48:59.269049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:59.269487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:59.270868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:48:59.271535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:48:59.880662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:48:59.892688 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d04a3034-0c08-42ad-9da2-095bad48d9bd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1700 microversion: 2.1 time: 0.646855 Jul 25 16:48:59.893368 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3098/6116] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:48:59 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1700 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:00.916909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:00.919062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:00.927359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:00.929066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:00.937784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:00.939328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:01.304258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:01.318076 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d358b70b-a92c-49ca-83c7-112792f5596e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1698 microversion: 2.1 time: 0.406998 Jul 25 16:49:01.318680 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3019/6117] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:00 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1698 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:02.342373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:02.342960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:02.350629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:02.351126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:02.351944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:02.352395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:02.802986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:02.819360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-887006c9-b665-459e-9cce-4f6ae1333af0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1695 microversion: 2.1 time: 0.480824 Jul 25 16:49:02.838882 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3099/6118] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:02 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1695 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:02.846583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:49:02.847298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:02.855100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:02.856970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:02.857906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:02.858419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:03.028137 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dec8fa63-ec62-43e5-a9a4-2f5dc3fca76f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action" status: 202 len: 0 microversion: 2.1 time: 0.186312 Jul 25 16:49:03.029962 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3020/6119] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:49:02 2022] POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:49:03.044278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:03.046600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:03.058662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:03.061601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:03.065731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:03.067043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:03.903920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:03.913005 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4b19de50-6884-40aa-ad87-2bc333abc4c4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.877525 Jul 25 16:49:03.913896 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3100/6120] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:03 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:04.890274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-47dc6b1d-2539-4e55-983c-676383da8b0e req-0e988d40-9ef6-4777-9055-3b3274432105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "name": "network-vif-plugged", "status": "completed", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:49:04.916023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-47dc6b1d-2539-4e55-983c-676383da8b0e req-0e988d40-9ef6-4777-9055-3b3274432105 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:04.921394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-47dc6b1d-2539-4e55-983c-676383da8b0e req-0e988d40-9ef6-4777-9055-3b3274432105 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:04.936819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:04.938303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:04.970776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:04.971618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:04.975378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-47dc6b1d-2539-4e55-983c-676383da8b0e req-0e988d40-9ef6-4777-9055-3b3274432105 service nova] Creating event network-vif-plugged:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h2-846219-13 Jul 25 16:49:04.977077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:04.980761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:05.001986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-47dc6b1d-2539-4e55-983c-676383da8b0e req-0e988d40-9ef6-4777-9055-3b3274432105 service nova] Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:49:05.047697 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-47dc6b1d-2539-4e55-983c-676383da8b0e req-0e988d40-9ef6-4777-9055-3b3274432105 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165271 Jul 25 16:49:05.052380 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3021/6121] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:49:05.218837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:05.231147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af68bfbb-de4b-4bb1-ae20-358b694b2981 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.298241 Jul 25 16:49:05.246548 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3101/6122] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:04 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:06.259153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:06.260665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:06.270044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:06.271212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:06.273068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:06.273788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:06.519480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:06.529976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e660abd4-2310-42eb-862a-d1950c0d0c93 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.278554 Jul 25 16:49:06.531316 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3022/6123] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:06 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:07.552213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:07.553463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:07.557449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=31 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:49:07.564435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:07.565366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:07.566556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:07.568367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:07.574270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:49:07.974729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:07.988999 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b623834-d09a-4364-a3a6-ee923b89c351 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.438523 Jul 25 16:49:07.997342 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3102/6124] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:07 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:09.025374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:09.026180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:09.053601 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=33 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:49:09.066881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:09.067033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:09.067917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:09.068600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:09.097187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:49:09.182548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6c102395-1b18-48bb-a8e5-a73d1ca20509 req-66c2acb7-ae0e-42b6-85c5-37c697dbe690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "name": "network-vif-unplugged", "status": "completed", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:49:09.195612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6c102395-1b18-48bb-a8e5-a73d1ca20509 req-66c2acb7-ae0e-42b6-85c5-37c697dbe690 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:09.196349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6c102395-1b18-48bb-a8e5-a73d1ca20509 req-66c2acb7-ae0e-42b6-85c5-37c697dbe690 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:09.219416 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6c102395-1b18-48bb-a8e5-a73d1ca20509 req-66c2acb7-ae0e-42b6-85c5-37c697dbe690 service nova] Creating event network-vif-unplugged:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:49:09.243444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-6c102395-1b18-48bb-a8e5-a73d1ca20509 req-66c2acb7-ae0e-42b6-85c5-37c697dbe690 service nova] Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:49:09.260962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6c102395-1b18-48bb-a8e5-a73d1ca20509 req-66c2acb7-ae0e-42b6-85c5-37c697dbe690 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081793 Jul 25 16:49:09.262774 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3103/6125] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:49:09.456771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:09.465373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f983ed1-7a76-43e0-b701-90b161865d94 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.445315 Jul 25 16:49:09.475163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3023/6126] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:09 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:10.506334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:10.507683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:10.518422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:10.519128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:10.520151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:10.520774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:10.774730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:10.778390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65c2fd15-4990-40b2-9ae6-654cbdf81c7e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.276684 Jul 25 16:49:10.792489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3104/6127] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:10 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:11.292340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-08de1ca8-42e3-44d9-bcd7-58a1d6073898 req-6facd2a5-e2e8-4a57-b09c-ce189d68064e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:49:11.308331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-08de1ca8-42e3-44d9-bcd7-58a1d6073898 req-6facd2a5-e2e8-4a57-b09c-ce189d68064e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:11.308789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-08de1ca8-42e3-44d9-bcd7-58a1d6073898 req-6facd2a5-e2e8-4a57-b09c-ce189d68064e service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:11.335491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-08de1ca8-42e3-44d9-bcd7-58a1d6073898 req-6facd2a5-e2e8-4a57-b09c-ce189d68064e service nova] Creating event network-changed:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:49:11.345085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-08de1ca8-42e3-44d9-bcd7-58a1d6073898 req-6facd2a5-e2e8-4a57-b09c-ce189d68064e service nova] Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 16:49:11.358692 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-08de1ca8-42e3-44d9-bcd7-58a1d6073898 req-6facd2a5-e2e8-4a57-b09c-ce189d68064e service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071429 Jul 25 16:49:11.360211 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3024/6128] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:49:11.800378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:11.801088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:11.815143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:11.816367 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:11.817406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:11.818045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:12.147300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:12.157601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1f0af8aa-eb1e-4d7f-8e87-4d46b76f3a73 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.361085 Jul 25 16:49:12.159132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3105/6129] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:11 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:13.185633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:13.187794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:13.199636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:13.201448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:13.203096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:13.203969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:13.420499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:13.431281 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0f1c5649-5f50-4907-b5b4-f84338006d02 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.252469 Jul 25 16:49:13.432411 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3025/6130] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:13 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:14.466233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:14.472483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:14.497795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:14.507933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:14.514469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:14.515488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:14.814725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:14.824844 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b32d634-52cf-4902-9cfd-508d73c89b74 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1694 microversion: 2.1 time: 0.370240 Jul 25 16:49:14.840417 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3106/6131] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:14 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1694 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:15.848790 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:49:15.849602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:15.857903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:15.858621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:15.859417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:15.859857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:16.016217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:49:16.025358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b8b9055-9e55-46a8-8e8f-e2b26e96d3c5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1687 microversion: 2.1 time: 0.180452 Jul 25 16:49:16.026300 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3026/6132] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:49:15 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:49:17.364901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a6998ed4-eb7b-4c13-88e5-288a88ed7408 req-812493dd-b111-4487-b1e9-65dd3b752b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "name": "network-vif-plugged", "status": "completed", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:49:17.382604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a6998ed4-eb7b-4c13-88e5-288a88ed7408 req-812493dd-b111-4487-b1e9-65dd3b752b96 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:17.383056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a6998ed4-eb7b-4c13-88e5-288a88ed7408 req-812493dd-b111-4487-b1e9-65dd3b752b96 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:17.408785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a6998ed4-eb7b-4c13-88e5-288a88ed7408 req-812493dd-b111-4487-b1e9-65dd3b752b96 service nova] Creating event network-vif-plugged:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:49:17.439387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a6998ed4-eb7b-4c13-88e5-288a88ed7408 req-812493dd-b111-4487-b1e9-65dd3b752b96 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079012 Jul 25 16:49:17.440026 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3107/6133] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:49:52.334744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:49:52.353869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:49:52.366011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=7 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:49:52.367246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=21 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:49:52.369265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:52.369976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:52.371006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:49:52.371870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:49:52.472310 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d4effda-b32e-492f-9b8f-4dea0a043cac tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action" status: 200 len: 63168 microversion: 2.1 time: 0.147355 Jul 25 16:49:52.473891 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3027/6134] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:49:52 2022] POST /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9/action => generated 63168 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:50:15.561853 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:15.564570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:15.571563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=11 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:15.572560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=29 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:15.575689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:15.576605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:15.578068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:15.578999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:15.909943 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ec2e61b0-1249-405f-a75d-cf6fad42c067 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1840 microversion: 2.1 time: 0.355691 Jul 25 16:50:15.911204 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3108/6135] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:15 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1840 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:17.670623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:17.672409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:17.678977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:17.679895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:17.683482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:17.689704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-123af8be-df32-4d52-b852-b610d8dddf5e req-0b3fb452-3221-41f6-bd30-7be023ff70bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:50:17.696968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:17.698184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:17.700118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:17.710633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-123af8be-df32-4d52-b852-b610d8dddf5e req-0b3fb452-3221-41f6-bd30-7be023ff70bf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:17.721863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-123af8be-df32-4d52-b852-b610d8dddf5e req-0b3fb452-3221-41f6-bd30-7be023ff70bf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:17.743678 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-123af8be-df32-4d52-b852-b610d8dddf5e req-0b3fb452-3221-41f6-bd30-7be023ff70bf service nova] Creating event network-changed:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:50:17.753520 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-123af8be-df32-4d52-b852-b610d8dddf5e req-0b3fb452-3221-41f6-bd30-7be023ff70bf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066880 Jul 25 16:50:17.755159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:50:17.755950 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3109/6136] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:50:17.919195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc4c3c66-3cb8-47c9-aec0-4c885ca457cd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 204 len: 0 microversion: 2.1 time: 0.252530 Jul 25 16:50:17.920328 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3028/6137] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:50:17 2022] DELETE /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:50:17.931310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:17.932540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:17.948767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:17.949182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:17.949993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:17.952353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:18.698881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:18.715085 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-54eaf5c0-57f7-48b8-86da-0e9ec3967768 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1693 microversion: 2.1 time: 0.787533 Jul 25 16:50:18.731395 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3110/6138] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:17 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1693 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:19.741459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:19.742166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:19.755614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:19.756534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:19.757576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:19.758296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:20.153758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:20.167018 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9fdad64b-e0cb-405c-aae0-996bbdcbd648 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1693 microversion: 2.1 time: 0.430286 Jul 25 16:50:20.168593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3029/6139] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:19 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1693 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:21.135016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-88d056bb-21ca-47b9-b646-04a44ff3ae21 req-4852bd01-b443-4fc1-a9d3-741c2440368c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9", "name": "network-vif-deleted", "tag": "ac59a5ba-4534-4d6a-9642-821d283f6406"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:50:21.164342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-88d056bb-21ca-47b9-b646-04a44ff3ae21 req-4852bd01-b443-4fc1-a9d3-741c2440368c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:21.166247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-88d056bb-21ca-47b9-b646-04a44ff3ae21 req-4852bd01-b443-4fc1-a9d3-741c2440368c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:21.188333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:21.190778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:21.211656 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-88d056bb-21ca-47b9-b646-04a44ff3ae21 req-4852bd01-b443-4fc1-a9d3-741c2440368c service nova] Creating event network-vif-deleted:ac59a5ba-4534-4d6a-9642-821d283f6406 for instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 on n-h1-846219-13 Jul 25 16:50:21.214801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:21.215472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:21.216326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:21.216765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:21.225423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-88d056bb-21ca-47b9-b646-04a44ff3ae21 req-4852bd01-b443-4fc1-a9d3-741c2440368c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095111 Jul 25 16:50:21.226857 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3111/6140] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:50:21.319362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:21.329200 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3be1626c-2743-4d34-b9a5-7edf7e8b7412 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 200 len: 1355 microversion: 2.1 time: 0.145220 Jul 25 16:50:21.330322 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3030/6141] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:21 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 1355 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:22.353818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:22.355817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:22.388728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:22.394006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:22.394955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:22.395426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:22.453588 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] HTTP exception thrown: Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 could not be found. Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Request method failure captured: Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 HTTP/1.1 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sgn4YkBMyCEyyAORyVf9SZjBBvuh81o-VzVNz2F1wNAr5HF5-hD4odv0heMCsEXrqL-2lCux1tP7m0PYr-vigSzzpDCzlqczfxYfRCOzVsm3BERebJbVFwnSoZ5CkBkCCaojMxgj5pmTX5yzsQVNJ7JSEUQ6hfrXXue07rD9iWFdyo Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cd51658ef95d4f69b50b94f0ebfc4205"}]}] Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: edc280fc36f7440a957c6856dd0877a3 Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 could not be found. Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9'} Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 could not be found. Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 could not be found. Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:50:22.464884 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 could not be found. Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Returning 404 to user: Instance e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:50:22.469580 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-140ef25a-fb0a-401e-9e9a-da2f1ff2ae44 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9" status: 404 len: 111 microversion: 2.1 time: 0.119783 Jul 25 16:50:22.474713 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3112/6142] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:22 2022] GET /compute/v2.1/servers/e49cdf1e-b3db-42fa-83d7-f80ce1ceb5c9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:50:27.899279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6078ba91-486f-4077-98f7-a11fc47d134e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '.version_select at 0x7f9d92942940>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:27.905626 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6078ba91-486f-4077-98f7-a11fc47d134e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [eedb447a-e383-4eb0-aa6d-41c096dddc49] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:50:28.924247 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [None req-6078ba91-486f-4077-98f7-a11fc47d134e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [eedb447a-e383-4eb0-aa6d-41c096dddc49] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 39202. Jul 25 16:50:28.948701 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6078ba91-486f-4077-98f7-a11fc47d134e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1437113524" status: 202 len: 0 microversion: 2.1 time: 1.053849 Jul 25 16:50:28.950477 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3031/6143] 10.222.0.105 () {58 vars in 1289 bytes} [Mon Jul 25 16:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1437113524 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:50:28.990013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1845cb12-7fc0-4c86-85c7-20f4c16c94ba tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: .version_select at 0x7f9d939435e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-527796315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW2RB6uvEoUmb7Vi09AokJFlFDn0xMMzW1pTr1QOPTUim6Sr7ntxCX/LJQBMsCuuvxUmeYZR4/AIgOhM8uT6Q93W0aGYVQeYABRb4idoGhgQeq1T/XsjxIkBhVuJ2b2sA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:50:29.010247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1845cb12-7fc0-4c86-85c7-20f4c16c94ba tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:50:29.018183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1845cb12-7fc0-4c86-85c7-20f4c16c94ba tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:50:29.054218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1845cb12-7fc0-4c86-85c7-20f4c16c94ba tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.068587 Jul 25 16:50:29.057660 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3113/6144] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:50:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:50:40.095313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1721916014", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "19938e78-3ceb-4ef3-8a71-0217cf8849cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-527796315", "security_groups": [{"name": "tempest-secgroup-smoke-312570672"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:50:40.120877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:40.124477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:40.359331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] validate_networks() for [('19938e78-3ceb-4ef3-8a71-0217cf8849cc', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:50:41.637005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:50:41.637657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:50:41.638307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:50:41.638774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:50:41.639150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:50:41.660707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:41.660707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:41.660707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:41.660707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:41.682613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:50:41.696236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:50:41.712740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:50:41.716208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:50:41.773004 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d32e97a-9633-42c2-8ce1-f7e9dacf6343 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.681949 Jul 25 16:50:41.774285 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3032/6145] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:50:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:50:41.786681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b84a3670-87bc-4c0e-8031-ca9fa06c2c5d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:41.787395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b84a3670-87bc-4c0e-8031-ca9fa06c2c5d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:41.794711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:41.795583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:41.796718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:41.893044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b84a3670-87bc-4c0e-8031-ca9fa06c2c5d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:41.904985 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b84a3670-87bc-4c0e-8031-ca9fa06c2c5d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1270 microversion: 2.1 time: 0.123525 Jul 25 16:50:41.907044 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3114/6146] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:41 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:42.928165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:42.928934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:42.947390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:42.948142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:42.949142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:42.949693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:43.231783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:43.243136 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-af7a037d-53d6-4806-b9f8-5428e135ec19 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1266 microversion: 2.1 time: 0.319685 Jul 25 16:50:43.256479 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3033/6147] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:42 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:44.268513 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:44.270370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:44.292762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:44.296356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:44.300128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:44.301179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:44.622236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:44.646539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff7488da-c4a5-40d9-9140-4a7ec7e12024 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1328 microversion: 2.1 time: 0.382128 Jul 25 16:50:44.661003 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3115/6148] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:44 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:45.672611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:45.684202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:45.697153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:45.697743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:45.698757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:45.706033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:46.170142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:46.182965 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1383cd01-1a53-4329-904d-b6f913c5f378 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.513534 Jul 25 16:50:46.186371 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3034/6149] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:45 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:46.825927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-48ec4810-0eb1-47e3-98ca-f24ef80dcff8 req-e52f9cea-0dd7-4ec6-9d5c-f9709ea0db9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:50:46.863746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-48ec4810-0eb1-47e3-98ca-f24ef80dcff8 req-e52f9cea-0dd7-4ec6-9d5c-f9709ea0db9d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:46.865489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-48ec4810-0eb1-47e3-98ca-f24ef80dcff8 req-e52f9cea-0dd7-4ec6-9d5c-f9709ea0db9d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:46.895506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-48ec4810-0eb1-47e3-98ca-f24ef80dcff8 req-e52f9cea-0dd7-4ec6-9d5c-f9709ea0db9d service nova] Creating event network-changed:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h1-846219-13 Jul 25 16:50:46.913971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-48ec4810-0eb1-47e3-98ca-f24ef80dcff8 req-e52f9cea-0dd7-4ec6-9d5c-f9709ea0db9d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091566 Jul 25 16:50:46.915418 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3116/6150] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:50:47.208146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:47.208771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:47.223829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:47.224298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:47.225125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:47.231327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:47.463800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:47.473156 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2c72aca-bc27-4857-8157-8e82d60982d0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.269703 Jul 25 16:50:47.486369 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3035/6151] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:47 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:48.501193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:48.503259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:48.514463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:48.514986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:48.515798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:48.516250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:48.731553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:48.746696 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-40ad654c-4e55-4470-a6e8-81c81f9a4ccd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.253556 Jul 25 16:50:48.748247 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3117/6152] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:48 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:49.787265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:49.787867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:49.806489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:49.806941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:49.816133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:49.820073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:50.066571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:50.074643 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0262841c-a7a4-4359-9d56-40f7dab0d509 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.306312 Jul 25 16:50:50.092592 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3036/6153] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:49 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:51.097412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:51.098053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:51.125637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:51.128787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:51.130481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:51.130481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:51.562012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:51.572015 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75910374-a845-492b-a139-3074b9479463 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.479426 Jul 25 16:50:51.574876 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3118/6154] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:51 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:52.602948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:52.605070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:52.621690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:52.623875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:52.629433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:52.634941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:52.636107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:52.636708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:53.380579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:53.393342 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0fb6ac41-e6c2-4414-9bab-2c1bcbb9ba0f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.798436 Jul 25 16:50:53.409865 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3037/6155] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:52 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:54.417566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:54.418285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:54.430142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:50:54.437515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:54.438163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:54.439033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:54.439487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:54.825190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:54.840493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-191a0f76-3c29-4c90-a8b3-27a67b083a32 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.422801 Jul 25 16:50:54.845364 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3119/6156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:54 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:55.866285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:55.867586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:55.886934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:55.892642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:55.894800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:55.895666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:56.424058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:56.435758 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c0059d9-613d-41a0-a21e-69a601fdefeb tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.573130 Jul 25 16:50:56.436680 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3038/6157] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:55 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:56.470961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1e263c95-d962-49a6-998e-4f8d5bc4048f req-36180c64-103c-4be6-964b-b46448e3111d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "name": "network-vif-plugged", "status": "completed", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:50:56.496170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1e263c95-d962-49a6-998e-4f8d5bc4048f req-36180c64-103c-4be6-964b-b46448e3111d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:56.496652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1e263c95-d962-49a6-998e-4f8d5bc4048f req-36180c64-103c-4be6-964b-b46448e3111d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:56.526248 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1e263c95-d962-49a6-998e-4f8d5bc4048f req-36180c64-103c-4be6-964b-b46448e3111d service nova] Creating event network-vif-plugged:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h1-846219-13 Jul 25 16:50:56.547104 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1e263c95-d962-49a6-998e-4f8d5bc4048f req-36180c64-103c-4be6-964b-b46448e3111d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469927 Jul 25 16:50:56.548121 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3120/6158] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:50:57.461990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:57.463356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:57.500749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:57.501761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:57.504735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:57.505334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:57.869403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:57.882811 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a309deed-5b80-48fd-868e-72b689fbaa2b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1395 microversion: 2.1 time: 0.425313 Jul 25 16:50:57.889324 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3039/6159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:57 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1395 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:58.911584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:58.912332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:58.927965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:58.930692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:58.931751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:58.937175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:59.316309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:59.330819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9832c19b-044e-4d4f-aac2-64040255e9a9 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1567 microversion: 2.1 time: 0.423700 Jul 25 16:50:59.333411 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3121/6160] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:58 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:50:59.366681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:50:59.369882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:50:59.402557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:59.408376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:59.409281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:50:59.409723 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:50:59.918476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:50:59.931313 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ced869c1-5b55-4193-b7d3-8506a0745982 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1567 microversion: 2.1 time: 0.575587 Jul 25 16:50:59.931949 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3040/6161] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:50:59 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1567 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:03.786490 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:51:03.787418 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:51:05.066720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:05.067371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:05.081763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:05.110590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:05.112255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:05.113230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:05.295809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3bb8b5fe-3792-47a6-b89d-1bd51efe0f0b req-78c8addf-34a1-4440-80f0-a8f5b34523eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:05.315546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3bb8b5fe-3792-47a6-b89d-1bd51efe0f0b req-78c8addf-34a1-4440-80f0-a8f5b34523eb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:05.317526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3bb8b5fe-3792-47a6-b89d-1bd51efe0f0b req-78c8addf-34a1-4440-80f0-a8f5b34523eb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:05.344110 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3bb8b5fe-3792-47a6-b89d-1bd51efe0f0b req-78c8addf-34a1-4440-80f0-a8f5b34523eb service nova] Creating event network-changed:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h1-846219-13 Jul 25 16:51:05.367258 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3bb8b5fe-3792-47a6-b89d-1bd51efe0f0b req-78c8addf-34a1-4440-80f0-a8f5b34523eb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277220 Jul 25 16:51:05.368387 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3041/6162] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:05.677556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:05.688063 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d5ddce4-24c7-4c44-a6a3-fff675bcd698 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1567 microversion: 2.1 time: 0.626123 Jul 25 16:51:05.689454 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3122/6163] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:05 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1567 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:35.596651 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:51:35.597251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:35.597991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=52 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:35.602223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1610590420", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "aa175682-ffa0-46e3-9ff3-86d83b7fd5a1"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:35.664486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] validate_networks() for [('aa175682-ffa0-46e3-9ff3-86d83b7fd5a1', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:51:36.089671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:51:36.090386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:51:36.090948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:51:36.091359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:51:36.091782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:51:36.101636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:36.102078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:36.103058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:36.103860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:36.122610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Getting quotas for project 5a237a6e4c8945bd87119a19c9a7b00e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:51:36.127924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Getting quotas for user 4ce9afbae53b43c584493b5e1284f74d and project 5a237a6e4c8945bd87119a19c9a7b00e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:51:36.140202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:51:36.142621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:51:36.186806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef29758e-df68-4f71-aac4-be2cebd842b3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.591995 Jul 25 16:51:36.187736 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3042/6164] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:51:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:51:36.198463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f0129fca-d68a-4ec0-895e-db137b807da4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:36.199077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f0129fca-d68a-4ec0-895e-db137b807da4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:36.201532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=20 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:36.202224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=40 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:36.259094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f0129fca-d68a-4ec0-895e-db137b807da4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:36.266557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f0129fca-d68a-4ec0-895e-db137b807da4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1218 microversion: 2.1 time: 0.072012 Jul 25 16:51:36.267424 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3123/6165] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:36 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:36.336581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:36.339172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:36.347162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:36.347618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:36.348394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:36.348939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:36.425344 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38c4d629-0c6a-48be-a607-d7569cf98106 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action" status: 200 len: 24561 microversion: 2.1 time: 0.092744 Jul 25 16:51:36.426064 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3043/6166] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:51:36 2022] POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action => generated 24561 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:51:37.287578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:37.288516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:37.298362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:37.298963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:37.299885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:37.300454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:37.382717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:37.393714 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-246d95dc-3ec3-46d4-907c-411a1981b185 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1270 microversion: 2.1 time: 0.110110 Jul 25 16:51:37.394741 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3124/6167] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:37 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:38.418397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:38.419169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:38.428953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:38.429483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:38.430221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:38.430654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:38.482849 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 41728. Jul 25 16:51:38.692733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:38.702044 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80daaf0f-d829-4d50-a9d4-551330e1a83b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.287975 Jul 25 16:51:38.703348 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3044/6168] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:38 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:39.297700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a89d9f5f-968d-48ba-9006-1a134f22e856 req-f8838647-154c-4ebe-aac0-fc0870efb14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2cc979-34d5-4f49-bfef-fafc12f07e44", "tag": "9c719300-d126-410f-9184-988e469a3b8e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:39.310886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a89d9f5f-968d-48ba-9006-1a134f22e856 req-f8838647-154c-4ebe-aac0-fc0870efb14f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:39.311582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a89d9f5f-968d-48ba-9006-1a134f22e856 req-f8838647-154c-4ebe-aac0-fc0870efb14f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:39.324529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a89d9f5f-968d-48ba-9006-1a134f22e856 req-f8838647-154c-4ebe-aac0-fc0870efb14f service nova] Creating event network-changed:9c719300-d126-410f-9184-988e469a3b8e for instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 on n-h2-846219-13 Jul 25 16:51:39.330403 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a89d9f5f-968d-48ba-9006-1a134f22e856 req-f8838647-154c-4ebe-aac0-fc0870efb14f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Jul 25 16:51:39.334984 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3125/6169] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:51:39.743761 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:39.744990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:39.757023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:39.757754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:39.758673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:39.759249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:39.931842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:39.940275 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d78a01e-42cb-4897-a086-e1ff5a2f6a33 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.207786 Jul 25 16:51:39.940871 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3045/6170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:39 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:40.965795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:40.967113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:40.973967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:40.975905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:40.977132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:40.979466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:41.275517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:41.284169 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ea759249-d133-4b70-a80a-328b0427c2dd tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.324199 Jul 25 16:51:41.284753 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3126/6171] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:40 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:42.305449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:42.306043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:42.313525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:42.313979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:42.314763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:42.315194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:42.480499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:42.491397 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-737577a9-25e7-4e75-88c0-f2f3f8cc11df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.189123 Jul 25 16:51:42.492817 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3046/6172] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:42 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:43.527375 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:43.527836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:43.546792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:43.548074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:43.553053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:43.554947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:43.797876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:43.809024 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d0e84b3-b5ce-46fc-974d-0e5059dfe1df tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.299142 Jul 25 16:51:43.814944 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3127/6173] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:43 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:51:44.845174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:44.846784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:44.861371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:44.862150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:44.863268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:44.863892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:45.217881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:45.226690 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2fefd004-b6f6-402b-85ed-fac141cd3546 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.394317 Jul 25 16:51:45.237251 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3047/6174] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:44 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:45.442106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d0a3a0c6-85bc-4396-8f8d-d66949200f3b req-3c321505-4fa5-4e66-91dc-42efa5ab7459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2cc979-34d5-4f49-bfef-fafc12f07e44", "name": "network-vif-plugged", "status": "completed", "tag": "9c719300-d126-410f-9184-988e469a3b8e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:45.507690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d0a3a0c6-85bc-4396-8f8d-d66949200f3b req-3c321505-4fa5-4e66-91dc-42efa5ab7459 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:45.508493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d0a3a0c6-85bc-4396-8f8d-d66949200f3b req-3c321505-4fa5-4e66-91dc-42efa5ab7459 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:45.522682 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d0a3a0c6-85bc-4396-8f8d-d66949200f3b req-3c321505-4fa5-4e66-91dc-42efa5ab7459 service nova] Creating event network-vif-plugged:9c719300-d126-410f-9184-988e469a3b8e for instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 on n-h2-846219-13 Jul 25 16:51:45.529073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d0a3a0c6-85bc-4396-8f8d-d66949200f3b req-3c321505-4fa5-4e66-91dc-42efa5ab7459 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091311 Jul 25 16:51:45.530165 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3128/6175] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:46.249769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:46.250577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:46.261712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:46.262969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:46.269567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:46.270294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:46.274042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:46.275197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:46.583659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:46.592386 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f95891be-e9f5-4e63-a797-490a8834e3a1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1318 microversion: 2.1 time: 0.348276 Jul 25 16:51:46.593166 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3048/6176] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:46 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:47.619562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:47.621490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:47.625183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:47.632009 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:47.632866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:47.634162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:47.634773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:47.792468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:47.827514 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e8318c62-e001-47f2-8dfa-14e17982195c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1502 microversion: 2.1 time: 0.214746 Jul 25 16:51:47.828128 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3129/6177] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:47 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:48.426557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:48.427715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:48.447958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:48.450055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:48.450945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:48.452235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:48.496868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:51:48.650592 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-417b8020-b2f0-486f-b47b-bfa9d4cbabc3 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 204 len: 0 microversion: 2.1 time: 0.232480 Jul 25 16:51:48.651415 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3049/6178] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:51:48 2022] DELETE /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:51:48.664993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:48.668664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:48.678214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:48.679092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:48.680140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:48.681042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:48.948273 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:48.959952 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-43e7c26d-3c6f-4e11-8ce8-1e35e7e1964e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1508 microversion: 2.1 time: 0.303997 Jul 25 16:51:48.961173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3130/6179] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:48 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:49.982959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:49.984506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:49.999149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:50.001610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:50.002619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:50.003211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:50.546754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:50.562453 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f4318a5-a2f1-455d-ab16-f5339908daf4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1508 microversion: 2.1 time: 0.584336 Jul 25 16:51:50.573129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3050/6180] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:49 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1508 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:51.270604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-234c5071-0eb3-4fe3-ada8-e95911004b4c req-1a7bd16f-ac20-4eec-85cb-5c9f5bb92454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2cc979-34d5-4f49-bfef-fafc12f07e44", "name": "network-vif-deleted", "tag": "9c719300-d126-410f-9184-988e469a3b8e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:51.345469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-234c5071-0eb3-4fe3-ada8-e95911004b4c req-1a7bd16f-ac20-4eec-85cb-5c9f5bb92454 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:51.348343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-234c5071-0eb3-4fe3-ada8-e95911004b4c req-1a7bd16f-ac20-4eec-85cb-5c9f5bb92454 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:51.381253 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-234c5071-0eb3-4fe3-ada8-e95911004b4c req-1a7bd16f-ac20-4eec-85cb-5c9f5bb92454 service nova] Creating event network-vif-deleted:9c719300-d126-410f-9184-988e469a3b8e for instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 on n-h2-846219-13 Jul 25 16:51:51.390940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-234c5071-0eb3-4fe3-ada8-e95911004b4c req-1a7bd16f-ac20-4eec-85cb-5c9f5bb92454 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128439 Jul 25 16:51:51.392224 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3131/6181] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:51.586286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:51.586836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:51.602173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:51.602621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:51.603797 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:51.604260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:51.667101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:51.668312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:51.668970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lazy-loading 'fault' on Instance uuid 8e2cc979-34d5-4f49-bfef-fafc12f07e44 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:51:51.746136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:51.756716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7928c981-ca9f-4c22-abe3-197b05b2c511 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 200 len: 1308 microversion: 2.1 time: 0.174340 Jul 25 16:51:51.772559 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3051/6182] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:51 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:52.782387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:52.783898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: 8e2cc979-34d5-4f49-bfef-fafc12f07e44] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:52.796751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:52.797607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:52.811551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:52.812065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:52.838491 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] HTTP exception thrown: Instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 could not be found. Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Request method failure captured: Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 HTTP/1.1 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3soVdOr_WhIPq379sNhKZ4xK2QF1rq-pVHBpSrobc7zrOJyoQKEQn0j9_XPPpPaaPgx-raPZ_FB4lebtALC-bPkQXwsWxzsRkzi8sAWIWfqooOdDgxvTxYRC8BAqKBowgGoy5W-K3FCKcDdqDjmnz26xBnlJyYePdAGultEEf8Ld6eA Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5a237a6e4c8945bd87119a19c9a7b00e Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-VolumesActionsTest-1828842832 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5a237a6e4c8945bd87119a19c9a7b00e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5a237a6e4c8945bd87119a19c9a7b00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5a237a6e4c8945bd87119a19c9a7b00e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5a237a6e4c8945bd87119a19c9a7b00e"}]}] Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-VolumesActionsTest-1828842832 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5a237a6e4c8945bd87119a19c9a7b00e Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-VolumesActionsTest-1828842832 Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-VolumesActionsTest-1828842832-project Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 4ce9afbae53b43c584493b5e1284f74d Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-VolumesActionsTest-1828842832-project Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 could not be found. Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8e2cc979-34d5-4f49-bfef-fafc12f07e44'} Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 could not be found. Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 could not be found. Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:51:52.840998 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 could not be found. Jul 25 16:51:52.845920 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:51:52.847783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Returning 404 to user: Instance 8e2cc979-34d5-4f49-bfef-fafc12f07e44 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:51:52.848900 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85cd01f7-4dda-4b1c-a84a-877007f6beff tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44" status: 404 len: 111 microversion: 2.1 time: 0.072618 Jul 25 16:51:52.850314 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3132/6183] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:52 2022] GET /compute/v2.1/servers/8e2cc979-34d5-4f49-bfef-fafc12f07e44 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:51:53.083518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-613049777", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "aa175682-ffa0-46e3-9ff3-86d83b7fd5a1"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:53.224696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] validate_networks() for [('aa175682-ffa0-46e3-9ff3-86d83b7fd5a1', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:51:53.778406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:51:53.779049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:51:53.779532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:51:53.780135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:51:53.780711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:51:53.792595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:53.793503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:53.794611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:53.795206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:53.824046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Getting quotas for project 5a237a6e4c8945bd87119a19c9a7b00e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:51:53.837712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Getting quotas for user 4ce9afbae53b43c584493b5e1284f74d and project 5a237a6e4c8945bd87119a19c9a7b00e. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:51:53.856877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:51:53.860312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:51:53.935633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cbe0a33c-0622-4f1c-9f5e-f74fa84a08d8 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.856168 Jul 25 16:51:53.946259 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3052/6184] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:51:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:51:53.951532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef1663b4-eae3-4d8f-b179-d5f7c793e902 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:53.952556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef1663b4-eae3-4d8f-b179-d5f7c793e902 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:54.074888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ef1663b4-eae3-4d8f-b179-d5f7c793e902 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:54.082528 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef1663b4-eae3-4d8f-b179-d5f7c793e902 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1217 microversion: 2.1 time: 0.134966 Jul 25 16:51:54.086035 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3133/6185] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:53 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:51:54.852212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eef6172f-f262-4720-9ae3-fdf721425e5d tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1716274441", "availability_zone": "foo_zone"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:54.874370 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:54.874370 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:51:54.874959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.aggregate [None req-eef6172f-f262-4720-9ae3-fdf721425e5d tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Generated uuid a6587292-224f-4f18-b536-c37f9eb4c460 for aggregate {{(pid=119598) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 16:51:54.910644 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eef6172f-f262-4720-9ae3-fdf721425e5d tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.254421 Jul 25 16:51:54.911637 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3053/6186] 10.222.0.105 () {60 vars in 1169 bytes} [Mon Jul 25 16:51:54 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:54.927668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a4f695d6-f054-414b-9873-cd8e720a5cd6 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:54.936213 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:54.936213 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:51:54.979050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a4f695d6-f054-414b-9873-cd8e720a5cd6 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.052879 Jul 25 16:51:54.980179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3134/6187] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:51:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:54.991491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4221b34a-53ba-4508-9ed6-b59d6a9e7b5a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:54.995494 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:54.995494 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:51:54.996972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4221b34a-53ba-4508-9ed6-b59d6a9e7b5a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:54.997703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4221b34a-53ba-4508-9ed6-b59d6a9e7b5a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:54.998610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4221b34a-53ba-4508-9ed6-b59d6a9e7b5a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:54.999113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4221b34a-53ba-4508-9ed6-b59d6a9e7b5a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:55.028778 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4221b34a-53ba-4508-9ed6-b59d6a9e7b5a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.041216 Jul 25 16:51:55.029572 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3054/6188] 10.222.0.105 () {58 vars in 1181 bytes} [Mon Jul 25 16:51:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.041561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0e60a55f-5a52-4b82-b9ba-260abbe5ff4c tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:55.042403 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.042403 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:51:55.050360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0e60a55f-5a52-4b82-b9ba-260abbe5ff4c tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012933 Jul 25 16:51:55.051185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3135/6189] 10.222.0.105 () {58 vars in 1148 bytes} [Mon Jul 25 16:51:55 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.072137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c075239-a9fd-4a49-96d9-75105e5cb5aa tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-13"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:55.075697 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.075697 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:51:55.084762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c075239-a9fd-4a49-96d9-75105e5cb5aa tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:55.085251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c075239-a9fd-4a49-96d9-75105e5cb5aa tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:55.107998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:55.108550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:55.124561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:55.125054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:55.125904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:55.126359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:55.226018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:55.242355 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b36fc2c8-eba0-4416-b85e-ba211d383008 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1269 microversion: 2.1 time: 0.134713 Jul 25 16:51:55.256241 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3136/6190] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:55 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:55.447757 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c075239-a9fd-4a49-96d9-75105e5cb5aa tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.379281 Jul 25 16:51:55.449414 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3055/6191] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:51:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.460861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-29b30d46-800c-4b4a-aa22-cb8f7e656e6a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:55.461840 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.461840 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:51:55.476736 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-29b30d46-800c-4b4a-aa22-cb8f7e656e6a tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.018629 Jul 25 16:51:55.484933 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3137/6192] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:51:55 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.491154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c4a9ca7c-a77c-438c-88ac-bd38fd0c81f2 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1591330560", "availability_zone": "foo_zone"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:55.585190 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.585190 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:51:55.649275 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c4a9ca7c-a77c-438c-88ac-bd38fd0c81f2 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.162510 Jul 25 16:51:55.650080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3056/6193] 10.222.0.105 () {60 vars in 1178 bytes} [Mon Jul 25 16:51:55 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.662206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0b94a2a-adf6-44fb-9a95-d36731186eef tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:55.665120 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.665120 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:51:55.700251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0b94a2a-adf6-44fb-9a95-d36731186eef tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.042349 Jul 25 16:51:55.701722 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3138/6194] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:51:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.714964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53cefd12-ac3a-430f-9b32-8f545c3a210d tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:55.716020 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.716020 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:51:55.726977 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53cefd12-ac3a-430f-9b32-8f545c3a210d tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.016798 Jul 25 16:51:55.727795 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3057/6195] 10.222.0.105 () {58 vars in 1157 bytes} [Mon Jul 25 16:51:55 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:55.740022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f0df14b-ee0d-4283-bea5-ea5f387f83e0 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-13"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:55.742740 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:55.742740 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 16:51:55.760909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f0df14b-ee0d-4283-bea5-ea5f387f83e0 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:55.760909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f0df14b-ee0d-4283-bea5-ea5f387f83e0 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:56.068705 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f0df14b-ee0d-4283-bea5-ea5f387f83e0 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.332380 Jul 25 16:51:56.070272 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3139/6196] 10.222.0.105 () {60 vars in 1199 bytes} [Mon Jul 25 16:51:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:56.087218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1f1cfe40-abc0-4c9f-929c-6d93ab06b160 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:56.088853 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:51:56.088853 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 16:51:56.121674 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1f1cfe40-abc0-4c9f-929c-6d93ab06b160 tempest-TestAggregatesBasicOps-195049217 tempest-TestAggregatesBasicOps-195049217-project-admin] 10.222.0.105 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.042995 Jul 25 16:51:56.123427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3058/6197] 10.222.0.105 () {58 vars in 1160 bytes} [Mon Jul 25 16:51:56 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 16:51:56.264644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:56.265313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:56.274490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:56.274946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:56.275735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:56.276585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:56.468840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:56.482099 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7a40ed3-dd76-4112-9647-f4b0526fc659 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.221279 Jul 25 16:51:56.483352 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3140/6198] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:56 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:57.296510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-117c01a5-a73b-4f13-bcd2-58a564c3311f req-18c815b1-cc0a-428d-8ebd-0126aa874e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59b94b4-3c74-4d4c-aaf3-5979266cb50c", "tag": "27f37f68-97de-43b8-a25d-b6d98eb4769c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:51:57.320115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:51:57.322503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-117c01a5-a73b-4f13-bcd2-58a564c3311f req-18c815b1-cc0a-428d-8ebd-0126aa874e2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:57.323169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-117c01a5-a73b-4f13-bcd2-58a564c3311f req-18c815b1-cc0a-428d-8ebd-0126aa874e2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:57.353689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-117c01a5-a73b-4f13-bcd2-58a564c3311f req-18c815b1-cc0a-428d-8ebd-0126aa874e2d service nova] Creating event network-changed:27f37f68-97de-43b8-a25d-b6d98eb4769c for instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c on n-h2-846219-13 Jul 25 16:51:57.361976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-117c01a5-a73b-4f13-bcd2-58a564c3311f req-18c815b1-cc0a-428d-8ebd-0126aa874e2d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069255 Jul 25 16:51:57.367879 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3059/6199] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:51:57.513220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:57.513999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:57.523384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:57.525695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:57.527582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:57.532629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:57.888722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:57.897550 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-91204bd1-d444-4724-a6d8-eeec51493fb4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.396648 Jul 25 16:51:57.898244 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3141/6200] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:57 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:51:58.923353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:51:58.924064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:51:58.932416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:58.933229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:58.934183 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:51:58.934762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:51:59.328305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:51:59.341929 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67e4d2e8-ef55-454d-a200-24ffe0fb7cc1 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.423131 Jul 25 16:51:59.342784 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3060/6201] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:51:58 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:00.368996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:00.370667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:00.379840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:00.380298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:00.381242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:00.381786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:00.582941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:00.592576 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ebab08e-1bd4-4ac8-ae48-984f69821698 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.228442 Jul 25 16:52:00.605700 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3142/6202] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:00 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:01.614661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:01.615283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:01.622885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:01.623334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:01.624623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:01.625065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:01.884888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:01.907320 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dca4c34c-c70f-494e-81d2-c370b933df3e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.294917 Jul 25 16:52:01.908769 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3061/6203] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:01 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:02.934114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:02.935500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:02.943949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:02.944710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:02.945723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:02.946337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:03.207154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:03.227879 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-adeafb5f-24da-49b1-96d5-82a3a8b1ca83 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.301281 Jul 25 16:52:03.229529 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3143/6204] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:02 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:03.595711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-afaba3c1-8807-4a47-9519-a403f4553171 req-2acd25f3-8347-4e0c-8e81-2cd9fee2f61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59b94b4-3c74-4d4c-aaf3-5979266cb50c", "name": "network-vif-plugged", "status": "completed", "tag": "27f37f68-97de-43b8-a25d-b6d98eb4769c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:03.614678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-afaba3c1-8807-4a47-9519-a403f4553171 req-2acd25f3-8347-4e0c-8e81-2cd9fee2f61c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:03.615557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-afaba3c1-8807-4a47-9519-a403f4553171 req-2acd25f3-8347-4e0c-8e81-2cd9fee2f61c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:03.628921 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-afaba3c1-8807-4a47-9519-a403f4553171 req-2acd25f3-8347-4e0c-8e81-2cd9fee2f61c service nova] Creating event network-vif-plugged:27f37f68-97de-43b8-a25d-b6d98eb4769c for instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c on n-h2-846219-13 Jul 25 16:52:03.641162 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-afaba3c1-8807-4a47-9519-a403f4553171 req-2acd25f3-8347-4e0c-8e81-2cd9fee2f61c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052967 Jul 25 16:52:03.642571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3062/6205] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:52:04.250787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:04.252015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:04.260352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:04.264750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:04.264750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:04.265692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:04.266137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:04.476755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:04.488421 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8a9bb17d-43c9-4edf-a015-adce583ae29e tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1317 microversion: 2.1 time: 0.242190 Jul 25 16:52:04.489723 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3144/6206] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:04 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:05.509733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:05.512312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:05.517727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:05.518444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:05.525977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:05.526502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:05.527315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:05.527751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:05.723735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:05.726178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:05.736661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fbc196a0-66af-4c73-9c9d-89d1ea8d56f4 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1501 microversion: 2.1 time: 0.227875 Jul 25 16:52:05.752372 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3063/6207] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:05 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:06.206142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:06.206950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:06.213368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:06.215024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:06.215489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:06.216281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:06.216726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:06.233223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=81 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:06.246068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:52:06.338119 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e2f54628-072f-4abf-b5e4-2dcdfe8af1d9 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 204 len: 0 microversion: 2.1 time: 0.135355 Jul 25 16:52:06.338685 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3145/6208] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:52:06 2022] DELETE /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:52:06.347928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:06.348515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:06.363135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:06.363578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:06.364384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:06.364818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:06.506780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:06.523715 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f63fe653-31df-4e57-bf1c-afea5bf367f6 tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1507 microversion: 2.1 time: 0.179787 Jul 25 16:52:06.524388 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3064/6209] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:06 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:07.653935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:07.653935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:07.653935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:07.653935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:07.653935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:07.653935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:07.879623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:07.891302 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-270bb3ce-4e47-4dfc-acb4-90d37f14112a tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1507 microversion: 2.1 time: 0.349979 Jul 25 16:52:07.892422 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3146/6210] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:07 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:08.568456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-267a601f-edf9-41d8-a1d9-9ca8a424722f req-e40bce81-49e4-4304-bf42-e3a77ba54c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59b94b4-3c74-4d4c-aaf3-5979266cb50c", "name": "network-vif-deleted", "tag": "27f37f68-97de-43b8-a25d-b6d98eb4769c"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:08.581026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-267a601f-edf9-41d8-a1d9-9ca8a424722f req-e40bce81-49e4-4304-bf42-e3a77ba54c7f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:08.581766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-267a601f-edf9-41d8-a1d9-9ca8a424722f req-e40bce81-49e4-4304-bf42-e3a77ba54c7f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:08.599638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-267a601f-edf9-41d8-a1d9-9ca8a424722f req-e40bce81-49e4-4304-bf42-e3a77ba54c7f service nova] Creating event network-vif-deleted:27f37f68-97de-43b8-a25d-b6d98eb4769c for instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c on n-h2-846219-13 Jul 25 16:52:08.608723 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-267a601f-edf9-41d8-a1d9-9ca8a424722f req-e40bce81-49e4-4304-bf42-e3a77ba54c7f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043995 Jul 25 16:52:08.611291 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3065/6211] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:52:08.914841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:08.916602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:08.925959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:08.925959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:08.959119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:08.959861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:09.022710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:09.023293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:09.023978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lazy-loading 'fault' on Instance uuid b59b94b4-3c74-4d4c-aaf3-5979266cb50c {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:52:09.097437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ce9afbae53b43c584493b5e1284f74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a237a6e4c8945bd87119a19c9a7b00e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:09.107410 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6714cd4b-efc4-4be4-a3d1-f6aa248a880b tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 200 len: 1307 microversion: 2.1 time: 0.196784 Jul 25 16:52:09.121383 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3147/6212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:08 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:10.132208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:10.134178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] [instance: b59b94b4-3c74-4d4c-aaf3-5979266cb50c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:10.144781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:10.145553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:10.146706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:10.147699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:10.170279 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] HTTP exception thrown: Instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c could not be found. Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Request method failure captured: Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c HTTP/1.1 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3soVdOr_WhIPq379sNhKZ4xK2QF1rq-pVHBpSrobc7zrOJyoQKEQn0j9_XPPpPaaPgx-raPZ_FB4lebtALC-bPkQXwsWxzsRkzi8sAWIWfqooOdDgxvTxYRC8BAqKBowgGoy5W-K3FCKcDdqDjmnz26xBnlJyYePdAGultEEf8Ld6eA Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 5a237a6e4c8945bd87119a19c9a7b00e Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-VolumesActionsTest-1828842832 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5a237a6e4c8945bd87119a19c9a7b00e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5a237a6e4c8945bd87119a19c9a7b00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5a237a6e4c8945bd87119a19c9a7b00e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5a237a6e4c8945bd87119a19c9a7b00e"}]}] Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-VolumesActionsTest-1828842832 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 5a237a6e4c8945bd87119a19c9a7b00e Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-VolumesActionsTest-1828842832 Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-VolumesActionsTest-1828842832-project Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 4ce9afbae53b43c584493b5e1284f74d Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-VolumesActionsTest-1828842832-project Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c could not be found. Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'b59b94b4-3c74-4d4c-aaf3-5979266cb50c'} Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c could not be found. Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c could not be found. Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:52:10.172381 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c could not be found. Jul 25 16:52:10.176451 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:10.178606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] Returning 404 to user: Instance b59b94b4-3c74-4d4c-aaf3-5979266cb50c could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:52:10.179903 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5ca9cdca-a8b6-4f1e-b1d2-507f5dca748c tempest-VolumesActionsTest-1828842832 tempest-VolumesActionsTest-1828842832-project] 10.222.0.105 "GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c" status: 404 len: 111 microversion: 2.1 time: 0.052916 Jul 25 16:52:10.181157 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3066/6213] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:10 2022] GET /compute/v2.1/servers/b59b94b4-3c74-4d4c-aaf3-5979266cb50c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:52:15.219214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:15.220534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:15.231200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:15.232839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:15.235393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:15.236040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:15.659388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:15.682189 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1400db50-32b6-412c-9118-c9d62579f9bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1685 microversion: 2.1 time: 0.471720 Jul 25 16:52:15.683445 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3148/6214] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:15 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1685 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:15.890578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:15.897970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:15.947086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:15.947086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:15.950136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:15.953386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:16.067827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-313ce70e-a101-4208-ac9f-bb8b486432a5 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action" status: 200 len: 32635 microversion: 2.1 time: 0.180904 Jul 25 16:52:16.068719 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3067/6215] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:52:15 2022] POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action => generated 32635 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:52:16.225054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:16.226605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:16.245635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:16.247096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:16.249048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:16.250129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:16.548355 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f1788aa-d872-4f76-8898-e3bdddfbddb4 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1838 microversion: 2.1 time: 0.327829 Jul 25 16:52:16.549859 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3149/6216] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:16 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1838 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:16.585251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:16.590953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:16.613920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:16.613920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:16.613920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:16.613920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:16.691356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lazy-loading 'flavor' on Instance uuid fe6f8240-ddc1-40b4-a29d-fecaeedba6db {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:52:16.726495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Going to try to live migrate instance to another host {{(pid=119598) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 16:52:20.594652 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b9895b14-42db-4887-8178-95a55f0e8ecd tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action" status: 202 len: 0 microversion: 2.1 time: 4.016022 Jul 25 16:52:20.596300 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3068/6217] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:52:16 2022] POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action => generated 0 bytes in 4018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:52:20.604862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:20.606470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:20.629238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:20.630018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:20.632882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:20.637652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:22.058698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:22.075216 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-beb1bcf0-12f6-4e77-a620-759b412f7a6a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 1.467070 Jul 25 16:52:22.075911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3150/6218] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:20 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:23.097876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:23.098490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:23.121576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:23.121966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:23.122760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:23.132447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:23.702013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:23.713013 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b7e18b5-af62-4b6b-acaa-1cf6e0ad9968 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.619143 Jul 25 16:52:23.720116 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3069/6219] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:23 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:24.744971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:24.746384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:24.757805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:24.767899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:24.770194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:24.772229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:24.826490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b0c31df8-980d-4a99-8a26-054c13db0213 req-3e47e1f4-e261-449e-a1eb-56b4ca9cede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "name": "network-vif-unplugged", "status": "completed", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:24.863858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b0c31df8-980d-4a99-8a26-054c13db0213 req-3e47e1f4-e261-449e-a1eb-56b4ca9cede6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:24.873840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b0c31df8-980d-4a99-8a26-054c13db0213 req-3e47e1f4-e261-449e-a1eb-56b4ca9cede6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:24.888691 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b0c31df8-980d-4a99-8a26-054c13db0213 req-3e47e1f4-e261-449e-a1eb-56b4ca9cede6 service nova] Creating event network-vif-unplugged:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h1-846219-13 Jul 25 16:52:24.901650 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b0c31df8-980d-4a99-8a26-054c13db0213 req-3e47e1f4-e261-449e-a1eb-56b4ca9cede6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073290 Jul 25 16:52:24.903813 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3070/6220] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:52:25.639665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:25.653501 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8bc299e-0f8b-4f95-ae19-b0ead40a6861 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.909959 Jul 25 16:52:25.661325 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3151/6221] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:24 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:26.683198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:26.683879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:26.705016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:26.705500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:26.707044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:26.710283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:26.996278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-20fad987-2bbb-4108-8ce1-e71f41660f22 req-08b34e04-afca-4e20-aacb-94ba55de1c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:27.031852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-20fad987-2bbb-4108-8ce1-e71f41660f22 req-08b34e04-afca-4e20-aacb-94ba55de1c1b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:27.032326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-20fad987-2bbb-4108-8ce1-e71f41660f22 req-08b34e04-afca-4e20-aacb-94ba55de1c1b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:27.060355 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-20fad987-2bbb-4108-8ce1-e71f41660f22 req-08b34e04-afca-4e20-aacb-94ba55de1c1b service nova] Creating event network-changed:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h1-846219-13 Jul 25 16:52:27.090390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:27.098788 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69243240-4901-4818-914d-1739d1a9b239 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.422481 Jul 25 16:52:27.100526 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-20fad987-2bbb-4108-8ce1-e71f41660f22 req-08b34e04-afca-4e20-aacb-94ba55de1c1b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110502 Jul 25 16:52:27.109471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3152/6223] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:52:27.109787 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3071/6223] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:26 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:28.144509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:28.145044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:28.175024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:28.175492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:28.176941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:28.179272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:28.481593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:28.496209 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c159936c-ef98-4c29-920f-44863be43562 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.367382 Jul 25 16:52:28.501458 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3153/6224] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:28 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:29.520277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:29.521519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:29.525865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=27 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:29.536702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:29.537707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:29.538771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:29.539766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:29.890045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:29.903460 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7cad0ac2-0778-49d6-8dd5-c83250ccb402 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.383952 Jul 25 16:52:29.906014 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3072/6225] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:29 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:30.944146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:30.944775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:30.958007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:30.958478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:30.959292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:30.959734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:31.248576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:31.257692 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a81eecd2-baea-40a3-82c0-60251c7b4349 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.317552 Jul 25 16:52:31.260706 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3154/6226] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:30 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:32.287129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:32.291457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:32.315373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:32.317310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:32.319527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:32.321161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:32.584555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a7545c4b-df3a-40ee-9782-1c82d9c17a4d req-0f7920e1-629d-4ba0-929a-48d3b78aec6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "name": "network-vif-unplugged", "status": "completed", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:32.621716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a7545c4b-df3a-40ee-9782-1c82d9c17a4d req-0f7920e1-629d-4ba0-929a-48d3b78aec6d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:32.622550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a7545c4b-df3a-40ee-9782-1c82d9c17a4d req-0f7920e1-629d-4ba0-929a-48d3b78aec6d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:32.662170 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a7545c4b-df3a-40ee-9782-1c82d9c17a4d req-0f7920e1-629d-4ba0-929a-48d3b78aec6d service nova] Creating event network-vif-unplugged:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h1-846219-13 Jul 25 16:52:32.682465 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a7545c4b-df3a-40ee-9782-1c82d9c17a4d req-0f7920e1-629d-4ba0-929a-48d3b78aec6d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.473511 Jul 25 16:52:32.685037 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3073/6227] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:52:32.766261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:32.782342 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb031ab9-b976-4f32-ab85-9a8d2e8f8d06 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.503439 Jul 25 16:52:32.797543 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3155/6228] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:32 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:33.827132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:33.828466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:33.854316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:33.857520 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:33.868639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:33.869754 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:34.288507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:34.308212 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-438a139f-dc9f-4082-ac9c-b9d45a2e4329 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.487146 Jul 25 16:52:34.328354 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3074/6229] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:33 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:35.332703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:35.333925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:35.356041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:35.357152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:35.358980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:35.359881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:35.592955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:35.605007 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-520f84ca-e9ca-44d1-98f6-7a27abc6860b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1695 microversion: 2.1 time: 0.276866 Jul 25 16:52:35.605675 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3156/6230] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:35 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1695 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:36.635992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:36.641971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:36.653345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:36.654082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:36.655593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:36.656347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:36.735463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:37.124605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:37.146451 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d540ab8-d237-4b32-af01-6dc41f6fa066 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1685 microversion: 2.1 time: 0.523385 Jul 25 16:52:37.147446 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3075/6231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:36 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1685 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:37.178151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:37.179299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:37.196235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:37.200172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:37.201528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:37.203355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:37.204249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:37.213307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:52:37.481298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ea74e67-41ff-4fee-8037-159a03363ae6 tempest-TestNetworkAdvancedServerOps-948802619 tempest-TestNetworkAdvancedServerOps-948802619-project-admin] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1838 microversion: 2.1 time: 0.311158 Jul 25 16:52:37.493242 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3157/6232] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:37 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1838 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:52:37.511082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:37.520707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:37.547945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:37.553829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:37.555799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:37.560711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:37.810294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:37.831917 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-255062d8-64b0-4cc7-886e-2b4342829fc3 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1685 microversion: 2.1 time: 0.327820 Jul 25 16:52:37.833930 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3076/6233] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:37 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1685 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:37.969322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:37.971815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:37.982272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:37.982746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:37.987581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:37.988062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:38.069402 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7ebde43b-d4a4-4f27-92a6-0c9b84e513c8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action" status: 200 len: 38626 microversion: 2.1 time: 0.104486 Jul 25 16:52:38.070105 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3158/6234] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:52:37 2022] POST /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db/action => generated 38626 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:52:39.759121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:39.759859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:39.799064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:39.799392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:39.799970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:39.800409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:39.806740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d9791d33-32ec-4962-9e4b-5ab9b23c3e45 req-772f28e7-8c74-457c-9025-2f4629c333e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:39.836535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d9791d33-32ec-4962-9e4b-5ab9b23c3e45 req-772f28e7-8c74-457c-9025-2f4629c333e6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:39.839233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d9791d33-32ec-4962-9e4b-5ab9b23c3e45 req-772f28e7-8c74-457c-9025-2f4629c333e6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:39.863045 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d9791d33-32ec-4962-9e4b-5ab9b23c3e45 req-772f28e7-8c74-457c-9025-2f4629c333e6 service nova] Creating event network-changed:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h2-846219-13 Jul 25 16:52:39.872245 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d9791d33-32ec-4962-9e4b-5ab9b23c3e45 req-772f28e7-8c74-457c-9025-2f4629c333e6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073715 Jul 25 16:52:39.873328 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3159/6235] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:52:39.947721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:52:40.135585 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-327ec33d-904a-43ad-bcaf-563776d95627 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 204 len: 0 microversion: 2.1 time: 0.380617 Jul 25 16:52:40.140558 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3077/6236] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:52:39 2022] DELETE /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:52:40.175662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:40.178850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:40.219277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:40.219945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:40.220788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:40.221291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:40.737584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:40.748054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c22d11dc-9967-4be5-85ee-0e105239c43f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1691 microversion: 2.1 time: 0.598942 Jul 25 16:52:40.763365 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3160/6237] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:40 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1691 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:41.775744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:41.776551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:41.793338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:41.797539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:41.798704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:41.801565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:41.988819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:52:42.013439 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bef49c4b-4f15-469b-acb8-4f9925c3a505 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 200 len: 1506 microversion: 2.1 time: 0.243916 Jul 25 16:52:42.014390 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3078/6238] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:41 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:52:42.183187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d9a7c29e-68b2-4a64-bb22-a21106bf697e req-9ba60a5b-9e17-498c-8344-6e7e349b92ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6f8240-ddc1-40b4-a29d-fecaeedba6db", "name": "network-vif-deleted", "tag": "1f0c2e46-a2b7-419b-9c5a-9a123128d971"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:42.242238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d9a7c29e-68b2-4a64-bb22-a21106bf697e req-9ba60a5b-9e17-498c-8344-6e7e349b92ba service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:42.242928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d9a7c29e-68b2-4a64-bb22-a21106bf697e req-9ba60a5b-9e17-498c-8344-6e7e349b92ba service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:42.274736 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d9a7c29e-68b2-4a64-bb22-a21106bf697e req-9ba60a5b-9e17-498c-8344-6e7e349b92ba service nova] Creating event network-vif-deleted:1f0c2e46-a2b7-419b-9c5a-9a123128d971 for instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db on n-h2-846219-13 Jul 25 16:52:42.297551 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d9a7c29e-68b2-4a64-bb22-a21106bf697e req-9ba60a5b-9e17-498c-8344-6e7e349b92ba service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113452 Jul 25 16:52:42.304341 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3161/6239] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:52:43.068194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:43.068194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: fe6f8240-ddc1-40b4-a29d-fecaeedba6db] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:52:43.095810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:43.096128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:43.096980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:52:43.097440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:52:43.139732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] HTTP exception thrown: Instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db could not be found. Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Request method failure captured: Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db HTTP/1.1 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sgn4YkBMyCEyyAORyVf9SZjBBvuh81o-VzVNz2F1wNAr5HF5-hD4odv0heMCsEXrqL-2lCux1tP7m0PYr-vigSzzpDCzlqczfxYfRCOzVsm3BERebJbVFwnSoZ5CkBkCCaojMxgj5pmTX5yzsQVNJ7JSEUQ6hfrXXue07rD9iWFdyo Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cd51658ef95d4f69b50b94f0ebfc4205"}]}] Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: edc280fc36f7440a957c6856dd0877a3 Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db could not be found. Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fe6f8240-ddc1-40b4-a29d-fecaeedba6db'} Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db could not be found. Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db could not be found. Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:43.143127 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db could not be found. Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Returning 404 to user: Instance fe6f8240-ddc1-40b4-a29d-fecaeedba6db could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:52:43.147923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6613ab2a-f5c7-477c-b04e-5a9eb6bbfcad tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db" status: 404 len: 111 microversion: 2.1 time: 0.108364 Jul 25 16:52:43.149436 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3079/6240] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:52:43 2022] GET /compute/v2.1/servers/fe6f8240-ddc1-40b4-a29d-fecaeedba6db => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:52:48.939772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a764a8b9-6359-4485-95b2-b0cc41b6cb43 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '.version_select at 0x7f9d9277a430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:52:48.987532 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a764a8b9-6359-4485-95b2-b0cc41b6cb43 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-527796315" status: 202 len: 0 microversion: 2.1 time: 0.053450 Jul 25 16:52:48.988749 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3162/6241] 10.222.0.105 () {58 vars in 1286 bytes} [Mon Jul 25 16:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-527796315 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:52:49.028864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b2cf5e5d-f4f9-4358-b4b4-c4d73a700e23 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: .version_select at 0x7f9d927e0c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-497600199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD/g6NBbOg7/YQICm5h6p4eFEr/iCBFwejNbHJDff25QNIfFXeZkBsfsEPJKvcfa0PVbdf9qMQgYhnagTftbv7Fs3KIpc/7+/82VZ8CEGxSP5eEqkgMsF6S09pV1xO2fA=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:52:49.067427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b2cf5e5d-f4f9-4358-b4b4-c4d73a700e23 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:52:49.083440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b2cf5e5d-f4f9-4358-b4b4-c4d73a700e23 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:52:49.131688 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b2cf5e5d-f4f9-4358-b4b4-c4d73a700e23 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.107006 Jul 25 16:52:49.135273 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3080/6242] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:52:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:53:01.374173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=19 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:01.379850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:01.391826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1672660966", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "0db94799-575b-4b7f-83f3-44a89065c626"}], "key_name": "tempest-TestNetworkAdvancedServerOps-497600199", "security_groups": [{"name": "tempest-secgroup-smoke-1697855262"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:53:01.669012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] validate_networks() for [('0db94799-575b-4b7f-83f3-44a89065c626', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:53:03.659330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:53:03.659951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:53:03.660304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:53:03.660755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:53:03.661663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:53:03.688785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:03.689617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:03.690700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:03.691404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:03.712271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:53:03.723257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Getting quotas for user edc280fc36f7440a957c6856dd0877a3 and project cd51658ef95d4f69b50b94f0ebfc4205. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:53:03.763572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:53:03.768917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:53:03.911433 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f5d4ed0-b6af-4e0a-ae20-87d1be6acbbd tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.535561 Jul 25 16:53:03.916748 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3163/6243] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:53:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:53:03.927409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91215001-d877-4c74-a599-499d6af37645 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:03.931057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91215001-d877-4c74-a599-499d6af37645 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:03.944993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:03.946339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:03.947465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:04.158591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-91215001-d877-4c74-a599-499d6af37645 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:04.185081 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91215001-d877-4c74-a599-499d6af37645 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1270 microversion: 2.1 time: 0.261751 Jul 25 16:53:04.198163 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3081/6244] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:03 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1270 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:05.218096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:05.218893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:05.236707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:05.237243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:05.238090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:05.238556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:05.517505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:05.543770 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f7b6d47-5140-45dd-a022-a08245bc4b11 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1266 microversion: 2.1 time: 0.330537 Jul 25 16:53:05.553591 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3164/6245] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:05 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:53:06.580317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:06.581285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:06.601550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:06.607244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:06.608566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:06.609055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:06.705886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:06.715424 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6ec14ac-2dbc-4db5-99ef-bdb031f8f293 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1328 microversion: 2.1 time: 0.140408 Jul 25 16:53:06.716036 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3082/6246] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:06 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1328 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:07.741337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:07.743042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:07.758951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:07.759605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:07.761816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:07.762285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:07.970932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:07.982915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ec3b55e4-69c3-418e-9a5d-9d8000629dfe tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.245540 Jul 25 16:53:07.984083 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3165/6247] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:07 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:08.652589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0e3d1af4-31ca-401f-829f-487f93d45a13 req-8a9b5f2a-3a0a-4cbe-94eb-3faa8ef5de42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:53:08.668167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0e3d1af4-31ca-401f-829f-487f93d45a13 req-8a9b5f2a-3a0a-4cbe-94eb-3faa8ef5de42 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:08.668979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0e3d1af4-31ca-401f-829f-487f93d45a13 req-8a9b5f2a-3a0a-4cbe-94eb-3faa8ef5de42 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:08.683804 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0e3d1af4-31ca-401f-829f-487f93d45a13 req-8a9b5f2a-3a0a-4cbe-94eb-3faa8ef5de42 service nova] Creating event network-changed:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:53:08.694331 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0e3d1af4-31ca-401f-829f-487f93d45a13 req-8a9b5f2a-3a0a-4cbe-94eb-3faa8ef5de42 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047416 Jul 25 16:53:08.702208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3083/6248] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:53:09.006709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:09.007647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:09.016440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:09.017571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:09.018677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:09.019399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:09.290668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:09.302226 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8557b86-6cb7-48c2-9c83-6149c1b7cb91 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.300637 Jul 25 16:53:09.305919 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3166/6249] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:08 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:10.336319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:10.337036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:10.348071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:10.348544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:10.349309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:10.349741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:10.542657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:10.551640 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-633260e8-f5af-4ace-9fab-6737cec1d195 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.219260 Jul 25 16:53:10.552708 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3084/6250] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:10 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:11.572355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:11.572954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:11.581127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:11.581829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:11.582857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:11.583470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:11.745290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:11.755306 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8c440a95-41fe-4c94-9966-d5b17bd0970b tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.186719 Jul 25 16:53:11.762919 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3167/6251] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:11 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:12.783406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:12.784049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:12.793658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:12.805390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:12.806451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:12.806908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:13.002247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:13.016109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0de0765a-188d-4385-b2a5-0b8df7fb9795 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.233381 Jul 25 16:53:13.016864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3085/6252] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:12 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:14.040795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:14.042200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:14.051097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:14.051792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:14.054728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:14.055602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:14.056568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:14.057262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:14.215376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:14.225073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65862390-d6ac-4eae-9360-0faa838722de tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.190298 Jul 25 16:53:14.241572 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3168/6253] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:14 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:15.250842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:15.253236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:15.261822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:15.276167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:15.279373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:15.280470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:15.283334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:15.935003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:15.943693 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5bd88ce-7c10-4f2f-bc9a-9e700fa2ca27 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.700043 Jul 25 16:53:15.953173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3086/6254] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:15 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:16.774748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8f6e25f7-86e0-43d6-be6a-22eca9e8caff req-bc330706-4542-4479-ac9e-f9873f8ec790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "name": "network-vif-plugged", "status": "completed", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:53:16.809945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8f6e25f7-86e0-43d6-be6a-22eca9e8caff req-bc330706-4542-4479-ac9e-f9873f8ec790 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:16.810739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8f6e25f7-86e0-43d6-be6a-22eca9e8caff req-bc330706-4542-4479-ac9e-f9873f8ec790 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:16.833756 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8f6e25f7-86e0-43d6-be6a-22eca9e8caff req-bc330706-4542-4479-ac9e-f9873f8ec790 service nova] Creating event network-vif-plugged:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:53:16.855162 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8f6e25f7-86e0-43d6-be6a-22eca9e8caff req-bc330706-4542-4479-ac9e-f9873f8ec790 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091697 Jul 25 16:53:16.856475 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3169/6255] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:53:16.968501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:16.969348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:17.010100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:17.010557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:17.011344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:17.011778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:17.300972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:17.311582 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-52d3daea-6488-47dc-9748-dce53a15d891 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.346886 Jul 25 16:53:17.313466 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3087/6256] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:16 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:18.335115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:18.335851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:18.343699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:18.344254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:18.345597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:18.345597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:18.513207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:18.521609 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89b627ce-1077-45f6-8f31-b4a28dbe11b7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1396 microversion: 2.1 time: 0.191262 Jul 25 16:53:18.536710 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3170/6257] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:18 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1396 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:19.544843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:19.546318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:19.555357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:19.557257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:19.558423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:19.559531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:19.740650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:19.750759 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b1a4605d-e1df-4295-aff3-437abc461434 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1567 microversion: 2.1 time: 0.210201 Jul 25 16:53:19.769013 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3088/6258] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:19 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:19.775808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:19.776586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:19.785555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:19.786164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:19.787088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:19.787638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:20.074365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:20.092962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e8780ca-bdc8-45a3-83e9-3b1b22bcb188 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1567 microversion: 2.1 time: 0.321994 Jul 25 16:53:20.094350 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3171/6259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:19 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:22.629046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:53:22.630295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:22.645024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:22.646898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:22.648803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:22.649475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:22.650139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e62e0deb-46cd-4e41-b497-a036131e4b79 req-3a2b5e8a-766c-40ab-a1a9-10c93151198c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:53:22.662439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e62e0deb-46cd-4e41-b497-a036131e4b79 req-3a2b5e8a-766c-40ab-a1a9-10c93151198c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:22.663283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e62e0deb-46cd-4e41-b497-a036131e4b79 req-3a2b5e8a-766c-40ab-a1a9-10c93151198c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:22.678362 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e62e0deb-46cd-4e41-b497-a036131e4b79 req-3a2b5e8a-766c-40ab-a1a9-10c93151198c service nova] Creating event network-changed:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:53:22.692452 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e62e0deb-46cd-4e41-b497-a036131e4b79 req-3a2b5e8a-766c-40ab-a1a9-10c93151198c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045753 Jul 25 16:53:22.700523 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3172/6260] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:53:22.961452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:53:22.976477 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-430cbe38-59a2-4ebf-b207-f5c91585623e tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1567 microversion: 2.1 time: 0.351460 Jul 25 16:53:22.977777 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3089/6261] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:53:22 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:53:57.711384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:57.713390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=48 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:53:58.027185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:53:58.030146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:53:58.062190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:58.062662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:58.063478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:53:58.063928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:53:58.128946 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ce47c695-70d3-4af8-a42d-218983ff63ca tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5/action" status: 200 len: 24566 microversion: 2.1 time: 0.423630 Jul 25 16:53:58.129886 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3173/6262] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:53:57 2022] POST /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5/action => generated 24566 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:54:24.258843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=20 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:24.259629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=44 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:24.389479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1773396593", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "0e36fc54-08f7-4b17-9d43-84cbde073692"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:24.444670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] validate_networks() for [('0e36fc54-08f7-4b17-9d43-84cbde073692', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:54:24.829702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:54:24.830141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:54:24.830615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:54:24.831023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:54:24.831435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:54:24.841565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:24.842089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:24.842947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:24.843381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:24.862897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Getting quotas for project bc0044e3cc1149fbb428bd1334116d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:54:24.868504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Getting quotas for user 63f7c37bf3094411ae750bc799a2638b and project bc0044e3cc1149fbb428bd1334116d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:54:24.881570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:54:24.883847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:54:24.930360 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b16978dd-57de-40ac-bf67-5554ddeba7f7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.673252 Jul 25 16:54:24.937066 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3090/6263] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:54:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:54:24.942949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2edd15c1-9b93-4c1a-9330-0941558fe664 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:24.943665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2edd15c1-9b93-4c1a-9330-0941558fe664 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:24.946259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:24.946918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:25.151070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2edd15c1-9b93-4c1a-9330-0941558fe664 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:25.160403 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2edd15c1-9b93-4c1a-9330-0941558fe664 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1219 microversion: 2.1 time: 0.221909 Jul 25 16:54:25.161057 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3174/6264] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:24 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1219 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:26.182064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:26.183361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:26.189727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:26.190175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:26.190946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:26.191374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:26.266220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:26.274176 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c644eff-845b-4e0d-a8c6-85bd9df8a650 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1277 microversion: 2.1 time: 0.097033 Jul 25 16:54:26.275000 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3091/6265] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:26 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:27.295917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:27.296699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:27.304300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:27.304851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:27.305618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:27.306096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:27.416271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-4deb1642-ff9d-42ad-9aef-a0f32e8279cd req-f7a8d0d6-262d-4b34-9e96-c04f3fc37f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205410d8-28bb-4187-8d28-9dd1a6df4534", "tag": "152a6256-29e0-4076-8b71-d15042d0f840"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:27.429698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4deb1642-ff9d-42ad-9aef-a0f32e8279cd req-f7a8d0d6-262d-4b34-9e96-c04f3fc37f32 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:27.431040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-4deb1642-ff9d-42ad-9aef-a0f32e8279cd req-f7a8d0d6-262d-4b34-9e96-c04f3fc37f32 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:27.449261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-4deb1642-ff9d-42ad-9aef-a0f32e8279cd req-f7a8d0d6-262d-4b34-9e96-c04f3fc37f32 service nova] Creating event network-changed:152a6256-29e0-4076-8b71-d15042d0f840 for instance 205410d8-28bb-4187-8d28-9dd1a6df4534 on n-h2-846219-13 Jul 25 16:54:27.455355 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-4deb1642-ff9d-42ad-9aef-a0f32e8279cd req-f7a8d0d6-262d-4b34-9e96-c04f3fc37f32 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043159 Jul 25 16:54:27.456092 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3092/6266] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:54:27.571193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:27.579519 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e236f1b8-e6bb-4105-8e98-bfc7843b0ae7 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1319 microversion: 2.1 time: 0.287670 Jul 25 16:54:27.580026 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3175/6267] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:27 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:28.602080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:28.602676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:28.609010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:28.609503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:28.610285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:28.610973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:28.859669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:28.878713 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e4f0f9b3-29db-4c23-93ba-0e695a007ccd tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1319 microversion: 2.1 time: 0.282313 Jul 25 16:54:28.879830 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3093/6268] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:28 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:29.902063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:29.902763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:29.911424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:29.911905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:29.912693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:29.913183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:30.054041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:30.062138 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4e76b4d6-4bc5-4c70-8b65-0629b56e2ddf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1319 microversion: 2.1 time: 0.164212 Jul 25 16:54:30.062719 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3176/6269] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:29 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:31.082743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:31.083410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:31.090129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:31.090580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:31.091430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:31.091837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:31.235117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:31.243224 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ac869d32-00c1-4e38-9fa7-97969ca3ea20 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1319 microversion: 2.1 time: 0.164578 Jul 25 16:54:31.243789 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3094/6270] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:31 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:32.266672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:32.267326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:32.276188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:32.276939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:32.278214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:32.278650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:32.321023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6753bfc5-367d-433a-99de-8b8f4c49d32c req-63595690-d672-407f-8de7-cf2114e5fcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205410d8-28bb-4187-8d28-9dd1a6df4534", "name": "network-vif-plugged", "status": "completed", "tag": "152a6256-29e0-4076-8b71-d15042d0f840"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:32.334187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6753bfc5-367d-433a-99de-8b8f4c49d32c req-63595690-d672-407f-8de7-cf2114e5fcb1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:32.334632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6753bfc5-367d-433a-99de-8b8f4c49d32c req-63595690-d672-407f-8de7-cf2114e5fcb1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:32.356295 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6753bfc5-367d-433a-99de-8b8f4c49d32c req-63595690-d672-407f-8de7-cf2114e5fcb1 service nova] Creating event network-vif-plugged:152a6256-29e0-4076-8b71-d15042d0f840 for instance 205410d8-28bb-4187-8d28-9dd1a6df4534 on n-h2-846219-13 Jul 25 16:54:32.361976 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6753bfc5-367d-433a-99de-8b8f4c49d32c req-63595690-d672-407f-8de7-cf2114e5fcb1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048115 Jul 25 16:54:32.362926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3095/6271] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:54:32.517964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:32.527377 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ddbd50d-ac69-43a1-89ad-b2ef5418a1c4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1319 microversion: 2.1 time: 0.265263 Jul 25 16:54:32.528094 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3177/6272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:32 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:33.554185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:33.555014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:33.562764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:33.562764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:33.572309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:33.572309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:33.730460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:33.739981 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b7d8eb0d-10e0-46f9-bae3-69676dcfa34f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1319 microversion: 2.1 time: 0.190998 Jul 25 16:54:33.746175 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3096/6273] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:33 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:34.762032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:34.762672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:34.770362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:34.770827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:34.771623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:34.772076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:34.914764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:34.922644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-009e3a24-b957-4875-a903-74f0f0aae234 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1505 microversion: 2.1 time: 0.164713 Jul 25 16:54:34.923323 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3178/6274] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:34 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:34.942757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:34.943361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:34.946202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:34.946878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:34.952906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:34.953378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:34.954169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:34.954590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:35.107385 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:35.116638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-421d1847-a39e-46fb-8b2b-bb40797b029a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1505 microversion: 2.1 time: 0.177682 Jul 25 16:54:35.117322 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3097/6275] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:34 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:35.137773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:35.138330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:35.144681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:35.145180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:35.146075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:35.146528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:35.160482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:35.170947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lazy-loading 'flavor' on Instance uuid 205410d8-28bb-4187-8d28-9dd1a6df4534 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:54:35.250139 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6447c8de-2cdc-43f4-b4a6-649d71bad5e5 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action" status: 202 len: 0 microversion: 2.1 time: 0.116161 Jul 25 16:54:35.252200 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3179/6276] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:54:35 2022] POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:54:35.260126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:35.260890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:35.267884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:35.268647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:35.269710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:35.270327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:35.422885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:35.432420 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a7f8f56e-c828-4c2d-a9bb-2b32d45b9c0d tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1513 microversion: 2.1 time: 0.176243 Jul 25 16:54:35.433080 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3098/6277] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:35 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:54:36.453766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:36.454471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:36.462244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.462709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.463547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.464056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.611713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:36.622142 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8700d16f-98d2-4149-bf81-dc8a2f5899eb tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1496 microversion: 2.1 time: 0.172632 Jul 25 16:54:36.622791 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3180/6278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:36 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1496 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:36.642814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:36.643546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:36.651176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.651656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.652506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.652971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.728968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dbbbdb60-aa0b-4eab-8397-552ab8e9dccf tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action" status: 202 len: 0 microversion: 2.1 time: 0.090169 Jul 25 16:54:36.730109 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3099/6279] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:54:36 2022] POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:54:36.738219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:36.738881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:36.745874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.746357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.747359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.748151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.939042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "984a5010-f259-40b9-952b-c497908cc5d8"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:36.942646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:36.949919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.951332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.951847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:36.952877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:36.988899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:36.999479 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-197f16f6-1691-4cc3-b7b4-40697e44c1ec tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1502 microversion: 2.1 time: 0.262547 Jul 25 16:54:37.000307 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3181/6280] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:36 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:37.038181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:54:37.038996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:54:37.039669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:54:37.040294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:54:37.040924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:54:37.118346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:37.131756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:37.131893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:37.132856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:37.133427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:37.163829 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4fbae21a-47b6-4680-9765-588408e50451 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5/action" status: 202 len: 1140 microversion: 2.1 time: 0.229039 Jul 25 16:54:37.164677 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3100/6281] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:54:36 2022] POST /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5/action => generated 1140 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:54:37.183270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:37.183889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:37.190683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:37.191242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:37.192182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:37.192570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:37.795789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:37.804924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c471aa2-6039-4165-9aaa-33e7ff65f1c7 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.626088 Jul 25 16:54:37.805695 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3182/6282] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:37 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:38.020123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:38.020826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:38.028594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:38.029039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:38.029852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:38.030292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:38.183204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:38.191142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0b8120a4-00eb-41c8-b2c6-126cae1e9060 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1502 microversion: 2.1 time: 0.175003 Jul 25 16:54:38.191760 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3101/6283] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:38 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:38.827354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:38.828014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:38.836213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:38.837159 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:38.837972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:38.838432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:38.981543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:38.990713 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69dfd131-dc16-48e2-a358-0ca655ea519d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.167568 Jul 25 16:54:38.991296 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3183/6284] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:38 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:39.212207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:39.212825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:39.220038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:39.220455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:39.221294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:39.221706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:39.369165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:39.377507 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8486b49f-c789-4c4b-9dd0-409de5b96b80 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1505 microversion: 2.1 time: 0.169382 Jul 25 16:54:39.378305 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3102/6285] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:39 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:39.398617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:39.399170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:39.405461 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:39.405926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:39.406711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:39.407155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:39.432585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lazy-loading 'flavor' on Instance uuid 205410d8-28bb-4187-8d28-9dd1a6df4534 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:54:39.511153 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ecb1bf4-505f-4262-b428-8418a1395319 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action" status: 202 len: 0 microversion: 2.1 time: 0.116821 Jul 25 16:54:39.512010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3184/6286] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:54:39 2022] POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:54:39.521130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:39.521976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:39.528672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:39.529300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:39.530228 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:39.530946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:39.684031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:39.692018 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5ac9ea9a-cafd-4899-8fdb-99e845c65ed4 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1513 microversion: 2.1 time: 0.175295 Jul 25 16:54:39.692653 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3103/6287] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:39 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:40.013148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:40.013880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:40.023204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.023675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.024474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.024924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.180645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:40.191534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b89fe4c5-ab93-44e5-acf2-e252315840d6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.183141 Jul 25 16:54:40.193571 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3185/6288] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:40 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:40.713346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:40.713930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:40.721126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.721607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.722361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.722786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.868140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:40.876287 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7bd19f6a-9a41-4d55-85cb-b191df0af927 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1496 microversion: 2.1 time: 0.166914 Jul 25 16:54:40.876997 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3104/6289] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:40 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:40.897794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:40.898345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:40.905270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.905732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.906520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.906967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.976279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b170a75c-db57-418c-b817-894319e3735e tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action" status: 202 len: 0 microversion: 2.1 time: 0.081865 Jul 25 16:54:40.979998 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3186/6290] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:54:40 2022] POST /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:54:40.985271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:40.985890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:40.992044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.992810 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:40.993573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:40.994320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:41.014487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:41.216721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:41.217561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:41.218652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:41.231208 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f44ade49-11ab-4b02-ac39-2c4a7a238cf9 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1502 microversion: 2.1 time: 0.249947 Jul 25 16:54:41.232124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:41.232563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:41.245371 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3105/6291] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:40 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:41.246050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:41.246050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:41.269710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:41.491185 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:41.500227 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2413ba28-20fc-41ac-bd84-158b343b91ce tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.288924 Jul 25 16:54:41.500853 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3187/6292] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:41 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:42.255691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:42.256258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:42.264403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:42.264920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:42.265980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:42.266498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:42.410176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:42.418346 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4e82e597-1d1c-46cc-b103-ae4cabec42d3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1502 microversion: 2.1 time: 0.166963 Jul 25 16:54:42.419089 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3106/6293] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:42 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:42.522083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:42.522639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:42.530048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:42.530724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:42.531510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:42.531937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:42.667007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:42.677000 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-41b63e56-ff9c-43cf-b9cd-636739f68a1a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.159412 Jul 25 16:54:42.677759 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3188/6294] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:42 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:43.439925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:43.440559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:43.448024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.448470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.449275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.449705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.590998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:43.599803 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-deece1a5-d7fb-49f2-a884-635ee246510a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1505 microversion: 2.1 time: 0.163657 Jul 25 16:54:43.600406 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3107/6295] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:43 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:43.624241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:43.625278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:43.634403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.634867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.635715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.636238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.663814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:54:43.701924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:43.702615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:43.709699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.710361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.711480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.712131 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.753651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f7a6315-1c41-4d0e-94e5-d636cef894c8 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "DELETE /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 204 len: 0 microversion: 2.1 time: 0.134917 Jul 25 16:54:43.754546 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3189/6296] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:54:43 2022] DELETE /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:54:43.766759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:43.767478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:43.774200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.774661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.775450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:43.775894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:43.913696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:43.922171 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-551ef65d-189c-4a23-a4a3-ab47de2168b4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.224326 Jul 25 16:54:43.922770 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3108/6297] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:43 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:43.960463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:43.968291 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0535be55-fe34-4a44-8c0c-f5e7f060390f tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1511 microversion: 2.1 time: 0.205787 Jul 25 16:54:43.968881 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3190/6298] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:43 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:54:44.943835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:44.944645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:44.952221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:44.952672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:44.953527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:44.953920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:44.990222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:44.990857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:44.998695 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:44.999517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:45.000495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:45.001121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:45.154220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:45.165231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4899a351-2876-481f-b37e-808bbc9be3a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.225216 Jul 25 16:54:45.177945 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3109/6299] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:44 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:45.186614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:45.194850 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a982a5f2-4b9b-430f-a99c-1e26762d78a3 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1511 microversion: 2.1 time: 0.208657 Jul 25 16:54:45.195376 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3191/6300] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:44 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:46.144617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b3d70206-b362-4583-a7e0-771629d8ca8a req-c0f6e064-e791-4d39-b76c-efcef552bf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205410d8-28bb-4187-8d28-9dd1a6df4534", "name": "network-vif-deleted", "tag": "152a6256-29e0-4076-8b71-d15042d0f840"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:46.158970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b3d70206-b362-4583-a7e0-771629d8ca8a req-c0f6e064-e791-4d39-b76c-efcef552bf0f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:46.159417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b3d70206-b362-4583-a7e0-771629d8ca8a req-c0f6e064-e791-4d39-b76c-efcef552bf0f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:46.173275 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b3d70206-b362-4583-a7e0-771629d8ca8a req-c0f6e064-e791-4d39-b76c-efcef552bf0f service nova] Creating event network-vif-deleted:152a6256-29e0-4076-8b71-d15042d0f840 for instance 205410d8-28bb-4187-8d28-9dd1a6df4534 on n-h2-846219-13 Jul 25 16:54:46.178806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b3d70206-b362-4583-a7e0-771629d8ca8a req-c0f6e064-e791-4d39-b76c-efcef552bf0f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038630 Jul 25 16:54:46.181478 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3110/6301] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:54:46.186636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:46.187261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:46.194882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:46.196322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:46.197440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:46.198093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:46.217292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:46.218107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:46.225244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:46.226045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:46.226948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:46.227494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:46.267587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:46.268029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:46.269294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lazy-loading 'fault' on Instance uuid 205410d8-28bb-4187-8d28-9dd1a6df4534 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:54:46.324475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63f7c37bf3094411ae750bc799a2638b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0044e3cc1149fbb428bd1334116d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:46.332034 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d028633a-b062-4504-b609-e61d9eb3990a tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 200 len: 1309 microversion: 2.1 time: 0.119813 Jul 25 16:54:46.332681 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3111/6302] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:46 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:54:46.370251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:46.378077 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cded52c2-82cf-4454-9415-8bfffe2ef62a tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.195355 Jul 25 16:54:46.378738 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3192/6303] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:46 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:46.536582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2fa1e305-2d6c-4e23-9de6-5def645debaa tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Action: 'create', calling method: .version_select at 0x7f9d9282b790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2129785783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxj0twS+Gi7rljvWvYXSrCk3/0VXgxWYmt21GhbG3TrTluYeeACFOqLImUCVBtxXSGzI4wIqkLupoi/xRW/XIrdV3MSSOI8o80JjF+CxK/gDSDdIGeJs5RWvQ86Ds+E3w=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:46.553709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-2fa1e305-2d6c-4e23-9de6-5def645debaa tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Getting quotas for project 5ec7bb8034284356a85d6a1a0433ff74. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:54:46.560448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-2fa1e305-2d6c-4e23-9de6-5def645debaa tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Getting quotas for user b692ec2a32f7415b87569fc9cee2440f and project 5ec7bb8034284356a85d6a1a0433ff74. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:54:46.586302 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2fa1e305-2d6c-4e23-9de6-5def645debaa tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053571 Jul 25 16:54:46.587053 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3112/6304] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:54:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:54:47.354847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:47.355493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] [instance: 205410d8-28bb-4187-8d28-9dd1a6df4534] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:47.363551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:47.363994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:47.364818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:47.365310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:47.380401 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] HTTP exception thrown: Instance 205410d8-28bb-4187-8d28-9dd1a6df4534 could not be found. Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Request method failure captured: Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 HTTP/1.1 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sq-iFh9VMHkmnakTE3P2cCmefHObkUIc3B3h7ChxA5IbuZUwQmmgX-hdg0fUBGxJPzxNpMU7t_GL19k9pwODqJgaNawdXBv_0dZumJkGbK4o_mCNjCDj0_2gQGikCZZ985OSUsMXYO3InWxCaSw7_ulCfhlA8krF-k8oefPcGM_rho Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: bc0044e3cc1149fbb428bd1334116d2f Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestServerAdvancedOps-1636684731 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bc0044e3cc1149fbb428bd1334116d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/bc0044e3cc1149fbb428bd1334116d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/bc0044e3cc1149fbb428bd1334116d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_bc0044e3cc1149fbb428bd1334116d2f"}]}] Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestServerAdvancedOps-1636684731 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: bc0044e3cc1149fbb428bd1334116d2f Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestServerAdvancedOps-1636684731 Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestServerAdvancedOps-1636684731-project Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 63f7c37bf3094411ae750bc799a2638b Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestServerAdvancedOps-1636684731-project Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 205410d8-28bb-4187-8d28-9dd1a6df4534 could not be found. Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '205410d8-28bb-4187-8d28-9dd1a6df4534'} Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205410d8-28bb-4187-8d28-9dd1a6df4534 could not be found. Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205410d8-28bb-4187-8d28-9dd1a6df4534 could not be found. Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:54:47.382141 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205410d8-28bb-4187-8d28-9dd1a6df4534 could not be found. Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] Returning 404 to user: Instance 205410d8-28bb-4187-8d28-9dd1a6df4534 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d7014566-51df-4515-b8c4-d61d856df970 tempest-TestServerAdvancedOps-1636684731 tempest-TestServerAdvancedOps-1636684731-project] 10.222.0.105 "GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534" status: 404 len: 111 microversion: 2.1 time: 0.033042 Jul 25 16:54:47.387303 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3193/6305] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:47 2022] GET /compute/v2.1/servers/205410d8-28bb-4187-8d28-9dd1a6df4534 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:54:47.400872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:47.401901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:47.408001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:47.408530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:47.409398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:47.409897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:47.551036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:47.558889 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40a515bc-045d-4561-b0fc-d1444bcc00a8 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.162928 Jul 25 16:54:47.559698 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3113/6306] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:47 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:47.799138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1728086845", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7c0e1454-0cd0-4e92-8f09-31a683705cdd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2129785783", "security_groups": [{"name": "tempest-secgroup-smoke-101854570"}], "networks": [{"uuid": "1f2433e4-bd5f-4438-93d3-ed40f8dcb588"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:47.916805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] validate_networks() for [('1f2433e4-bd5f-4438-93d3-ed40f8dcb588', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:54:48.501032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:54:48.501669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:54:48.501975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:54:48.502405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:54:48.502870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:54:48.512631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:48.513149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:48.514061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:48.514569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:48.533191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Getting quotas for project 5ec7bb8034284356a85d6a1a0433ff74. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:54:48.538840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Getting quotas for user b692ec2a32f7415b87569fc9cee2440f and project 5ec7bb8034284356a85d6a1a0433ff74. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:54:48.580674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:48.581475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:48.589800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:48.590236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:48.591070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:48.591532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:48.606186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:54:48.608374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c0e1454-0cd0-4e92-8f09-31a683705cdd',volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:54:48.764206 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:48.772833 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d0ba9c71-3cb2-4111-81f1-8574a8c54f14 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.196163 Jul 25 16:54:48.777563 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3114/6307] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:48 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:54:48.804168 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4439c4a5-6e66-4696-8d6e-377637e6d881 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.008840 Jul 25 16:54:48.804947 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3194/6308] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:54:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:54:48.819820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2982081-0e71-41ce-b3bb-d0006d726040 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:48.820441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2982081-0e71-41ce-b3bb-d0006d726040 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:48.897296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2982081-0e71-41ce-b3bb-d0006d726040 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:48.905885 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2982081-0e71-41ce-b3bb-d0006d726040 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1102 microversion: 2.1 time: 0.091547 Jul 25 16:54:48.906990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3115/6309] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:48 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1102 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:49.800004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:49.801593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:49.836759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:49.837516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:49.838502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:49.839117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:49.931081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:49.939146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:49.957265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:49.957801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:49.958627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:49.959070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:50.059859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:50.077220 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9121dd29-5e58-4d62-aa8e-e99f6dcd6a95 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.282032 Jul 25 16:54:50.078205 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3195/6310] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:49 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:50.099329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:50.108195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ef4f93f-7727-4bc9-95d9-0ba79e342a23 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1218 microversion: 2.1 time: 0.184217 Jul 25 16:54:50.108878 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3116/6311] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:49 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:51.099488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:51.101508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:51.109939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:51.110803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:51.112224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:51.113156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:51.135449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:51.136762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:51.149345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:51.150049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:51.151065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:51.155421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:51.494290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:51.506048 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13265814-5d60-4e50-ab92-e50846513e6f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.410441 Jul 25 16:54:51.506667 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3196/6312] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:51 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:51.545897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:51.561384 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aacb365c-203f-4699-a0ad-105ba1e1f12b tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1285 microversion: 2.1 time: 0.427421 Jul 25 16:54:51.578417 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3117/6313] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:51 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1285 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:54:51.890939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8a181801-a4ea-4061-b491-9a13dc041ef1 req-b2b6a854-3244-42ed-a9eb-5c65daca0c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:54:51.919118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8a181801-a4ea-4061-b491-9a13dc041ef1 req-b2b6a854-3244-42ed-a9eb-5c65daca0c86 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:51.922867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8a181801-a4ea-4061-b491-9a13dc041ef1 req-b2b6a854-3244-42ed-a9eb-5c65daca0c86 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:51.956811 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8a181801-a4ea-4061-b491-9a13dc041ef1 req-b2b6a854-3244-42ed-a9eb-5c65daca0c86 service nova] Creating event network-changed:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:54:51.966016 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8a181801-a4ea-4061-b491-9a13dc041ef1 req-b2b6a854-3244-42ed-a9eb-5c65daca0c86 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080402 Jul 25 16:54:51.967214 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3197/6314] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:54:52.528410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:52.529049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:52.538811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:52.539259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:52.540042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:52.540478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:52.586465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:52.587203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:52.597985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:52.599529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:52.600364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:52.601143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:52.904871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:52.935683 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3af8b4db-a0e7-48e1-b6f3-c9a4dfd092e6 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.411135 Jul 25 16:54:52.936454 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3118/6315] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:52 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:53.021331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:53.034112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3a34d70-004f-42dc-8633-db0305f8d977 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1285 microversion: 2.1 time: 0.451778 Jul 25 16:54:53.034985 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3198/6316] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:52 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1285 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:53.958983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:53.960300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:53.968399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:53.969285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:53.985236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:53.985873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:54.068472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:54.069230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:54.078489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:54.079412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:54.080480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:54.081196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:54.310184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:54.322218 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c0c15f9b-e329-4760-97a2-2b6ea4e06e39 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1285 microversion: 2.1 time: 0.264798 Jul 25 16:54:54.326125 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3199/6317] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:54 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:54.347229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:54.362636 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-05a5e48e-94dd-4c49-b11b-017d34dfe11f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1694 microversion: 2.1 time: 0.408585 Jul 25 16:54:54.363531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3119/6318] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:53 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1694 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:55.344085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:55.346400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:55.353963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:55.357576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:55.358330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:55.359382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:55.360760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:55.384970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:55.386742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:55.395881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:55.401858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:55.404710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:55.408747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:55.411333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:55.724861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:55.733968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:55.739788 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fd500526-9960-45ea-a954-08d3a0d92cb2 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1700 microversion: 2.1 time: 0.357406 Jul 25 16:54:55.742377 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3120/6319] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:55 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1700 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:54:55.753423 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-97a70d4e-5534-488e-8537-6ed0ee3c6c21 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1285 microversion: 2.1 time: 0.404727 Jul 25 16:54:55.753423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3200/6320] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:55 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1285 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:56.766318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:56.766846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:56.767266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:56.769237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:56.775645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:56.776104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:56.776920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:56.777405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:56.777558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:56.777949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:56.779167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:56.779614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:57.011381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:57.013062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:57.023790 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2fb45778-e1ed-47c1-a155-e932bd6e24c0 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1700 microversion: 2.1 time: 0.261522 Jul 25 16:54:57.024197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef02cb98-0753-48ac-bc26-2924fde1ae29 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.261926 Jul 25 16:54:57.024586 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3201/6321] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:56 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1700 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:57.025274 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3121/6322] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:56 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:58.047521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:58.052458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:58.053875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:58.054943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:58.077974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:58.078704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:58.079427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:58.080434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:58.081192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:58.084578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:58.084787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:58.087798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:58.435646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:58.443824 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-96da7034-bedc-4693-abe7-f0967fd540aa tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1700 microversion: 2.1 time: 0.400060 Jul 25 16:54:58.444428 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3122/6323] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:58 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1700 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:58.467505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:58.476663 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-63485800-6923-4de0-8f4d-c833a61d4146 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.434154 Jul 25 16:54:58.490214 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3202/6324] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:58 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:59.466319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:59.467544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:59.480514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:59.485681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:59.486767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:59.488291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:59.488930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:59.499658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:54:59.502117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:54:59.520835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:59.521651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:54:59.529452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:59.533772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:59.534915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:54:59.535908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:54:59.818151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:59.835273 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f80a4e2-cb2f-4339-bd40-95de35975cd6 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.338008 Jul 25 16:54:59.837078 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3203/6325] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:59 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:54:59.859890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:54:59.873785 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b7e07d8-ecf2-42f6-854b-69be6cf58f0d tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1685 microversion: 2.1 time: 0.411783 Jul 25 16:54:59.875108 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3123/6326] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:54:59 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1685 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:00.142108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-cb3de7d3-057f-4762-afb0-f1f7a6dfec30 req-b363d6be-bd0c-4e43-a8cc-da2181614870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "name": "network-vif-unplugged", "status": "completed", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:00.160347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cb3de7d3-057f-4762-afb0-f1f7a6dfec30 req-b363d6be-bd0c-4e43-a8cc-da2181614870 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:00.160804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cb3de7d3-057f-4762-afb0-f1f7a6dfec30 req-b363d6be-bd0c-4e43-a8cc-da2181614870 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:00.165076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:00.198237 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-cb3de7d3-057f-4762-afb0-f1f7a6dfec30 req-b363d6be-bd0c-4e43-a8cc-da2181614870 service nova] Creating event network-vif-unplugged:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:55:00.216292 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-cb3de7d3-057f-4762-afb0-f1f7a6dfec30 req-b363d6be-bd0c-4e43-a8cc-da2181614870 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077690 Jul 25 16:55:00.216957 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3204/6327] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:00.885989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:00.888523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:00.900924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:00.902934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:00.905741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:00.906363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:00.934234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:01.096281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:01.106509 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c707beab-3adf-47e7-a9c4-7d1aa5e38e6f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.252410 Jul 25 16:55:01.107861 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3124/6328] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:00 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:01.931950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4569e296-e789-45eb-b053-834e934d2308 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Action: 'create', calling method: .version_select at 0x7f9d92a49f70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1246564788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxabcOIu1Od1A+vlB7i9EqSxDwCMBeRaqxQ6b/HSjSkV82Hy8PSWdZPns9x9isido87YDimdwCSyVlSAh3+ywoPsK3pAnkWnr2JxCSW+zB5iD1JlN4eYEtv2wugIdJePw=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:01.951979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4569e296-e789-45eb-b053-834e934d2308 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Getting quotas for project 617450f0bedd49c0af29b7c814be15bf. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:55:01.960111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-4569e296-e789-45eb-b053-834e934d2308 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Getting quotas for user 10492024296d445aad69edfaf87f6407 and project 617450f0bedd49c0af29b7c814be15bf. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:55:01.990992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4569e296-e789-45eb-b053-834e934d2308 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.249412 Jul 25 16:55:01.991920 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3205/6329] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 16:55:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:02.129627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:02.130855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:02.138635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:02.139130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:02.139890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:02.140523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:02.326510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:02.336155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20d09563-c401-416c-ba35-52b63d0335e7 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.210816 Jul 25 16:55:02.337696 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3125/6330] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:02 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:03.138650 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1982533036", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1246564788", "security_groups": [{"name": "tempest-secgroup-smoke-1989323267"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "1a5db048-9eca-47c6-92f0-f9fb4af5196b"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:03.271184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] validate_networks() for [('1a5db048-9eca-47c6-92f0-f9fb4af5196b', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:55:03.361151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:03.361816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:03.370766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:03.372001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:03.372689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:03.373145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:03.689499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:03.700172 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-54bf543a-879e-40b9-acda-38aaa2370628 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.344163 Jul 25 16:55:03.713801 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3126/6331] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:03 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:55:03.734467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-7564d027-bf40-4a1a-83f4-1773c239f0bc req-997f350e-6f08-41f3-a819-2af3e3c2d775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "name": "network-vif-plugged", "status": "completed", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:03.745374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7564d027-bf40-4a1a-83f4-1773c239f0bc req-997f350e-6f08-41f3-a819-2af3e3c2d775 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:03.746108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-7564d027-bf40-4a1a-83f4-1773c239f0bc req-997f350e-6f08-41f3-a819-2af3e3c2d775 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:03.760175 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-7564d027-bf40-4a1a-83f4-1773c239f0bc req-997f350e-6f08-41f3-a819-2af3e3c2d775 service nova] Creating event network-vif-plugged:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:55:03.765607 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-7564d027-bf40-4a1a-83f4-1773c239f0bc req-997f350e-6f08-41f3-a819-2af3e3c2d775 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034551 Jul 25 16:55:03.766874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3127/6332] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:03.886240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Getting quotas for project 617450f0bedd49c0af29b7c814be15bf. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:55:03.892474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Getting quotas for user 10492024296d445aad69edfaf87f6407 and project 617450f0bedd49c0af29b7c814be15bf. Resources: dict_keys(['metadata_items']) {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:55:03.912364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:55:03.912899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:55:03.913488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:55:03.914127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:55:03.914660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:55:03.923707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:03.924167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:03.924980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:03.925466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:03.943047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Getting quotas for project 617450f0bedd49c0af29b7c814be15bf. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:55:03.948743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Getting quotas for user 10492024296d445aad69edfaf87f6407 and project 617450f0bedd49c0af29b7c814be15bf. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:55:03.962301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:55:03.964867 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:55:04.014577 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-904f5617-4738-4997-951a-83d833067d7d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.879928 Jul 25 16:55:04.015525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3206/6333] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 16:55:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 16:55:04.027125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35ae30d4-bf81-4fd3-9ac3-a53c3c5b170e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:04.027840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35ae30d4-bf81-4fd3-9ac3-a53c3c5b170e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:04.102273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35ae30d4-bf81-4fd3-9ac3-a53c3c5b170e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:04.110046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35ae30d4-bf81-4fd3-9ac3-a53c3c5b170e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1307 microversion: 2.1 time: 0.087135 Jul 25 16:55:04.110811 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3128/6334] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:04 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:04.723350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:04.723914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:04.732204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:04.732952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:04.733965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:04.734418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:04.897399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:04.905798 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ed81659d-11aa-4d4d-aa06-473c38768329 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.188098 Jul 25 16:55:04.906630 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3207/6335] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:04 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:05.132123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:05.133460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:05.141734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:05.142154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:05.142959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:05.143395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:05.209197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:05.217358 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a98c6af-3047-40b9-b128-8527ed07c0b1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1359 microversion: 2.1 time: 0.089170 Jul 25 16:55:05.218009 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3129/6336] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:05 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1359 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:05.926714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:05.927429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:05.935368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:05.935871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:05.936901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:05.937398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:06.087226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:06.096145 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f851f21-0680-45fd-86f6-f541602dab18 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.173542 Jul 25 16:55:06.096873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3208/6337] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:05 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:06.245512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:06.247474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:06.263783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:06.265063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:06.266156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:06.266996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:06.460081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:06.474707 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc1320e4-a4db-48bb-83c2-4fc55b7bead5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.236280 Jul 25 16:55:06.476293 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3130/6338] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:06 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:06.489220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c46be22d-7a90-42d3-bea8-a294c0a2e180 req-060f6708-8f46-4dec-9059-b7594378de19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "name": "network-vif-plugged", "status": "completed", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:06.509887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c46be22d-7a90-42d3-bea8-a294c0a2e180 req-060f6708-8f46-4dec-9059-b7594378de19 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:06.510529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c46be22d-7a90-42d3-bea8-a294c0a2e180 req-060f6708-8f46-4dec-9059-b7594378de19 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:06.526882 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c46be22d-7a90-42d3-bea8-a294c0a2e180 req-060f6708-8f46-4dec-9059-b7594378de19 service nova] Creating event network-vif-plugged:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:55:06.533999 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c46be22d-7a90-42d3-bea8-a294c0a2e180 req-060f6708-8f46-4dec-9059-b7594378de19 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051078 Jul 25 16:55:06.535819 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3209/6339] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:06.905013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6405de69-b19f-4b0c-bb4f-5b843aa7d637 req-afc0c6b0-8a56-4150-a51e-3b9c9533bc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8825f9fe-bba3-42b6-a550-99429884ea01", "tag": "26792aa2-e039-438d-8c89-4cf8cf4002a6"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:06.928570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6405de69-b19f-4b0c-bb4f-5b843aa7d637 req-afc0c6b0-8a56-4150-a51e-3b9c9533bc56 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:06.929013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6405de69-b19f-4b0c-bb4f-5b843aa7d637 req-afc0c6b0-8a56-4150-a51e-3b9c9533bc56 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:06.943617 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6405de69-b19f-4b0c-bb4f-5b843aa7d637 req-afc0c6b0-8a56-4150-a51e-3b9c9533bc56 service nova] Creating event network-changed:26792aa2-e039-438d-8c89-4cf8cf4002a6 for instance 8825f9fe-bba3-42b6-a550-99429884ea01 on n-h1-846219-13 Jul 25 16:55:06.950610 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6405de69-b19f-4b0c-bb4f-5b843aa7d637 req-afc0c6b0-8a56-4150-a51e-3b9c9533bc56 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051953 Jul 25 16:55:06.951332 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3131/6340] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:07.119800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:07.121522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:07.131033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:07.132370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:07.133238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:07.134233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:07.292429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:07.303779 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6696a589-bc0d-4660-a0fb-6499385e5cbb tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1273 microversion: 2.1 time: 0.189373 Jul 25 16:55:07.304975 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3210/6341] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:07 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:07.503286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:07.506557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:07.516180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:07.517250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:07.518240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:07.520395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:07.718459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:07.728949 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-01cd72c2-af3c-44e6-b523-2fdb48d2ed38 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.235142 Jul 25 16:55:07.730722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3132/6342] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:07 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:08.325903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:08.326509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:08.334202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:08.334674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:08.335474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:08.335932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:08.480216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:08.488083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5322a542-155e-40ca-add3-904c5062e5a1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1463 microversion: 2.1 time: 0.166298 Jul 25 16:55:08.488656 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3211/6343] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:08 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1463 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:08.509369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:08.510620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:08.518491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:08.518929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:08.519731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:08.520155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:08.665983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:08.676796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21ce746f-6df7-49cd-ac3e-968fdf4d9636 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1463 microversion: 2.1 time: 0.171703 Jul 25 16:55:08.677421 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3133/6344] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:08 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:08.750587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:08.751212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:08.757542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:08.758007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:08.758795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:08.759244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:08.938082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:08.946697 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-106263b2-1188-40b9-864f-ee9829eb438d tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.199836 Jul 25 16:55:08.947076 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3212/6345] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:08 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:09.967200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:09.967876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:09.975546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:09.975982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:09.976743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:09.977197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:10.122523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:10.130732 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-600a2eab-5e06-48e1-b1c6-94a26f3ef8b8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.167607 Jul 25 16:55:10.131358 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3134/6346] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:09 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:11.152137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:11.152712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:11.160455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:11.160999 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:11.161914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:11.162404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:11.307294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-b401a02a-0eaa-4baa-839b-d1e09229513b req-536090e3-d96e-4aaa-90ab-aaf858a61a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:11.319608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:11.322330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b401a02a-0eaa-4baa-839b-d1e09229513b req-536090e3-d96e-4aaa-90ab-aaf858a61a5d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:11.323109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-b401a02a-0eaa-4baa-839b-d1e09229513b req-536090e3-d96e-4aaa-90ab-aaf858a61a5d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:11.328986 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75ed62f1-aef7-4bad-b961-c70df378acc5 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.180920 Jul 25 16:55:11.330204 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3213/6347] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:11 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:11.335457 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-b401a02a-0eaa-4baa-839b-d1e09229513b req-536090e3-d96e-4aaa-90ab-aaf858a61a5d service nova] Creating event network-changed:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:55:11.340684 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-b401a02a-0eaa-4baa-839b-d1e09229513b req-536090e3-d96e-4aaa-90ab-aaf858a61a5d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037678 Jul 25 16:55:11.341927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3135/6348] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:12.351330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:12.352729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:12.361917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:12.362439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:12.363498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:12.364285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:12.727025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:12.736522 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f52efa71-21a4-448f-9e87-0d0140ccdcdb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.390037 Jul 25 16:55:12.737432 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3214/6349] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:12 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:13.109268 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d1967cf3-c4fc-4b05-9732-ff3b76302947 req-efe66685-cdf1-49ba-b985-55f7f132ce4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:13.121468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d1967cf3-c4fc-4b05-9732-ff3b76302947 req-efe66685-cdf1-49ba-b985-55f7f132ce4d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:13.121910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d1967cf3-c4fc-4b05-9732-ff3b76302947 req-efe66685-cdf1-49ba-b985-55f7f132ce4d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:13.133533 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d1967cf3-c4fc-4b05-9732-ff3b76302947 req-efe66685-cdf1-49ba-b985-55f7f132ce4d service nova] Creating event network-changed:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:55:13.138876 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d1967cf3-c4fc-4b05-9732-ff3b76302947 req-efe66685-cdf1-49ba-b985-55f7f132ce4d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034004 Jul 25 16:55:13.139674 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3136/6350] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:13.736563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-58df3049-2736-497c-8bb6-8e77f8fe4f63 req-90235601-5eab-43c5-ac43-4800ade59009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8825f9fe-bba3-42b6-a550-99429884ea01", "name": "network-vif-plugged", "status": "completed", "tag": "26792aa2-e039-438d-8c89-4cf8cf4002a6"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:13.746908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-58df3049-2736-497c-8bb6-8e77f8fe4f63 req-90235601-5eab-43c5-ac43-4800ade59009 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:13.747363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-58df3049-2736-497c-8bb6-8e77f8fe4f63 req-90235601-5eab-43c5-ac43-4800ade59009 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:13.759120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:13.759818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:13.766374 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-58df3049-2736-497c-8bb6-8e77f8fe4f63 req-90235601-5eab-43c5-ac43-4800ade59009 service nova] Creating event network-vif-plugged:26792aa2-e039-438d-8c89-4cf8cf4002a6 for instance 8825f9fe-bba3-42b6-a550-99429884ea01 on n-h1-846219-13 Jul 25 16:55:13.767000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:13.767333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:13.768212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:13.768637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:13.772011 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-58df3049-2736-497c-8bb6-8e77f8fe4f63 req-90235601-5eab-43c5-ac43-4800ade59009 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039294 Jul 25 16:55:13.772813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3215/6351] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:13.924705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:13.935068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ce51c114-dd2a-4b00-b9b2-685c2c4a8548 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.180467 Jul 25 16:55:13.935811 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3137/6352] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:13 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:14.953539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:14.954416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:14.960118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:14.960756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:14.969113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:14.969595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:14.970518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:14.970997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:15.116485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:15.126161 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6bb2136c-2e5c-4855-93a7-e307cf5b1f5e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1433 microversion: 2.1 time: 0.173609 Jul 25 16:55:15.126771 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3216/6353] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:14 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1433 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:15.155702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8b49fa2d-25e6-4afa-9c74-2dfe0d83a1ce req-c618e965-9391-4417-af9d-19db71246bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:15.162019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:15.168983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8b49fa2d-25e6-4afa-9c74-2dfe0d83a1ce req-c618e965-9391-4417-af9d-19db71246bad service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:15.169421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8b49fa2d-25e6-4afa-9c74-2dfe0d83a1ce req-c618e965-9391-4417-af9d-19db71246bad service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:15.180382 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8b49fa2d-25e6-4afa-9c74-2dfe0d83a1ce req-c618e965-9391-4417-af9d-19db71246bad service nova] Creating event network-changed:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:55:15.185487 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8b49fa2d-25e6-4afa-9c74-2dfe0d83a1ce req-c618e965-9391-4417-af9d-19db71246bad service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035303 Jul 25 16:55:15.186094 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3138/6354] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:16.147536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:16.148130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:16.155667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:16.156127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:16.156901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:16.157380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:16.297598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:16.306118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f0b2e2a-7c5f-4689-9e30-294c44234e87 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1613 microversion: 2.1 time: 0.162543 Jul 25 16:55:16.306702 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3217/6355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:16 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:16.326796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:16.327428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:16.334926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:16.335383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:16.336140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:16.336568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:16.502103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:16.513181 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41160d9d-13de-4ebb-aaa6-92f9f204aae8 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1613 microversion: 2.1 time: 0.190329 Jul 25 16:55:16.514026 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3139/6356] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:16 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1613 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:16.534918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:16.535642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:16.541983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:16.542450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:16.543258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:16.543945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:16.701452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:16.714200 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-23db0c6a-3a79-4b92-97f7-c40662d527f9 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1613 microversion: 2.1 time: 0.182917 Jul 25 16:55:16.715045 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3218/6357] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:16 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1613 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:18.494025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f0fd58f5-b380-40b0-ad0b-537215464406 req-619e24cd-8f59-481c-ad00-81e229704301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8825f9fe-bba3-42b6-a550-99429884ea01", "tag": "26792aa2-e039-438d-8c89-4cf8cf4002a6"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:18.504580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f0fd58f5-b380-40b0-ad0b-537215464406 req-619e24cd-8f59-481c-ad00-81e229704301 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:18.505213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f0fd58f5-b380-40b0-ad0b-537215464406 req-619e24cd-8f59-481c-ad00-81e229704301 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:18.516953 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f0fd58f5-b380-40b0-ad0b-537215464406 req-619e24cd-8f59-481c-ad00-81e229704301 service nova] Creating event network-changed:26792aa2-e039-438d-8c89-4cf8cf4002a6 for instance 8825f9fe-bba3-42b6-a550-99429884ea01 on n-h1-846219-13 Jul 25 16:55:18.522232 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f0fd58f5-b380-40b0-ad0b-537215464406 req-619e24cd-8f59-481c-ad00-81e229704301 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032093 Jul 25 16:55:18.522866 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3140/6358] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:38.182509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:38.184881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:38.187715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:38.188430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=66 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:38.195473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:38.195950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:38.196759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:38.197383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:38.270721 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3b7669f-4a45-45b9-baf2-7cd5052559f4 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "POST /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5/action" status: 200 len: 24569 microversion: 2.1 time: 0.092120 Jul 25 16:55:38.271381 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3219/6359] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 16:55:38 2022] POST /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:55:47.121168 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:55:47.127540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1a80114b-060f-4a14-b80d-9ce48fe2b451 req-8941186a-b863-47e3-8222-63281eed677c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:47.135259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=43 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:47.136036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=68 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:55:47.139909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1a80114b-060f-4a14-b80d-9ce48fe2b451 req-8941186a-b863-47e3-8222-63281eed677c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:47.140487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1a80114b-060f-4a14-b80d-9ce48fe2b451 req-8941186a-b863-47e3-8222-63281eed677c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:47.141076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:47.141928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:47.149302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:47.149763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:47.150604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:47.150972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:47.153573 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1a80114b-060f-4a14-b80d-9ce48fe2b451 req-8941186a-b863-47e3-8222-63281eed677c service nova] Creating event network-changed:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:55:47.159650 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1a80114b-060f-4a14-b80d-9ce48fe2b451 req-8941186a-b863-47e3-8222-63281eed677c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036237 Jul 25 16:55:47.160363 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3220/6360] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:55:47.180155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:55:47.271608 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0dcfd2d5-7016-4040-b502-c8df9e225427 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "DELETE /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 204 len: 0 microversion: 2.1 time: 0.151628 Jul 25 16:55:47.273397 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3141/6361] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:55:47 2022] DELETE /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:55:47.282863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:47.284011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:47.290890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:47.291202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:47.292270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:47.292718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:47.463704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:47.473715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a0deb342-c2cb-4296-bee2-eb64a2707f9f tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1587 microversion: 2.1 time: 0.195432 Jul 25 16:55:47.475055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3221/6362] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:47 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1587 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:48.498912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:48.499648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:48.511303 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 45710. Jul 25 16:55:48.515377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:48.515813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:48.516616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:48.517063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:48.728381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:48.737680 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f0eef75e-5992-48e8-88ed-066e9bf811fc tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1587 microversion: 2.1 time: 0.242982 Jul 25 16:55:48.738286 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3142/6363] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:48 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1587 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:49.760130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:49.760823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:49.778666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:49.778902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:49.779936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:49.780414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:49.848812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-89e9b52c-4879-43fe-8ec5-c3b10d34a3fc req-2629ba73-3c20-4971-8720-e6a56b0004e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db783112-64b0-4177-9fef-72e20ba059a5", "name": "network-vif-deleted", "tag": "e16ecf73-2db7-4d3a-bda2-d45126d6dd7a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:55:49.861510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-89e9b52c-4879-43fe-8ec5-c3b10d34a3fc req-2629ba73-3c20-4971-8720-e6a56b0004e1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:49.862368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-89e9b52c-4879-43fe-8ec5-c3b10d34a3fc req-2629ba73-3c20-4971-8720-e6a56b0004e1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:49.868174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:49.875035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-89e9b52c-4879-43fe-8ec5-c3b10d34a3fc req-2629ba73-3c20-4971-8720-e6a56b0004e1 service nova] Creating event network-vif-deleted:e16ecf73-2db7-4d3a-bda2-d45126d6dd7a for instance db783112-64b0-4177-9fef-72e20ba059a5 on n-h2-846219-13 Jul 25 16:55:49.879292 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-19cd9095-dbcd-44e2-8fd1-1853faa2bf0d tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1402 microversion: 2.1 time: 0.123121 Jul 25 16:55:49.879974 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3222/6364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:49 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:49.880128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-89e9b52c-4879-43fe-8ec5-c3b10d34a3fc req-2629ba73-3c20-4971-8720-e6a56b0004e1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Jul 25 16:55:49.880667 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3143/6365] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:55:50.901362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:50.902022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:50.909809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:50.910306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:50.911127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:50.911557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:50.976333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:50.984379 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4270dd4e-88df-4387-be16-273dd0aeafe2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1233 microversion: 2.1 time: 0.087116 Jul 25 16:55:50.984962 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3223/6366] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:50 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:52.007153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:52.008033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:52.014711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:52.015136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:52.015940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:52.016407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:52.084590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:52.093043 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7c0df743-0228-4bfc-8f19-e4c05e825a41 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1233 microversion: 2.1 time: 0.091050 Jul 25 16:55:52.093728 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3144/6367] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:52 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:53.115609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:53.116523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:53.126577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:53.127176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:53.128111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:53.128658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:53.195252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:53.203467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-838611c7-64dc-48b7-ad66-187ad89d82f2 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1233 microversion: 2.1 time: 0.092379 Jul 25 16:55:53.204211 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3224/6368] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:53 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1233 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:54.227295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:54.227873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:54.242550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:54.243136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:54.243978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:54.244416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:54.539625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:54.540058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:54.540508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lazy-loading 'fault' on Instance uuid db783112-64b0-4177-9fef-72e20ba059a5 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:55:54.587397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b692ec2a32f7415b87569fc9cee2440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec7bb8034284356a85d6a1a0433ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:55:54.594639 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8765ca7-58f4-4199-8111-88bf8d59fe83 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 200 len: 1192 microversion: 2.1 time: 0.373496 Jul 25 16:55:54.595213 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3145/6369] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:54 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 1192 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:55:55.617165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:55.617964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] [instance: db783112-64b0-4177-9fef-72e20ba059a5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:55:55.627517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:55.627973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:55.628818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:55:55.629226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:55:55.643016 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] HTTP exception thrown: Instance db783112-64b0-4177-9fef-72e20ba059a5 could not be found. Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Request method failure captured: Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 HTTP/1.1 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3so8sfbO7eXqUXeJBs3fT5IStptezlM_k3AocJrU66FY1b3AIesWkX6vP609Ts1uX7KOuzocJ9WZvz-8drwUc6G3plUfdsOBnyXj1-KgCUXKOuVCPw7E05YwcWctXYHKCp7elwjQIoLIdo88gsw7OU1LgRFxd7jbE6N0p7WzY0wyLn8 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5ec7bb8034284356a85d6a1a0433ff74 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestVolumeBackupRestore-1630196677 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5ec7bb8034284356a85d6a1a0433ff74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5ec7bb8034284356a85d6a1a0433ff74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5ec7bb8034284356a85d6a1a0433ff74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5ec7bb8034284356a85d6a1a0433ff74"}]}] Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestVolumeBackupRestore-1630196677 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5ec7bb8034284356a85d6a1a0433ff74 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1630196677 Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestVolumeBackupRestore-1630196677-project Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b692ec2a32f7415b87569fc9cee2440f Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestVolumeBackupRestore-1630196677-project Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance db783112-64b0-4177-9fef-72e20ba059a5 could not be found. Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'db783112-64b0-4177-9fef-72e20ba059a5'} Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db783112-64b0-4177-9fef-72e20ba059a5 could not be found. Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db783112-64b0-4177-9fef-72e20ba059a5 could not be found. Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:55:55.644627 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db783112-64b0-4177-9fef-72e20ba059a5 could not be found. Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Returning 404 to user: Instance db783112-64b0-4177-9fef-72e20ba059a5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e7154108-1768-43cf-8e08-0222ed07fae1 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5" status: 404 len: 111 microversion: 2.1 time: 0.033799 Jul 25 16:55:55.649696 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3225/6370] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:55:55 2022] GET /compute/v2.1/servers/db783112-64b0-4177-9fef-72e20ba059a5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:55:55.822638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c4abb2a9-c674-4f4a-a701-1f4a72354c35 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] Calling method '.version_select at 0x7f9d9275f820>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:55:55.844580 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c4abb2a9-c674-4f4a-a701-1f4a72354c35 tempest-TestVolumeBackupRestore-1630196677 tempest-TestVolumeBackupRestore-1630196677-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2129785783" status: 202 len: 0 microversion: 2.1 time: 0.025792 Jul 25 16:55:55.849341 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3146/6371] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 16:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2129785783 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:56:18.467074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:56:18.468602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:56:18.471905 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:18.472825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:56:18.478314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=14 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:56:18.478764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=32 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:56:18.484072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:18.484634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:18.485740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:18.486396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:18.523259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:56:18.614114 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-44c9d1df-819e-4b03-b53d-f68a6afc67dc tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 204 len: 0 microversion: 2.1 time: 0.150216 Jul 25 16:56:18.614368 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3226/6372] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 16:56:18 2022] DELETE /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:56:18.627253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:18.628015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:56:18.630885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-afefca40-b5b7-4dd2-af8b-968b1f3dbc9b req-c3976a2d-2d59-463e-a1c4-cf9d990bd198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:56:18.634649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:18.635245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:18.636084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:18.636588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:18.642235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-afefca40-b5b7-4dd2-af8b-968b1f3dbc9b req-c3976a2d-2d59-463e-a1c4-cf9d990bd198 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:18.643116 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-afefca40-b5b7-4dd2-af8b-968b1f3dbc9b req-c3976a2d-2d59-463e-a1c4-cf9d990bd198 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:18.654771 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-afefca40-b5b7-4dd2-af8b-968b1f3dbc9b req-c3976a2d-2d59-463e-a1c4-cf9d990bd198 service nova] Creating event network-changed:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:56:18.660326 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-afefca40-b5b7-4dd2-af8b-968b1f3dbc9b req-c3976a2d-2d59-463e-a1c4-cf9d990bd198 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195485 Jul 25 16:56:18.660943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3147/6373] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:56:18.780636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:56:18.790399 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2ee2e1bc-035b-422b-8e71-35b53706e87f tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1691 microversion: 2.1 time: 0.168103 Jul 25 16:56:18.791043 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3227/6374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:56:18 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:56:19.816498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:19.817225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:56:19.824214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:19.824628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:19.825449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:19.825877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:19.978568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:56:19.987260 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-14b11681-d5b2-4578-99b2-7f8f37133297 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1691 microversion: 2.1 time: 0.176661 Jul 25 16:56:19.988140 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3148/6375] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:56:19 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:56:21.011006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:21.011728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:56:21.019773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:21.020374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:21.021587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:21.022767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:21.246388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-564707c2-6321-4b62-b6c4-01913312be41 req-8cca9453-b0ff-4586-a73f-5422b753f482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f5169e-8974-44b8-86e2-33a58f9b23d5", "name": "network-vif-deleted", "tag": "a9cc9a6a-561f-4e3d-9692-a7df718ed224"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:56:21.254331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc280fc36f7440a957c6856dd0877a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd51658ef95d4f69b50b94f0ebfc4205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:56:21.258099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-564707c2-6321-4b62-b6c4-01913312be41 req-8cca9453-b0ff-4586-a73f-5422b753f482 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:21.258536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-564707c2-6321-4b62-b6c4-01913312be41 req-8cca9453-b0ff-4586-a73f-5422b753f482 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:21.263236 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50594bec-bd26-486e-aad3-bff05e3f7869 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 200 len: 1573 microversion: 2.1 time: 0.256080 Jul 25 16:56:21.277148 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3228/6376] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:56:21 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 1573 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:56:21.277481 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-564707c2-6321-4b62-b6c4-01913312be41 req-8cca9453-b0ff-4586-a73f-5422b753f482 service nova] Creating event network-vif-deleted:a9cc9a6a-561f-4e3d-9692-a7df718ed224 for instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 on n-h1-846219-13 Jul 25 16:56:21.285753 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-564707c2-6321-4b62-b6c4-01913312be41 req-8cca9453-b0ff-4586-a73f-5422b753f482 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042791 Jul 25 16:56:21.286771 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3149/6377] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 16:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:56:22.290975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:22.291977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] [instance: d7f5169e-8974-44b8-86e2-33a58f9b23d5] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:56:22.303879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:22.304625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:22.305932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:22.306652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:22.323260 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] HTTP exception thrown: Instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 could not be found. Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Request method failure captured: Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 HTTP/1.1 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sgn4YkBMyCEyyAORyVf9SZjBBvuh81o-VzVNz2F1wNAr5HF5-hD4odv0heMCsEXrqL-2lCux1tP7m0PYr-vigSzzpDCzlqczfxYfRCOzVsm3BERebJbVFwnSoZ5CkBkCCaojMxgj5pmTX5yzsQVNJ7JSEUQ6hfrXXue07rD9iWFdyo Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/cd51658ef95d4f69b50b94f0ebfc4205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_cd51658ef95d4f69b50b94f0ebfc4205"}]}] Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: cd51658ef95d4f69b50b94f0ebfc4205 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-995602377 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: edc280fc36f7440a957c6856dd0877a3 Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkAdvancedServerOps-995602377-project Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 could not be found. Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd7f5169e-8974-44b8-86e2-33a58f9b23d5'} Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 could not be found. Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 could not be found. Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:56:22.324996 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 could not be found. Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Returning 404 to user: Instance d7f5169e-8974-44b8-86e2-33a58f9b23d5 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3042da79-d977-4c81-bd4a-6dafc1ad09bf tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5" status: 404 len: 111 microversion: 2.1 time: 0.042195 Jul 25 16:56:22.330093 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3229/6378] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 16:56:22 2022] GET /compute/v2.1/servers/d7f5169e-8974-44b8-86e2-33a58f9b23d5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:56:25.811153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6112cbcd-c2b6-43f3-89a1-13daf7170212 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] Calling method '.version_select at 0x7f9d9282fd30>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:25.832234 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6112cbcd-c2b6-43f3-89a1-13daf7170212 tempest-TestNetworkAdvancedServerOps-995602377 tempest-TestNetworkAdvancedServerOps-995602377-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-497600199" status: 202 len: 0 microversion: 2.1 time: 0.026186 Jul 25 16:56:25.832750 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3150/6379] 10.222.0.105 () {58 vars in 1286 bytes} [Mon Jul 25 16:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-497600199 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:56:35.765473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:56:35.766442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:56:35.769542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:56:35.770340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:56:35.776887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:35.777383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:35.778177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:56:35.778634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:56:35.805032 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e3867e7a-b2a8-411f-82fa-271c9cb1b66e tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.045772 Jul 25 16:56:35.805652 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3230/6380] 10.222.0.105 () {58 vars in 1298 bytes} [Mon Jul 25 16:56:35 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:57:43.751060 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:57:43.751060 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:57:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:57:44.253131 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:57:44.253790 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 16:57:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:58:27.413549 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:58:27.414071 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 16:58:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:59:24.177133 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:59:24.177797 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 16:59:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:59:40.701491 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:59:40.702738 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 16:59:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:00:39.448810 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e98af31f-6032-407f-97ae-f2fce361f28a] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:00:39.449763 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:00:39.450317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:00:39.451171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:00:39.694574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:39.695177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:39.702694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:39.703061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:39.703818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:39.704248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:39.734758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:00:39.827968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c9075811-f7d0-4516-9357-288a2f199fcb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 204 len: 0 microversion: 2.1 time: 0.381046 Jul 25 17:00:39.828561 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3151/6381] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:00:39 2022] DELETE /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:00:39.835953 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:00:39.836883 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:00:39.837421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:00:39.838184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:00:39.842077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:39.842694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:39.850835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:39.851289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:39.852057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:39.852500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:40.111411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:00:40.119615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4f6f031-0ed1-4eca-88ee-9009ff9830d1 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1738 microversion: 2.1 time: 0.285877 Jul 25 17:00:40.120222 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3231/6382] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:00:39 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:00:41.147263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:41.148191 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:41.157022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:41.157495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:41.158265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:41.158692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:41.167541 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [e98af31f-6032-407f-97ae-f2fce361f28a] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 46414. Jul 25 17:00:41.168285 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 46416. Jul 25 17:00:41.559340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:00:41.567638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fcc0595-4af9-4a59-a7e9-cbba9d4b88fd tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1738 microversion: 2.1 time: 0.424771 Jul 25 17:00:41.568252 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3152/6383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:00:41 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:00:42.019975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-afa42505-670d-4d35-8c29-62ef8bf73a34 req-65ccfbec-6b1d-47f1-8f0a-9e122d8188d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8825f9fe-bba3-42b6-a550-99429884ea01", "name": "network-vif-deleted", "tag": "26792aa2-e039-438d-8c89-4cf8cf4002a6"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:00:42.035183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-afa42505-670d-4d35-8c29-62ef8bf73a34 req-65ccfbec-6b1d-47f1-8f0a-9e122d8188d3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:42.035643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-afa42505-670d-4d35-8c29-62ef8bf73a34 req-65ccfbec-6b1d-47f1-8f0a-9e122d8188d3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:42.050876 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 46424. Jul 25 17:00:42.052892 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 46422. Jul 25 17:00:42.055771 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-afa42505-670d-4d35-8c29-62ef8bf73a34 req-65ccfbec-6b1d-47f1-8f0a-9e122d8188d3 service nova] Creating event network-vif-deleted:26792aa2-e039-438d-8c89-4cf8cf4002a6 for instance 8825f9fe-bba3-42b6-a550-99429884ea01 on n-h1-846219-13 Jul 25 17:00:42.063387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-afa42505-670d-4d35-8c29-62ef8bf73a34 req-65ccfbec-6b1d-47f1-8f0a-9e122d8188d3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047063 Jul 25 17:00:42.064053 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3232/6384] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:00:42.590842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:42.591626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:42.598968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:42.599839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:42.600750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:42.601284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:42.636589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:42.637220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:42.637935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lazy-loading 'fault' on Instance uuid 8825f9fe-bba3-42b6-a550-99429884ea01 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:00:42.723998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10492024296d445aad69edfaf87f6407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617450f0bedd49c0af29b7c814be15bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:00:42.731227 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6c7be5e-fd61-4830-b034-1e2954cece4a tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 200 len: 1393 microversion: 2.1 time: 0.146091 Jul 25 17:00:42.731800 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3153/6385] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:00:42 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 1393 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:00:43.755270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:43.755936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:43.767527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:43.768082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:43.768979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:43.769639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:43.788836 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] HTTP exception thrown: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Request method failure captured: Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 HTTP/1.1 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3srgBvy45oOP6Dje15dACyCaV0DgY9v7xOflz1rSyu1o5ky_uIg7DQnLrlHPS-eiu_L90zz8S0JJ3Xj7ZIYmUVlpz-xvxO_6H1VyupRgRdeYYnUMPH8SadauUPDAH__B3kdGU71KyxfLi2L2HsVRx4JikU0eF-K7qIHF7JDVsp32OFc Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 617450f0bedd49c0af29b7c814be15bf Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_617450f0bedd49c0af29b7c814be15bf"}]}] Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 617450f0bedd49c0af29b7c814be15bf Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestServerBasicOps-2021129056-project Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 10492024296d445aad69edfaf87f6407 Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestServerBasicOps-2021129056-project Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8825f9fe-bba3-42b6-a550-99429884ea01'} Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:00:43.790460 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Returning 404 to user: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9422f33a-06a1-42ab-9cc4-b7b7901b81bb tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 404 len: 111 microversion: 2.1 time: 0.042899 Jul 25 17:00:43.796144 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3233/6386] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:00:43 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:00:44.278227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:44.278806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:44.286143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:44.286594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:44.287373 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:44.287806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:44.300956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] HTTP exception thrown: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Request method failure captured: Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 HTTP/1.1 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3srgBvy45oOP6Dje15dACyCaV0DgY9v7xOflz1rSyu1o5ky_uIg7DQnLrlHPS-eiu_L90zz8S0JJ3Xj7ZIYmUVlpz-xvxO_6H1VyupRgRdeYYnUMPH8SadauUPDAH__B3kdGU71KyxfLi2L2HsVRx4JikU0eF-K7qIHF7JDVsp32OFc Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 617450f0bedd49c0af29b7c814be15bf Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_617450f0bedd49c0af29b7c814be15bf"}]}] Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 617450f0bedd49c0af29b7c814be15bf Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestServerBasicOps-2021129056-project Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 10492024296d445aad69edfaf87f6407 Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestServerBasicOps-2021129056-project Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '8825f9fe-bba3-42b6-a550-99429884ea01'} Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:00:44.302690 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Returning 404 to user: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b370ccf-35ac-4108-bd2e-d938f80da705 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "DELETE /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 404 len: 111 microversion: 2.1 time: 0.032789 Jul 25 17:00:44.307716 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3154/6387] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:00:44 2022] DELETE /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:00:44.313262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:44.313893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] [instance: 8825f9fe-bba3-42b6-a550-99429884ea01] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:00:44.320355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:44.320756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:44.321565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:00:44.322015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:00:44.336284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] HTTP exception thrown: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Request method failure captured: Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 HTTP/1.1 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3srgBvy45oOP6Dje15dACyCaV0DgY9v7xOflz1rSyu1o5ky_uIg7DQnLrlHPS-eiu_L90zz8S0JJ3Xj7ZIYmUVlpz-xvxO_6H1VyupRgRdeYYnUMPH8SadauUPDAH__B3kdGU71KyxfLi2L2HsVRx4JikU0eF-K7qIHF7JDVsp32OFc Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 617450f0bedd49c0af29b7c814be15bf Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/617450f0bedd49c0af29b7c814be15bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_617450f0bedd49c0af29b7c814be15bf"}]}] Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 617450f0bedd49c0af29b7c814be15bf Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestServerBasicOps-2021129056 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestServerBasicOps-2021129056-project Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 10492024296d445aad69edfaf87f6407 Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestServerBasicOps-2021129056-project Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '8825f9fe-bba3-42b6-a550-99429884ea01'} Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:00:44.337890 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Returning 404 to user: Instance 8825f9fe-bba3-42b6-a550-99429884ea01 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a29bb861-1b10-4e9b-9b6d-e94db74787e3 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01" status: 404 len: 111 microversion: 2.1 time: 0.030078 Jul 25 17:00:44.343021 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3234/6388] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:00:44 2022] GET /compute/v2.1/servers/8825f9fe-bba3-42b6-a550-99429884ea01 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:00:44.522889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a45ed732-7a36-4fd8-a1b5-1351d7faacc4 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] Calling method '.version_select at 0x7f9da4a74550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:00:44.551943 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a45ed732-7a36-4fd8-a1b5-1351d7faacc4 tempest-TestServerBasicOps-2021129056 tempest-TestServerBasicOps-2021129056-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1246564788" status: 202 len: 0 microversion: 2.1 time: 0.032915 Jul 25 17:00:44.552520 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3155/6389] 10.222.0.105 () {58 vars in 1259 bytes} [Mon Jul 25 17:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1246564788 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:01:03.760888 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:01:03.761517 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:01:03.807629 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:01:03.807872 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:01:03.894545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:03.895290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:04.015365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-345147057", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:04.262741 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:01:04.263227 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:01:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:01:04.283189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] validate_networks() for None {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:01:04.487762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:01:04.488362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:01:04.489080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:01:04.489725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:01:04.490344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:01:04.504257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:04.504760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:04.505767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:04.506466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:04.525977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Getting quotas for project 5495e4bca0614d6b819e23eec8ab033f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:01:04.531414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Getting quotas for user 20717253d29a43fb96137a2688be122e and project 5495e4bca0614d6b819e23eec8ab033f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:01:04.545042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:01:04.547476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:01:04.599241 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a8a1f6a-162b-4d97-972c-67ae805f1832 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.710068 Jul 25 17:01:04.599942 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3235/6390] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:01:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:01:04.610536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:04.611274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:04.615529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-07c7af82-f2c9-4ff1-a781-5a85efa075f1 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:04.616149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-07c7af82-f2c9-4ff1-a781-5a85efa075f1 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:04.818273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-07c7af82-f2c9-4ff1-a781-5a85efa075f1 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:04.825347 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-07c7af82-f2c9-4ff1-a781-5a85efa075f1 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1225 microversion: 2.1 time: 0.216605 Jul 25 17:01:04.825917 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3156/6391] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:04 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1225 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:05.848747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ac610cf-9a3c-4ff0-b136-09b607b2af27 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:05.849412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ac610cf-9a3c-4ff0-b136-09b607b2af27 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:05.904676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ac610cf-9a3c-4ff0-b136-09b607b2af27 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:05.914773 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ac610cf-9a3c-4ff0-b136-09b607b2af27 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1225 microversion: 2.1 time: 0.071347 Jul 25 17:01:05.915505 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3236/6392] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:05 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1225 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:06.935923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-97d03840-2e73-4f23-b75c-3ecb5b3e5864 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:06.936537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-97d03840-2e73-4f23-b75c-3ecb5b3e5864 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:06.991470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-97d03840-2e73-4f23-b75c-3ecb5b3e5864 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:06.998631 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-97d03840-2e73-4f23-b75c-3ecb5b3e5864 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1225 microversion: 2.1 time: 0.066732 Jul 25 17:01:06.999211 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3157/6393] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:06 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1225 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:08.020354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b9aac4a-12d3-48cc-b7f4-57917e7c1a19 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:08.020984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b9aac4a-12d3-48cc-b7f4-57917e7c1a19 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:08.078738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b9aac4a-12d3-48cc-b7f4-57917e7c1a19 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:08.086410 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b9aac4a-12d3-48cc-b7f4-57917e7c1a19 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1225 microversion: 2.1 time: 0.070042 Jul 25 17:01:08.087060 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3237/6394] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:08 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1225 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:09.109394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:09.110032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:09.119201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:09.119657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:09.120716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:09.121216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:09.196062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:09.204417 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-788a3e28-8268-4fdd-9bab-019f61059fa6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1229 microversion: 2.1 time: 0.099684 Jul 25 17:01:09.204965 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3158/6395] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:09 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:10.228062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:10.228729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:10.237830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:10.238194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:10.239052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:10.239511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:10.310809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:10.318712 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff6e4a96-6deb-4e46-986a-3b152cf59d3f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1283 microversion: 2.1 time: 0.096337 Jul 25 17:01:10.319306 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3238/6396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:10 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:11.343210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:11.344078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:11.350742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:11.351207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:11.352106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:11.352585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:11.555091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:11.575656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c71c2218-12a0-492d-b604-67b1ffd7c676 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.237702 Jul 25 17:01:11.576348 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3159/6397] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:11 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:11.951515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-e82d23b0-dbf7-493c-b40c-08f4e8fc2de9 req-9859444f-ac84-4763-b736-985c32d82944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1978cb94-306b-433f-b4cc-535e5d976bb8", "tag": "123e23da-0a80-47f7-8ab1-ac6d270771a7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:11.962287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e82d23b0-dbf7-493c-b40c-08f4e8fc2de9 req-9859444f-ac84-4763-b736-985c32d82944 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:11.962739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-e82d23b0-dbf7-493c-b40c-08f4e8fc2de9 req-9859444f-ac84-4763-b736-985c32d82944 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:11.974432 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-e82d23b0-dbf7-493c-b40c-08f4e8fc2de9 req-9859444f-ac84-4763-b736-985c32d82944 service nova] Creating event network-changed:123e23da-0a80-47f7-8ab1-ac6d270771a7 for instance 1978cb94-306b-433f-b4cc-535e5d976bb8 on n-h1-846219-13 Jul 25 17:01:11.979843 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-e82d23b0-dbf7-493c-b40c-08f4e8fc2de9 req-9859444f-ac84-4763-b736-985c32d82944 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093495 Jul 25 17:01:11.980835 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3239/6398] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:12.598078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:12.598766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:12.606647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:12.607092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:12.607860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:12.608286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:12.755606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:12.763501 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65021f7e-fe61-424c-9f37-1921cc871a31 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.169728 Jul 25 17:01:12.764347 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3160/6399] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:12 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:13.787254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:13.788098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:13.796207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:13.796680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:13.797668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:13.798198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:13.942909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:13.951054 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fefb85f3-d104-4df7-ac8c-5dde2506a0f6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.170013 Jul 25 17:01:13.951621 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3240/6400] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:13 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:14.974319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:14.974981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:14.983821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:14.984275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:14.985052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:14.985523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:15.198529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:15.209857 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1ea419a5-1ae5-40a5-9299-65c8027ea6a8 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.239905 Jul 25 17:01:15.211346 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3161/6401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:14 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:16.232476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:16.233183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:16.235906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:16.245558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:16.246111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:16.247178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:16.247704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:16.394773 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:16.403249 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a2397364-8837-4e77-a3f9-4678c83f6f5f tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.175689 Jul 25 17:01:16.403936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3241/6402] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:16 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:17.294832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:17.360706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-d63f6264-cea4-45c8-aa63-3e6e8b75644c req-0e0a69f3-fe1d-4cac-bda4-0d13fef23b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1978cb94-306b-433f-b4cc-535e5d976bb8", "name": "network-vif-plugged", "status": "completed", "tag": "123e23da-0a80-47f7-8ab1-ac6d270771a7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:17.370553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d63f6264-cea4-45c8-aa63-3e6e8b75644c req-0e0a69f3-fe1d-4cac-bda4-0d13fef23b36 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:17.371136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-d63f6264-cea4-45c8-aa63-3e6e8b75644c req-0e0a69f3-fe1d-4cac-bda4-0d13fef23b36 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:17.385278 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-d63f6264-cea4-45c8-aa63-3e6e8b75644c req-0e0a69f3-fe1d-4cac-bda4-0d13fef23b36 service nova] Creating event network-vif-plugged:123e23da-0a80-47f7-8ab1-ac6d270771a7 for instance 1978cb94-306b-433f-b4cc-535e5d976bb8 on n-h1-846219-13 Jul 25 17:01:17.390990 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-d63f6264-cea4-45c8-aa63-3e6e8b75644c req-0e0a69f3-fe1d-4cac-bda4-0d13fef23b36 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101248 Jul 25 17:01:17.391769 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3162/6403] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:17.431371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:17.431934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:17.439807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:17.440389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:17.441193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:17.441908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:17.653621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:17.664133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f7fb571f-79b8-47cf-9665-d577054432d6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.236848 Jul 25 17:01:17.664737 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3242/6404] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:17 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:18.688552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:18.689390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:18.700005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:18.700383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:18.701127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:18.701595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:18.835358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:18.844299 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-abc73fe0-d6dc-46f1-b376-c04fb94022a6 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1325 microversion: 2.1 time: 0.161762 Jul 25 17:01:18.844926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3163/6405] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:18 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:19.868990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:19.870549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:19.872544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:19.879103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:19.879562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:19.880333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:19.880774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.013256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:20.022326 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13ac09fe-886a-495d-bd85-fef84d281a0d tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1475 microversion: 2.1 time: 0.159539 Jul 25 17:01:20.022925 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3243/6406] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:19 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:20.098771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8abf7419-2b62-4e50-9203-0344a8992cdc tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Calling method '.version_select at 0x7f9d930ac430>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.167316 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8abf7419-2b62-4e50-9203-0344a8992cdc tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/21d876efb6ae4b24bbf7a26848d88331" status: 200 len: 371 microversion: 2.1 time: 0.126438 Jul 25 17:01:20.168129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3164/6407] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 17:01:20 2022] GET /compute/v2.1/os-quota-sets/21d876efb6ae4b24bbf7a26848d88331 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:20.183137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7eef46bd-c5dc-4552-a502-4971e1b432fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-319837980", "id": 982709945, "os-flavor-access:is_public": "True"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:20.186293 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 17:01:20.186293 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 17:01:20.203243 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7eef46bd-c5dc-4552-a502-4971e1b432fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024035 Jul 25 17:01:20.203878 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3244/6408] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:01:20 2022] POST /compute/v2.1/flavors => generated 436 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:20.215757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "982709945"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:20.218119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:20.224862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.225379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.226142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.226579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.389939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '53438016c1544cc7aea778f9105264c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d876efb6ae4b24bbf7a26848d88331', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:20.398476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-319837980 {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:01:20.406580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.407029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.407841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.408266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.430049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Getting quotas for project 5495e4bca0614d6b819e23eec8ab033f. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:01:20.435633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Getting quotas for user 20717253d29a43fb96137a2688be122e and project 5495e4bca0614d6b819e23eec8ab033f. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:01:20.450047 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] ram quota exceeded for 21d876efb6ae4b24bbf7a26848d88331, tried to resize instance. Jul 25 17:01:20.450876 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Request method failure captured: Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8/action HTTP/1.1 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 38 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sxPbEXWTB8rMJgdBT7i00yap6JMcq-FMtyML_CGiAcZLxCb34jk60VZ1V3sMpDojxOx1EyWhe-zNM6cMZRZQKzHPWLXCk3Q40pCpYcXoD1-hxerYrMnpZMOCAEi50JXOdDUCL0370hqSVkFiZjUN0X6SozLIyGNqMXh-wleqR7AE78 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 21d876efb6ae4b24bbf7a26848d88331 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1754400623 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,admin,reader Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,admin,reader Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21d876efb6ae4b24bbf7a26848d88331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21d876efb6ae4b24bbf7a26848d88331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21d876efb6ae4b24bbf7a26848d88331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21d876efb6ae4b24bbf7a26848d88331"}]}] Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1754400623 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 21d876efb6ae4b24bbf7a26848d88331 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1754400623 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersAdminNegativeTestJSON-1754400623-project-admin Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 53438016c1544cc7aea778f9105264c5 Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1754400623-project-admin Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: {"resize": {"flavorRef": "982709945"}} Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '1978cb94-306b-433f-b4cc-535e5d976bb8', 'body': {'resize': {'flavorRef': '982709945'}}} Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:01:20.454113 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9d1cd11-304a-4c1c-bdfe-6efc85ec15fd tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8/action" status: 403 len: 118 microversion: 2.1 time: 0.243859 Jul 25 17:01:20.460138 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3165/6409] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:01:20 2022] POST /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8/action => generated 118 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 17:01:20.464948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3f5e233b-80c6-4e75-8cc7-3dbdc7530708 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.465739 n-d-846219-13 devstack@n-api.service[119599]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 17:01:20.465739 n-d-846219-13 devstack@n-api.service[119599]: warnings.warn(msg) Jul 25 17:01:20.484213 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3f5e233b-80c6-4e75-8cc7-3dbdc7530708 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/982709945" status: 202 len: 0 microversion: 2.1 time: 0.023225 Jul 25 17:01:20.485392 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3245/6410] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 17:01:20 2022] DELETE /compute/v2.1/flavors/982709945 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:01:20.493349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09ff37f9-4e18-48be-8f36-321c198a9953 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.514346 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09ff37f9-4e18-48be-8f36-321c198a9953 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.024729 Jul 25 17:01:20.514941 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3166/6411] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 17:01:20 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:20.539017 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-308c6097-1cbf-4510-9577-412ed4b696d4 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Calling method '.version_select at 0x7f9d92319820>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.613664 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-308c6097-1cbf-4510-9577-412ed4b696d4 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "GET /compute/v2.1/os-quota-sets/21d876efb6ae4b24bbf7a26848d88331" status: 200 len: 371 microversion: 2.1 time: 0.078332 Jul 25 17:01:20.614245 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3246/6412] 10.222.0.105 () {58 vars in 1247 bytes} [Mon Jul 25 17:01:20 2022] GET /compute/v2.1/os-quota-sets/21d876efb6ae4b24bbf7a26848d88331 => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:20.625773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09ba23bb-1687-44ee-8c06-dddb56dc5b73 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1590454100", "id": 959560694, "os-flavor-access:is_public": "True"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:20.628738 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 17:01:20.628738 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 17:01:20.646979 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09ba23bb-1687-44ee-8c06-dddb56dc5b73 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024846 Jul 25 17:01:20.647502 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3167/6413] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:01:20 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:20.659594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "959560694"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:20.662005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:20.668435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.668874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.669713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.670116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.819382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '53438016c1544cc7aea778f9105264c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d876efb6ae4b24bbf7a26848d88331', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:20.826641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1590454100 {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:01:20.833586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.834044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.834845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.835286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.859013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Getting quotas for project 5495e4bca0614d6b819e23eec8ab033f. Resources: {'ram', 'cores'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:01:20.864217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Getting quotas for user 20717253d29a43fb96137a2688be122e and project 5495e4bca0614d6b819e23eec8ab033f. Resources: {'ram', 'cores'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:01:20.879306 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.compute.api [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] cores quota exceeded for 21d876efb6ae4b24bbf7a26848d88331, tried to resize instance. Jul 25 17:01:20.879954 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Request method failure captured: Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8/action HTTP/1.1 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 38 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sxPbEXWTB8rMJgdBT7i00yap6JMcq-FMtyML_CGiAcZLxCb34jk60VZ1V3sMpDojxOx1EyWhe-zNM6cMZRZQKzHPWLXCk3Q40pCpYcXoD1-hxerYrMnpZMOCAEi50JXOdDUCL0370hqSVkFiZjUN0X6SozLIyGNqMXh-wleqR7AE78 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 21d876efb6ae4b24bbf7a26848d88331 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1754400623 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,admin,reader Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,admin,reader Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21d876efb6ae4b24bbf7a26848d88331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/21d876efb6ae4b24bbf7a26848d88331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/21d876efb6ae4b24bbf7a26848d88331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_21d876efb6ae4b24bbf7a26848d88331"}]}] Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1754400623 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 21d876efb6ae4b24bbf7a26848d88331 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1754400623 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersAdminNegativeTestJSON-1754400623-project-admin Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 53438016c1544cc7aea778f9105264c5 Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1754400623-project-admin Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: {"resize": {"flavorRef": "959560694"}} Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1978cb94-306b-433f-b4cc-535e5d976bb8', 'body': {'resize': {'flavorRef': '959560694'}}} Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:01:20.881994 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e6531fc7-4e57-48fb-b01f-5de86eca20fb tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "POST /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8/action" status: 403 len: 113 microversion: 2.1 time: 0.227843 Jul 25 17:01:20.887238 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3247/6414] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:01:20 2022] POST /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8/action => generated 113 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:01:20.893119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a9b6ed04-3afc-487c-8644-22e519fcf333 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.893883 n-d-846219-13 devstack@n-api.service[119598]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 17:01:20.893883 n-d-846219-13 devstack@n-api.service[119598]: warnings.warn(msg) Jul 25 17:01:20.915275 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a9b6ed04-3afc-487c-8644-22e519fcf333 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "DELETE /compute/v2.1/flavors/959560694" status: 202 len: 0 microversion: 2.1 time: 0.025608 Jul 25 17:01:20.915957 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3168/6415] 10.222.0.105 () {58 vars in 1163 bytes} [Mon Jul 25 17:01:20 2022] DELETE /compute/v2.1/flavors/959560694 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:01:20.925738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f91d5da2-ddf3-4237-b438-34ec126c3fe4 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.945460 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f91d5da2-ddf3-4237-b438-34ec126c3fe4 tempest-ServersAdminNegativeTestJSON-1754400623 tempest-ServersAdminNegativeTestJSON-1754400623-project-admin] 10.222.0.105 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.023565 Jul 25 17:01:20.946042 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3248/6416] 10.222.0.105 () {58 vars in 1151 bytes} [Mon Jul 25 17:01:20 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:20.969416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:20.970134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:20.980338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.980835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:20.981646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:20.982081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:21.012673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:01:21.105714 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4b84ba02-f48b-432a-9fe2-1b013934f119 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 204 len: 0 microversion: 2.1 time: 0.142919 Jul 25 17:01:21.106928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3169/6417] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:01:20 2022] DELETE /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:01:21.115052 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:21.115679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:21.122088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:21.122550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:21.123341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:21.123789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:21.286274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:21.297047 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89c46993-988a-4f2f-8947-d43b7e7d0da9 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1481 microversion: 2.1 time: 0.185484 Jul 25 17:01:21.297902 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3249/6418] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:21 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1481 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:01:22.323817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:22.324477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:22.332885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:22.333374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:22.334148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:22.334582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:22.470041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:22.478085 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dd7701e7-eaf6-438f-acf7-0f10904ec8fc tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1481 microversion: 2.1 time: 0.158850 Jul 25 17:01:22.478687 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3170/6419] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:22 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1481 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:23.500086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:23.500668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:23.509895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:23.510410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:23.511337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:23.511889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:23.607278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20717253d29a43fb96137a2688be122e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5495e4bca0614d6b819e23eec8ab033f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:23.616626 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9ee4926a-5028-42df-9f05-3d584ec23425 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 200 len: 1439 microversion: 2.1 time: 0.120905 Jul 25 17:01:23.617254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3250/6420] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:23 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:23.646445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5e9294d7-d809-42e9-a628-a967c54b695e req-09d955c4-dc3b-4567-b9da-188a9b5347eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1978cb94-306b-433f-b4cc-535e5d976bb8", "name": "network-vif-deleted", "tag": "123e23da-0a80-47f7-8ab1-ac6d270771a7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:23.657821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5e9294d7-d809-42e9-a628-a967c54b695e req-09d955c4-dc3b-4567-b9da-188a9b5347eb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:23.658272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5e9294d7-d809-42e9-a628-a967c54b695e req-09d955c4-dc3b-4567-b9da-188a9b5347eb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:23.671035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5e9294d7-d809-42e9-a628-a967c54b695e req-09d955c4-dc3b-4567-b9da-188a9b5347eb service nova] Creating event network-vif-deleted:123e23da-0a80-47f7-8ab1-ac6d270771a7 for instance 1978cb94-306b-433f-b4cc-535e5d976bb8 on n-h1-846219-13 Jul 25 17:01:23.676440 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5e9294d7-d809-42e9-a628-a967c54b695e req-09d955c4-dc3b-4567-b9da-188a9b5347eb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033670 Jul 25 17:01:23.677086 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3171/6421] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:24.640133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:24.640756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] [instance: 1978cb94-306b-433f-b4cc-535e5d976bb8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:24.648247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:24.648729 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:24.649539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:24.649992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:24.663711 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] HTTP exception thrown: Instance 1978cb94-306b-433f-b4cc-535e5d976bb8 could not be found. Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Request method failure captured: Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 HTTP/1.1 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sxPp7m2WJHsyDCePDh14YqMR92h9RfzTJPHV8cM-jhWcnp4jTw1lnQe5aG2YTl3AiiAbwGl6L8ZMa0AWlXv2FXwdoUs1ZethuvoOPfh-dhwBboy7vM9iaXWgeMUB22zKY3uIGW_brV1nz25WC1wNh7AVC8i7VlWJIVZtUNBeI9Mjqk Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 5495e4bca0614d6b819e23eec8ab033f Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-101436993 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5495e4bca0614d6b819e23eec8ab033f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/5495e4bca0614d6b819e23eec8ab033f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/5495e4bca0614d6b819e23eec8ab033f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_5495e4bca0614d6b819e23eec8ab033f"}]}] Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersAdminNegativeTestJSON-101436993 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 5495e4bca0614d6b819e23eec8ab033f Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-101436993 Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersAdminNegativeTestJSON-101436993-project Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 20717253d29a43fb96137a2688be122e Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersAdminNegativeTestJSON-101436993-project Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 1978cb94-306b-433f-b4cc-535e5d976bb8 could not be found. Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1978cb94-306b-433f-b4cc-535e5d976bb8'} Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1978cb94-306b-433f-b4cc-535e5d976bb8 could not be found. Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1978cb94-306b-433f-b4cc-535e5d976bb8 could not be found. Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:24.665321 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1978cb94-306b-433f-b4cc-535e5d976bb8 could not be found. Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] Returning 404 to user: Instance 1978cb94-306b-433f-b4cc-535e5d976bb8 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fc9989c-da12-4ef4-838b-4eccba53c433 tempest-ServersAdminNegativeTestJSON-101436993 tempest-ServersAdminNegativeTestJSON-101436993-project] 10.222.0.105 "GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8" status: 404 len: 111 microversion: 2.1 time: 0.030659 Jul 25 17:01:24.671049 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3251/6422] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:24 2022] GET /compute/v2.1/servers/1978cb94-306b-433f-b4cc-535e5d976bb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:01:31.044670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:31.045481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:31.176173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-609100324", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "cfdc0999-00f0-42d6-982e-a6358df88d62"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:31.232727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] validate_networks() for [('cfdc0999-00f0-42d6-982e-a6358df88d62', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:01:31.638752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:01:31.639421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:01:31.639904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:01:31.640312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:01:31.640871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:01:31.651528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:31.651916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:31.652807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:31.653605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:31.674302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Getting quotas for project 06f1a4eac8f14f2389a85cb6871635ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:01:31.680658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Getting quotas for user 85903197c3784428ad990faceb66f241 and project 06f1a4eac8f14f2389a85cb6871635ad. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:01:31.693768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:01:31.696164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:01:31.747473 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eb49e262-b7bc-4feb-b2a2-9bfb0ad180d1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.704728 Jul 25 17:01:31.748341 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3172/6423] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:01:31 2022] POST /compute/v2.1/servers => generated 382 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:01:31.760047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2c5b0ba0-1d3b-40ed-88d4-a85747da3653 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:31.761864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2c5b0ba0-1d3b-40ed-88d4-a85747da3653 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:31.771400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:31.772322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:31.832533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2c5b0ba0-1d3b-40ed-88d4-a85747da3653 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:31.844186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2c5b0ba0-1d3b-40ed-88d4-a85747da3653 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1218 microversion: 2.1 time: 0.086879 Jul 25 17:01:31.845518 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3252/6424] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:31 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:32.867238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:32.867874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:32.875642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:32.876081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:32.876863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:32.877329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:32.940716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:32.950020 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ada29cd1-b2b2-46d5-b9fe-d6acd2160953 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1270 microversion: 2.1 time: 0.087573 Jul 25 17:01:32.950586 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3173/6425] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:32 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:33.972023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:33.973518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:33.978457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:33.984633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:33.985263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:33.985973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:33.986525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:33.990564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=62 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:34.253523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:34.262967 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-419bf20d-38a7-43f2-8570-84cb5c5a392e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.295506 Jul 25 17:01:34.263564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3253/6426] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:33 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:34.750903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c2fd30cf-d9c7-4c23-b963-647b149d1157 req-b50ed7ce-08a6-4d3b-a0ee-f4e6eccbd146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b826ff-cc3d-43bd-a255-a97b81d5583c", "tag": "80d8c5de-420e-405b-896b-926d237a6dc7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:34.776178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:34.783627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c2fd30cf-d9c7-4c23-b963-647b149d1157 req-b50ed7ce-08a6-4d3b-a0ee-f4e6eccbd146 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:34.784061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c2fd30cf-d9c7-4c23-b963-647b149d1157 req-b50ed7ce-08a6-4d3b-a0ee-f4e6eccbd146 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:34.787584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:34.800285 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c2fd30cf-d9c7-4c23-b963-647b149d1157 req-b50ed7ce-08a6-4d3b-a0ee-f4e6eccbd146 service nova] Creating event network-changed:80d8c5de-420e-405b-896b-926d237a6dc7 for instance 02b826ff-cc3d-43bd-a255-a97b81d5583c on n-h1-846219-13 Jul 25 17:01:34.806664 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c2fd30cf-d9c7-4c23-b963-647b149d1157 req-b50ed7ce-08a6-4d3b-a0ee-f4e6eccbd146 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059484 Jul 25 17:01:34.807465 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3174/6427] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:35.284568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:35.285478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:35.292587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:35.293048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:35.293856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:35.294347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:35.431901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:35.440150 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8f8a44a8-4361-45f0-82ce-de114bcbf526 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.159531 Jul 25 17:01:35.440734 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3254/6428] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:35 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:36.466718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:36.467463 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:36.479574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:36.480211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:36.481155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:36.481611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:36.632542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:36.640863 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f91133d8-6529-4e22-8cfe-f170e35e4ebb tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.182799 Jul 25 17:01:36.641488 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3175/6429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:36 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:37.665161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:37.665864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:37.676497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:37.677083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:37.678314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:37.678825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:37.820013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:37.828238 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2cf48323-8479-4274-8358-e4cd6b722c0e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.169298 Jul 25 17:01:37.828824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3255/6430] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:37 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:38.853684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:38.854577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:38.862465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:38.862894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:38.863678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:38.864115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:39.009860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:39.021340 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72d52004-55c4-4f52-b6ed-045bf856f699 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.173962 Jul 25 17:01:39.022210 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3176/6431] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:38 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:40.049965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:40.051006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:40.064200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:40.064200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:40.065182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:40.065638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:40.205662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:40.213932 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1178e3ef-3352-4a9c-9e6b-4b6352bed1a5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.173597 Jul 25 17:01:40.214506 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3256/6432] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:40 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:41.236699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:41.237270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:41.243867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:41.244324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:41.245110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:41.245572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:41.384313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:41.392315 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5f12bdb-1976-460f-932d-1d1657985e07 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.159962 Jul 25 17:01:41.392899 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3177/6433] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:41 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:41.559997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-09720541-8214-4237-8143-e411df62447d req-3cc1a4c9-4b1d-4552-9ca5-c66f3222f8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b826ff-cc3d-43bd-a255-a97b81d5583c", "name": "network-vif-plugged", "status": "completed", "tag": "80d8c5de-420e-405b-896b-926d237a6dc7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:41.569713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-09720541-8214-4237-8143-e411df62447d req-3cc1a4c9-4b1d-4552-9ca5-c66f3222f8b8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:41.570137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-09720541-8214-4237-8143-e411df62447d req-3cc1a4c9-4b1d-4552-9ca5-c66f3222f8b8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:41.581422 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-09720541-8214-4237-8143-e411df62447d req-3cc1a4c9-4b1d-4552-9ca5-c66f3222f8b8 service nova] Creating event network-vif-plugged:80d8c5de-420e-405b-896b-926d237a6dc7 for instance 02b826ff-cc3d-43bd-a255-a97b81d5583c on n-h1-846219-13 Jul 25 17:01:41.586491 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-09720541-8214-4237-8143-e411df62447d req-3cc1a4c9-4b1d-4552-9ca5-c66f3222f8b8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091039 Jul 25 17:01:41.587092 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3257/6434] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:01:42.413919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:42.414582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:42.416645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:42.417377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:42.425056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:42.425589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:42.426375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:42.426852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:42.571148 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:42.578975 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-801ee494-8f74-40a0-ab7c-fce378ec6e18 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1318 microversion: 2.1 time: 0.169231 Jul 25 17:01:42.579554 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3178/6435] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:42 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:43.597706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:01:43.603302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:43.604078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:43.611048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:43.611507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:43.612285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:43.612744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:43.763295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:43.771236 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1edcea82-5a90-4876-b624-920a1eb4f6fc tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1506 microversion: 2.1 time: 0.174634 Jul 25 17:01:43.771864 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3258/6436] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:43 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:43.792170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:01:43.794524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:43.801895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:43.802344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:43.803110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:43.803580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:43.884792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:43.892300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:01:43.898910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:01:43.899366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:01:43.899843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:01:43.900251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:01:43.900661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:01:44.015221 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ae25c724-b33d-4b32-a4b4-93ae58b8d4d4 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "POST /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c/action" status: 202 len: 0 microversion: 2.1 time: 0.227080 Jul 25 17:01:44.019704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3179/6437] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:01:43 2022] POST /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:01:44.024423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:44.025060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:44.031561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:44.032036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:44.033173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:44.033727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:44.172440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:44.180251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81453d1e-b1f8-4e14-acef-210a976c2c27 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1515 microversion: 2.1 time: 0.159908 Jul 25 17:01:44.181165 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3259/6438] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:44 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:01:45.202349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:45.203097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:45.210289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:45.210739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:45.211553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:45.211979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:45.347283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:45.355689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f653209d-2e58-4d54-8195-d3cd9b52dd67 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1515 microversion: 2.1 time: 0.158122 Jul 25 17:01:45.356249 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3180/6439] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:45 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:46.377595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:46.378200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:46.385904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:46.386400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:46.387345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:46.387843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:46.529696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:46.537622 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68a526a8-6347-48d5-b389-b2ee0c9cf568 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.164180 Jul 25 17:01:46.538185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3260/6440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:46 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:47.560652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:47.561331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:47.568785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:47.569274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:47.570062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:47.570497 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:47.712220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:47.724120 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b4c0ee37-26ca-4148-ad32-6f75d0dc9ee7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.168098 Jul 25 17:01:47.724927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3181/6441] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:47 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:48.748551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:48.749195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:48.756816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:48.757318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:48.758083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:48.758527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:48.897703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:48.905361 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9d2c718-9db7-4526-9309-71d8c134db1e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.161265 Jul 25 17:01:48.905947 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3261/6442] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:48 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:49.930357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:49.931306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:49.942567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:49.943242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:49.944432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:49.945204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:50.092614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:50.101404 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43d4d210-fe0d-4f42-b534-fa67753ce5da tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.177247 Jul 25 17:01:50.102188 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3182/6443] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:49 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:51.123985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:51.125637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:51.140777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:51.141402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:51.142537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:51.143199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:51.293963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:51.301765 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca830160-4729-46d4-8a3e-619db0e9dd7c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.181894 Jul 25 17:01:51.302317 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3262/6444] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:51 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:52.326123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:52.326703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:52.334071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:52.334524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:52.335296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:52.335728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:52.474532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:52.483111 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5d546ea8-ddee-4e86-b802-6881fa659801 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.162438 Jul 25 17:01:52.483710 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3183/6445] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:52 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:53.505557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:53.506383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:53.513641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:53.514102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:53.514890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:53.515337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:53.659058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:53.666779 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-21cce30e-222b-46ef-a52a-1c1dd283a7e5 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.165223 Jul 25 17:01:53.667335 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3263/6446] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:53 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:54.687682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:54.688295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:54.698789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:54.699305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:54.700099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:54.700548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:54.838236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:54.846637 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9851a726-5965-4571-b277-b4607e9204a7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.162926 Jul 25 17:01:54.847225 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3184/6447] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:54 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:55.868481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:55.869065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:55.878581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:55.879043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:55.880270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:55.880965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:56.042201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:56.050807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b033ba4-ca95-4fc0-8a33-bf904340871a tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.186335 Jul 25 17:01:56.051294 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3264/6448] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:55 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:57.079566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:57.080145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:57.089664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:57.090193 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:57.090971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:57.091412 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:57.238261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:57.246266 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a6078581-92d5-4ef7-81fc-73865726d5b7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.170572 Jul 25 17:01:57.246860 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3185/6449] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:57 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:58.269083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:58.269765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:58.280553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:58.281184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:58.282287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:58.282765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:58.424849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:58.436922 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e0e6ffba-41a3-4e35-92a3-a9253137b253 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.172673 Jul 25 17:01:58.437733 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3265/6450] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:58 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:01:59.459014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:01:59.459636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:01:59.467084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:59.467544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:59.469014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:01:59.469458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:01:59.979542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:01:59.993973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-afc7f13e-9efe-440d-8c07-e82413e7bac2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.537057 Jul 25 17:01:59.993973 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3186/6451] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:01:59 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:01.014840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:01.015449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:01.022920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:01.023385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:01.024171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:01.024615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:01.168401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:01.176581 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d82af47a-3c02-43e5-aa5a-307dacb06ef2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.165709 Jul 25 17:02:01.177156 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3266/6452] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:01 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:02.199443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:02.200069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:02.207770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:02.208221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:02.208988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:02.209478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:02.371819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:02.380109 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-44e6eb08-9f1a-4709-bd61-60f2fe45d792 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.185294 Jul 25 17:02:02.380693 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3187/6453] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:02 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:03.403296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:03.404056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:03.413714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:03.414345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:03.415369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:03.415997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:03.570291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:03.578368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4db7a856-d73f-4f40-89a7-0bdbe535c956 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.180501 Jul 25 17:02:03.579185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3267/6454] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:03 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:04.601331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:04.601962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:04.609504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:04.609948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:04.610954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:04.611188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:04.751921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:04.759903 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dcbed431-60a9-4bb1-9a8e-03748fdf9564 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.162524 Jul 25 17:02:04.760488 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3188/6455] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:04 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:05.781299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:05.781928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:05.784805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=30 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:05.790634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:05.791091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:05.791875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:05.792320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:05.795122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=86 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:05.942352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:05.952683 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a277d06d-40cd-4ed9-9eb4-cdc68e8e0ec2 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.175402 Jul 25 17:02:05.953291 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3268/6456] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:05 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:06.978903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:06.979549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:06.982406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=34 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:06.988250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:06.988701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:06.989503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:06.989940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:06.992744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:07.140591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:07.152213 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43796754-7c77-4c11-b568-1bd003196137 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.177193 Jul 25 17:02:07.152981 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3189/6457] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:06 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:08.180186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:08.180822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:08.189042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:08.189628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:08.190767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:08.191229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:08.332926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:08.343155 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26a32083-0cfd-4b9e-9563-a8b4394886f0 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.166929 Jul 25 17:02:08.343760 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3269/6458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:08 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:09.366089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:09.366999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:09.376585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:09.377259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:09.378428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:09.379030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:09.538696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:09.547022 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-73909857-c3a1-40a2-bba0-daa562929952 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.186621 Jul 25 17:02:09.547606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3190/6459] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:09 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:10.568707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:10.569384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:10.576667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:10.577135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:10.577949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:10.578390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:10.723345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:10.735172 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f48e4b58-d099-43ae-a738-64e1b3349d0c tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.170116 Jul 25 17:02:10.736044 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3270/6460] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:10 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:11.760845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:11.761658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:11.768476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:11.768915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:11.769713 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:11.770199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:11.932042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:11.943598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-44b3e207-67c0-4cba-b28c-ab099d05c1ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.186876 Jul 25 17:02:11.944458 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3191/6461] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:11 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:12.972225 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:12.972930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:12.979858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:12.980326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:12.981118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:12.981619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:13.121247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:13.129409 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b7ca38a-a23a-4c19-aa02-e3e81834259f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.163108 Jul 25 17:02:13.129994 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3271/6462] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:12 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:14.150942 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:14.151600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:14.159085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:14.159551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:14.160351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:14.160770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:14.305279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:14.315483 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-008bb0d1-ed37-42c9-96e7-c188ec6481ec tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.168297 Jul 25 17:02:14.316273 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3192/6463] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:14 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:15.336849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:15.337503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:15.346760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:15.347223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:15.348013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:15.348498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:15.485981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:15.497047 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-817d606e-2ad7-4c64-a67d-16c22a9d1395 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.164054 Jul 25 17:02:15.497894 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3272/6464] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:15 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:16.523188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:16.523845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:16.531391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:16.531830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:16.532571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:16.533011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:16.692315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:16.703296 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c64e0e6c-54d4-44e7-90f8-1563a1a8795e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.184023 Jul 25 17:02:16.704174 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3193/6465] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:16 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:17.729472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:17.730168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:17.737715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:17.738193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:17.738942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:17.739383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:17.885451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:17.893298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-90db3679-e91e-475b-b4c2-bea8b000d56e tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1520 microversion: 2.1 time: 0.168147 Jul 25 17:02:17.893875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3273/6466] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:17 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:18.914492 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:18.915106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:18.922119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:18.922571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:18.923343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:18.923778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:19.188634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:19.196815 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ed97583-a345-49f0-bcf6-48b14fa05c5f tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1519 microversion: 2.1 time: 0.286200 Jul 25 17:02:19.197655 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3194/6467] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:18 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:19.318690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8cb01ec2-3e46-4b64-959e-cf1c919648a5 req-bee24f95-69ed-42bf-b95b-2241dc507b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b826ff-cc3d-43bd-a255-a97b81d5583c", "name": "network-vif-unplugged", "status": "completed", "tag": "80d8c5de-420e-405b-896b-926d237a6dc7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:19.329407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8cb01ec2-3e46-4b64-959e-cf1c919648a5 req-bee24f95-69ed-42bf-b95b-2241dc507b7a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:19.329936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8cb01ec2-3e46-4b64-959e-cf1c919648a5 req-bee24f95-69ed-42bf-b95b-2241dc507b7a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:19.343220 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8cb01ec2-3e46-4b64-959e-cf1c919648a5 req-bee24f95-69ed-42bf-b95b-2241dc507b7a service nova] Creating event network-vif-unplugged:80d8c5de-420e-405b-896b-926d237a6dc7 for instance 02b826ff-cc3d-43bd-a255-a97b81d5583c on n-h2-846219-13 Jul 25 17:02:19.349215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-8cb01ec2-3e46-4b64-959e-cf1c919648a5 req-bee24f95-69ed-42bf-b95b-2241dc507b7a service nova] Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:02:19.361367 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8cb01ec2-3e46-4b64-959e-cf1c919648a5 req-bee24f95-69ed-42bf-b95b-2241dc507b7a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046299 Jul 25 17:02:19.362051 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3274/6468] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:02:20.221794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:20.222949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:20.235683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:20.236417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:20.238464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:20.238464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:20.380767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:20.392912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5bbf1d03-3abd-4dc2-9501-18042185ef01 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1517 microversion: 2.1 time: 0.176847 Jul 25 17:02:20.393737 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3195/6469] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:20 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:21.379876 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ad2fcdb5-bb91-4844-afc9-91bce2ddfbe3 req-19b85007-391a-40e1-91ac-feada7131136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b826ff-cc3d-43bd-a255-a97b81d5583c", "tag": "80d8c5de-420e-405b-896b-926d237a6dc7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:21.395283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ad2fcdb5-bb91-4844-afc9-91bce2ddfbe3 req-19b85007-391a-40e1-91ac-feada7131136 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:21.395745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ad2fcdb5-bb91-4844-afc9-91bce2ddfbe3 req-19b85007-391a-40e1-91ac-feada7131136 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:21.409165 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ad2fcdb5-bb91-4844-afc9-91bce2ddfbe3 req-19b85007-391a-40e1-91ac-feada7131136 service nova] Creating event network-changed:80d8c5de-420e-405b-896b-926d237a6dc7 for instance 02b826ff-cc3d-43bd-a255-a97b81d5583c on n-h2-846219-13 Jul 25 17:02:21.415452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-ad2fcdb5-bb91-4844-afc9-91bce2ddfbe3 req-19b85007-391a-40e1-91ac-feada7131136 service nova] Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:02:21.418430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:21.419082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:21.426748 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ad2fcdb5-bb91-4844-afc9-91bce2ddfbe3 req-19b85007-391a-40e1-91ac-feada7131136 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052444 Jul 25 17:02:21.427442 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3275/6470] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:02:21.428340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:21.428871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:21.429915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:21.430195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:21.773965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:21.782411 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0debe14f-c027-46d9-87d6-0ef9726145ea tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1517 microversion: 2.1 time: 0.368411 Jul 25 17:02:21.782999 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3196/6471] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:21 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:22.805412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:22.806119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:22.813125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:22.813598 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:22.814368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:22.814818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:22.978746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:22.987147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f3bd74de-9fc3-442b-b265-28e9cbd9d3b1 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1514 microversion: 2.1 time: 0.186855 Jul 25 17:02:22.987988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3276/6472] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:22 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:23.007993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:23.008580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:23.015763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:23.016210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:23.016974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:23.017432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:23.050265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:02:23.101478 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.compute.api [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Found an unconfirmed migration during delete, id: 16, status: finished Jul 25 17:02:24.583503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6ad87096-e547-4c30-8707-e0b513b24616 req-1121b937-6189-4ca3-9ca5-543e7686ce88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b826ff-cc3d-43bd-a255-a97b81d5583c", "name": "network-vif-plugged", "status": "completed", "tag": "80d8c5de-420e-405b-896b-926d237a6dc7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:24.595787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6ad87096-e547-4c30-8707-e0b513b24616 req-1121b937-6189-4ca3-9ca5-543e7686ce88 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:24.596366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6ad87096-e547-4c30-8707-e0b513b24616 req-1121b937-6189-4ca3-9ca5-543e7686ce88 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:24.611391 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6ad87096-e547-4c30-8707-e0b513b24616 req-1121b937-6189-4ca3-9ca5-543e7686ce88 service nova] Creating event network-vif-plugged:80d8c5de-420e-405b-896b-926d237a6dc7 for instance 02b826ff-cc3d-43bd-a255-a97b81d5583c on n-h2-846219-13 Jul 25 17:02:24.617534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6ad87096-e547-4c30-8707-e0b513b24616 req-1121b937-6189-4ca3-9ca5-543e7686ce88 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038908 Jul 25 17:02:24.618300 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3277/6473] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:02:24.702814 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-335ab7e3-641e-4c81-89d2-171b89256760 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "DELETE /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 204 len: 0 microversion: 2.1 time: 1.698437 Jul 25 17:02:24.703565 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3197/6474] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:02:23 2022] DELETE /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 0 bytes in 1700 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:02:24.712516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:24.713351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:24.720054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:24.720511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:24.721296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:24.721742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:24.867208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:24.875315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-864094ab-15eb-4353-b541-60790bc4ab52 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1506 microversion: 2.1 time: 0.167015 Jul 25 17:02:24.875911 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3278/6475] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:24 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:25.897080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:25.897758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:25.906921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:25.907503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:25.908703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:25.909336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:26.051634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85903197c3784428ad990faceb66f241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f1a4eac8f14f2389a85cb6871635ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:26.060934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0a65a5f3-a023-42f2-9232-54bcf9c59ca7 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 200 len: 1506 microversion: 2.1 time: 0.168518 Jul 25 17:02:26.065244 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3198/6476] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:25 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:26.556716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-18f7f732-dcf3-4988-a460-76cbdf57ec43 req-ea07ee04-aacd-475e-a043-4b499d080802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b826ff-cc3d-43bd-a255-a97b81d5583c", "name": "network-vif-deleted", "tag": "80d8c5de-420e-405b-896b-926d237a6dc7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:26.577772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-18f7f732-dcf3-4988-a460-76cbdf57ec43 req-ea07ee04-aacd-475e-a043-4b499d080802 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:26.578304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-18f7f732-dcf3-4988-a460-76cbdf57ec43 req-ea07ee04-aacd-475e-a043-4b499d080802 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:26.595034 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-18f7f732-dcf3-4988-a460-76cbdf57ec43 req-ea07ee04-aacd-475e-a043-4b499d080802 service nova] Creating event network-vif-deleted:80d8c5de-420e-405b-896b-926d237a6dc7 for instance 02b826ff-cc3d-43bd-a255-a97b81d5583c on n-h2-846219-13 Jul 25 17:02:26.600324 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-18f7f732-dcf3-4988-a460-76cbdf57ec43 req-ea07ee04-aacd-475e-a043-4b499d080802 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048749 Jul 25 17:02:26.600957 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3279/6477] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:02:27.083357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:27.083974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:27.092108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:27.092890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:27.093863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:27.094310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:27.110255 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] HTTP exception thrown: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Request method failure captured: Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c HTTP/1.1 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sxqNRE-s9vKtI0muyrFJWL27BBD_D5Bgm_dqmqhYJIPXED4R6K9AjA7BixQEjgWzQ9b4wAgPDWsDp78GJGL2R30A9DuFXrl0-W0U5-cePZroPMiRWOjJthkUI3eUZmwFMemTc-ykwdNW6fwIx-7dbTzmmrQiqd86QZg9-B9tXSivJc Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 06f1a4eac8f14f2389a85cb6871635ad Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_06f1a4eac8f14f2389a85cb6871635ad"}]}] Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 06f1a4eac8f14f2389a85cb6871635ad Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1939605623-project Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 85903197c3784428ad990faceb66f241 Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1939605623-project Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '02b826ff-cc3d-43bd-a255-a97b81d5583c'} Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:02:27.112046 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Returning 404 to user: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74caa8c4-6fc9-4be7-bf68-9a147ddefd14 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 404 len: 111 microversion: 2.1 time: 0.034572 Jul 25 17:02:27.117580 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3199/6478] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:27 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:02:27.133587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:27.134215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:27.140810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:27.141324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:27.142095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:27.142539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:27.156334 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] HTTP exception thrown: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Request method failure captured: Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c HTTP/1.1 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sxqNRE-s9vKtI0muyrFJWL27BBD_D5Bgm_dqmqhYJIPXED4R6K9AjA7BixQEjgWzQ9b4wAgPDWsDp78GJGL2R30A9DuFXrl0-W0U5-cePZroPMiRWOjJthkUI3eUZmwFMemTc-ykwdNW6fwIx-7dbTzmmrQiqd86QZg9-B9tXSivJc Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 06f1a4eac8f14f2389a85cb6871635ad Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_06f1a4eac8f14f2389a85cb6871635ad"}]}] Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 06f1a4eac8f14f2389a85cb6871635ad Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-DeleteServersTestJSON-1939605623-project Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 85903197c3784428ad990faceb66f241 Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-DeleteServersTestJSON-1939605623-project Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '02b826ff-cc3d-43bd-a255-a97b81d5583c'} Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:02:27.158058 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Returning 404 to user: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-420fb65f-e0b4-44aa-8815-984aef6b7f84 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "DELETE /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 404 len: 111 microversion: 2.1 time: 0.030389 Jul 25 17:02:27.163589 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3280/6479] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:02:27 2022] DELETE /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:02:27.168465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:27.169122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] [instance: 02b826ff-cc3d-43bd-a255-a97b81d5583c] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:27.175769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:27.176233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:27.177074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:27.177542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:27.192651 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] HTTP exception thrown: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Request method failure captured: Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c HTTP/1.1 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sxqNRE-s9vKtI0muyrFJWL27BBD_D5Bgm_dqmqhYJIPXED4R6K9AjA7BixQEjgWzQ9b4wAgPDWsDp78GJGL2R30A9DuFXrl0-W0U5-cePZroPMiRWOjJthkUI3eUZmwFMemTc-ykwdNW6fwIx-7dbTzmmrQiqd86QZg9-B9tXSivJc Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 06f1a4eac8f14f2389a85cb6871635ad Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/06f1a4eac8f14f2389a85cb6871635ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_06f1a4eac8f14f2389a85cb6871635ad"}]}] Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 06f1a4eac8f14f2389a85cb6871635ad Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1939605623 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-DeleteServersTestJSON-1939605623-project Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 85903197c3784428ad990faceb66f241 Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-DeleteServersTestJSON-1939605623-project Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '02b826ff-cc3d-43bd-a255-a97b81d5583c'} Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:02:27.194477 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] Returning 404 to user: Instance 02b826ff-cc3d-43bd-a255-a97b81d5583c could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8bec4818-c85f-4a3c-b156-6712bb2b77e8 tempest-DeleteServersTestJSON-1939605623 tempest-DeleteServersTestJSON-1939605623-project] 10.222.0.105 "GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c" status: 404 len: 111 microversion: 2.1 time: 0.031531 Jul 25 17:02:27.199508 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3200/6480] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:27 2022] GET /compute/v2.1/servers/02b826ff-cc3d-43bd-a255-a97b81d5583c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:02:36.305694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-480201594", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "52825cf0-893d-491e-902c-ce5b09a5e7ce"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:36.314486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=26 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:36.364548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] validate_networks() for [('52825cf0-893d-491e-902c-ce5b09a5e7ce', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:02:36.851885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:02:36.852490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:02:36.853170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:02:36.853709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:02:36.854307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:02:36.870915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:36.871370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:36.872179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:36.872623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:36.877932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=62 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:36.894122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Getting quotas for project da116f060c33486c982315e03d343ed0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:02:36.900190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Getting quotas for user 570d3ff324924628bb3882a27ac93036 and project da116f060c33486c982315e03d343ed0. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:02:36.913651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:02:36.916151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:02:36.965315 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-18eae7bf-baec-4bd4-bd35-b6f3681c20cd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.799842 Jul 25 17:02:36.965988 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3281/6481] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:02:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:02:36.977674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11dad9da-ee5f-4379-bcd5-02400d771312 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:36.978298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11dad9da-ee5f-4379-bcd5-02400d771312 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:37.037195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11dad9da-ee5f-4379-bcd5-02400d771312 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:37.051185 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11dad9da-ee5f-4379-bcd5-02400d771312 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1221 microversion: 2.1 time: 0.077442 Jul 25 17:02:37.052171 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3201/6482] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:36 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:02:38.073991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:38.074805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:38.084797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:38.085661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:38.086473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:38.086920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:38.337590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:38.346737 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc6b7c19-9137-448b-96d4-b850792ff3b8 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1281 microversion: 2.1 time: 0.278510 Jul 25 17:02:38.347830 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3282/6483] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:38 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:39.372844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:39.373699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:39.376442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:39.379986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:39.387013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:39.387471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:39.388285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:39.388715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:39.614392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:39.637393 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d4b4e71-0d40-43c5-9282-168213445091 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.271107 Jul 25 17:02:39.638352 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3202/6484] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:39 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:39.790542 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-1e15731b-4da0-4f06-b208-d9d9ecfb6ad1 req-e59330c3-3930-4d65-a918-44ddd5d4d9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868c6222-caf3-4258-90bd-cfbff787b3b7", "tag": "1603ee11-0eb8-41dc-b4f8-91d538159851"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:39.807789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1e15731b-4da0-4f06-b208-d9d9ecfb6ad1 req-e59330c3-3930-4d65-a918-44ddd5d4d9e6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:39.808253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-1e15731b-4da0-4f06-b208-d9d9ecfb6ad1 req-e59330c3-3930-4d65-a918-44ddd5d4d9e6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:39.821073 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-1e15731b-4da0-4f06-b208-d9d9ecfb6ad1 req-e59330c3-3930-4d65-a918-44ddd5d4d9e6 service nova] Creating event network-changed:1603ee11-0eb8-41dc-b4f8-91d538159851 for instance 868c6222-caf3-4258-90bd-cfbff787b3b7 on n-h1-846219-13 Jul 25 17:02:39.827236 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-1e15731b-4da0-4f06-b208-d9d9ecfb6ad1 req-e59330c3-3930-4d65-a918-44ddd5d4d9e6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042291 Jul 25 17:02:39.828184 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3283/6485] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:02:40.659021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:40.659625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:40.667289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:40.667733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:40.668544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:40.668956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:40.854473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:40.863189 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d9d5551f-28e9-4813-8f99-31028736889e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.208031 Jul 25 17:02:40.863922 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3203/6486] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:40 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:41.886207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:41.886807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:41.893775 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:41.894241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:41.895029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:41.895485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:42.034822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:42.043672 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93d904ad-ece4-4c6f-82af-a2e6754fa107 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.162884 Jul 25 17:02:42.044295 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3284/6487] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:41 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:43.064082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:43.064605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:43.072793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:43.073275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:43.074141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:43.074575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:43.227256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:43.235973 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67ff7746-6e2f-4bc9-a0c0-bb38ef9c1725 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.176017 Jul 25 17:02:43.236597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3204/6488] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:43 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:44.256386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:44.257020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:44.267516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:44.268004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:44.268821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:44.269333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:44.412587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:44.420595 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c88a3399-4e23-47af-b59f-8a92ad1e9561 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.168191 Jul 25 17:02:44.421208 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3285/6489] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:44 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:45.442086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:45.442697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:45.450248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:45.450717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:45.451491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:45.451918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:45.595681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:45.605046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5bb199b5-db68-4a88-a06f-afbf8a3aea2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.166960 Jul 25 17:02:45.605669 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3205/6490] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:45 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:45.819805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c4bebd58-a94b-4116-90aa-314f7c96a034 req-31c52caa-7c8f-4343-9a75-f8865de20cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868c6222-caf3-4258-90bd-cfbff787b3b7", "name": "network-vif-plugged", "status": "completed", "tag": "1603ee11-0eb8-41dc-b4f8-91d538159851"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:45.830940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c4bebd58-a94b-4116-90aa-314f7c96a034 req-31c52caa-7c8f-4343-9a75-f8865de20cfb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:45.831353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c4bebd58-a94b-4116-90aa-314f7c96a034 req-31c52caa-7c8f-4343-9a75-f8865de20cfb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:45.843763 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c4bebd58-a94b-4116-90aa-314f7c96a034 req-31c52caa-7c8f-4343-9a75-f8865de20cfb service nova] Creating event network-vif-plugged:1603ee11-0eb8-41dc-b4f8-91d538159851 for instance 868c6222-caf3-4258-90bd-cfbff787b3b7 on n-h1-846219-13 Jul 25 17:02:45.848807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c4bebd58-a94b-4116-90aa-314f7c96a034 req-31c52caa-7c8f-4343-9a75-f8865de20cfb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Jul 25 17:02:45.849627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3286/6491] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:02:46.627271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:46.627886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:46.635573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:46.636107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:46.637031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:46.637516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:46.781538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:46.793877 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4a03551b-6943-40c3-be13-23ffb18bfef0 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1321 microversion: 2.1 time: 0.170155 Jul 25 17:02:46.794572 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3206/6492] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:46 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:47.814417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:47.815229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:47.820355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:47.821082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:47.828830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:47.829364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:47.830134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:47.830609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:47.977415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:47.988813 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-199ac0ee-2338-4415-85e5-d16817962994 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1511 microversion: 2.1 time: 0.176173 Jul 25 17:02:47.989527 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3287/6493] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:47 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:48.009603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:48.010210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:48.012082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:02:48.020524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.021071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.022009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.022691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.171582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:48.179622 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-747d41ac-be49-4e2f-a168-5254f1481f4b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1511 microversion: 2.1 time: 0.173867 Jul 25 17:02:48.180210 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3207/6494] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:48 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:48.203393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:48.206030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:48.214612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.215073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.216359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.216359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.286539 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7d682d19-4636-4bfb-88ee-5700c4593cff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "PUT /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1083 microversion: 2.1 time: 0.090261 Jul 25 17:02:48.287210 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3288/6495] 10.222.0.105 () {60 vars in 1261 bytes} [Mon Jul 25 17:02:48 2022] PUT /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1083 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:48.304195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:48.304808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:48.311452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.311909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.312679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.313142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.463464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:48.471806 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b4b99d3-5301-46eb-9c35-8a215b05297f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1509 microversion: 2.1 time: 0.171577 Jul 25 17:02:48.472384 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3208/6496] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:48 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:48.494391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:48.495514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:48.503725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.504190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.505006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.505488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.652363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:48.660703 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f07973e7-120f-44ab-9f9d-6632f30773ee tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1509 microversion: 2.1 time: 0.172867 Jul 25 17:02:48.661325 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3289/6497] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:48 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:48.681521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:02:48.683946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:48.690110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.690553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.691350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.691775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.726314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:48.732528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:02:48.739586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:02:48.740006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:02:48.740475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:02:48.740879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:02:48.741329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:02:48.810345 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2511bab0-d293-4358-8031-5bd4841f315c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7/action" status: 202 len: 0 microversion: 2.1 time: 0.133258 Jul 25 17:02:48.811420 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3209/6498] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:02:48 2022] POST /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:02:48.819586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:48.820306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:48.827800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.828265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.829114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:48.829722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:48.968571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:48.976822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4eb04fdc-a9aa-4ef4-a5a4-b28ce8d4b472 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1520 microversion: 2.1 time: 0.161181 Jul 25 17:02:48.977423 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3290/6499] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:48 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:49.998504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:49.999132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:50.010196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:50.010398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:50.011452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:50.011933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:50.152105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:50.163005 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fbae25c0-c891-4ed9-ac78-3471cb0ad2b6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1520 microversion: 2.1 time: 0.168418 Jul 25 17:02:50.163602 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3210/6500] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:49 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:51.184192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:51.184760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:51.192255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:51.192710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:51.193516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:51.193932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:51.340850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:51.349433 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6ce1de0-175d-4168-ad3b-b343ac6f7f63 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.169082 Jul 25 17:02:51.350028 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3291/6501] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:51 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:52.371147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:52.371656 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:52.379146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:52.379657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:52.380448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:52.380879 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:52.521151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:52.529766 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9074d4ac-0006-42da-839b-27730a13ac56 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.162652 Jul 25 17:02:52.530381 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3211/6502] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:52 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:53.552160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:53.552803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:53.560587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:53.561055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:53.561899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:53.562341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:53.695191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:53.703727 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1239dbc-cf92-43c8-bf45-01572741d2d6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.155754 Jul 25 17:02:53.704327 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3292/6503] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:53 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:54.729199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:54.729824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:54.737324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:54.737750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:54.738539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:54.738974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:54.892586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:54.902855 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ddd6494c-d04b-4302-af93-08adb87f505b tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.179296 Jul 25 17:02:54.903413 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3212/6504] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:54 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:55.926257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:55.927326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:55.936588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:55.937258 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:55.938468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:55.939123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:56.093156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:56.104866 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f3cffb7d-5354-4762-8ffb-8be2e1864d9c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.183430 Jul 25 17:02:56.105636 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3293/6505] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:55 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:57.127132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:57.127652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:57.135163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:57.135617 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:57.136389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:57.136823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:57.276483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:57.284942 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e2da7e04-1a94-409c-88f6-1f07c6e65554 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.161946 Jul 25 17:02:57.285574 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3213/6506] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:57 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:58.307765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:58.308407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:58.316850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:58.317324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:58.318116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:58.318602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:58.473418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:58.484445 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-240c7411-d2d5-4218-a2c0-4169a9f52cb2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.180927 Jul 25 17:02:58.485239 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3294/6507] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:58 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:02:59.506515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:02:59.507213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:02:59.514850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:59.515303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:59.516083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:02:59.516522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:02:59.652036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:02:59.659827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-57d56037-2d0e-4363-b310-58a2cd59ce1c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.157437 Jul 25 17:02:59.660371 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3214/6508] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:02:59 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:00.686703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:00.687334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:00.694774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:00.695239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:00.696022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:00.696472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:00.842041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:00.849773 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-58b8f0de-8f31-423a-b67f-2af56138b949 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.168902 Jul 25 17:03:00.850353 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3295/6509] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:00 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:01.871502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:01.872037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:01.879997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:01.880446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:01.881273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:01.881735 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:02.029634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:02.037364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-342b078b-2994-4491-b9ab-c829f8f173c2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.169915 Jul 25 17:03:02.037928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3215/6510] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:01 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:03.059676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:03.060356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:03.068016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:03.068483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:03.069304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:03.069743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:03.222569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:03.233976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1503a7b2-b129-4185-af57-2f0c6239b528 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.178310 Jul 25 17:03:03.234566 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3296/6511] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:03 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:04.259291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:04.259971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:04.268491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:04.268945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:04.269750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:04.270189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:04.410588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:04.422363 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6dd5fce9-715b-49b7-9d24-3a2e2e3b57b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.169369 Jul 25 17:03:04.423117 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3216/6512] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:04 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:05.444201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:05.444841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:05.454490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:05.455179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:05.456330 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:05.457142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:05.607199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:05.615214 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1e4dadd7-73b8-421b-8bb9-2513d69d88f4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.174948 Jul 25 17:03:05.615813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3297/6513] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:05 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:06.638933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:06.639672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:06.649779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:06.650425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:06.651477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:06.652029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:06.656701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:06.821307 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:06.832152 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f875dbf-b9f0-4bdb-8430-a1b51d4f7272 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.199148 Jul 25 17:03:06.833008 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3217/6514] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:06 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:07.858112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:07.858690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:07.861551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:07.868236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:07.868659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:07.869466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:07.869915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:07.873087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:08.023964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:08.034860 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f1f5e62e-5ed1-454c-aeb9-a7e2b494f7c4 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.180839 Jul 25 17:03:08.035459 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3298/6515] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:07 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:09.057988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:09.058639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:09.066360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:09.066813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:09.067592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:09.068031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:09.210359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:09.218552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f526e00f-9a8e-495a-a875-567e584b886c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.164835 Jul 25 17:03:09.219247 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3218/6516] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:09 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:10.241307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:10.241977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:10.250856 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:10.251383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:10.252337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:10.252803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:10.401121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:10.410141 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f133db3a-0f39-4d27-9314-027f98279b55 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.173670 Jul 25 17:03:10.410748 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3299/6517] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:10 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:11.435072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:11.435664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:11.438005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=38 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:11.444016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:11.444461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:11.445257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:11.445688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:11.597346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:11.605482 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5494bcb-5b38-4c79-aaa1-b387c3b767db tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.176976 Jul 25 17:03:11.606073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3219/6518] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:11 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:12.627759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:12.628352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:12.635369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:12.635834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:12.636624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:12.637074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:12.797682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:12.808737 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d503fa8b-c4f6-4691-9cc3-3f5cc44e9b69 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.184992 Jul 25 17:03:12.809592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3300/6519] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:12 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:13.832445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:13.833709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:13.843361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:13.843940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:13.844941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:13.845574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:13.981075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:13.989338 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74bc3293-6321-4e76-b265-27d9e988dee9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.161981 Jul 25 17:03:13.989930 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3220/6520] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:13 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:15.010496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:15.011061 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:15.018432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:15.018888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:15.019805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:15.020133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:15.164318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:15.172332 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cef00bec-cfcb-4cab-87d8-56a84d81eca6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.165890 Jul 25 17:03:15.172912 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3301/6521] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:15 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:16.194528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:16.195143 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:16.202649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:16.203097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:16.203848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:16.204270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:16.347549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:16.355844 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8823837a-4a99-4bfa-adfd-786417eea284 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.165626 Jul 25 17:03:16.356481 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3221/6522] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:16 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:17.380244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:17.380872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:17.391917 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:17.392624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:17.393993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:17.394466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:17.532595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:17.540516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-23ff9fb7-33af-4737-95cc-43f0b1872164 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.165961 Jul 25 17:03:17.541280 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3302/6523] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:17 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:18.563087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:18.563667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:18.572616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:18.573200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:18.574288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:18.574853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:18.725671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:18.737927 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25161f4e-15d3-4c2d-8560-20292fc6c1cb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.178753 Jul 25 17:03:18.738786 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3222/6524] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:18 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:19.764026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:19.764622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:19.772187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:19.772651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:19.773474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:19.773946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:19.919931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:19.928872 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b376de2-03e8-4a73-9082-7d71c20c099f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.169232 Jul 25 17:03:19.929604 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3303/6525] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:19 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:20.957631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:20.958511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:20.966712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:20.967159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:20.967984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:20.968406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:21.122024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:21.129879 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c1ec5dc-c1c4-45b7-8675-475612ebab67 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.177429 Jul 25 17:03:21.130464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3223/6526] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:20 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:22.151169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:22.151811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:22.159546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:22.160000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:22.160784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:22.161253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:22.299970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:22.308047 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-86a24bd6-376e-4722-bbd9-bea4fab37dc2 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.160828 Jul 25 17:03:22.308602 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3304/6527] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:22 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:23.328767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:23.329403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:23.336832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:23.337318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:23.338074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:23.338502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:23.486597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:23.494591 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-94f507e7-5b25-41e8-9a30-8f9904fbc3b9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1525 microversion: 2.1 time: 0.169816 Jul 25 17:03:23.495216 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3224/6528] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:23 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:24.257596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b63f2552-990e-4ed4-ae7d-d518518ada49 req-1fa98349-4894-4474-a529-557fc80f7de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868c6222-caf3-4258-90bd-cfbff787b3b7", "name": "network-vif-unplugged", "status": "completed", "tag": "1603ee11-0eb8-41dc-b4f8-91d538159851"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:24.268961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b63f2552-990e-4ed4-ae7d-d518518ada49 req-1fa98349-4894-4474-a529-557fc80f7de7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:24.269578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b63f2552-990e-4ed4-ae7d-d518518ada49 req-1fa98349-4894-4474-a529-557fc80f7de7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:24.282563 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b63f2552-990e-4ed4-ae7d-d518518ada49 req-1fa98349-4894-4474-a529-557fc80f7de7 service nova] Creating event network-vif-unplugged:1603ee11-0eb8-41dc-b4f8-91d538159851 for instance 868c6222-caf3-4258-90bd-cfbff787b3b7 on n-h2-846219-13 Jul 25 17:03:24.288340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-b63f2552-990e-4ed4-ae7d-d518518ada49 req-1fa98349-4894-4474-a529-557fc80f7de7 service nova] Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:03:24.299899 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b63f2552-990e-4ed4-ae7d-d518518ada49 req-1fa98349-4894-4474-a529-557fc80f7de7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046634 Jul 25 17:03:24.300734 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3305/6529] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:24.516788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:24.517769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:24.526343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:24.540933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:24.542028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:24.542486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:24.780120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:24.788006 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-21291da3-fe6c-46d1-9a37-1e3436e5526f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1524 microversion: 2.1 time: 0.275774 Jul 25 17:03:24.788608 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3225/6530] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:24 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1524 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:25.814192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:25.815403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:25.827143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:25.829062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:25.829062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:25.829368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:25.985637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:25.993623 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cb1ff686-accc-499e-a5ee-b54ca85f6086 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1522 microversion: 2.1 time: 0.186582 Jul 25 17:03:25.994190 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3306/6531] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:25 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:26.317802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-53d3ee03-a4a2-422d-b4c8-abe8fd6c70d9 req-3490e967-832d-4b3c-be06-43f09bab0995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868c6222-caf3-4258-90bd-cfbff787b3b7", "tag": "1603ee11-0eb8-41dc-b4f8-91d538159851"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:26.328499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-53d3ee03-a4a2-422d-b4c8-abe8fd6c70d9 req-3490e967-832d-4b3c-be06-43f09bab0995 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:26.328941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-53d3ee03-a4a2-422d-b4c8-abe8fd6c70d9 req-3490e967-832d-4b3c-be06-43f09bab0995 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:26.341995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-53d3ee03-a4a2-422d-b4c8-abe8fd6c70d9 req-3490e967-832d-4b3c-be06-43f09bab0995 service nova] Creating event network-changed:1603ee11-0eb8-41dc-b4f8-91d538159851 for instance 868c6222-caf3-4258-90bd-cfbff787b3b7 on n-h2-846219-13 Jul 25 17:03:26.347845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-53d3ee03-a4a2-422d-b4c8-abe8fd6c70d9 req-3490e967-832d-4b3c-be06-43f09bab0995 service nova] Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:03:26.359128 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-53d3ee03-a4a2-422d-b4c8-abe8fd6c70d9 req-3490e967-832d-4b3c-be06-43f09bab0995 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045189 Jul 25 17:03:26.359741 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3226/6532] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:27.015416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:27.016004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:27.023664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:27.024145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:27.024912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:27.025387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:27.390913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:27.400484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af963e32-0fd7-4d4f-b7bf-825e98218edb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1519 microversion: 2.1 time: 0.388901 Jul 25 17:03:27.406211 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3307/6533] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:27 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:27.426115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:27.426767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:27.433716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:27.434086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:27.434849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:27.435281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:27.496169 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c265d40-c3f8-4b7c-90f5-e608d4e67def tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7/action" status: 204 len: 0 microversion: 2.1 time: 0.076140 Jul 25 17:03:27.500105 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3227/6534] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:03:27 2022] POST /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 17:03:27.505521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:27.506143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:27.513567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:27.514477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:27.515732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:27.516019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:27.682115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:27.690212 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6793c833-e038-49af-a47a-4ca629d78582 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1519 microversion: 2.1 time: 0.188689 Jul 25 17:03:27.690734 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3308/6535] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:27 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:28.712990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:28.713999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:28.721508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:28.721948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:28.722729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:28.723162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:28.794391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-43bbc3f4-4036-433a-816e-80fbad1e92c2 req-54192d3e-e927-4535-9af0-2437d66f2c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868c6222-caf3-4258-90bd-cfbff787b3b7", "name": "network-vif-plugged", "status": "completed", "tag": "1603ee11-0eb8-41dc-b4f8-91d538159851"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:28.811094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-43bbc3f4-4036-433a-816e-80fbad1e92c2 req-54192d3e-e927-4535-9af0-2437d66f2c80 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:28.812702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-43bbc3f4-4036-433a-816e-80fbad1e92c2 req-54192d3e-e927-4535-9af0-2437d66f2c80 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:28.831286 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-43bbc3f4-4036-433a-816e-80fbad1e92c2 req-54192d3e-e927-4535-9af0-2437d66f2c80 service nova] Creating event network-vif-plugged:1603ee11-0eb8-41dc-b4f8-91d538159851 for instance 868c6222-caf3-4258-90bd-cfbff787b3b7 on n-h2-846219-13 Jul 25 17:03:28.837484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-43bbc3f4-4036-433a-816e-80fbad1e92c2 req-54192d3e-e927-4535-9af0-2437d66f2c80 service nova] Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:03:28.849602 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-43bbc3f4-4036-433a-816e-80fbad1e92c2 req-54192d3e-e927-4535-9af0-2437d66f2c80 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059677 Jul 25 17:03:28.850530 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3309/6536] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:28.889483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:28.901069 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39f841b8-9d80-4449-9a5d-15d32920d10c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1519 microversion: 2.1 time: 0.193003 Jul 25 17:03:28.901809 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3228/6537] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:28 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:29.924925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:29.925610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:29.932376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:29.932835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:29.933636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:29.934075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:30.069858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:30.077704 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1525e8d4-18c0-495c-abcf-fac445748c94 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1511 microversion: 2.1 time: 0.158299 Jul 25 17:03:30.078285 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3310/6538] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:29 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:30.099619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:30.100209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:30.107618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:30.108071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:30.108848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:30.109322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:30.254043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:30.262339 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6f151ef4-59e0-4c43-88ea-f40c4d67b2ed tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1511 microversion: 2.1 time: 0.166650 Jul 25 17:03:30.262930 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3229/6539] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:30 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:30.286307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bcaad04-cbd7-4c09-892f-68b782cc28bb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'create', calling method: .version_select at 0x7f9d92319310>, body: {"keypair": {"name": "tempest-keypair-407379292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrgb5dRbZRLS/BMcmyTpzUnsHdokrXO8vZIgh3Z9nq1A4YbL5SHJy3rOuUpJTSo229sYIJhxCNzayheY5E8O4VDfZN/amnPhBRKgKFZrkVklSd54CdT/ulhvQUDAhnYJg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:30.307751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7bcaad04-cbd7-4c09-892f-68b782cc28bb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Getting quotas for project da116f060c33486c982315e03d343ed0. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:03:30.314568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7bcaad04-cbd7-4c09-892f-68b782cc28bb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Getting quotas for user 570d3ff324924628bb3882a27ac93036 and project da116f060c33486c982315e03d343ed0. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:03:30.346439 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7bcaad04-cbd7-4c09-892f-68b782cc28bb tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064050 Jul 25 17:03:30.347056 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3311/6540] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:03:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:31.719284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:31.719937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:31.727744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:31.728234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:31.729088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:31.729609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:31.868511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:31.876619 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-503bbb7e-2995-446c-a16b-f5b570dc6923 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 200 len: 1511 microversion: 2.1 time: 0.161648 Jul 25 17:03:31.877272 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3230/6541] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:31 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:31.898045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:31.898599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:31.906041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:31.906505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:31.907296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:31.907740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:31.933426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:03:32.013361 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fc4fde7-1051-4969-91a2-22379d7109b7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "DELETE /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 204 len: 0 microversion: 2.1 time: 0.119640 Jul 25 17:03:32.014400 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3312/6542] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:03:31 2022] DELETE /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:03:32.073144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1354031193", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "52825cf0-893d-491e-902c-ce5b09a5e7ce"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:32.128495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] validate_networks() for [('52825cf0-893d-491e-902c-ce5b09a5e7ce', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:03:32.520990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:03:32.521452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:03:32.521928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:03:32.522315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:03:32.522751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:03:32.532422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:32.532871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:32.533772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:32.534208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:32.554591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Getting quotas for project da116f060c33486c982315e03d343ed0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:03:32.560271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Getting quotas for user 570d3ff324924628bb3882a27ac93036 and project da116f060c33486c982315e03d343ed0. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:03:32.574527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:03:32.576812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:03:32.622884 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-13fae084-a5a7-4773-ad07-c5d3185a4cdd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.553694 Jul 25 17:03:32.623562 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3231/6543] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:03:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:03:32.635372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c971738b-c1e7-4caf-931f-20f240a9c05e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:32.636082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c971738b-c1e7-4caf-931f-20f240a9c05e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:32.694769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c971738b-c1e7-4caf-931f-20f240a9c05e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:32.703468 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c971738b-c1e7-4caf-931f-20f240a9c05e tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1222 microversion: 2.1 time: 0.072333 Jul 25 17:03:32.704069 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3313/6544] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:32 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:33.725652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:33.727192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:33.735312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:33.735997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:33.736832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:33.737285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:33.819256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:33.830694 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3476ae1d-0063-473a-bb3a-961f8c4928ec tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1274 microversion: 2.1 time: 0.109756 Jul 25 17:03:33.831806 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3232/6545] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:33 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:33.944925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7bad643c-c7f1-4a40-af6a-c5af29e6ed54 req-7350f87b-2473-4dc5-b738-68aac7ef79e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868c6222-caf3-4258-90bd-cfbff787b3b7", "name": "network-vif-deleted", "tag": "1603ee11-0eb8-41dc-b4f8-91d538159851"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:33.961631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7bad643c-c7f1-4a40-af6a-c5af29e6ed54 req-7350f87b-2473-4dc5-b738-68aac7ef79e4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:33.962489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7bad643c-c7f1-4a40-af6a-c5af29e6ed54 req-7350f87b-2473-4dc5-b738-68aac7ef79e4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:33.977951 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7bad643c-c7f1-4a40-af6a-c5af29e6ed54 req-7350f87b-2473-4dc5-b738-68aac7ef79e4 service nova] Creating event network-vif-deleted:1603ee11-0eb8-41dc-b4f8-91d538159851 for instance 868c6222-caf3-4258-90bd-cfbff787b3b7 on n-h2-846219-13 Jul 25 17:03:33.983507 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7bad643c-c7f1-4a40-af6a-c5af29e6ed54 req-7350f87b-2473-4dc5-b738-68aac7ef79e4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042065 Jul 25 17:03:33.984792 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3314/6546] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:34.852521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:34.853051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:34.860613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:34.861066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:34.862028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:34.862467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:34.999188 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:35.001524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:35.009429 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-186d4f6e-b60c-4c6c-abc3-c5d0b515bede tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.160967 Jul 25 17:03:35.010037 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3233/6547] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:34 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:35.415480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6dafa057-b0b3-4322-8fca-3dcb14f13418 req-6f7b05c6-820a-4045-ab10-b43953ca6036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b638d109-e0c5-4054-b4c1-1f002defe92a", "tag": "a8783024-bce9-49be-a2b1-ccb84885a430"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:35.425643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6dafa057-b0b3-4322-8fca-3dcb14f13418 req-6f7b05c6-820a-4045-ab10-b43953ca6036 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:35.426100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6dafa057-b0b3-4322-8fca-3dcb14f13418 req-6f7b05c6-820a-4045-ab10-b43953ca6036 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:35.448295 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6dafa057-b0b3-4322-8fca-3dcb14f13418 req-6f7b05c6-820a-4045-ab10-b43953ca6036 service nova] Creating event network-changed:a8783024-bce9-49be-a2b1-ccb84885a430 for instance b638d109-e0c5-4054-b4c1-1f002defe92a on n-h1-846219-13 Jul 25 17:03:35.453516 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6dafa057-b0b3-4322-8fca-3dcb14f13418 req-6f7b05c6-820a-4045-ab10-b43953ca6036 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096427 Jul 25 17:03:35.454298 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3315/6548] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:36.033146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:36.033920 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:36.042135 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:36.042515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:36.043286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:36.043724 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:36.191563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:36.203046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9a9fa7f-82c3-410d-bafc-642e918c865d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.175632 Jul 25 17:03:36.203817 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3234/6549] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:36 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:37.227063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:37.227816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:37.234629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:37.235095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:37.235879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:37.236333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:37.388840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:37.396578 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f31dbf87-a52f-4f9c-bb65-4ddae015aa2a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.174806 Jul 25 17:03:37.397196 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3316/6550] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:37 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:38.420862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:38.421470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:38.429434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:38.429891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:38.430650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:38.431119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:38.570150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:38.578046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d43dd5f4-8456-4b31-bdb8-0b3b6de0d62c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.161251 Jul 25 17:03:38.578628 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3235/6551] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:38 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:39.600572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:39.601198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:39.604028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:39.609526 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:39.609985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:39.610779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:39.611222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:39.614560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:39.752239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:39.760698 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c673ec3-5f72-4bec-9ecc-25f28782e38d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.164277 Jul 25 17:03:39.761302 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3317/6552] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:39 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:40.789763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:40.790428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:40.800456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:40.800910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:40.801707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:40.802136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:40.936540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:40.948240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8f168b6a-b815-4eb3-a2df-a6fba48cacff tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.162028 Jul 25 17:03:40.949044 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3236/6553] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:40 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:41.972547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:41.973828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:41.981227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:41.981693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:41.982531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:41.982981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:42.118767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:42.126345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-83f15760-5dae-4d5e-a01c-70a07c103936 req-6182babc-7831-4e04-85b0-ce86977b6971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b638d109-e0c5-4054-b4c1-1f002defe92a", "name": "network-vif-plugged", "status": "completed", "tag": "a8783024-bce9-49be-a2b1-ccb84885a430"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:42.127343 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e7900e4c-5453-4a3a-8f6d-42c410803a1d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.159063 Jul 25 17:03:42.134377 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3318/6554] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:41 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:42.134646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:42.142337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-83f15760-5dae-4d5e-a01c-70a07c103936 req-6182babc-7831-4e04-85b0-ce86977b6971 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:42.142969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-83f15760-5dae-4d5e-a01c-70a07c103936 req-6182babc-7831-4e04-85b0-ce86977b6971 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:42.156231 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-83f15760-5dae-4d5e-a01c-70a07c103936 req-6182babc-7831-4e04-85b0-ce86977b6971 service nova] Creating event network-vif-plugged:a8783024-bce9-49be-a2b1-ccb84885a430 for instance b638d109-e0c5-4054-b4c1-1f002defe92a on n-h1-846219-13 Jul 25 17:03:42.161380 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-83f15760-5dae-4d5e-a01c-70a07c103936 req-6182babc-7831-4e04-85b0-ce86977b6971 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039557 Jul 25 17:03:42.162174 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3237/6555] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:03:43.149792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:43.150410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:43.152390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:43.159011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:43.159465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:43.160227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:43.160670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:43.315471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:43.324022 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ab62603-fb2b-4889-a4d9-9adfaf2a1468 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1322 microversion: 2.1 time: 0.178092 Jul 25 17:03:43.324612 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3319/6556] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:43 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:44.347313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:44.348083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:44.350266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:44.350948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:03:44.357897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.358455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.359234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.359748 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.509746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:44.517779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-06b48413-8c05-49f1-a6a6-9b2dad34e197 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1511 microversion: 2.1 time: 0.175093 Jul 25 17:03:44.518397 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3238/6557] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:44 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:44.541004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:44.541687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:44.551014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.551483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.552271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.552754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.700156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:44.709819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7ef20783-1587-4977-8494-02b09b126db6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1511 microversion: 2.1 time: 0.174710 Jul 25 17:03:44.710435 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3320/6558] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:44 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:44.730377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:03:44.732760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:44.739020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.739458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.740208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.740634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.768438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:44.774940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:03:44.781690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:03:44.782103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:03:44.782566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:03:44.782960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:03:44.783419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:03:44.855552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a7b6049f-19d9-48ee-a16d-68744c451589 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a/action" status: 202 len: 0 microversion: 2.1 time: 0.129089 Jul 25 17:03:44.856637 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3239/6559] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:03:44 2022] POST /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:03:44.864725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:44.865410 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:44.871637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.872102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:44.872881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:44.873360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:45.009580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:45.017532 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eaeb53c0-8e08-4fd7-8093-d7f7a6f972d9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1518 microversion: 2.1 time: 0.156861 Jul 25 17:03:45.018101 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3321/6560] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:44 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:46.039120 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:46.039710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:46.047313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:46.047779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:46.048559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:46.049124 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:46.195372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:46.203056 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fc1e923-25c8-438c-b36c-b988b61726da tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1518 microversion: 2.1 time: 0.168051 Jul 25 17:03:46.203642 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3240/6561] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:46 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:47.227939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:47.228929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:47.236493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:47.236955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:47.237776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:47.238223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:47.378154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:47.385976 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b2c51671-8b45-486a-afca-bd525d55356f tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.163297 Jul 25 17:03:47.386530 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3322/6562] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:47 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:48.408984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:48.409619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:48.418244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:48.418816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:48.419751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:48.420313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:48.563410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:48.573473 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-80f2fb6b-61ea-4d5e-9aa8-7e2c45ad96ae tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.168975 Jul 25 17:03:48.574165 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3241/6563] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:48 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:49.601048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:49.601645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:49.609286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:49.609752 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:49.610556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:49.611007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:49.774712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:49.787229 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-639a0431-fc26-4e27-b35e-61562c4a304a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.190053 Jul 25 17:03:49.788287 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3323/6564] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:49 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:50.813758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:50.814374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:50.821070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:50.821553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:50.822300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:50.822730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:50.970136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:50.977962 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-656fdd43-21d3-4c98-8c17-ef696a558d99 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.168329 Jul 25 17:03:50.978474 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3242/6565] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:50 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:52.007893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:52.008497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:52.018718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:52.019184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:52.019986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:52.020425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:52.170681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:52.179919 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-002dd0b8-7913-4460-aa5d-edb68872c414 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.177976 Jul 25 17:03:52.180498 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3324/6566] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:52 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:53.201027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:53.201639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:53.208884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:53.209375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:53.210134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:53.210669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:53.366020 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:53.377565 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3f48c6bb-30f0-4fe2-8a11-6c798279f866 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.180266 Jul 25 17:03:53.378333 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3243/6567] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:53 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:54.399245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:54.399812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:54.407497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:54.407954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:54.408825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:54.409319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:54.806643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:54.817312 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0637a60d-86a7-4777-9e98-6f47ca335948 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.422067 Jul 25 17:03:54.817896 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3325/6568] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:54 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:55.839947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:55.840922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:55.848899 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:55.849383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:55.850169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:55.850606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:55.993585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:56.004885 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37b982a1-166f-45d7-b4a1-3e94da0eb6f5 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.169219 Jul 25 17:03:56.005520 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3244/6569] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:55 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:57.035813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:57.036318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:57.043899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:57.044359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:57.045124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:57.045690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:57.195767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:57.208088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7393d5bd-98de-455e-81e6-227798fd5338 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.177220 Jul 25 17:03:57.208837 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3326/6570] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:57 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:58.230171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:58.230760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:58.238197 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:58.238646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:58.239401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:58.239828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:58.377918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:58.385605 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f5f71e2-7442-43aa-b190-5fdcb645d957 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.159431 Jul 25 17:03:58.386192 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3245/6571] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:58 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:03:59.407957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:03:59.408549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:03:59.416701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:59.417188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:59.418000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:03:59.418453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:03:59.554631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:03:59.563354 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-baa7015b-6f16-476f-bd58-0b8d2ea54cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.159353 Jul 25 17:03:59.564016 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3327/6572] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:03:59 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:00.588077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:00.588812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:00.599316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:00.599765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:00.600538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:00.600967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:00.753298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:00.761624 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7fb2861e-fc76-4869-895a-c2388648f814 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.179290 Jul 25 17:04:00.762289 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3246/6573] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:00 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:01.786991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:01.787592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:01.798046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:01.798576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:01.799730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:01.800290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:01.946655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:01.958503 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6a8c7e80-6d14-4e51-a99e-37389063fd70 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.177705 Jul 25 17:04:01.959417 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3328/6574] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:01 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:02.985725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:02.986402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:02.994149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:02.994635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:02.995441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:02.995908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:03.158082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:03.168734 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4210c0dc-787c-4b55-9bc4-5c9b5c720b81 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.187353 Jul 25 17:04:03.169366 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3247/6575] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:02 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:04.192172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:04.192864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:04.200209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:04.200667 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:04.201467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:04.201911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:04.342699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:04.351706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c2258160-6a10-4d6e-8cf3-88572b3f1b54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.163324 Jul 25 17:04:04.352453 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3329/6576] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:04 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:05.374049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:05.374972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:05.385088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:05.385088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:05.385088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:05.385088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:05.525154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:05.533120 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b6d0911-69f8-45fb-bf57-0679ca2d3726 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.163620 Jul 25 17:04:05.533709 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3248/6577] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:05 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:06.558127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:06.558794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:06.568738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:06.569353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:06.570505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:06.571039 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:06.726385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:06.738793 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5e97d178-cf3a-4853-9b30-8a3bb835c590 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.185767 Jul 25 17:04:06.739454 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3330/6578] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:06 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:07.764359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:07.764947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:07.772752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:07.773238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:07.773985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:07.774447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:07.777052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:07.913973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:07.922138 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ae1fec7-10fc-470a-9850-e2ebd58774ac tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.163173 Jul 25 17:04:07.922722 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3249/6579] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:07 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:08.954011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:08.954651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:08.964782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:08.965290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:08.966424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:08.966911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:09.125315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:09.133934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af2af5b6-ca26-426c-a9f7-b1f62bde2004 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.186038 Jul 25 17:04:09.134669 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3331/6580] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:08 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:10.164504 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:10.165581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:10.173953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:10.174405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:10.175195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:10.175610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:10.320807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:10.328722 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bee6e95f-0187-4bb6-8229-7ec78e9125a3 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.170147 Jul 25 17:04:10.329424 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3250/6581] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:10 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:11.352605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:11.353281 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:11.356415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=30 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:11.363582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:11.364131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:11.365055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:11.365617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:11.368827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=90 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:11.515634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:11.523517 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b2382ff-d584-4df2-979d-a6230af45523 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.175644 Jul 25 17:04:11.524110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3332/6582] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:11 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:12.555867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:12.556637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:12.564688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:12.565200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:12.565915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:12.566339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:12.711397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:12.720125 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fee4747d-576d-479c-91bc-f47d6901a993 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.170820 Jul 25 17:04:12.720721 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3251/6583] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:12 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:13.741131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:13.741763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:13.748456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:13.748925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:13.749728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:13.750174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:13.885540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:13.894118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dcf2e715-5334-4964-acec-6b25333a0ef9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.157261 Jul 25 17:04:13.894691 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3333/6584] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:13 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:14.919757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:14.920403 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:14.924299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=34 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:14.931395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:14.931897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:14.932923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:14.933483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:15.091230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:15.099926 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ea3472d2-944a-4306-ac78-d6ae37b75d1a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.187075 Jul 25 17:04:15.100528 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3252/6585] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:14 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:16.121734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:16.123732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:16.132580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:16.133045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:16.133892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:16.134338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:16.289985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:16.298475 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1da0d5dd-3e34-4fc0-b036-75452ba90411 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.180959 Jul 25 17:04:16.299049 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3334/6586] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:16 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:17.323918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:17.324477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:17.331906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:17.332361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:17.333199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:17.333644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:17.477327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:17.489299 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9d853973-8546-431e-a907-6d64ddb19bbd tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.171880 Jul 25 17:04:17.490016 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3253/6587] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:17 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:18.510931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:18.511546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:18.519441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:18.519849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:18.520610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:18.521068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:18.657559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:18.665504 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b62affb8-cb79-4496-a57c-78e950a8e9f7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1523 microversion: 2.1 time: 0.158498 Jul 25 17:04:18.666092 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3335/6588] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:18 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:19.687013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:19.687613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:19.695005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:19.695467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:19.696249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:19.696715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:19.921630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-72107351-cbf1-40df-9a93-72d7dd32e37e req-b017b303-7a76-4e75-85a3-d7c4cf211687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b638d109-e0c5-4054-b4c1-1f002defe92a", "name": "network-vif-unplugged", "status": "completed", "tag": "a8783024-bce9-49be-a2b1-ccb84885a430"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:19.923824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:19.931907 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b2d6a36-3890-4061-b48e-39a43226cd87 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1522 microversion: 2.1 time: 0.248833 Jul 25 17:04:19.932812 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3254/6589] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:19 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:19.932962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-72107351-cbf1-40df-9a93-72d7dd32e37e req-b017b303-7a76-4e75-85a3-d7c4cf211687 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:19.933444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-72107351-cbf1-40df-9a93-72d7dd32e37e req-b017b303-7a76-4e75-85a3-d7c4cf211687 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:19.946151 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-72107351-cbf1-40df-9a93-72d7dd32e37e req-b017b303-7a76-4e75-85a3-d7c4cf211687 service nova] Creating event network-vif-unplugged:a8783024-bce9-49be-a2b1-ccb84885a430 for instance b638d109-e0c5-4054-b4c1-1f002defe92a on n-h2-846219-13 Jul 25 17:04:19.952015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-72107351-cbf1-40df-9a93-72d7dd32e37e req-b017b303-7a76-4e75-85a3-d7c4cf211687 service nova] Instance b638d109-e0c5-4054-b4c1-1f002defe92a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:04:19.963018 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-72107351-cbf1-40df-9a93-72d7dd32e37e req-b017b303-7a76-4e75-85a3-d7c4cf211687 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045673 Jul 25 17:04:19.963808 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3336/6590] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:20.954592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:20.955180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:20.962677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:20.963136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:20.963919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:20.964383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:21.122483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:21.133068 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a4a228da-412d-43c3-9731-04fdc5ea6968 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1520 microversion: 2.1 time: 0.182544 Jul 25 17:04:21.133903 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3255/6591] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:20 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:21.988055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8fa0565b-f205-4bbe-b257-4d8df0050170 req-6eabc369-15fc-4fc1-99ac-0455b47fbb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b638d109-e0c5-4054-b4c1-1f002defe92a", "tag": "a8783024-bce9-49be-a2b1-ccb84885a430"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:21.998162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8fa0565b-f205-4bbe-b257-4d8df0050170 req-6eabc369-15fc-4fc1-99ac-0455b47fbb07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:21.998618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8fa0565b-f205-4bbe-b257-4d8df0050170 req-6eabc369-15fc-4fc1-99ac-0455b47fbb07 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:22.010446 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8fa0565b-f205-4bbe-b257-4d8df0050170 req-6eabc369-15fc-4fc1-99ac-0455b47fbb07 service nova] Creating event network-changed:a8783024-bce9-49be-a2b1-ccb84885a430 for instance b638d109-e0c5-4054-b4c1-1f002defe92a on n-h2-846219-13 Jul 25 17:04:22.016545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-8fa0565b-f205-4bbe-b257-4d8df0050170 req-6eabc369-15fc-4fc1-99ac-0455b47fbb07 service nova] Instance b638d109-e0c5-4054-b4c1-1f002defe92a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:04:22.027409 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8fa0565b-f205-4bbe-b257-4d8df0050170 req-6eabc369-15fc-4fc1-99ac-0455b47fbb07 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044350 Jul 25 17:04:22.028024 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3337/6592] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:22.156230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:22.157595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:22.172606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:22.173490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:22.174462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:22.175091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:22.432856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:22.445402 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9d2f0a5-ed22-4868-893b-6fece481e494 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1520 microversion: 2.1 time: 0.292245 Jul 25 17:04:22.447381 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3256/6593] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:22 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:23.469760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:23.470463 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:23.477295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:23.477770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:23.478524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:23.478984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:23.624629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:23.640463 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fb7699c0-7471-4b0c-bd64-2f0e72805fb9 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1517 microversion: 2.1 time: 0.176508 Jul 25 17:04:23.641058 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3338/6594] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:23 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:23.664377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:23.665172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:23.673816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:23.674264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:23.675031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:23.675465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:23.742567 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb0c7459-628b-44bb-b357-f70dd18aae4d tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "POST /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a/action" status: 204 len: 0 microversion: 2.1 time: 0.084628 Jul 25 17:04:23.743299 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3257/6595] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:04:23 2022] POST /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:04:23.753676 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:23.754315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:23.761195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:23.761768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:23.763174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:23.763847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:23.901026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:23.908960 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4942511-84ea-4d2f-b874-2040a7ca3122 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1517 microversion: 2.1 time: 0.159678 Jul 25 17:04:23.909604 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3339/6596] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:23 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:24.933032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:24.933975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:24.940914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:24.941402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:24.942200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:24.942619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:25.051754 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f25edfb6-5270-450e-840a-4084c2859482 req-2f089e91-ca85-4128-81a2-7145d0790835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b638d109-e0c5-4054-b4c1-1f002defe92a", "name": "network-vif-plugged", "status": "completed", "tag": "a8783024-bce9-49be-a2b1-ccb84885a430"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:25.072500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f25edfb6-5270-450e-840a-4084c2859482 req-2f089e91-ca85-4128-81a2-7145d0790835 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:25.077168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f25edfb6-5270-450e-840a-4084c2859482 req-2f089e91-ca85-4128-81a2-7145d0790835 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:25.087060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:25.090376 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f25edfb6-5270-450e-840a-4084c2859482 req-2f089e91-ca85-4128-81a2-7145d0790835 service nova] Creating event network-vif-plugged:a8783024-bce9-49be-a2b1-ccb84885a430 for instance b638d109-e0c5-4054-b4c1-1f002defe92a on n-h2-846219-13 Jul 25 17:04:25.095925 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f25edfb6-5270-450e-840a-4084c2859482 req-2f089e91-ca85-4128-81a2-7145d0790835 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047816 Jul 25 17:04:25.096861 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3340/6597] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:25.100796 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e8db1ee9-3600-487a-ab3e-3ab838e89de7 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1517 microversion: 2.1 time: 0.173508 Jul 25 17:04:25.106327 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3258/6598] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:24 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:26.124433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:26.125292 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:26.132365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.132824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.133628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.134076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.276311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:26.284559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7bce6897-1cef-40de-8422-9aa6b28bc92a tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1509 microversion: 2.1 time: 0.165323 Jul 25 17:04:26.285151 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3341/6599] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:26 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:26.306248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:26.306821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:26.314262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.314775 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.315505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.315945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.460261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:26.468869 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03068970-1602-4b38-be1a-90ec15559f54 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1509 microversion: 2.1 time: 0.166555 Jul 25 17:04:26.469567 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3259/6600] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:26 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:04:26.489304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:26.490063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:26.497272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.497741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.498529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.499157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.646030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:26.654300 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-76d928a2-b0e7-40e8-bfec-3e59ff488cb6 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1509 microversion: 2.1 time: 0.169171 Jul 25 17:04:26.654859 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3342/6601] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:26 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:26.678146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:26.678648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:26.687570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.688204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.689778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.691137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.723685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:04:26.811513 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2634b98a-b4e4-4eea-82e7-3c6201ed6f90 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 204 len: 0 microversion: 2.1 time: 0.136973 Jul 25 17:04:26.812208 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3260/6602] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:04:26 2022] DELETE /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:04:26.831082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:26.831631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:26.838530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.838908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.839706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.840532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.867496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:04:26.917031 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.compute.api [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Instance is already in deleting state, ignoring this request Jul 25 17:04:26.917908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-967dcfd7-51f6-4d15-8b07-a78dc5af4236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 204 len: 0 microversion: 2.1 time: 0.091068 Jul 25 17:04:26.918495 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3343/6603] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:04:26 2022] DELETE /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:04:26.927845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:26.928595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:26.935006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.935436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:26.936213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:26.936648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:27.080866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:27.088656 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-727adcc0-7caa-48e3-bbec-24ddc417aa57 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1515 microversion: 2.1 time: 0.165098 Jul 25 17:04:27.089189 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3261/6604] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:26 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:28.110942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:28.111525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:28.119115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:28.119636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:28.120384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:28.120855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:28.361831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570d3ff324924628bb3882a27ac93036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da116f060c33486c982315e03d343ed0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:28.373393 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8affff28-7f49-4b4a-9f9b-e5c8d561c657 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 200 len: 1515 microversion: 2.1 time: 0.266363 Jul 25 17:04:28.374132 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3344/6605] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:28 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:28.755066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0bf69301-25cf-4a12-8293-b5a9ae1bf2f5 req-6deb6b5a-e751-4135-a4d7-61d049bf537f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b638d109-e0c5-4054-b4c1-1f002defe92a", "name": "network-vif-deleted", "tag": "a8783024-bce9-49be-a2b1-ccb84885a430"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:28.768362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0bf69301-25cf-4a12-8293-b5a9ae1bf2f5 req-6deb6b5a-e751-4135-a4d7-61d049bf537f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:28.769119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0bf69301-25cf-4a12-8293-b5a9ae1bf2f5 req-6deb6b5a-e751-4135-a4d7-61d049bf537f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:28.783306 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0bf69301-25cf-4a12-8293-b5a9ae1bf2f5 req-6deb6b5a-e751-4135-a4d7-61d049bf537f service nova] Creating event network-vif-deleted:a8783024-bce9-49be-a2b1-ccb84885a430 for instance b638d109-e0c5-4054-b4c1-1f002defe92a on n-h2-846219-13 Jul 25 17:04:28.790024 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0bf69301-25cf-4a12-8293-b5a9ae1bf2f5 req-6deb6b5a-e751-4135-a4d7-61d049bf537f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038825 Jul 25 17:04:28.790978 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3262/6606] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:29.395824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:29.396409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: b638d109-e0c5-4054-b4c1-1f002defe92a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:29.404974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:29.405571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:29.406467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:29.407005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:29.423467 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] HTTP exception thrown: Instance b638d109-e0c5-4054-b4c1-1f002defe92a could not be found. Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Request method failure captured: Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a HTTP/1.1 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sysVDABXySn9fDlZxIvAiMymu3epBz8u-9pZhhLaOljHpPYI16ftTUw0XhhhGF4w1JT8ipsoXbkf4mR1zelyOcqNbo23v2pxTzfU_GbT2Bp2HeDMslO4ZVpAFawfMQW5F0LjGbFo0_nW9cj8-3O0Sxnxc6yFtMZvY7r5fxi65npu4Q Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: da116f060c33486c982315e03d343ed0 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/da116f060c33486c982315e03d343ed0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/da116f060c33486c982315e03d343ed0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/da116f060c33486c982315e03d343ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_da116f060c33486c982315e03d343ed0"}]}] Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: da116f060c33486c982315e03d343ed0 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerDiskConfigTestJSON-2034746427-project Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 570d3ff324924628bb3882a27ac93036 Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerDiskConfigTestJSON-2034746427-project Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b638d109-e0c5-4054-b4c1-1f002defe92a could not be found. Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b638d109-e0c5-4054-b4c1-1f002defe92a'} Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b638d109-e0c5-4054-b4c1-1f002defe92a could not be found. Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b638d109-e0c5-4054-b4c1-1f002defe92a could not be found. Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:04:29.425151 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b638d109-e0c5-4054-b4c1-1f002defe92a could not be found. Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Returning 404 to user: Instance b638d109-e0c5-4054-b4c1-1f002defe92a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dac3102f-388d-4a57-a106-32fc6e23e9ea tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a" status: 404 len: 111 microversion: 2.1 time: 0.035614 Jul 25 17:04:29.429474 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3345/6607] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:29 2022] GET /compute/v2.1/servers/b638d109-e0c5-4054-b4c1-1f002defe92a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:04:29.438314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-68451524-f3ee-49e2-a857-12c70a384c4c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '.version_select at 0x7f9d939b9550>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:29.466981 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-68451524-f3ee-49e2-a857-12c70a384c4c tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407379292" status: 202 len: 0 microversion: 2.1 time: 0.034715 Jul 25 17:04:29.467570 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3263/6608] 10.222.0.105 () {58 vars in 1223 bytes} [Mon Jul 25 17:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407379292 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:04:30.113104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:30.113632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:30.121718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:30.122182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:30.122972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:30.123423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:30.137388 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] HTTP exception thrown: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Request method failure captured: Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 HTTP/1.1 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3sysVDABXySn9fDlZxIvAiMymu3epBz8u-9pZhhLaOljHpPYI16ftTUw0XhhhGF4w1JT8ipsoXbkf4mR1zelyOcqNbo23v2pxTzfU_GbT2Bp2HeDMslO4ZVpAFawfMQW5F0LjGbFo0_nW9cj8-3O0Sxnxc6yFtMZvY7r5fxi65npu4Q Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: da116f060c33486c982315e03d343ed0 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/da116f060c33486c982315e03d343ed0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/da116f060c33486c982315e03d343ed0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/da116f060c33486c982315e03d343ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_da116f060c33486c982315e03d343ed0"}]}] Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: da116f060c33486c982315e03d343ed0 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerDiskConfigTestJSON-2034746427-project Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 570d3ff324924628bb3882a27ac93036 Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerDiskConfigTestJSON-2034746427-project Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '868c6222-caf3-4258-90bd-cfbff787b3b7'} Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:04:30.138964 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Returning 404 to user: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fe8d3fc3-7345-4683-b576-abad98cd0236 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "DELETE /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 404 len: 111 microversion: 2.1 time: 0.031423 Jul 25 17:04:30.142525 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3346/6609] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:04:30 2022] DELETE /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:04:30.153528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:30.154378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] [instance: 868c6222-caf3-4258-90bd-cfbff787b3b7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:30.163822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:30.164465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:30.165352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:30.165792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:30.181379 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] HTTP exception thrown: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Request method failure captured: Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 HTTP/1.1 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3sysVDABXySn9fDlZxIvAiMymu3epBz8u-9pZhhLaOljHpPYI16ftTUw0XhhhGF4w1JT8ipsoXbkf4mR1zelyOcqNbo23v2pxTzfU_GbT2Bp2HeDMslO4ZVpAFawfMQW5F0LjGbFo0_nW9cj8-3O0Sxnxc6yFtMZvY7r5fxi65npu4Q Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: da116f060c33486c982315e03d343ed0 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/da116f060c33486c982315e03d343ed0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/da116f060c33486c982315e03d343ed0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/da116f060c33486c982315e03d343ed0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_da116f060c33486c982315e03d343ed0"}]}] Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: da116f060c33486c982315e03d343ed0 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2034746427 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerDiskConfigTestJSON-2034746427-project Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 570d3ff324924628bb3882a27ac93036 Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerDiskConfigTestJSON-2034746427-project Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '868c6222-caf3-4258-90bd-cfbff787b3b7'} Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:04:30.183112 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] Returning 404 to user: Instance 868c6222-caf3-4258-90bd-cfbff787b3b7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1681f052-f70c-4198-bdd1-78b8e1fd3816 tempest-ServerDiskConfigTestJSON-2034746427 tempest-ServerDiskConfigTestJSON-2034746427-project] 10.222.0.105 "GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7" status: 404 len: 111 microversion: 2.1 time: 0.039016 Jul 25 17:04:30.187028 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3264/6610] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:30 2022] GET /compute/v2.1/servers/868c6222-caf3-4258-90bd-cfbff787b3b7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:04:39.299549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0e3f080-8b51-4a0a-85df-5827938f77e3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'create', calling method: .version_select at 0x7f9d9012d1f0>, body: {"keypair": {"name": "tempest-keypair-1835995925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWqZOT5V6RhWHVuNthhpg4WYU+zE69ezejA8oh+Vs6XHmYKy5a9KfX3tsXlCAJafTyTDpf4KdJNq4nHe+yrIyIT8kiAWNMtmkpyaQTMWZ+IfBlp7TR4Np2dvTGfdX3/Rg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:39.315470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b0e3f080-8b51-4a0a-85df-5827938f77e3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:04:39.321160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-b0e3f080-8b51-4a0a-85df-5827938f77e3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:04:39.348849 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0e3f080-8b51-4a0a-85df-5827938f77e3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182805 Jul 25 17:04:39.349674 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3347/6611] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:04:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:40.747872 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1875214498", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3adbff68-0cfb-4ba7-9368-9b060050df5e"}], "security_groups": [{"name": "tempest-securitygroup--1752674610"}], "key_name": "tempest-keypair-1835995925", "user_data": "}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:40.757136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:40.757849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:40.881453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] validate_networks() for [('3adbff68-0cfb-4ba7-9368-9b060050df5e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:04:41.549042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:04:41.549543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:04:41.550011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:04:41.550408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:04:41.550808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:04:41.560728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:41.561158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:41.562466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:41.562850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:41.580808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:04:41.586534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:04:41.600260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:04:41.602627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:04:41.650214 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e829caec-593c-4bca-93e4-ecd70771359f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.906851 Jul 25 17:04:41.651177 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3265/6612] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:04:40 2022] POST /compute/v2.1/servers => generated 411 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:04:41.661918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e878ff52-8033-461f-a4fc-41ec8030d945 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:41.663125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e878ff52-8033-461f-a4fc-41ec8030d945 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:41.670010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:41.674243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:41.738261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e878ff52-8033-461f-a4fc-41ec8030d945 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:41.746130 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e878ff52-8033-461f-a4fc-41ec8030d945 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1243 microversion: 2.1 time: 0.088025 Jul 25 17:04:41.746722 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3348/6613] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:41 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:42.766209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:42.766927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:42.775594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:42.776114 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:42.776938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:42.777456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:42.847025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:42.855379 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d45e9236-231a-4193-ad9f-51e40ead3665 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1295 microversion: 2.1 time: 0.093055 Jul 25 17:04:42.855974 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3266/6614] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:42 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:43.876218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:43.876851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:43.885024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:43.885516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:43.886352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:43.886799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:43.954217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:43.962644 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-80f12be3-3f27-43bd-91f2-d252e92aa4d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1301 microversion: 2.1 time: 0.090404 Jul 25 17:04:43.963335 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3349/6615] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:43 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:44.954429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9631c605-89a8-4ebb-859c-f966b7cb781d req-60ba6201-153c-4eb2-b7de-0c5b64dd63dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:44.985735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:44.986383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:44.986781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9631c605-89a8-4ebb-859c-f966b7cb781d req-60ba6201-153c-4eb2-b7de-0c5b64dd63dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:44.987244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9631c605-89a8-4ebb-859c-f966b7cb781d req-60ba6201-153c-4eb2-b7de-0c5b64dd63dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:44.995179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:44.995926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:44.997146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:44.997800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:45.005799 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9631c605-89a8-4ebb-859c-f966b7cb781d req-60ba6201-153c-4eb2-b7de-0c5b64dd63dc service nova] Creating event network-changed:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h1-846219-13 Jul 25 17:04:45.016192 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9631c605-89a8-4ebb-859c-f966b7cb781d req-60ba6201-153c-4eb2-b7de-0c5b64dd63dc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065331 Jul 25 17:04:45.017159 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3267/6616] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:45.148219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:45.156753 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f3917be-46d2-4dda-b684-2e5ea7848a98 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.176404 Jul 25 17:04:45.157187 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3350/6617] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:44 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:04:46.179002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:46.179686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:46.186145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:46.186594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:46.187299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:46.187763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:46.336575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:46.345348 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6d8d311c-ce75-4ddc-8bd0-d8a137520b64 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.171413 Jul 25 17:04:46.345982 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3268/6618] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:46 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:47.372182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:47.372766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:47.380755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:47.381307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:47.382713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:47.383373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:47.537079 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:47.545321 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e281727-d688-4bc8-9c3c-589db939cc55 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.177202 Jul 25 17:04:47.545906 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3351/6619] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:47 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:48.570808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:48.572435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:48.581177 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:48.581913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:48.582399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:48.582960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:48.735543 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:48.743575 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c494fe76-882a-49a9-a1f9-3e18988e2bce tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.180454 Jul 25 17:04:48.744213 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3269/6620] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:48 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:49.764454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:49.765070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:49.773120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:49.773627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:49.774403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:49.774849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:49.919122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:49.929376 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-99c0f100-5589-4cdb-9ebc-87f6aabcdde1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.168482 Jul 25 17:04:49.930351 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3352/6621] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:49 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:50.464333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-f6c9f2e1-8d35-4e0b-95b5-186e56ab974b req-77d0e810-fa47-4271-83f0-2e14c6a4440c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "name": "network-vif-plugged", "status": "completed", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:50.475534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f6c9f2e1-8d35-4e0b-95b5-186e56ab974b req-77d0e810-fa47-4271-83f0-2e14c6a4440c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:50.475977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-f6c9f2e1-8d35-4e0b-95b5-186e56ab974b req-77d0e810-fa47-4271-83f0-2e14c6a4440c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:50.487602 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-f6c9f2e1-8d35-4e0b-95b5-186e56ab974b req-77d0e810-fa47-4271-83f0-2e14c6a4440c service nova] Creating event network-vif-plugged:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h1-846219-13 Jul 25 17:04:50.492769 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-f6c9f2e1-8d35-4e0b-95b5-186e56ab974b req-77d0e810-fa47-4271-83f0-2e14c6a4440c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032287 Jul 25 17:04:50.493812 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3270/6622] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:50.951086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:50.951704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:50.959145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:50.959610 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:50.960388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:50.960839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:51.105737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:51.118193 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7432b142-1b4f-4ec3-bf8d-528968adb62d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.170943 Jul 25 17:04:51.118800 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3353/6623] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:50 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:52.138080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:52.138883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:52.143671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:52.144381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:52.151845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:52.152292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:52.153065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:52.153522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:52.311654 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:52.319864 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a4993cd-e9ad-4523-9bcc-9d7436fdc09f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1369 microversion: 2.1 time: 0.183710 Jul 25 17:04:52.320403 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3271/6624] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:52 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:53.345951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:53.346850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:53.349553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:04:53.359069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:53.359770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:53.360913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:53.361389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:53.504342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:04:53.512277 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-488333c9-4299-46a0-a452-e701d0f9bb6a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1556 microversion: 2.1 time: 0.174124 Jul 25 17:04:53.512866 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3354/6625] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:04:53 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:04:53.534449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:04:53.534981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:04:53.542261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:53.542710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:53.543477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:53.543909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:53.629549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3e1e9b83-eb6a-4b90-9ee2-89caf4b3de16 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098976 Jul 25 17:04:53.630171 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3272/6626] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 17:04:53 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:04:54.784913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-38460429-2efe-41e1-85aa-927af13f17c1 req-25a91b14-eea2-46ad-8c9a-c06f3b7a2800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:04:54.796072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-38460429-2efe-41e1-85aa-927af13f17c1 req-25a91b14-eea2-46ad-8c9a-c06f3b7a2800 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:04:54.796543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-38460429-2efe-41e1-85aa-927af13f17c1 req-25a91b14-eea2-46ad-8c9a-c06f3b7a2800 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:04:54.809606 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-38460429-2efe-41e1-85aa-927af13f17c1 req-25a91b14-eea2-46ad-8c9a-c06f3b7a2800 service nova] Creating event network-changed:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h1-846219-13 Jul 25 17:04:54.815013 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-38460429-2efe-41e1-85aa-927af13f17c1 req-25a91b14-eea2-46ad-8c9a-c06f3b7a2800 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034071 Jul 25 17:04:54.815641 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3355/6627] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:22.391196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:22.391854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=34 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:22.396757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:22.397393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:22.404987 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:22.405482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:22.406272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:22.406712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:22.616095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:22.624546 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30301e42-200c-4d8a-9e18-2b090dee81b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1675 microversion: 2.1 time: 0.236612 Jul 25 17:06:22.625148 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3273/6628] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:22 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:22.644299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=17 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:22.644981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=38 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:22.649749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:22.650459 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:22.657741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:22.658203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:22.658997 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:22.659449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:22.855566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:22.864316 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b00483da-42bb-45c6-8ede-56fcb039997a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1675 microversion: 2.1 time: 0.222863 Jul 25 17:06:22.864942 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3356/6629] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:22 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:22.884776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:22.885409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:22.892115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:22.892553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:22.893394 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:22.893813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:23.037382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:23.046284 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a69ffc28-175c-4999-9b97-25eaf172fb23 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1675 microversion: 2.1 time: 0.165340 Jul 25 17:06:23.046879 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3274/6630] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:22 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:23.067203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:23.069469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:23.075849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:23.076310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:23.077084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:23.077952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:23.107371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:23.114852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:06:23.122386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:06:23.122823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:06:23.123306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:06:23.123737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:06:23.124158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:06:23.195210 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f122381-9be6-48fd-b0c8-547299acaa44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4/action" status: 202 len: 0 microversion: 2.1 time: 0.131637 Jul 25 17:06:23.199378 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3357/6631] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:06:23 2022] POST /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:06:23.204701 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:23.205360 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:23.211410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:23.211861 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:23.212631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:23.213069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:23.363886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:23.372073 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-44b57151-daf8-44d4-a331-8b16d81e50c7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1684 microversion: 2.1 time: 0.171340 Jul 25 17:06:23.372622 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3275/6632] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:23 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:24.396184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:24.396779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:24.408241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:24.408686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:24.409558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:24.410109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:24.850904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:24.859517 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-43854ec5-b429-4ef3-9526-58803cfd4bd3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1684 microversion: 2.1 time: 0.470578 Jul 25 17:06:24.860100 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3358/6633] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:24 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1684 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:25.884029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:25.884603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:25.895304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:25.895937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:25.897012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:25.897655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:26.054024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:26.062743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f56cfb9-7277-488b-817a-c0cd553c6a08 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.184857 Jul 25 17:06:26.063337 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3276/6634] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:25 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:27.092133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:27.093537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:27.100730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:27.101196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:27.102015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:27.102468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:27.243996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:27.251868 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-33b742cc-b553-4202-8c40-af37c3e8b396 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.163934 Jul 25 17:06:27.252440 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3359/6635] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:27 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:28.276749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:28.277529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:28.288453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:28.289062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:28.290195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:28.290740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:28.436413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:28.447761 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-070f6e5e-aac3-4e0b-aba5-86c7008c12d0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.177161 Jul 25 17:06:28.448458 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3277/6636] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:28 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:29.471054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:29.471712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:29.479415 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:29.479868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:29.480642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:29.481083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:29.623471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:29.635649 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94f88892-702d-46d1-8f84-ff3fe666f45f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.168499 Jul 25 17:06:29.636457 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3360/6637] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:29 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:30.660173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:30.660779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:30.668523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:30.668977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:30.670314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:30.671090 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:30.820946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:30.829309 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f84e9a08-c856-4c2b-bad2-81b8e36b83a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.173117 Jul 25 17:06:30.829946 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3278/6638] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:30 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:31.852046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:31.852701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:31.860446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:31.860971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:31.863211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:31.863211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:32.003883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:32.012200 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac498902-5cf9-4228-b67c-2fab0fc62e37 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.164258 Jul 25 17:06:32.012865 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3361/6639] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:31 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:33.036651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:33.037336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:33.047513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:33.048316 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:33.049750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:33.050368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:33.192734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:33.202453 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fa18aff6-e4ac-498f-a2d2-97670eeffab8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.171761 Jul 25 17:06:33.203106 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3279/6640] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:33 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:34.231144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:34.231918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:34.239450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:34.239939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:34.240736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:34.241217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:34.384912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:34.397358 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d401b761-c304-4564-9895-bf2a4ffa327b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.171039 Jul 25 17:06:34.398005 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3362/6641] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:34 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:35.419292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:35.419875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:35.427347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:35.427795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:35.428561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:35.428997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:35.568630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:35.576739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34d7b776-1a39-4b81-b261-a89fd7724a3b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.161376 Jul 25 17:06:35.577751 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3280/6642] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:35 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:36.599457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:36.600054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:36.607448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:36.607910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:36.608715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:36.609191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:36.748314 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:36.756371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a30579a1-da8b-4b83-9bd5-e0a80ec6bfc9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.160870 Jul 25 17:06:36.756955 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3363/6643] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:36 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:37.781414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:37.782073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:37.792573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:37.793269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:37.794416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:37.794888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:38.249099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:38.257122 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4f5fc413-2dad-40ee-9352-bee901440563 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1689 microversion: 2.1 time: 0.481828 Jul 25 17:06:38.257754 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3281/6644] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:37 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1689 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:38.683298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f05a26e5-0df1-406a-a10d-e8c335826ea4 req-9fde033b-61d2-450f-895e-bfbca806a15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "name": "network-vif-unplugged", "status": "completed", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:38.693823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f05a26e5-0df1-406a-a10d-e8c335826ea4 req-9fde033b-61d2-450f-895e-bfbca806a15f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:38.694294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f05a26e5-0df1-406a-a10d-e8c335826ea4 req-9fde033b-61d2-450f-895e-bfbca806a15f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:38.710186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f05a26e5-0df1-406a-a10d-e8c335826ea4 req-9fde033b-61d2-450f-895e-bfbca806a15f service nova] Creating event network-vif-unplugged:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h2-846219-13 Jul 25 17:06:38.716238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-f05a26e5-0df1-406a-a10d-e8c335826ea4 req-9fde033b-61d2-450f-895e-bfbca806a15f service nova] Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:06:38.728523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f05a26e5-0df1-406a-a10d-e8c335826ea4 req-9fde033b-61d2-450f-895e-bfbca806a15f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113404 Jul 25 17:06:38.729547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3364/6645] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:39.278838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:39.279300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:39.286555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:39.287003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:39.287798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:39.288230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:39.508709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:39.516918 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6eff94af-86e8-44a8-914a-60b56ad0c9be tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1688 microversion: 2.1 time: 0.242213 Jul 25 17:06:39.517587 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3282/6646] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:39 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:40.543361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:40.544129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:40.552803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:40.553200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:40.554040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:40.554499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:40.714796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:40.723395 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7029f79a-3b73-41bd-be1c-265fa1304803 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1686 microversion: 2.1 time: 0.187259 Jul 25 17:06:40.723977 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3365/6647] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:40 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:40.761057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3e5d12bb-925e-4cbf-bb97-30fd83f95679 req-3ad818e6-ea09-4966-9747-8205827ec8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:40.773491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3e5d12bb-925e-4cbf-bb97-30fd83f95679 req-3ad818e6-ea09-4966-9747-8205827ec8ae service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:40.773939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3e5d12bb-925e-4cbf-bb97-30fd83f95679 req-3ad818e6-ea09-4966-9747-8205827ec8ae service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:40.786110 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3e5d12bb-925e-4cbf-bb97-30fd83f95679 req-3ad818e6-ea09-4966-9747-8205827ec8ae service nova] Creating event network-changed:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h2-846219-13 Jul 25 17:06:40.792593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-3e5d12bb-925e-4cbf-bb97-30fd83f95679 req-3ad818e6-ea09-4966-9747-8205827ec8ae service nova] Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:06:40.804880 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3e5d12bb-925e-4cbf-bb97-30fd83f95679 req-3ad818e6-ea09-4966-9747-8205827ec8ae service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049797 Jul 25 17:06:40.806248 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3283/6648] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:41.744796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:41.745435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:41.752575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:41.753046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:41.753857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:41.754304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:41.896524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:41.904541 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-454123a7-91c9-456a-a99d-e9f5cb65dc77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1683 microversion: 2.1 time: 0.163780 Jul 25 17:06:41.905281 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3366/6649] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:41 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:41.927249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:41.927894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:41.934275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:41.934719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:41.935453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:41.935888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:41.996887 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cdac2bb9-178f-4c16-b7c9-0cebf2f0010e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4/action" status: 204 len: 0 microversion: 2.1 time: 0.074746 Jul 25 17:06:41.997579 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3284/6650] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:06:41 2022] POST /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 17:06:42.005935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:42.006567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:42.013466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:42.014268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:42.015234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:42.015846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:42.152841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:42.160711 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b50afcaa-342c-4fbd-855e-2df7fc8ae2ec tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1683 microversion: 2.1 time: 0.158690 Jul 25 17:06:42.161314 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3367/6651] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:42 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:43.184021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:43.184704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:43.191931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:43.192409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:43.193204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:43.193636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:43.339715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:43.348220 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b21ec63-2718-4a29-a118-121a67e52d77 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1683 microversion: 2.1 time: 0.169699 Jul 25 17:06:43.348798 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3285/6652] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:43 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:43.710132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-864fb8a7-d664-4c2a-a7fd-980365ba73dc req-295acafd-b7ce-4dff-b795-f9417b7ae6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "name": "network-vif-plugged", "status": "completed", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:43.721015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-864fb8a7-d664-4c2a-a7fd-980365ba73dc req-295acafd-b7ce-4dff-b795-f9417b7ae6ab service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:43.721538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-864fb8a7-d664-4c2a-a7fd-980365ba73dc req-295acafd-b7ce-4dff-b795-f9417b7ae6ab service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:43.734636 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-864fb8a7-d664-4c2a-a7fd-980365ba73dc req-295acafd-b7ce-4dff-b795-f9417b7ae6ab service nova] Creating event network-vif-plugged:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h2-846219-13 Jul 25 17:06:43.739733 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-864fb8a7-d664-4c2a-a7fd-980365ba73dc req-295acafd-b7ce-4dff-b795-f9417b7ae6ab service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092119 Jul 25 17:06:43.740337 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3368/6653] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:44.372666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:44.373452 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:44.381058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.381541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.382552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.382984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.537483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:44.545146 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f331d633-dc8e-4474-993e-d54ea46051db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1675 microversion: 2.1 time: 0.178091 Jul 25 17:06:44.545977 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3286/6654] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:44 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:44.572845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:44.573593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:44.580786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.581403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.582184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.582638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.724380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:44.735601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ce8b58c-8d67-4b46-ad9c-c10b63153576 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1675 microversion: 2.1 time: 0.168987 Jul 25 17:06:44.736190 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3369/6655] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:44 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:44.755776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:44.756382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:44.763173 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.763624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.764496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.764923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.916098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:44.927696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9a49f615-6696-499d-90a0-940f0788a955 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1675 microversion: 2.1 time: 0.175557 Jul 25 17:06:44.928522 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3287/6656] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:44 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:44.952983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:44.953550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:44.960486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.960949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.961774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:44.962235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:44.989504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:06:45.039206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:45.078609 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-45d1a1b3-dcbf-4401-af25-cd86903db811 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 204 len: 0 microversion: 2.1 time: 0.129731 Jul 25 17:06:45.079645 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3370/6657] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:06:44 2022] DELETE /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:06:45.088248 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:45.088911 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:45.095944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:45.096399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:45.097204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:45.097672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:45.247258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:45.250688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:45.257693 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82d1d655-8d44-418b-aebc-8e73844cc687 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1681 microversion: 2.1 time: 0.173433 Jul 25 17:06:45.258307 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3288/6658] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:45 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:46.279887 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:46.280631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:46.287912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:46.288378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:46.289190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:46.289639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:46.509902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:46.518120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-206cf991-ff9e-4ba6-80f7-5611f64cbd69 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 200 len: 1681 microversion: 2.1 time: 0.242722 Jul 25 17:06:46.518726 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3371/6659] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:46 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:47.305467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-72ad1170-2c66-4941-9ca0-7f6e3f1ba483 req-ada537cc-70ef-4272-be81-8bb512dc6fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e16173-b3d5-487f-b860-96641f1a9bc4", "name": "network-vif-deleted", "tag": "1735e181-e7bb-4518-853d-cf0799b131b2"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:47.317427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-72ad1170-2c66-4941-9ca0-7f6e3f1ba483 req-ada537cc-70ef-4272-be81-8bb512dc6fcf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:47.317868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-72ad1170-2c66-4941-9ca0-7f6e3f1ba483 req-ada537cc-70ef-4272-be81-8bb512dc6fcf service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:47.330827 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-72ad1170-2c66-4941-9ca0-7f6e3f1ba483 req-ada537cc-70ef-4272-be81-8bb512dc6fcf service nova] Creating event network-vif-deleted:1735e181-e7bb-4518-853d-cf0799b131b2 for instance 65e16173-b3d5-487f-b860-96641f1a9bc4 on n-h2-846219-13 Jul 25 17:06:47.336188 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-72ad1170-2c66-4941-9ca0-7f6e3f1ba483 req-ada537cc-70ef-4272-be81-8bb512dc6fcf service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035597 Jul 25 17:06:47.336801 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3289/6660] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:47.542882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:47.543716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:47.551571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:47.552164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:47.553051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:47.553986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:47.569192 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 HTTP/1.1 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '65e16173-b3d5-487f-b860-96641f1a9bc4'} Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:06:47.571293 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:06:47.575602 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff1c2ae4-46c1-4773-8200-487dc9ed3e09 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 404 len: 111 microversion: 2.1 time: 0.038119 Jul 25 17:06:47.576382 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3372/6661] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:47 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:06:47.589597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:47.590294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:47.597200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:47.597645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:47.598400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:47.598828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:47.612219 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 HTTP/1.1 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '65e16173-b3d5-487f-b860-96641f1a9bc4'} Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:06:47.613951 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10777ec7-91ae-4d3b-95bd-40cd8b61bcb3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 404 len: 111 microversion: 2.1 time: 0.030307 Jul 25 17:06:47.620842 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3290/6662] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:47 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:06:47.665349 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-556385421", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "3adbff68-0cfb-4ba7-9368-9b060050df5e"}], "security_groups": [{"name": "tempest-securitygroup--1752674610"}], "key_name": "tempest-keypair-1835995925", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:47.777021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] validate_networks() for [('3adbff68-0cfb-4ba7-9368-9b060050df5e', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:06:48.170449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:06:48.171156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:06:48.171651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:06:48.172051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:06:48.172496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:06:48.182222 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:48.182691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:48.183507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:48.183956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:48.202469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:06:48.207931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:06:48.220823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:06:48.223181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:06:48.279611 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8b341a8a-63d3-480b-b0b2-99b98783b02e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.618203 Jul 25 17:06:48.286524 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3373/6663] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:06:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:06:48.291885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-924104de-a8b7-4e89-82db-1c535ee2a00b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:48.293260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-924104de-a8b7-4e89-82db-1c535ee2a00b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:48.351535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-924104de-a8b7-4e89-82db-1c535ee2a00b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:48.359564 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-924104de-a8b7-4e89-82db-1c535ee2a00b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1242 microversion: 2.1 time: 0.071772 Jul 25 17:06:48.360144 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3291/6664] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:48 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:06:49.382138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:49.382698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:49.393174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:49.394594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:49.396071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:49.396521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:49.472076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:49.480533 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5cab6466-a753-4de0-8d4d-7741ed9649dd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1312 microversion: 2.1 time: 0.103606 Jul 25 17:06:49.481312 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3374/6665] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:49 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:50.502481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:50.503089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:50.510200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:50.510629 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:50.511409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:50.511865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:50.765875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:50.773786 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-55bc7366-2442-477c-89f3-3067d7d4fe7c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1368 microversion: 2.1 time: 0.275245 Jul 25 17:06:50.774370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3292/6666] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:50 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:51.168032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-06b846e9-c888-4189-a36f-4a7456e6e644 req-2fb964a9-cb05-4ddb-b8bb-df2c6bf8b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:51.182029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-06b846e9-c888-4189-a36f-4a7456e6e644 req-2fb964a9-cb05-4ddb-b8bb-df2c6bf8b4ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:51.182489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-06b846e9-c888-4189-a36f-4a7456e6e644 req-2fb964a9-cb05-4ddb-b8bb-df2c6bf8b4ef service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:51.195383 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-06b846e9-c888-4189-a36f-4a7456e6e644 req-2fb964a9-cb05-4ddb-b8bb-df2c6bf8b4ef service nova] Creating event network-changed:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h2-846219-13 Jul 25 17:06:51.200684 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-06b846e9-c888-4189-a36f-4a7456e6e644 req-2fb964a9-cb05-4ddb-b8bb-df2c6bf8b4ef service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042410 Jul 25 17:06:51.201381 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3375/6667] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:51.795380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:51.795905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:51.803560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:51.804001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:51.804750 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:51.805204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:51.957065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:51.964993 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-73bbf5e7-a23e-4e39-835d-55e4525f1e15 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1368 microversion: 2.1 time: 0.173660 Jul 25 17:06:51.965606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3293/6668] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:51 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:52.988445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:52.989227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:52.991274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:52.997260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:52.997741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:52.998554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:52.999013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:53.142586 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:53.150927 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-61c0210d-03f6-4dcf-b30e-ae1a517cca71 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1368 microversion: 2.1 time: 0.167753 Jul 25 17:06:53.151520 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3376/6669] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:52 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:54.172717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:54.173383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:54.176255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=45 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:54.181767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:54.182204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:54.182955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:54.183380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:54.312953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:54.320502 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-29b5e6fd-aa8e-4bb4-a1ee-d3afe5e5f2db tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1368 microversion: 2.1 time: 0.151715 Jul 25 17:06:54.321072 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3294/6670] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:54 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:55.343591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:55.344524 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:55.352136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:55.352599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:55.353404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:55.353849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:55.485772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:55.493723 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f5a0a578-d4bd-4fbf-bb7e-02e4696a8fc4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1368 microversion: 2.1 time: 0.154393 Jul 25 17:06:55.494305 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3377/6671] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:55 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:55.677880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-99cd7c6e-ddcf-4363-9100-8dc57798feff req-97b7ce1d-d174-43a0-ab27-4dd5010d799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "name": "network-vif-plugged", "status": "completed", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:55.689517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-99cd7c6e-ddcf-4363-9100-8dc57798feff req-97b7ce1d-d174-43a0-ab27-4dd5010d799b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:55.689958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-99cd7c6e-ddcf-4363-9100-8dc57798feff req-97b7ce1d-d174-43a0-ab27-4dd5010d799b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:55.701384 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-99cd7c6e-ddcf-4363-9100-8dc57798feff req-97b7ce1d-d174-43a0-ab27-4dd5010d799b service nova] Creating event network-vif-plugged:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h2-846219-13 Jul 25 17:06:55.706518 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-99cd7c6e-ddcf-4363-9100-8dc57798feff req-97b7ce1d-d174-43a0-ab27-4dd5010d799b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Jul 25 17:06:55.707143 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3295/6672] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:56.516994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:56.517612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:56.525306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:56.525784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:56.526581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:56.527112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:56.663962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:56.674401 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-54f5c6ca-8beb-40a0-a8a7-8037bd643ed7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1368 microversion: 2.1 time: 0.161603 Jul 25 17:06:56.674977 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3378/6673] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:56 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:57.702657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:57.704045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:57.714835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:57.715586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:57.716847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:57.717653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:57.857606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:06:57.869375 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-287a87bc-025d-4c5e-aa28-6cfbf9577e04 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1555 microversion: 2.1 time: 0.175431 Jul 25 17:06:57.870236 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3296/6674] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:06:57 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:06:57.893042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:06:57.893581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:06:57.901013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:57.901510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:57.902317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:57.902757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:57.989274 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e69902b3-a7e5-4527-80e1-309fc758761a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100349 Jul 25 17:06:57.989897 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3379/6675] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 17:06:57 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:06:58.964856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-5aaa52fc-ec88-4178-9d5b-d1c907141de7 req-1bb731b4-89c5-4941-9689-fb093da37ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:06:58.970179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:06:58.977281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5aaa52fc-ec88-4178-9d5b-d1c907141de7 req-1bb731b4-89c5-4941-9689-fb093da37ba0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:06:58.977755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-5aaa52fc-ec88-4178-9d5b-d1c907141de7 req-1bb731b4-89c5-4941-9689-fb093da37ba0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:06:58.989635 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-5aaa52fc-ec88-4178-9d5b-d1c907141de7 req-1bb731b4-89c5-4941-9689-fb093da37ba0 service nova] Creating event network-changed:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h2-846219-13 Jul 25 17:06:58.995080 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-5aaa52fc-ec88-4178-9d5b-d1c907141de7 req-1bb731b4-89c5-4941-9689-fb093da37ba0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Jul 25 17:06:58.995943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3297/6676] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:07:32.126725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:32.127977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:32.131286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=7 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:32.132388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:32.139596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d361d99-dd7b-42df-86b6-99e28f8f3bff tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:32.151486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d361d99-dd7b-42df-86b6-99e28f8f3bff tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:32.151977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d361d99-dd7b-42df-86b6-99e28f8f3bff tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:32.174770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d361d99-dd7b-42df-86b6-99e28f8f3bff tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Going to try to stop instance {{(pid=119599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 17:07:32.233359 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d361d99-dd7b-42df-86b6-99e28f8f3bff tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action" status: 202 len: 0 microversion: 2.1 time: 0.107875 Jul 25 17:07:32.234018 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3380/6677] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:07:32 2022] POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:07:32.243210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:32.243916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:32.246064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=7 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:32.246752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=33 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:32.253156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:32.253613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:32.254393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:32.254834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:32.386363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:32.394451 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4372bdb-09f7-4731-96ba-884a29cac834 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.155787 Jul 25 17:07:32.395040 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3298/6678] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:32 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:07:33.424739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:33.426546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:33.435129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:33.435590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:33.436385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:33.436837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:33.573718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:33.584148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ecb900be-4df0-4980-9adc-b14fb9760620 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.170556 Jul 25 17:07:33.584813 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3381/6679] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:33 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:34.610324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:34.610998 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:34.619369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:34.619869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:34.620716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:34.621236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:34.758923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:34.767339 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b76721f1-e49a-426e-a237-cea7c6a57942 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.161545 Jul 25 17:07:34.767945 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3299/6680] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:34 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:35.789571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:35.790204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:35.797908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:35.798354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:35.799253 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:35.799738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:35.950177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:35.958434 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b3591a9-2a45-418b-8725-f9304b48b726 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.172984 Jul 25 17:07:35.958997 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3382/6681] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:35 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:36.987422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:36.988460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:37.000476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:37.001285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:37.002585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:37.003303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:37.158898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:37.167292 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-915d72b5-31d1-469e-937d-bbe686f6d25b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.186452 Jul 25 17:07:37.167874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3300/6682] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:36 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:38.193203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:38.194379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:38.206746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:38.207603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:38.208957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:38.209838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:38.357133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:38.368857 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1054efdd-ce47-469d-ae54-f8eb6b554118 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.182233 Jul 25 17:07:38.369712 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3383/6683] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:38 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:39.399798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:39.400649 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:39.412314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:39.413137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:39.414395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:39.415158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:39.565358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:39.573666 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e190476b-996f-4583-9139-6e023835620c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.180582 Jul 25 17:07:39.574254 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3301/6684] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:39 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:40.595525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:40.596384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:40.604117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:40.604581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:40.605401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:40.605850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:40.749514 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:40.757420 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-331678d7-eba3-44b3-9ab6-1a7b56fb2395 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.166008 Jul 25 17:07:40.758007 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3384/6685] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:40 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:41.780637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:41.781366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:41.789011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:41.789557 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:41.790401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:41.790883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:41.933830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:41.941477 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23ca7185-adef-411a-a173-19942a5d8fb8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.165938 Jul 25 17:07:41.942060 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3302/6686] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:41 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:42.972175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:42.972816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:42.979701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:42.980162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:42.980941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:42.981416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:43.408907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:43.420609 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-14957beb-19c5-40d9-91f7-f3ba3314af74 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1661 microversion: 2.1 time: 0.452846 Jul 25 17:07:43.421544 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3385/6687] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:42 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1661 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:43.445282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:43.447632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:43.455174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:43.455624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:43.456377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:43.456803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:43.486424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:43.492886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Old instance type m1.heat2, new instance type m1.heat {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:07:43.499717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:07:43.500134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:07:43.500602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:07:43.501004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:07:43.501427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:07:43.568297 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [0304e008-f307-467a-888f-ca12b3dfd211] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:07:43.788352 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:07:43.788624 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:07:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:07:44.192085 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:07:44.192236 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action (ip 10.222.0.105) !!! Jul 25 17:07:44.578341 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [0304e008-f307-467a-888f-ca12b3dfd211] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 47766. Jul 25 17:07:44.583155 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec0291dc-baaa-4a72-9def-6701b84873cb tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action" status: 202 len: 0 microversion: 2.1 time: 1.142059 Jul 25 17:07:44.584246 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3303/6688] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:07:43 2022] POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:07:44.594608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:44.595398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:44.609578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:44.610023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:44.611364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:44.611827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:44.749980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:44.759251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7d28367b-5724-44cf-b76e-b119baa24431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.169315 Jul 25 17:07:44.759384 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3386/6689] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:44 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:45.782947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:45.783718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:45.792279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:45.792743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:45.793595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:45.793955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:45.923762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:45.931875 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9a9f0ead-318a-42fa-8d4d-52f2d161f349 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1684 microversion: 2.1 time: 0.154968 Jul 25 17:07:45.932442 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3304/6690] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:45 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:46.961561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:46.962475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:46.973287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:46.973868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:46.974793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:46.975321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:47.116973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:47.125114 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2a5da87-8e69-4ea1-b9ea-37071418727e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1689 microversion: 2.1 time: 0.170371 Jul 25 17:07:47.125781 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3387/6691] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:46 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:48.149082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:48.150074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:48.160674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:48.161317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:48.162322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:48.162910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:48.311083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:48.319719 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4ab4b0ce-a898-4f57-aaf5-7f0b501ebd0e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1689 microversion: 2.1 time: 0.176450 Jul 25 17:07:48.320308 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3305/6692] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:48 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:49.155766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f5646b7c-45b4-4572-b8da-2599438f593c req-de36073c-e242-448d-867f-784ba8ce7016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "name": "network-vif-unplugged", "status": "completed", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:49.167837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f5646b7c-45b4-4572-b8da-2599438f593c req-de36073c-e242-448d-867f-784ba8ce7016 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:49.168531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f5646b7c-45b4-4572-b8da-2599438f593c req-de36073c-e242-448d-867f-784ba8ce7016 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:49.181332 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f5646b7c-45b4-4572-b8da-2599438f593c req-de36073c-e242-448d-867f-784ba8ce7016 service nova] Creating event network-vif-unplugged:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h1-846219-13 Jul 25 17:07:49.187397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-f5646b7c-45b4-4572-b8da-2599438f593c req-de36073c-e242-448d-867f-784ba8ce7016 service nova] Instance fee53782-c354-4bd3-bcc6-d955e3623987 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:07:49.199855 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f5646b7c-45b4-4572-b8da-2599438f593c req-de36073c-e242-448d-867f-784ba8ce7016 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048352 Jul 25 17:07:49.201553 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3388/6693] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:07:49.341380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:49.342016 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:49.350600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:49.351125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:49.352085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:49.352626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:49.510938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:49.519143 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03abd5ef-b4a2-4afe-80f9-46bfdae30208 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1688 microversion: 2.1 time: 0.182051 Jul 25 17:07:49.519705 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3306/6694] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:49 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:50.540656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:50.542355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:50.549960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:50.550469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:50.551271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:50.551782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:50.693234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:50.700972 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a23f98c2-1019-4a9f-a729-c25f56a9a489 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1688 microversion: 2.1 time: 0.164749 Jul 25 17:07:50.701577 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3389/6695] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:50 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:51.230339 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-bdfd485e-b54a-43f2-a0c1-10902dd5aad4 req-b5bd8185-fa26-4e7a-9d47-e317b4b471dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:51.241655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bdfd485e-b54a-43f2-a0c1-10902dd5aad4 req-b5bd8185-fa26-4e7a-9d47-e317b4b471dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:51.242105 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-bdfd485e-b54a-43f2-a0c1-10902dd5aad4 req-b5bd8185-fa26-4e7a-9d47-e317b4b471dc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:51.254465 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-bdfd485e-b54a-43f2-a0c1-10902dd5aad4 req-b5bd8185-fa26-4e7a-9d47-e317b4b471dc service nova] Creating event network-changed:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h1-846219-13 Jul 25 17:07:51.260181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-bdfd485e-b54a-43f2-a0c1-10902dd5aad4 req-b5bd8185-fa26-4e7a-9d47-e317b4b471dc service nova] Instance fee53782-c354-4bd3-bcc6-d955e3623987 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:07:51.271636 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-bdfd485e-b54a-43f2-a0c1-10902dd5aad4 req-b5bd8185-fa26-4e7a-9d47-e317b4b471dc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047621 Jul 25 17:07:51.272170 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3307/6696] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:07:51.722954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:51.723591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:51.731013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:51.731474 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:51.732266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:51.732727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:51.900824 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:51.909120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c6ebbe6-2d5f-4ab0-bd9c-cdbc468d236b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1686 microversion: 2.1 time: 0.190553 Jul 25 17:07:51.909710 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3390/6697] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:51 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:52.937014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:52.937787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:52.945587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:52.946039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:52.946816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:52.947259 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:53.082981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:53.091003 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9857d16d-ac6d-468a-abb4-7681abe17be2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1686 microversion: 2.1 time: 0.159145 Jul 25 17:07:53.092156 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3308/6698] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:52 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:54.114715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:54.115533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:54.125992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:54.126719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:54.128051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:54.128785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:54.263390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:54.271072 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-235cc13b-baa7-4a84-8976-3cd5730dd020 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1682 microversion: 2.1 time: 0.162508 Jul 25 17:07:54.271667 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3391/6699] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:54 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:54.291590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:54.292099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:54.299322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:54.299771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:54.300532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:54.300965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:54.368549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c3a98cf-21bf-41b6-a564-2fa671f89ca0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action" status: 204 len: 0 microversion: 2.1 time: 0.080088 Jul 25 17:07:54.369450 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3309/6700] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:07:54 2022] POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:07:54.377993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:54.378633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:54.384848 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:54.385382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:54.386248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:54.386763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:54.607140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:54.616026 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68534835-eac8-427f-9eca-a728db3d22d9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1682 microversion: 2.1 time: 0.241899 Jul 25 17:07:54.616615 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3392/6701] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:54 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:55.638892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:55.639619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:55.647019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:55.647562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:55.648444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:55.648939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:55.785502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:55.793465 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74d3dfd9-65d5-4076-a03e-8a95dfaa4195 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1661 microversion: 2.1 time: 0.158766 Jul 25 17:07:55.794060 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3310/6702] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:55 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:55.814064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:55.814700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:55.821949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:55.822425 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:55.823216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:55.823673 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:55.965838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:55.973925 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3b02212-9d23-414c-b36e-42d170faa6a1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1661 microversion: 2.1 time: 0.163767 Jul 25 17:07:55.974540 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3393/6703] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:55 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1661 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:55.994584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4fabcd0-faed-4cf0-9d0f-41682afa1720 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:56.001231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4fabcd0-faed-4cf0-9d0f-41682afa1720 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:56.001689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4fabcd0-faed-4cf0-9d0f-41682afa1720 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:56.024128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4fabcd0-faed-4cf0-9d0f-41682afa1720 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Going to try to start instance {{(pid=119598) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 17:07:56.047705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:56.070918 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4fabcd0-faed-4cf0-9d0f-41682afa1720 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action" status: 202 len: 0 microversion: 2.1 time: 0.080156 Jul 25 17:07:56.071539 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3311/6704] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:07:55 2022] POST /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:07:56.079906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:56.080546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:56.087716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:56.088191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:56.089018 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:56.089475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:56.230902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:56.238660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b464c1a1-4a9a-46ef-8e12-e9acf3f35f59 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1670 microversion: 2.1 time: 0.162707 Jul 25 17:07:56.239251 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3394/6705] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:56 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:57.264352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:57.264882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:57.272171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:57.272666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:57.273551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:57.274004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:57.415008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:57.426666 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5a99b800-6f71-4b02-9c4d-769fecc4d944 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1670 microversion: 2.1 time: 0.169920 Jul 25 17:07:57.428344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-256f2e08-12d3-4f02-846b-3fe81db1b163 req-27682833-609a-40d9-b1af-712d8dd4f4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "name": "network-vif-plugged", "status": "completed", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:07:57.440170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-256f2e08-12d3-4f02-846b-3fe81db1b163 req-27682833-609a-40d9-b1af-712d8dd4f4ad service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:57.440750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-256f2e08-12d3-4f02-846b-3fe81db1b163 req-27682833-609a-40d9-b1af-712d8dd4f4ad service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:57.451196 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3312/6706] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:57 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:57.453716 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-256f2e08-12d3-4f02-846b-3fe81db1b163 req-27682833-609a-40d9-b1af-712d8dd4f4ad service nova] Creating event network-vif-plugged:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h1-846219-13 Jul 25 17:07:57.459232 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-256f2e08-12d3-4f02-846b-3fe81db1b163 req-27682833-609a-40d9-b1af-712d8dd4f4ad service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035016 Jul 25 17:07:57.460340 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3395/6707] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:07:58.454984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:58.455968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:58.467588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:58.468329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:58.469625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:58.470363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:58.615892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:58.627341 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b7c5894a-e4be-452b-aeb7-9299d26c235b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1674 microversion: 2.1 time: 0.178849 Jul 25 17:07:58.627926 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3313/6708] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:58 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:58.649341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:58.649964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:58.656492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:58.656955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:58.657783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:58.658203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:58.677564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:07:58.683774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:07:58.766854 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13d4cd84-0594-4bc3-85b9-5acad0af5ec3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 204 len: 0 microversion: 2.1 time: 0.121643 Jul 25 17:07:58.767867 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3396/6709] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:07:58 2022] DELETE /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:07:58.780602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:58.781428 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:58.790594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:58.791302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:58.792511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:58.793230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:58.935355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:07:58.943337 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-238d3881-3492-4322-916a-c223338ff1b4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1680 microversion: 2.1 time: 0.169229 Jul 25 17:07:58.943911 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3314/6710] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:58 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:07:59.970125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:07:59.971256 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:07:59.982457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:59.982859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:07:59.983641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:07:59.984090 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:00.123150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:00.130957 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-67d48e5a-c188-4c95-b679-d0590233da2a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1680 microversion: 2.1 time: 0.168347 Jul 25 17:08:00.131504 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3397/6711] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:07:59 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:01.153031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:01.153693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:01.160964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:01.161462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:01.162241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:01.162673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:01.300324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:01.308039 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ef299d81-9583-4b35-ab56-f43c119f9c4a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 200 len: 1680 microversion: 2.1 time: 0.159506 Jul 25 17:08:01.308651 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3315/6712] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:01 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:01.734838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-68ec32da-48a0-4086-93db-e174d9e0fe49 req-769794ed-0b79-4952-b4e4-8325f63ba978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee53782-c354-4bd3-bcc6-d955e3623987", "name": "network-vif-deleted", "tag": "8eb1dd77-7c7f-4345-90a9-0e231bf02e32"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:08:01.747007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-68ec32da-48a0-4086-93db-e174d9e0fe49 req-769794ed-0b79-4952-b4e4-8325f63ba978 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:01.747465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-68ec32da-48a0-4086-93db-e174d9e0fe49 req-769794ed-0b79-4952-b4e4-8325f63ba978 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:01.758942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-68ec32da-48a0-4086-93db-e174d9e0fe49 req-769794ed-0b79-4952-b4e4-8325f63ba978 service nova] Creating event network-vif-deleted:8eb1dd77-7c7f-4345-90a9-0e231bf02e32 for instance fee53782-c354-4bd3-bcc6-d955e3623987 on n-h1-846219-13 Jul 25 17:08:01.764047 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-68ec32da-48a0-4086-93db-e174d9e0fe49 req-769794ed-0b79-4952-b4e4-8325f63ba978 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Jul 25 17:08:01.767815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3398/6713] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:08:02.330025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:02.330676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:02.333519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=41 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:02.338831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:02.339290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:02.340053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:02.340468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:02.357048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 HTTP/1.1 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fee53782-c354-4bd3-bcc6-d955e3623987'} Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:08:02.358737 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a8803952-cd6b-48a0-bc9a-08a6bdc1c5e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 404 len: 111 microversion: 2.1 time: 0.034029 Jul 25 17:08:02.362964 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3316/6714] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:02 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:08:02.374448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:02.375180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:02.377472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:02.383004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:02.383476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:02.384284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:02.384739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:02.401177 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 HTTP/1.1 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fee53782-c354-4bd3-bcc6-d955e3623987'} Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:08:02.403195 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:08:02.407234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e4e7e819-5b7e-4e96-9ab7-f6a3af3bdca8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 404 len: 111 microversion: 2.1 time: 0.034595 Jul 25 17:08:02.414373 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3399/6715] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:02 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:08:02.455651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-40280811", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "3adbff68-0cfb-4ba7-9368-9b060050df5e"}], "security_groups": [{"name": "tempest-securitygroup--1752674610"}], "key_name": "tempest-keypair-1835995925", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:08:02.563068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] validate_networks() for [('3adbff68-0cfb-4ba7-9368-9b060050df5e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:08:02.995937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:08:02.996443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:08:02.996928 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:08:02.997379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:08:02.997783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:08:03.007121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:03.007564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:03.008349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:03.008777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:03.025864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:08:03.031417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:08:03.046357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:08:03.049039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:08:03.102382 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9377e5ef-4a3b-46f4-b84d-c20ea4d5b42e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.650600 Jul 25 17:08:03.103023 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3317/6716] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:08:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:08:03.114259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-51fa308b-2a74-4a17-adb0-9c9e2ab5bda3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:03.115030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-51fa308b-2a74-4a17-adb0-9c9e2ab5bda3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:03.170554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-51fa308b-2a74-4a17-adb0-9c9e2ab5bda3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:03.181547 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-51fa308b-2a74-4a17-adb0-9c9e2ab5bda3 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1241 microversion: 2.1 time: 0.071147 Jul 25 17:08:03.182168 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3400/6717] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:03 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:04.203768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:04.204397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:04.210784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:04.211237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:04.212030 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:04.212466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:04.311658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:04.319528 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1c45a855-921f-4143-b220-8f763b32502a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1299 microversion: 2.1 time: 0.120800 Jul 25 17:08:04.320036 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3318/6718] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:04 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:05.342401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:05.343029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:05.350481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:05.351069 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:05.351961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:05.352485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:05.552410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-968962f0-ca50-468e-b812-d54aae4abbcc req-5520ce76-3d93-44ff-811a-ee62d1676c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:08:05.569584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-968962f0-ca50-468e-b812-d54aae4abbcc req-5520ce76-3d93-44ff-811a-ee62d1676c71 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:05.570133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-968962f0-ca50-468e-b812-d54aae4abbcc req-5520ce76-3d93-44ff-811a-ee62d1676c71 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:05.576865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:05.586675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48b712c2-694d-4144-b100-3d1a8e3736d6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1367 microversion: 2.1 time: 0.249201 Jul 25 17:08:05.588842 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3401/6719] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:05 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:05.610035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-968962f0-ca50-468e-b812-d54aae4abbcc req-5520ce76-3d93-44ff-811a-ee62d1676c71 service nova] Creating event network-changed:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h2-846219-13 Jul 25 17:08:05.616699 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-968962f0-ca50-468e-b812-d54aae4abbcc req-5520ce76-3d93-44ff-811a-ee62d1676c71 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068017 Jul 25 17:08:05.617758 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3319/6720] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:08:06.615780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:06.616688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:06.626374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:06.626847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:06.627615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:06.628129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:06.775184 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:06.783507 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-351864aa-3bc4-43ce-adb0-88fb7f31d0b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1367 microversion: 2.1 time: 0.174320 Jul 25 17:08:06.784131 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3402/6721] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:06 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:07.809687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:07.810420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:07.817321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:07.817763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:07.818539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:07.818974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:07.952161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:07.960026 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dffa189f-fac9-499b-9104-011f198874c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1367 microversion: 2.1 time: 0.156898 Jul 25 17:08:07.960577 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3320/6722] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:07 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:08.986023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:08.987060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:08.998938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:08.999734 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:09.001027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:09.001846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:09.141289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:09.149378 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c3e7eae-808c-4780-85c0-503328432cf1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1367 microversion: 2.1 time: 0.170134 Jul 25 17:08:09.149968 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3403/6723] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:08 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:10.034618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-62360afb-abad-4d55-9ccd-8f67052a71ba req-4fb7529e-3ffc-4f06-93a3-17410fff03f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "name": "network-vif-plugged", "status": "completed", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:08:10.048929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-62360afb-abad-4d55-9ccd-8f67052a71ba req-4fb7529e-3ffc-4f06-93a3-17410fff03f0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:10.049399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-62360afb-abad-4d55-9ccd-8f67052a71ba req-4fb7529e-3ffc-4f06-93a3-17410fff03f0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:10.061271 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-62360afb-abad-4d55-9ccd-8f67052a71ba req-4fb7529e-3ffc-4f06-93a3-17410fff03f0 service nova] Creating event network-vif-plugged:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h2-846219-13 Jul 25 17:08:10.066192 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-62360afb-abad-4d55-9ccd-8f67052a71ba req-4fb7529e-3ffc-4f06-93a3-17410fff03f0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037634 Jul 25 17:08:10.067154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3321/6724] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:08:10.171270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:10.171976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:10.179413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:10.179910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:10.180699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:10.181153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:10.320908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:10.330892 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49b8e2fe-8263-471e-ab4e-f0d96848c466 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1367 microversion: 2.1 time: 0.163489 Jul 25 17:08:10.331584 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3404/6725] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:10 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:11.356165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:11.356769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:11.363537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:11.363988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:11.364747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:11.365208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:11.502568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:11.510487 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-83bdf0a8-5ab6-40c3-92a6-695c9b0cfcd8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1554 microversion: 2.1 time: 0.159185 Jul 25 17:08:11.511101 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3322/6726] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:11 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:11.531830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:11.532370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:11.539512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:11.539981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:11.540759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:11.541310 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:11.627079 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e30047e1-5967-47b4-8314-dd435758e2dc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098881 Jul 25 17:08:11.627887 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3405/6727] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 17:08:11 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:08:12.603232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3ffdf7da-6909-450e-a6e3-ec1dddc396b6 req-9ee0b21a-66d2-42c0-91c7-82ae0cfd2a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:08:12.614365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3ffdf7da-6909-450e-a6e3-ec1dddc396b6 req-9ee0b21a-66d2-42c0-91c7-82ae0cfd2a94 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:12.614818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3ffdf7da-6909-450e-a6e3-ec1dddc396b6 req-9ee0b21a-66d2-42c0-91c7-82ae0cfd2a94 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:12.626270 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3ffdf7da-6909-450e-a6e3-ec1dddc396b6 req-9ee0b21a-66d2-42c0-91c7-82ae0cfd2a94 service nova] Creating event network-changed:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h2-846219-13 Jul 25 17:08:12.631367 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3ffdf7da-6909-450e-a6e3-ec1dddc396b6 req-9ee0b21a-66d2-42c0-91c7-82ae0cfd2a94 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032170 Jul 25 17:08:12.632120 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3323/6728] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:08:45.723896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.724855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=15 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.725965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.731267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:08:45.733597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:45.742637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:45.743107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:45.743902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:45.744356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:45.774741 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:45.780703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119599) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:08:45.787272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:08:45.787720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:08:45.788217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:08:45.788642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:08:45.789073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:08:45.859316 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31a4cc0c-da8f-4aef-82b8-005c56599f5c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9/action" status: 202 len: 0 microversion: 2.1 time: 0.138978 Jul 25 17:08:45.859973 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3406/6729] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:08:45 2022] POST /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:08:45.865330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.866538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.868580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.869340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:08:45.874053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:45.874751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:45.883118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:45.883678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:45.884436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:45.884862 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:46.024830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:46.038462 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-24b895c3-2e4e-4305-8727-29c819823619 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1682 microversion: 2.1 time: 0.169160 Jul 25 17:08:46.044377 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3324/6730] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:45 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:08:47.062214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:47.062762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:47.069255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:47.069730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:47.070521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:47.071029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:47.215998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:47.226712 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c0578fb-d94b-4145-9a46-423fc5065881 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1682 microversion: 2.1 time: 0.170644 Jul 25 17:08:47.227357 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3407/6731] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:47 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:48.252198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:48.253244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:48.264847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:48.265648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:48.266910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:48.267632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:48.405469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:48.413582 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2606d136-e9e5-40cc-9292-e2eca739edea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.167915 Jul 25 17:08:48.414157 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3325/6732] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:48 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:49.439602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:49.440651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:49.450235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:49.450711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:49.451504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:49.451960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:49.582825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:49.592279 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f444da47-fc07-4164-af33-a915c35584ef tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.159593 Jul 25 17:08:49.592875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3408/6733] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:49 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:50.613290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:50.613915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:50.621300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:50.621743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:50.622518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:50.622927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:50.771812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:50.783240 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6655dfc-48cd-4c78-b989-946333df2ac0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.173739 Jul 25 17:08:50.784015 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3326/6734] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:50 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:51.808925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:51.809331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:51.816506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:51.816976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:51.817805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:51.818250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:51.966468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:51.974830 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2391aff0-8a20-45a2-8316-d98892e50410 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.171415 Jul 25 17:08:51.975419 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3409/6735] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:51 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:52.996355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:52.996970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:53.004382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:53.004827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:53.005613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:53.006037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:53.137834 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:53.145859 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-af7f64dc-3501-4901-9dd2-9c01d1a4201d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.153486 Jul 25 17:08:53.146486 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3327/6736] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:52 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:54.172384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:54.173491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:54.183653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:54.184123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:54.184914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:54.185408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:54.320158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:54.328133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53253cd5-8542-45c5-9445-4eb989c87bd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.162802 Jul 25 17:08:54.328733 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3410/6737] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:54 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:55.353159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:55.353729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:55.361481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:55.361954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:55.362759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:55.363218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:55.494083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:55.502017 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-30ede5d8-975e-4727-b2ba-52ac2ed79dd1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.155657 Jul 25 17:08:55.502624 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3328/6738] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:55 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:56.526403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:56.527025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:56.534801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:56.535271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:56.536303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:56.536767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:56.687501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:56.696643 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-154dd0fa-e6cc-48ea-945f-b61204e60d85 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.175848 Jul 25 17:08:56.697276 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3411/6739] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:56 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:57.721986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:57.722967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:57.732376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:57.732847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:57.733660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:57.734099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:57.868886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:57.876731 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-41caa667-a779-425a-93b5-3b7f0cb6120c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.161677 Jul 25 17:08:57.877341 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3329/6740] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:57 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:08:58.901704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:08:58.902808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:08:58.914563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:58.915181 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:58.915967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:08:58.916420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:08:59.051211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:08:59.059642 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ee7b7155-debd-42e8-9432-cfd32aa9171d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1687 microversion: 2.1 time: 0.164686 Jul 25 17:08:59.060228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3412/6741] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:08:58 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:00.081186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:00.081794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:00.088840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:00.089322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:00.090082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:00.090510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:00.227671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:00.235278 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1e34de96-e088-4e7e-b769-9b2099fd74b9 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1686 microversion: 2.1 time: 0.157978 Jul 25 17:09:00.235864 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3330/6742] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:00 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:00.606874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-aa270448-34ab-4c82-9f67-0251633bf453 req-15c4eb15-dd68-410d-a9cb-cf04e1c58654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "name": "network-vif-unplugged", "status": "completed", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:00.617933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-aa270448-34ab-4c82-9f67-0251633bf453 req-15c4eb15-dd68-410d-a9cb-cf04e1c58654 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:00.618438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-aa270448-34ab-4c82-9f67-0251633bf453 req-15c4eb15-dd68-410d-a9cb-cf04e1c58654 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:00.631639 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-aa270448-34ab-4c82-9f67-0251633bf453 req-15c4eb15-dd68-410d-a9cb-cf04e1c58654 service nova] Creating event network-vif-unplugged:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h1-846219-13 Jul 25 17:09:00.638482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-aa270448-34ab-4c82-9f67-0251633bf453 req-15c4eb15-dd68-410d-a9cb-cf04e1c58654 service nova] Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:09:00.650706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-aa270448-34ab-4c82-9f67-0251633bf453 req-15c4eb15-dd68-410d-a9cb-cf04e1c58654 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111472 Jul 25 17:09:00.651716 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3413/6743] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:01.257896 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:01.258573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:01.265856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:01.266351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:01.267108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:01.267547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:01.426473 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:01.435082 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a3f1042-73d2-459f-b289-be83dca38718 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1686 microversion: 2.1 time: 0.181084 Jul 25 17:09:01.435934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3331/6744] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:01 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:02.463133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:02.463892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:02.471003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:02.471494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:02.472315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:02.472788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:02.623615 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:02.635256 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4730c7dc-5d08-49be-8cfb-ed996c9816fe tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1684 microversion: 2.1 time: 0.179847 Jul 25 17:09:02.636047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3414/6745] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:02 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:02.666489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fb3237a1-4293-489a-af7d-f062e87b2b4e req-5da1d6ba-bcb8-452e-86d5-b52c1215a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:02.677377 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fb3237a1-4293-489a-af7d-f062e87b2b4e req-5da1d6ba-bcb8-452e-86d5-b52c1215a0f9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:02.677826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fb3237a1-4293-489a-af7d-f062e87b2b4e req-5da1d6ba-bcb8-452e-86d5-b52c1215a0f9 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:02.690160 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fb3237a1-4293-489a-af7d-f062e87b2b4e req-5da1d6ba-bcb8-452e-86d5-b52c1215a0f9 service nova] Creating event network-changed:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h1-846219-13 Jul 25 17:09:02.696329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-fb3237a1-4293-489a-af7d-f062e87b2b4e req-5da1d6ba-bcb8-452e-86d5-b52c1215a0f9 service nova] Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:09:02.707687 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fb3237a1-4293-489a-af7d-f062e87b2b4e req-5da1d6ba-bcb8-452e-86d5-b52c1215a0f9 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044977 Jul 25 17:09:02.708293 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3332/6746] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:03.666427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:03.667191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:03.676436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:03.677023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:03.678066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:03.678685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:03.825958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:03.837537 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c38419af-e4bc-474b-ac19-42aa5dc07ca2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1684 microversion: 2.1 time: 0.177547 Jul 25 17:09:03.838152 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3415/6747] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:03 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:04.865717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:04.866875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:04.874618 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:04.875056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:04.875832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:04.876261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:05.007958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:05.015910 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8028ed11-664b-4d6e-9f9c-1f281c96f978 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1684 microversion: 2.1 time: 0.158865 Jul 25 17:09:05.016496 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3333/6748] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:04 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:06.038385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:06.039137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:06.047387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.047924 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.048767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.049304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.186385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:06.195093 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db5ae524-c836-4a4e-8508-270c8742e48a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1681 microversion: 2.1 time: 0.161051 Jul 25 17:09:06.195712 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3416/6749] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:06 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:06.217146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:06.217759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:06.225294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.225796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.226679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.227115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.264226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.264684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.265508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.265945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.292073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:09:06.297766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:09:06.404651 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f8c0b2ab-ec8e-4627-8e92-6a5ecc305e29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9/action" status: 202 len: 0 microversion: 2.1 time: 0.192268 Jul 25 17:09:06.405303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3334/6750] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:09:06 2022] POST /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:09:06.413740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:06.414392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:06.421823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.422430 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.423218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:06.423678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:06.562679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:06.570663 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ea8eb0a-b08c-43df-a62c-ab90326493a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1680 microversion: 2.1 time: 0.160823 Jul 25 17:09:06.571254 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3417/6751] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:06 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:07.594903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:07.595605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:07.603507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:07.603967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:07.604740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:07.605231 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:07.739791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-38ce4da2-fe46-435e-bd35-979b31701f56 req-52579168-e168-4c4f-9d2f-6489e367a3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "name": "network-vif-plugged", "status": "completed", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:07.750482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:07.752120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-38ce4da2-fe46-435e-bd35-979b31701f56 req-52579168-e168-4c4f-9d2f-6489e367a3d1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:07.752570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-38ce4da2-fe46-435e-bd35-979b31701f56 req-52579168-e168-4c4f-9d2f-6489e367a3d1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:07.760847 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0be55697-e1b7-49e9-aa73-f4fb05fb15a8 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1680 microversion: 2.1 time: 0.171104 Jul 25 17:09:07.761706 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3335/6752] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:07 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:07.766118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-38ce4da2-fe46-435e-bd35-979b31701f56 req-52579168-e168-4c4f-9d2f-6489e367a3d1 service nova] Creating event network-vif-plugged:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h1-846219-13 Jul 25 17:09:07.771812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-38ce4da2-fe46-435e-bd35-979b31701f56 req-52579168-e168-4c4f-9d2f-6489e367a3d1 service nova] Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:09:07.782855 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-38ce4da2-fe46-435e-bd35-979b31701f56 req-52579168-e168-4c4f-9d2f-6489e367a3d1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046831 Jul 25 17:09:07.783471 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3418/6753] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:09:08.786756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:08.787824 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:08.796890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:08.797368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:08.798127 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:08.798559 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:08.946348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:08.955282 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0b7bb0ee-f472-423d-849d-5f529bece463 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1680 microversion: 2.1 time: 0.175315 Jul 25 17:09:08.955889 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3336/6754] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:08 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:09.979596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:09.980380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:09.987172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:09.987743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:09.988659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:09.989119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:10.255940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:10.264106 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc1d7a1f-8846-4c2e-b6f8-3e1bd0e8dbb4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1680 microversion: 2.1 time: 0.290459 Jul 25 17:09:10.264696 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3419/6755] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:09 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1680 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:10.363820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cdf3549c-580f-465e-9fd6-6d8164eec8fb req-a3a4c7d9-e9f7-40c5-af9c-031fbfb4498a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "name": "network-vif-unplugged", "status": "completed", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:10.375604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cdf3549c-580f-465e-9fd6-6d8164eec8fb req-a3a4c7d9-e9f7-40c5-af9c-031fbfb4498a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:10.376161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cdf3549c-580f-465e-9fd6-6d8164eec8fb req-a3a4c7d9-e9f7-40c5-af9c-031fbfb4498a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:10.388872 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cdf3549c-580f-465e-9fd6-6d8164eec8fb req-a3a4c7d9-e9f7-40c5-af9c-031fbfb4498a service nova] Creating event network-vif-unplugged:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h2-846219-13 Jul 25 17:09:10.394583 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-cdf3549c-580f-465e-9fd6-6d8164eec8fb req-a3a4c7d9-e9f7-40c5-af9c-031fbfb4498a service nova] Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:09:10.405241 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cdf3549c-580f-465e-9fd6-6d8164eec8fb req-a3a4c7d9-e9f7-40c5-af9c-031fbfb4498a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045469 Jul 25 17:09:10.405862 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3337/6756] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:11.286175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:11.286791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:11.294977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:11.295446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:11.296262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:11.296715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:11.720556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:11.728832 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6650b4a2-cc8e-4701-82b8-1c8bf541eb6e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1680 microversion: 2.1 time: 0.446914 Jul 25 17:09:11.729578 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3420/6757] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:11 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1680 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:12.427087 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6f3adb03-6e76-4784-8210-ff6ac24c77c6 req-ff94b29b-27bb-4fa5-a9bb-578aaedfc4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:12.438574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6f3adb03-6e76-4784-8210-ff6ac24c77c6 req-ff94b29b-27bb-4fa5-a9bb-578aaedfc4a3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:12.439089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6f3adb03-6e76-4784-8210-ff6ac24c77c6 req-ff94b29b-27bb-4fa5-a9bb-578aaedfc4a3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:12.443692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:12.453661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6f3adb03-6e76-4784-8210-ff6ac24c77c6 req-ff94b29b-27bb-4fa5-a9bb-578aaedfc4a3 service nova] Creating event network-changed:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h2-846219-13 Jul 25 17:09:12.460489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-6f3adb03-6e76-4784-8210-ff6ac24c77c6 req-ff94b29b-27bb-4fa5-a9bb-578aaedfc4a3 service nova] Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:09:12.471551 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6f3adb03-6e76-4784-8210-ff6ac24c77c6 req-ff94b29b-27bb-4fa5-a9bb-578aaedfc4a3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050313 Jul 25 17:09:12.472149 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3338/6758] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:12.754964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:12.755580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:12.763135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:12.763597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:12.764397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:12.764859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:12.989742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:12.993418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:13.000209 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0bb23e0e-8c59-4ac3-a65c-d056c6ea83a2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1680 microversion: 2.1 time: 0.249304 Jul 25 17:09:13.000823 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3421/6759] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:12 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:14.028309 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:14.029657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:14.040396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.041160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.042464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.043185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.185764 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:14.193645 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-904f8473-a677-49d6-a4e4-b45f171d34a0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1673 microversion: 2.1 time: 0.174091 Jul 25 17:09:14.194261 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3339/6760] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:14 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:14.213998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:14.214641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:14.222672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.223134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.224245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.224699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.364334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:14.374925 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5bb236d8-0761-4b31-b845-2613b88341ea tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1673 microversion: 2.1 time: 0.164994 Jul 25 17:09:14.375510 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3422/6761] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:14 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:14.395398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:14.396011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:14.403418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.403891 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.404772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.405244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.542941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:14.551741 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a343bd2c-989b-48ed-9b5f-3c4ab5ca0411 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1673 microversion: 2.1 time: 0.160339 Jul 25 17:09:14.552370 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3340/6762] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:14 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:14.572165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:14.572614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:14.579302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.579767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.580575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.581027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.606555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:09:14.693961 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-76d83376-347d-42ee-9ff5-ce2de02aff45 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 204 len: 0 microversion: 2.1 time: 0.125246 Jul 25 17:09:14.694869 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3423/6763] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:09:14 2022] DELETE /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:09:14.704449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:14.705059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:14.711446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.711887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.712643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:14.713073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:14.846757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:14.855499 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5079b272-bf44-4298-9fde-7abc7770f183 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1679 microversion: 2.1 time: 0.155510 Jul 25 17:09:14.856245 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3341/6764] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:14 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:15.878264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:15.879040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:15.881894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:15.887849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:15.888316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:15.889123 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:15.889570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:16.105353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:16.114737 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9b874742-10b6-4340-b252-39b9f84e1a44 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1679 microversion: 2.1 time: 0.240735 Jul 25 17:09:16.122948 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3424/6765] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:15 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:16.862567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-fa0de33c-d15e-41cc-972b-e9c95751d88f req-c1e5cab8-27e5-451c-be57-513c2864d7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7c6c6f-1cb8-47da-b363-a86cf842a8a9", "name": "network-vif-deleted", "tag": "06115abe-ea67-4388-871b-5d8266e1cc54"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:16.872930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:16.874367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:16.880515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fa0de33c-d15e-41cc-972b-e9c95751d88f req-c1e5cab8-27e5-451c-be57-513c2864d7aa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:16.881038 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-fa0de33c-d15e-41cc-972b-e9c95751d88f req-c1e5cab8-27e5-451c-be57-513c2864d7aa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:16.896463 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-fa0de33c-d15e-41cc-972b-e9c95751d88f req-c1e5cab8-27e5-451c-be57-513c2864d7aa service nova] Creating event network-vif-deleted:06115abe-ea67-4388-871b-5d8266e1cc54 for instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 on n-h2-846219-13 Jul 25 17:09:16.902445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-fa0de33c-d15e-41cc-972b-e9c95751d88f req-c1e5cab8-27e5-451c-be57-513c2864d7aa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044667 Jul 25 17:09:16.903073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3342/6766] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:17.140255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:17.140996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:17.148647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:17.149132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:17.149970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:17.150427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:17.182625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:17.183095 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:17.183566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lazy-loading 'fault' on Instance uuid fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:09:17.228915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:17.237856 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36f016fc-a38d-49c6-b3a2-2207eead8a9e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 200 len: 1331 microversion: 2.1 time: 0.101703 Jul 25 17:09:17.238439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3425/6767] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:17 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:18.264264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:18.265461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:18.277756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:18.278510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:18.279699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:18.280129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:18.293705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 HTTP/1.1 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fb7c6c6f-1cb8-47da-b363-a86cf842a8a9'} Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:09:18.295353 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e0d89061-f0b6-4cfe-b6a1-7897dbb7c56b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 404 len: 111 microversion: 2.1 time: 0.039716 Jul 25 17:09:18.299107 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3343/6768] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:18 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:09:18.312125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:18.312782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:18.320466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:18.320861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:18.321680 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:18.322130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:18.335762 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 HTTP/1.1 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fb7c6c6f-1cb8-47da-b363-a86cf842a8a9'} Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:09:18.337476 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3bad4be3-ae2c-4bf3-9fa9-d172324f8659 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 404 len: 111 microversion: 2.1 time: 0.030770 Jul 25 17:09:18.341456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3426/6769] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:18 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:09:18.453138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-620547568", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "3adbff68-0cfb-4ba7-9368-9b060050df5e"}], "security_groups": [{"name": "tempest-securitygroup--1752674610"}], "key_name": "tempest-keypair-1835995925", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:18.578809 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] validate_networks() for [('3adbff68-0cfb-4ba7-9368-9b060050df5e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:09:18.970335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:09:18.970758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:09:18.971252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:09:18.971745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:09:18.972395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:09:18.983399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:18.983909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:18.984727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:18.985151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:19.003704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:09:19.009071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:09:19.022547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:09:19.024957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:09:19.078556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91bb9ceb-228b-40ee-bf52-53c36fdd733b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.629366 Jul 25 17:09:19.079250 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3344/6770] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:09:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:09:19.091434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3ac76804-0ffc-43d3-b3a5-88bda485ec6c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:19.092155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3ac76804-0ffc-43d3-b3a5-88bda485ec6c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:19.152681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3ac76804-0ffc-43d3-b3a5-88bda485ec6c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:19.159921 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3ac76804-0ffc-43d3-b3a5-88bda485ec6c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1242 microversion: 2.1 time: 0.072953 Jul 25 17:09:19.160522 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3427/6771] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:19 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:20.183073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:20.183659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:20.190467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:20.190915 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:20.191686 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:20.192126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:20.264204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:20.273233 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98f8feab-02d4-47ae-98f3-501d7b4cc159 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1294 microversion: 2.1 time: 0.095368 Jul 25 17:09:20.274115 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3345/6772] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:20 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:21.295177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:21.295816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:21.307604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:21.308085 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:21.308899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:21.309382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:21.442147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:21.450598 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f7de7eab-6c18-472d-9530-5d98be6d1730 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.159379 Jul 25 17:09:21.451320 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3428/6773] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:21 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:21.837867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3be42bd2-b864-481d-a618-0b3b5cc7abfb req-ae698714-e9fa-477e-8e34-1f32f72913ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:21.852421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3be42bd2-b864-481d-a618-0b3b5cc7abfb req-ae698714-e9fa-477e-8e34-1f32f72913ec service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:21.853464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3be42bd2-b864-481d-a618-0b3b5cc7abfb req-ae698714-e9fa-477e-8e34-1f32f72913ec service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:21.867023 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3be42bd2-b864-481d-a618-0b3b5cc7abfb req-ae698714-e9fa-477e-8e34-1f32f72913ec service nova] Creating event network-changed:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:09:21.872763 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3be42bd2-b864-481d-a618-0b3b5cc7abfb req-ae698714-e9fa-477e-8e34-1f32f72913ec service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039650 Jul 25 17:09:21.873360 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3346/6774] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:22.472618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:22.473266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:22.481293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:22.481784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:22.482690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:22.483148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:22.617788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:22.626098 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3510cca2-60c4-4359-9390-68cdee8143c4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.157635 Jul 25 17:09:22.626748 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3429/6775] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:22 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:23.649702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:23.650285 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:23.657002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:23.657467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:23.658227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:23.658651 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:23.804054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:23.813809 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d7324c24-92ab-421a-9e71-69804e90d780 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.169307 Jul 25 17:09:23.814422 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3347/6776] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:23 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:24.839147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:24.840120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:24.849423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:24.849915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:24.850714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:24.851175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:24.983627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:24.991450 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6afb86b8-05ce-4837-964e-aea07649cbca tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.158903 Jul 25 17:09:24.992005 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3430/6777] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:24 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:26.017081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:26.017672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:26.025420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:26.025868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:26.026612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:26.027040 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:26.169614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:26.177620 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d138029-dc2a-4e16-a5e4-f9a798a013cf tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.166598 Jul 25 17:09:26.178193 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3348/6778] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:26 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:27.203668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:27.204778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:27.217195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:27.218006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:27.219265 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:27.219724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:27.358709 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:27.366659 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b925d530-f68a-4550-9088-286c6abaa656 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.169727 Jul 25 17:09:27.367247 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3431/6779] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:27 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:27.824171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c89052a3-d43b-4fd9-a027-59bdb3979419 req-d80008da-cd6d-4487-ac8f-52e58d24a50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "name": "network-vif-plugged", "status": "completed", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:27.835930 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c89052a3-d43b-4fd9-a027-59bdb3979419 req-d80008da-cd6d-4487-ac8f-52e58d24a50b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:27.836454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c89052a3-d43b-4fd9-a027-59bdb3979419 req-d80008da-cd6d-4487-ac8f-52e58d24a50b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:27.848274 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c89052a3-d43b-4fd9-a027-59bdb3979419 req-d80008da-cd6d-4487-ac8f-52e58d24a50b service nova] Creating event network-vif-plugged:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:09:27.853612 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c89052a3-d43b-4fd9-a027-59bdb3979419 req-d80008da-cd6d-4487-ac8f-52e58d24a50b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Jul 25 17:09:27.854210 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3349/6780] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:28.392541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:28.393706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:28.405899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:28.406727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:28.408132 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:28.408584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:28.542370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:28.550513 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2fac506d-4c6d-4f27-b73d-5fa65aef2689 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.164763 Jul 25 17:09:28.551097 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3432/6781] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:28 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:29.572344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:29.573501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:29.579540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:29.580529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:29.587880 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:29.588324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:29.589084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:29.589538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:29.742444 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:29.755766 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-49e09341-db66-48c8-8f04-d7f640fd4929 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1368 microversion: 2.1 time: 0.185994 Jul 25 17:09:29.756644 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3350/6782] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:29 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:30.783622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:30.784437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:30.786776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:09:30.794955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:30.795532 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:30.796552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:30.797145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:30.936830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:09:30.944887 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b97c5da8-6b16-46a2-8bca-0e60edc16906 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1556 microversion: 2.1 time: 0.167871 Jul 25 17:09:30.945505 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3433/6783] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:09:30 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:09:30.969341 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:09:30.970186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:09:30.981956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:30.982647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:30.985160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:30.985805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:31.074988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c970f9b-d2fb-4b3e-9687-1804534ac4c1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112580 Jul 25 17:09:31.075704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3351/6784] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 17:09:30 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:09:32.055932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f49e9f89-f25a-4b97-adef-cef2095fabc3 req-cc5bba8c-8141-4810-8bae-340acf71c77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:09:32.066756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f49e9f89-f25a-4b97-adef-cef2095fabc3 req-cc5bba8c-8141-4810-8bae-340acf71c77d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:09:32.067195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f49e9f89-f25a-4b97-adef-cef2095fabc3 req-cc5bba8c-8141-4810-8bae-340acf71c77d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:09:32.082533 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f49e9f89-f25a-4b97-adef-cef2095fabc3 req-cc5bba8c-8141-4810-8bae-340acf71c77d service nova] Creating event network-changed:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:09:32.087994 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f49e9f89-f25a-4b97-adef-cef2095fabc3 req-cc5bba8c-8141-4810-8bae-340acf71c77d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040232 Jul 25 17:09:32.088590 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3434/6785] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:02.586996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:02.587736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=58 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:02.592580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:02.593249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:02.600917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:02.601384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:02.602455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:02.602886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:02.742725 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:02.750912 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cf14d8fe-3c4b-48bb-b552-94548e792b22 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1675 microversion: 2.1 time: 0.166424 Jul 25 17:11:02.751464 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3352/6786] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:02 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:02.778109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=25 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:02.778915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:02.783643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5386dd-89f0-491b-9ad1-ab689996fbbf"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:02.786342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:02.793933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:02.794396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:02.795163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:02.795609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:03.070582 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-acfff258-0193-4e04-883f-6d69cf1dedd4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295129 Jul 25 17:11:03.071259 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3435/6787] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 17:11:02 2022] POST /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:03.799434 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:11:03.800405 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:11:03.824653 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:11:03.824872 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:11:04.201521 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:11:04.202002 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:11:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:11:14.918318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:14.920576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:14.923117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:14.923798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:14.930157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:14.930605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:14.931345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:14.931806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:14.960672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:14.966705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:11:14.973831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:11:14.974245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:11:14.974716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:11:14.975107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:11:14.975508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:11:15.042598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-05b086ba-2e6d-4c84-bad0-7c13d769145e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/action" status: 202 len: 0 microversion: 2.1 time: 0.128073 Jul 25 17:11:15.043196 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3353/6788] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:11:14 2022] POST /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:11:15.049812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:15.050810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:15.055356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:15.055834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:15.063814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:15.064218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:15.065022 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:15.065497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:15.204838 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:15.213128 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75e842a7-074c-48d3-96e1-c6bf78f998b6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1730 microversion: 2.1 time: 0.165291 Jul 25 17:11:15.213728 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3436/6789] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:15 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:16.238538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:16.239640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:16.252235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:16.252674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:16.253494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:16.253921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:16.390229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:16.399298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dcce47bf-ab72-41b6-8305-bf0c4c6c4907 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1730 microversion: 2.1 time: 0.167376 Jul 25 17:11:16.399897 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3354/6790] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:16 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:17.427164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:17.428208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:17.440565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:17.441416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:17.443196 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:17.443959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:17.591801 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:17.600387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02a9e8b7-89ae-42b4-857a-90450263f900 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.179964 Jul 25 17:11:17.600979 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3437/6791] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:17 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:18.625427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:18.626258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:18.634141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:18.634634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:18.635487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:18.635968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:18.782825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:18.791503 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4cceacc6-4ce7-462d-a40c-911673aa5050 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.172464 Jul 25 17:11:18.792056 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3355/6792] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:18 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:19.813850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:19.814496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:19.830170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:19.831130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:19.831899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:19.832343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:19.970779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:19.982330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-85f22655-a35d-4779-bb79-bfccf799f492 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.172375 Jul 25 17:11:19.983133 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3438/6793] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:19 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:21.004964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:21.005663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:21.013552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:21.014026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:21.014840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:21.015297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:21.158595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:21.166797 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6284764e-906d-4c06-8950-ddb92ff55c2e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.166455 Jul 25 17:11:21.167363 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3356/6794] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:20 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:22.188687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:22.189328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:22.197445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:22.197921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:22.198718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:22.199176 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:22.333051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:22.341818 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-68b6d84d-6148-486a-a192-f91a8a73fd5a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.157325 Jul 25 17:11:22.342414 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3439/6795] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:22 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:23.366697 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:23.367498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:23.376800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:23.377445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:23.378438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:23.379011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:23.600769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:23.609233 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f9c0249c-6419-44e5-97f9-ff6132525f9d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.247799 Jul 25 17:11:23.609807 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3357/6796] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:23 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:24.634646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:24.635701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:24.645728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:24.646194 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:24.646980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:24.647434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:24.830852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:24.840222 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-62b2421b-6fc1-4061-acec-30e7662d4c95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.212148 Jul 25 17:11:24.840826 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3440/6797] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:24 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:25.862573 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:25.863252 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:25.871060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:25.871531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:25.872305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:25.872743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:26.011709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:26.020139 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22c3edd3-61df-47ec-b3d8-b4dcd17ec01b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.161467 Jul 25 17:11:26.020720 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3358/6798] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:25 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:27.045947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:27.046952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:27.055064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:27.055535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:27.056333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:27.056790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:27.196264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:27.204528 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9ef153a-458e-43bf-a018-3954c2f0c155 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.165223 Jul 25 17:11:27.205121 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3441/6799] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:27 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:28.227751 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:28.228420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:28.237413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:28.237926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:28.238792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:28.239279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:28.385249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:28.393951 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0c176166-1bbf-43c0-ad55-39d91ee8e09b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.170941 Jul 25 17:11:28.394571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3359/6800] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:28 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:29.421152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:29.422183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:29.430632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:29.431062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:29.431927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:29.432377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:29.572693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:29.580993 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a696da7-6a4e-4575-9e0b-8df056e332a6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.167272 Jul 25 17:11:29.581612 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3442/6801] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:29 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:30.607567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:30.608128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:30.615988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:30.616462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:30.617240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:30.617672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:30.755251 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:30.763866 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-48cfc18c-df0c-4e3d-b0cb-23c0675b8fde tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.160304 Jul 25 17:11:30.764473 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3360/6802] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:30 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:31.786049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:31.786612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:31.794863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:31.795305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:31.796096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:31.796545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:31.974836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:31.983816 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-905fcb59-e76b-4dd2-99a2-987f98a695fc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1735 microversion: 2.1 time: 0.202029 Jul 25 17:11:31.984398 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3443/6803] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:31 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:32.331288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c5242058-af57-4c68-b657-24829cc47ecc req-e1b7a7dd-6c12-4dc4-9709-a8d36e8fd9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "name": "network-vif-unplugged", "status": "completed", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:32.344036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c5242058-af57-4c68-b657-24829cc47ecc req-e1b7a7dd-6c12-4dc4-9709-a8d36e8fd9db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:32.344470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c5242058-af57-4c68-b657-24829cc47ecc req-e1b7a7dd-6c12-4dc4-9709-a8d36e8fd9db service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:32.356794 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c5242058-af57-4c68-b657-24829cc47ecc req-e1b7a7dd-6c12-4dc4-9709-a8d36e8fd9db service nova] Creating event network-vif-unplugged:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h2-846219-13 Jul 25 17:11:32.362484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-c5242058-af57-4c68-b657-24829cc47ecc req-e1b7a7dd-6c12-4dc4-9709-a8d36e8fd9db service nova] Instance 949526f8-c5f4-4865-a9c0-d982916085f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:11:32.373375 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c5242058-af57-4c68-b657-24829cc47ecc req-e1b7a7dd-6c12-4dc4-9709-a8d36e8fd9db service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046534 Jul 25 17:11:32.374249 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3361/6804] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:33.006465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:33.007282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:33.016282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:33.017195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:33.018201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:33.018717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:33.235364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:33.243792 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0ac5ae92-03d5-4ea3-b06a-d59459ef4541 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1734 microversion: 2.1 time: 0.241847 Jul 25 17:11:33.244383 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3444/6805] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:33 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:34.267280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:34.267963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:34.275010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:34.275482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:34.276236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:34.276720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:34.396896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d733b0b5-698b-4c06-acd7-c51a0f879fda req-ab719069-7522-4403-a8e0-84bcfd6f9637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:34.408813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d733b0b5-698b-4c06-acd7-c51a0f879fda req-ab719069-7522-4403-a8e0-84bcfd6f9637 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:34.409393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d733b0b5-698b-4c06-acd7-c51a0f879fda req-ab719069-7522-4403-a8e0-84bcfd6f9637 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:34.422165 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d733b0b5-698b-4c06-acd7-c51a0f879fda req-ab719069-7522-4403-a8e0-84bcfd6f9637 service nova] Creating event network-changed:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h2-846219-13 Jul 25 17:11:34.426585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:34.435523 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45d90d8d-17bd-4b09-8c8c-6ca0e565a57f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.173354 Jul 25 17:11:34.436094 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3362/6806] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:34 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:34.439221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-d733b0b5-698b-4c06-acd7-c51a0f879fda req-ab719069-7522-4403-a8e0-84bcfd6f9637 service nova] Instance 949526f8-c5f4-4865-a9c0-d982916085f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:11:34.456102 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d733b0b5-698b-4c06-acd7-c51a0f879fda req-ab719069-7522-4403-a8e0-84bcfd6f9637 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063030 Jul 25 17:11:34.457017 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3445/6807] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:35.459187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:35.459800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:35.467043 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:35.467494 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:35.468265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:35.468704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:35.614586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:35.623053 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2d3a505f-6d60-4ba6-8146-688b3c648397 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.167796 Jul 25 17:11:35.623606 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3363/6808] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:35 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:36.645697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:36.646564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:36.653359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:36.653828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:36.654633 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:36.655089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:36.791662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:36.800277 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e69dd510-a696-437b-ab24-3d213be314cc tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.159963 Jul 25 17:11:36.800837 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3446/6809] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:36 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:37.822092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:37.822676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:37.830388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:37.830856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:37.831655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:37.832098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:37.972705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:37.981745 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26720e19-07c3-498a-aeb2-a746e6830078 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.163560 Jul 25 17:11:37.982542 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3364/6810] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:37 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:39.008003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:39.009031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:39.019743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:39.020211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:39.021026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:39.021512 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:39.159857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:39.168139 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0de1085d-2089-4c06-8b73-bcda2bab8d29 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.166876 Jul 25 17:11:39.168747 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3447/6811] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:38 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:40.192019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:40.192688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:40.201691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:40.202233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:40.203160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:40.203661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:40.358973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:40.368048 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-926af57b-a574-4e09-b3be-9c2264204ef6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.181643 Jul 25 17:11:40.368627 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3365/6812] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:40 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:41.394306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:41.394954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:41.404227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:41.404808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:41.405819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:41.406342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:41.550087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:41.559027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9120de36-bded-477d-a78a-d69f54dc6334 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.171393 Jul 25 17:11:41.560083 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3448/6813] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:41 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:42.584949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:42.585592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:42.592163 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:42.592615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:42.593491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:42.593955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:42.734125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:42.745036 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-faae2692-07cd-4d7e-af02-0526f18777d4 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.164727 Jul 25 17:11:42.745851 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3366/6814] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:42 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:43.771146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:43.772174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:43.783380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:43.784156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:43.785130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:43.785577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:43.930245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:43.942596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0418bb02-82cc-4988-984f-9b5203c1b71d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.178440 Jul 25 17:11:43.943165 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3449/6815] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:43 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:44.968420 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:44.969479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:44.973980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=33 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:44.983720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:44.984466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:44.985780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:44.986505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:44.989817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:45.125012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:45.133703 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9f80d69f-12d5-4b9d-82e6-0637a937cf0b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1732 microversion: 2.1 time: 0.172214 Jul 25 17:11:45.134292 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3367/6816] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:44 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:46.159521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:46.160304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:46.163799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=29 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:46.170965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.171549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.172522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.173086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.176535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=83 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:46.320113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:46.332857 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e69874a8-f2bc-4371-8ac4-137d7492698d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1729 microversion: 2.1 time: 0.180186 Jul 25 17:11:46.333459 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3450/6817] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:46 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:46.354435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:46.355084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:46.362165 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.362661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.363458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.363895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.409121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.409591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.410380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.410814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.431677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:11:46.437048 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Getting quotas for user b553521a9a934091ae194601502b9e24 and project 7425b5f3860f45928e8be1703c79a07a. Resources: {'ram', 'cores'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:11:46.548597 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-17274c77-4e12-4585-b647-472ed9de6874 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "POST /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/action" status: 202 len: 0 microversion: 2.1 time: 0.198246 Jul 25 17:11:46.549315 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3368/6818] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:11:46 2022] POST /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:11:46.558830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:46.559467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:46.565877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.567489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.568852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:46.569404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:46.772894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:46.781826 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65f5bf58-917a-4e16-af5c-c5b6f24722b5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.227946 Jul 25 17:11:46.782426 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3451/6819] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:46 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:47.808707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:47.809888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:47.819633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:47.820075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:47.820829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:47.821302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:47.971835 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:47.980490 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-633b8591-ae96-417a-84cb-00a3669ae934 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.180324 Jul 25 17:11:47.981068 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3369/6820] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:47 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:48.796073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3a283ad7-dff5-4b28-81fb-666b7527fc7f req-41137ccf-c341-49ea-9c45-f0ff25a3e02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "name": "network-vif-plugged", "status": "completed", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:48.807449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3a283ad7-dff5-4b28-81fb-666b7527fc7f req-41137ccf-c341-49ea-9c45-f0ff25a3e02b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:48.807912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3a283ad7-dff5-4b28-81fb-666b7527fc7f req-41137ccf-c341-49ea-9c45-f0ff25a3e02b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:48.821234 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3a283ad7-dff5-4b28-81fb-666b7527fc7f req-41137ccf-c341-49ea-9c45-f0ff25a3e02b service nova] Creating event network-vif-plugged:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h2-846219-13 Jul 25 17:11:48.827029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-3a283ad7-dff5-4b28-81fb-666b7527fc7f req-41137ccf-c341-49ea-9c45-f0ff25a3e02b service nova] Instance 949526f8-c5f4-4865-a9c0-d982916085f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:11:48.838081 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3a283ad7-dff5-4b28-81fb-666b7527fc7f req-41137ccf-c341-49ea-9c45-f0ff25a3e02b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096088 Jul 25 17:11:48.838647 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3452/6821] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:49.004554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:49.005194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:49.012814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:49.013298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:49.014414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:49.014857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:49.155848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:49.164172 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f13b6c31-c472-4b35-a29f-d16fcdd39b95 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.165739 Jul 25 17:11:49.164843 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3370/6822] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:48 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:50.187835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:50.188442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:50.195740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:50.196219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:50.197043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:50.197533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:50.342481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:50.351426 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-57399827-c213-417f-839d-3df2d9d5bdd5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.169022 Jul 25 17:11:50.352007 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3453/6823] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:50 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:51.373073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:51.373696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:51.380852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:51.381344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:51.382101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:51.382524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:51.529392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:51.539761 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77c1a85b-15f9-47a7-9c84-63f3dd499070 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.170336 Jul 25 17:11:51.540745 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3371/6824] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:51 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:51.940266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ab51911e-b9aa-4701-a685-8259b1e19a26 req-28531414-0235-4900-8238-4038ba443b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "name": "network-vif-unplugged", "status": "completed", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:51.951922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ab51911e-b9aa-4701-a685-8259b1e19a26 req-28531414-0235-4900-8238-4038ba443b77 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:51.952386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ab51911e-b9aa-4701-a685-8259b1e19a26 req-28531414-0235-4900-8238-4038ba443b77 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:51.964889 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ab51911e-b9aa-4701-a685-8259b1e19a26 req-28531414-0235-4900-8238-4038ba443b77 service nova] Creating event network-vif-unplugged:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:11:51.970627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-ab51911e-b9aa-4701-a685-8259b1e19a26 req-28531414-0235-4900-8238-4038ba443b77 service nova] Instance 949526f8-c5f4-4865-a9c0-d982916085f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:11:51.982289 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ab51911e-b9aa-4701-a685-8259b1e19a26 req-28531414-0235-4900-8238-4038ba443b77 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046193 Jul 25 17:11:51.983067 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3454/6825] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:52.560796 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:52.561570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:52.568703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:52.569182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:52.569946 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:52.570380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:52.711538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:52.720010 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c480b91-c5a2-40e0-a6a8-54ea79c3ae62 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.162822 Jul 25 17:11:52.720922 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3372/6826] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:52 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:53.744613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:53.745521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:53.752520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:53.753067 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:53.753883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:53.754331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:53.895326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:53.905214 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6b22e12b-e68e-4ff4-84bc-48e4dd46dc43 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.165784 Jul 25 17:11:53.905854 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3455/6827] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:53 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:54.001806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-505a63b4-3f2c-4aa6-81d9-551f07e83be7 req-391578b0-d858-4116-bdd9-43aa20fd44bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:11:54.012303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-505a63b4-3f2c-4aa6-81d9-551f07e83be7 req-391578b0-d858-4116-bdd9-43aa20fd44bb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:54.012770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-505a63b4-3f2c-4aa6-81d9-551f07e83be7 req-391578b0-d858-4116-bdd9-43aa20fd44bb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:54.024552 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-505a63b4-3f2c-4aa6-81d9-551f07e83be7 req-391578b0-d858-4116-bdd9-43aa20fd44bb service nova] Creating event network-changed:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:11:54.029859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-505a63b4-3f2c-4aa6-81d9-551f07e83be7 req-391578b0-d858-4116-bdd9-43aa20fd44bb service nova] Instance 949526f8-c5f4-4865-a9c0-d982916085f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:11:54.040742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-505a63b4-3f2c-4aa6-81d9-551f07e83be7 req-391578b0-d858-4116-bdd9-43aa20fd44bb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042690 Jul 25 17:11:54.041391 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3373/6828] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:11:54.927738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:54.928326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:54.935985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:54.936445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:54.937257 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:54.937714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:55.072199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:55.081012 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f84fbea5-d3fb-48f2-b6c5-03520e519028 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.157451 Jul 25 17:11:55.081768 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3456/6829] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:54 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:56.105208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:56.105976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:56.112732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:56.113214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:56.113985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:56.114416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:56.264058 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:56.272878 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3cf98070-f3a4-48a6-b2e2-472ad615157a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.173639 Jul 25 17:11:56.273386 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3374/6830] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:56 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:57.294436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:57.295055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:57.302551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:57.303015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:57.303793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:57.304239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:57.439730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:57.448450 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b51c969e-e932-435f-9377-85cf4aa960e5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.158046 Jul 25 17:11:57.449078 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3457/6831] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:57 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:58.474104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:58.475104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:58.478571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:11:58.488670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:58.489129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:58.489897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:58.490311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:58.634811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:58.646529 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a3c3cf91-fb64-466a-bb31-cb044fd2b3ba tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.179053 Jul 25 17:11:58.647119 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3375/6832] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:58 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:11:59.671968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:11:59.672992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:11:59.684823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:59.685652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:59.686992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:11:59.687746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:11:59.842906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:11:59.851996 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1ef472cd-fc77-4bdf-959f-4ba4de384a57 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.186742 Jul 25 17:11:59.852953 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3458/6833] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:11:59 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:00.873727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:00.874312 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:00.881716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:00.882170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:00.882937 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:00.883371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:01.023437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:01.035201 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8692718c-da00-4f15-afb6-08c6200c9cb5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.165540 Jul 25 17:12:01.035801 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3376/6834] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:00 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:02.057849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:02.058434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:02.066640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:02.067244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:02.068435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:02.069041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:02.223631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:02.236613 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6f498c25-21ee-4e32-83ec-e470a38e13f6 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.183118 Jul 25 17:12:02.237449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3459/6835] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:02 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:03.259823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:03.260425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:03.267546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:03.267994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:03.268756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:03.269227 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:03.408046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:03.419876 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f3bc6766-2dad-416c-b383-43b6a89fa97b tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.163674 Jul 25 17:12:03.420648 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3377/6836] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:03 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:04.446133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:04.447186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:04.459114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:04.459600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:04.460439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:04.460894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:04.620884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:04.630298 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-77fc2ecb-f3f7-4d4c-9f1c-2338fec0f3d7 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.190956 Jul 25 17:12:04.630915 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3460/6837] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:04 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:05.656906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:05.657584 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:05.665432 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:05.665866 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:05.666619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:05.667044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:05.812975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:05.828073 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-adb15e24-7b9c-45c0-a9a2-73e41df07f80 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.175496 Jul 25 17:12:05.828690 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3378/6838] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:05 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:06.856317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:06.856976 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:06.864548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:06.865016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:06.865852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:06.866305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:07.009294 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:07.019624 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-84c6f8c6-1cfc-4bb0-8f85-b8218b989ce2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1728 microversion: 2.1 time: 0.167535 Jul 25 17:12:07.020186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3461/6839] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:06 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:08.041792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:08.042467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:08.050356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.050816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.051599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.052175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.189853 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:08.198276 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1a81c5c3-6643-4be0-b24d-5df6bbebdfa2 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1721 microversion: 2.1 time: 0.160887 Jul 25 17:12:08.198861 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3379/6840] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:08 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:08.222255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:08.223012 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:08.232280 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.232948 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.234250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.234955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.377303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:08.386201 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-deff93f8-6667-4318-94f5-8f8174659e72 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1721 microversion: 2.1 time: 0.170568 Jul 25 17:12:08.386803 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3462/6841] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:08 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:08.406769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:08.407390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:08.413774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.414233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.415000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.415439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.561740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:08.570382 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eb7a6fc6-1dd4-4095-ba52-e39347d595c5 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1721 microversion: 2.1 time: 0.167425 Jul 25 17:12:08.570879 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3380/6842] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:08 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:08.591449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:08.591966 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:08.598625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.599091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.599881 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.600390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.627617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:12:08.710484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-476614a0-c956-4ca9-813d-29c313a25864 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 204 len: 0 microversion: 2.1 time: 0.122663 Jul 25 17:12:08.711103 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3463/6843] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:08 2022] DELETE /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:12:08.719995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:08.720613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:08.727232 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.727673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.728742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:08.729244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:08.731814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:08.871117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:08.880988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5fdd1f6d-f808-4566-ac6c-f18a5a139e20 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1727 microversion: 2.1 time: 0.164925 Jul 25 17:12:08.881693 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3381/6844] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:08 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:08.988979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5a42c4e4-8efa-4eaa-9731-c211253649c0 req-6312cc96-c0c9-46aa-b7d8-52394bca73d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "name": "network-vif-plugged", "status": "completed", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:09.001128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5a42c4e4-8efa-4eaa-9731-c211253649c0 req-6312cc96-c0c9-46aa-b7d8-52394bca73d8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:09.001832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5a42c4e4-8efa-4eaa-9731-c211253649c0 req-6312cc96-c0c9-46aa-b7d8-52394bca73d8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:09.013893 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5a42c4e4-8efa-4eaa-9731-c211253649c0 req-6312cc96-c0c9-46aa-b7d8-52394bca73d8 service nova] Creating event network-vif-plugged:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:12:09.019041 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5a42c4e4-8efa-4eaa-9731-c211253649c0 req-6312cc96-c0c9-46aa-b7d8-52394bca73d8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034491 Jul 25 17:12:09.019696 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3464/6845] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:12:09.906990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:09.907953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:09.917620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:09.918071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:09.918860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:09.919291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:10.067956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:10.077417 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d2383428-5e11-48f0-bf31-bef980c99ba1 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1727 microversion: 2.1 time: 0.176893 Jul 25 17:12:10.078024 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3382/6846] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:09 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:11.100560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:11.101226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:11.109940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:11.110546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:11.111339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:11.111959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:11.250545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:11.259059 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4d364984-2c3b-4a0f-aa57-577d7b408d66 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1727 microversion: 2.1 time: 0.163993 Jul 25 17:12:11.259667 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3465/6847] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:11 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:12.112848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c31876c1-f437-44f7-9819-b4d678eb264b req-5c6fbe53-34fb-4135-a728-45fdde46d74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949526f8-c5f4-4865-a9c0-d982916085f7", "name": "network-vif-deleted", "tag": "db0e4971-0621-4e2d-a104-5de34de66b87"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:12.123081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c31876c1-f437-44f7-9819-b4d678eb264b req-5c6fbe53-34fb-4135-a728-45fdde46d74a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:12.123621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c31876c1-f437-44f7-9819-b4d678eb264b req-5c6fbe53-34fb-4135-a728-45fdde46d74a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:12.135722 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c31876c1-f437-44f7-9819-b4d678eb264b req-5c6fbe53-34fb-4135-a728-45fdde46d74a service nova] Creating event network-vif-deleted:db0e4971-0621-4e2d-a104-5de34de66b87 for instance 949526f8-c5f4-4865-a9c0-d982916085f7 on n-h1-846219-13 Jul 25 17:12:12.141588 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c31876c1-f437-44f7-9819-b4d678eb264b req-5c6fbe53-34fb-4135-a728-45fdde46d74a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032498 Jul 25 17:12:12.142293 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3383/6848] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:12:12.280918 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:12.281575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:12.289478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:12.289958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:12.290776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:12.291234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:12.311490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:12.365313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:12.374702 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e5a9e53-92c0-42d4-9ec5-bd76222dd03f tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1373 microversion: 2.1 time: 0.098020 Jul 25 17:12:12.375859 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3466/6849] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:12 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1373 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:13.397677 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:13.398383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:13.405190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:13.405645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:13.406413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:13.406844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:13.469990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:13.478991 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-539de097-420f-4928-b2a1-a33bcaf68ffd tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1373 microversion: 2.1 time: 0.086526 Jul 25 17:12:13.479570 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3384/6850] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:13 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:14.501023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:14.501559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:14.508736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:14.509263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:14.510037 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:14.510467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:14.578750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:14.587371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0db8fd91-b587-4266-8a55-5d027af169fa tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1373 microversion: 2.1 time: 0.090341 Jul 25 17:12:14.588112 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3467/6851] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:14 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:15.609211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:15.609788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:15.612643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:15.618925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:15.619358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:15.620219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:15.620627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:15.689128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b553521a9a934091ae194601502b9e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7425b5f3860f45928e8be1703c79a07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:15.697360 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99c00595-d562-49d5-8fac-684bce0da2b0 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 200 len: 1373 microversion: 2.1 time: 0.092103 Jul 25 17:12:15.697940 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3385/6852] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:15 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:16.721128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:16.721804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:16.726001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:16.732065 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:16.732529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:16.733352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:16.733806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:16.750529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 HTTP/1.1 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '949526f8-c5f4-4865-a9c0-d982916085f7'} Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:16.752266 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7843b326-ad1b-49f8-ac00-d66489ba6852 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 404 len: 111 microversion: 2.1 time: 0.038759 Jul 25 17:12:16.756173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3468/6853] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:16 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:16.824588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:16.826992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:16.834475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:16.834926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:16.835680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:16.836109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:16.848825 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-volume_attachments HTTP/1.1 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '949526f8-c5f4-4865-a9c0-d982916085f7'} Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:16.850526 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3aed6125-c0d3-466e-a88c-d0a0f9c5971c tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031839 Jul 25 17:12:16.854424 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3386/6854] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:12:16 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.186839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.187390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.194782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.195208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.195986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.196432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.210181 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 HTTP/1.1 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '949526f8-c5f4-4865-a9c0-d982916085f7'} Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.211865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2518c642-6e65-4fbe-b4bc-d64695eba892 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 404 len: 111 microversion: 2.1 time: 0.030408 Jul 25 17:12:20.216186 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3469/6855] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:20 2022] DELETE /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.222292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.222903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 949526f8-c5f4-4865-a9c0-d982916085f7] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.230777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.231226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.231991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.232424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.246134 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 HTTP/1.1 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '949526f8-c5f4-4865-a9c0-d982916085f7'} Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.247684 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 949526f8-c5f4-4865-a9c0-d982916085f7 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9ec7833a-646a-45bb-b161-6bd089a7e431 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7" status: 404 len: 111 microversion: 2.1 time: 0.030758 Jul 25 17:12:20.251380 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3387/6856] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:20 2022] GET /compute/v2.1/servers/949526f8-c5f4-4865-a9c0-d982916085f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.258291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.258850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.265186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.265662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.266444 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.266926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.281616 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 HTTP/1.1 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fb7c6c6f-1cb8-47da-b363-a86cf842a8a9'} Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.283296 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c5e19c5-16bd-4f7f-9321-73267095524e tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 404 len: 111 microversion: 2.1 time: 0.030792 Jul 25 17:12:20.289164 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3470/6857] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:20 2022] DELETE /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.294967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.295662 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fb7c6c6f-1cb8-47da-b363-a86cf842a8a9] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.302578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.303151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.304017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.304551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.319381 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 HTTP/1.1 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fb7c6c6f-1cb8-47da-b363-a86cf842a8a9'} Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.321423 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb88f5f3-cd4a-4625-a449-c522c79b7d41 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9" status: 404 len: 111 microversion: 2.1 time: 0.032042 Jul 25 17:12:20.325828 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3388/6858] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:20 2022] GET /compute/v2.1/servers/fb7c6c6f-1cb8-47da-b363-a86cf842a8a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.336671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.337266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.344161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.344630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.345472 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.345941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.360997 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 HTTP/1.1 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'fee53782-c354-4bd3-bcc6-d955e3623987'} Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.362632 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-49b784de-e90e-4f8f-a9b5-dc87f33b2219 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 404 len: 111 microversion: 2.1 time: 0.035945 Jul 25 17:12:20.366214 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3471/6859] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:20 2022] DELETE /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.372820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.373460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: fee53782-c354-4bd3-bcc6-d955e3623987] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.379664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.380117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.380874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.381328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.395181 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 HTTP/1.1 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'fee53782-c354-4bd3-bcc6-d955e3623987'} Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.396734 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance fee53782-c354-4bd3-bcc6-d955e3623987 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25ec77fe-188a-4de0-8160-00ba30918273 tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987" status: 404 len: 111 microversion: 2.1 time: 0.029182 Jul 25 17:12:20.400637 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3389/6860] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:20 2022] GET /compute/v2.1/servers/fee53782-c354-4bd3-bcc6-d955e3623987 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.407823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.408344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.414820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.415286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.416071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.416527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.430675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 HTTP/1.1 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '65e16173-b3d5-487f-b860-96641f1a9bc4'} Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.432295 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.435889 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d8e247c5-f571-4d2c-be06-a85f140dd68a tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 404 len: 111 microversion: 2.1 time: 0.030640 Jul 25 17:12:20.437321 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3472/6861] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:20 2022] DELETE /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.442429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.443041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] [instance: 65e16173-b3d5-487f-b860-96641f1a9bc4] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:20.449758 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.450145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.450898 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:20.451355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:20.464951 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] HTTP exception thrown: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Request method failure captured: Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 HTTP/1.1 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s0nU6LSu1qyN9brXfdVOhEOfbuQed3F81H0-IewwIoxQHU-ixa4ZueJGicPWf1-3NChVXLqOrI1mJtTmBMYddfeSjtRHTClVNcOSOvcdGZrLX4I3q5SREqsD3SH-l631Oesc4XliNEWgisLjVuiUMxmoz-p4Q4TPfcnM5D4msUtPgU Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7425b5f3860f45928e8be1703c79a07a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7425b5f3860f45928e8be1703c79a07a"}]}] Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7425b5f3860f45928e8be1703c79a07a Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServerActionsTestJSON-1692965687 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b553521a9a934091ae194601502b9e24 Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServerActionsTestJSON-1692965687-project Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '65e16173-b3d5-487f-b860-96641f1a9bc4'} Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:20.466533 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Returning 404 to user: Instance 65e16173-b3d5-487f-b860-96641f1a9bc4 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e1ef6f3c-a568-474e-b060-df2dd6293e4d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4" status: 404 len: 111 microversion: 2.1 time: 0.029408 Jul 25 17:12:20.470144 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3390/6862] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:20 2022] GET /compute/v2.1/servers/65e16173-b3d5-487f-b860-96641f1a9bc4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:20.477082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b3a58ae-1d47-4332-9328-978f2e9d215d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] Calling method '.version_select at 0x7f9d93584790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:20.502305 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b3a58ae-1d47-4332-9328-978f2e9d215d tempest-ServerActionsTestJSON-1692965687 tempest-ServerActionsTestJSON-1692965687-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835995925" status: 202 len: 0 microversion: 2.1 time: 0.029109 Jul 25 17:12:20.502936 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3473/6863] 10.222.0.105 () {58 vars in 1226 bytes} [Mon Jul 25 17:12:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835995925 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:12:30.446769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=11 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:30.455787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=35 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:30.471218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-753926647", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "8181a783-34bf-482e-9c4c-28f72fb67f45"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:30.525246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] validate_networks() for [('8181a783-34bf-482e-9c4c-28f72fb67f45', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:12:30.917321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:12:30.917739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:12:30.918208 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:12:30.918613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:12:30.919017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:12:30.928532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:30.929049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:30.929965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:30.930390 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:30.950524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Getting quotas for project 763f7ba91c8b468abec36bfb48661553. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:12:30.955958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Getting quotas for user b93458013f254e8fbb1983b8a0e55c3d and project 763f7ba91c8b468abec36bfb48661553. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:12:30.968769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:12:30.971119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:12:31.022823 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb92f43b-c529-4e9f-b7dc-cae8fbb65e4b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.670000 Jul 25 17:12:31.023526 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3391/6864] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:12:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:12:31.032364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=19 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:31.034147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:31.038792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-419b5b87-78ba-423a-90b0-1abc7f10221a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:31.041374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-419b5b87-78ba-423a-90b0-1abc7f10221a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:31.101525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-419b5b87-78ba-423a-90b0-1abc7f10221a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:31.111330 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-419b5b87-78ba-423a-90b0-1abc7f10221a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1220 microversion: 2.1 time: 0.080687 Jul 25 17:12:31.112030 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3474/6865] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:31 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:32.133480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:32.134258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:32.159585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:32.160521 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:32.161509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:32.162101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:32.262731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:32.272437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7238bb6a-1623-4856-b37f-a30e0651b04d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1290 microversion: 2.1 time: 0.143532 Jul 25 17:12:32.274354 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3392/6866] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:32 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:33.295066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:33.296414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:33.304221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:33.304944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:33.305774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:33.306216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:33.543736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:33.552851 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26119ae5-aee1-4d68-b89c-693568aa3325 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1320 microversion: 2.1 time: 0.262034 Jul 25 17:12:33.558284 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3475/6867] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:33 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:33.899547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-66d9b469-ea73-4a18-a8a8-d1f5c249feff req-0fc0121b-f747-4e5a-99e4-8e965e73025f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb48bcd-8297-431e-bd4d-711c7fd7a272", "tag": "b63bbe04-51d7-4962-9a81-d5dcdace875d"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:33.914742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-66d9b469-ea73-4a18-a8a8-d1f5c249feff req-0fc0121b-f747-4e5a-99e4-8e965e73025f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:33.915175 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-66d9b469-ea73-4a18-a8a8-d1f5c249feff req-0fc0121b-f747-4e5a-99e4-8e965e73025f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:33.927349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-66d9b469-ea73-4a18-a8a8-d1f5c249feff req-0fc0121b-f747-4e5a-99e4-8e965e73025f service nova] Creating event network-changed:b63bbe04-51d7-4962-9a81-d5dcdace875d for instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 on n-h2-846219-13 Jul 25 17:12:33.933944 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-66d9b469-ea73-4a18-a8a8-d1f5c249feff req-0fc0121b-f747-4e5a-99e4-8e965e73025f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143298 Jul 25 17:12:33.935121 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3393/6868] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:12:34.582241 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:34.583326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:34.595242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:34.596032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:34.597452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:34.598217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:34.739790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:34.751397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ada7a961-4962-412e-9af7-af46c6fec8c2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1320 microversion: 2.1 time: 0.175477 Jul 25 17:12:34.752162 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3476/6869] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:34 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:35.776690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:35.777413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:35.784474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:35.784936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:35.785789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:35.786213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:35.927174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:35.935098 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-13c9e580-44e3-4bda-b89d-9d7b65b344f7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1320 microversion: 2.1 time: 0.165135 Jul 25 17:12:35.935879 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3394/6870] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:35 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:36.956640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:36.957331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:36.966660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:36.967140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:36.967929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:36.968398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:37.113447 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:37.122059 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ffaa7cc2-c7de-4369-be82-7c338ab5e317 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1320 microversion: 2.1 time: 0.169760 Jul 25 17:12:37.122719 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3477/6871] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:36 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:38.147036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:38.147969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:38.155515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:38.155965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:38.156768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:38.157240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:38.288496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:38.296185 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a45a4b5b-f298-4c5b-962f-fee0e0a3df15 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1320 microversion: 2.1 time: 0.155248 Jul 25 17:12:38.296742 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3395/6872] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:38 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:39.023793 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-cf0d3c80-5a25-40b8-8ab5-a3bbbe4a540e req-34c82129-ced9-43d7-8264-5532de758784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb48bcd-8297-431e-bd4d-711c7fd7a272", "name": "network-vif-plugged", "status": "completed", "tag": "b63bbe04-51d7-4962-9a81-d5dcdace875d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:39.035831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cf0d3c80-5a25-40b8-8ab5-a3bbbe4a540e req-34c82129-ced9-43d7-8264-5532de758784 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:39.035994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-cf0d3c80-5a25-40b8-8ab5-a3bbbe4a540e req-34c82129-ced9-43d7-8264-5532de758784 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:39.050744 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-cf0d3c80-5a25-40b8-8ab5-a3bbbe4a540e req-34c82129-ced9-43d7-8264-5532de758784 service nova] Creating event network-vif-plugged:b63bbe04-51d7-4962-9a81-d5dcdace875d for instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 on n-h2-846219-13 Jul 25 17:12:39.056849 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-cf0d3c80-5a25-40b8-8ab5-a3bbbe4a540e req-34c82129-ced9-43d7-8264-5532de758784 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036751 Jul 25 17:12:39.057786 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3478/6873] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:12:39.321146 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:39.321912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:39.330345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:39.330883 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:39.331780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:39.332294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:39.466929 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:39.474809 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-986cb2e5-062c-4266-983a-901ff3cf14e0 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1320 microversion: 2.1 time: 0.160015 Jul 25 17:12:39.475426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3396/6874] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:39 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:40.500045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:40.501404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:40.509807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:40.510637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:40.511435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:40.512035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:40.655396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:40.663638 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ac80b351-8ed3-432c-8498-ca417226ecb2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.171453 Jul 25 17:12:40.664256 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3479/6875] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:40 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:40.729203 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344660471", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "8181a783-34bf-482e-9c4c-28f72fb67f45"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:40.786863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] validate_networks() for [('8181a783-34bf-482e-9c4c-28f72fb67f45', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:12:40.940802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:40.963003 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:41.188894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:12:41.189350 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:12:41.189825 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:12:41.190255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:12:41.190666 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:12:41.199876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:41.200322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:41.201142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:41.201580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:41.218349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Getting quotas for project 763f7ba91c8b468abec36bfb48661553. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:12:41.223661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Getting quotas for user b93458013f254e8fbb1983b8a0e55c3d and project 763f7ba91c8b468abec36bfb48661553. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:12:41.236455 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:12:41.238738 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:12:41.283481 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8872b907-0bc7-478b-89c3-a954622cdde1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.560081 Jul 25 17:12:41.284132 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3397/6876] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:12:40 2022] POST /compute/v2.1/servers => generated 382 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:12:41.295255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-13599a5c-ff9c-4bf3-8473-c84c072f4f95 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:41.295880 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-13599a5c-ff9c-4bf3-8473-c84c072f4f95 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:41.303104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:41.352600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-13599a5c-ff9c-4bf3-8473-c84c072f4f95 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:41.359934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-13599a5c-ff9c-4bf3-8473-c84c072f4f95 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1220 microversion: 2.1 time: 0.068756 Jul 25 17:12:41.360502 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3480/6877] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:41 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:42.386678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:42.387219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:42.394436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:42.394886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:42.395635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:42.396061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:42.459591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:42.467740 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-39d9434a-c9b4-471d-b453-ccf39a4a0187 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1272 microversion: 2.1 time: 0.088171 Jul 25 17:12:42.468313 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3398/6878] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:42 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:43.489344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:43.490504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:43.497916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:43.498473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:43.499312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:43.499959 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:43.651685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:43.660095 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a24d3b48-1ff2-4a24-a30f-4ef4240061ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.175000 Jul 25 17:12:43.660691 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3481/6879] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:43 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:43.927951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-526d21b4-f793-4402-bc15-8808e56dd3c0 req-7c2eece8-e210-43a6-8e0e-360dd1759bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1391b7f3-4742-4d37-a7a8-3482ef7dc5cb", "tag": "250c7f02-768a-460b-b6d6-9c443a1d5158"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:43.966224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-526d21b4-f793-4402-bc15-8808e56dd3c0 req-7c2eece8-e210-43a6-8e0e-360dd1759bd0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:43.966652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-526d21b4-f793-4402-bc15-8808e56dd3c0 req-7c2eece8-e210-43a6-8e0e-360dd1759bd0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:43.987717 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-526d21b4-f793-4402-bc15-8808e56dd3c0 req-7c2eece8-e210-43a6-8e0e-360dd1759bd0 service nova] Creating event network-changed:250c7f02-768a-460b-b6d6-9c443a1d5158 for instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb on n-h1-846219-13 Jul 25 17:12:43.995419 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-526d21b4-f793-4402-bc15-8808e56dd3c0 req-7c2eece8-e210-43a6-8e0e-360dd1759bd0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076919 Jul 25 17:12:43.996160 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3399/6880] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:12:44.684562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:44.685539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:44.694776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:44.695359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:44.696371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:44.697071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:44.839561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:44.848088 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-76f05e47-c4c3-424a-8f8d-6b82967b95a2 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.169370 Jul 25 17:12:44.848666 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3482/6881] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:44 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:45.875511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:45.876632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:45.886272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:45.886720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:45.887487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:45.887913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:46.024441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:46.035965 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c815a38e-0e8e-4cd0-9a7e-41bee1e9d32a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.168498 Jul 25 17:12:46.036726 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3400/6882] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:45 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:47.058795 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:47.059457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:47.067290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:47.067763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:47.068582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:47.069028 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:47.206700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:47.215035 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1dfb8ac6-2737-4ed7-8846-55586c545f33 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.161582 Jul 25 17:12:47.220740 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3483/6883] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:47 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:48.240180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:48.241012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:48.251372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:48.251811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:48.252572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:48.252994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:48.405533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:48.417882 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ba8cd2b0-df9f-47c7-b8ae-d1eaed61e204 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.184018 Jul 25 17:12:48.418699 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3401/6884] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:48 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:49.444043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:49.445076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:49.456990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:49.457806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:49.459081 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:49.459830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:49.604651 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:49.615946 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-87bef9a2-eb5b-4327-8f78-69c2fd40a4d5 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.178318 Jul 25 17:12:49.616724 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3484/6885] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:49 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:50.640378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:50.640945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:50.648315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:50.648794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:50.649598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:50.650057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:50.784061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:50.792305 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d950cc76-f500-4d48-93d5-e52af9c2eec1 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.158369 Jul 25 17:12:50.792894 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3402/6886] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:50 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:51.208400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-450d93f3-fde1-4200-8dc4-b58092a8e402 req-8a0bd167-9388-4bdb-a288-ac1446b5f68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1391b7f3-4742-4d37-a7a8-3482ef7dc5cb", "name": "network-vif-plugged", "status": "completed", "tag": "250c7f02-768a-460b-b6d6-9c443a1d5158"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:51.219861 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-450d93f3-fde1-4200-8dc4-b58092a8e402 req-8a0bd167-9388-4bdb-a288-ac1446b5f68b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:51.220342 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-450d93f3-fde1-4200-8dc4-b58092a8e402 req-8a0bd167-9388-4bdb-a288-ac1446b5f68b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:51.232251 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-450d93f3-fde1-4200-8dc4-b58092a8e402 req-8a0bd167-9388-4bdb-a288-ac1446b5f68b service nova] Creating event network-vif-plugged:250c7f02-768a-460b-b6d6-9c443a1d5158 for instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb on n-h1-846219-13 Jul 25 17:12:51.237607 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-450d93f3-fde1-4200-8dc4-b58092a8e402 req-8a0bd167-9388-4bdb-a288-ac1446b5f68b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Jul 25 17:12:51.238446 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3485/6887] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:12:51.814141 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:51.814660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:51.816689 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:51.817354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:51.824338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:51.824786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:51.825589 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:51.826025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:51.963487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:51.971285 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0a8e45f1-18c2-4b0e-8206-c71653bfbb4e tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.161376 Jul 25 17:12:51.971943 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3403/6888] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:51 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:52.989755 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:52.994897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:52.995652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:53.002602 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:53.003072 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:53.003844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:53.004303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:53.145496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:53.154483 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9e217283-7189-4a61-aaf6-c86662b600fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1320 microversion: 2.1 time: 0.165627 Jul 25 17:12:53.155233 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3486/6889] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:52 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:54.180031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:54.181037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:54.190836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:54.191283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:54.192044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:54.192474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:54.348029 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:54.359487 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-218d137e-6aeb-42c7-8342-c4ff8f317e6f tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1507 microversion: 2.1 time: 0.185994 Jul 25 17:12:54.360077 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3404/6890] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:54 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:54.379837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:54.380382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:54.387753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:54.388213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:54.388985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:54.389507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:54.414855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:12:54.497660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cbea7973-1365-40fb-9d47-7e9f6714fa8a tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 204 len: 0 microversion: 2.1 time: 0.121511 Jul 25 17:12:54.498311 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3487/6891] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:54 2022] DELETE /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 17:12:54.509253 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:54.510336 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:54.518459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:54.518999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:54.519854 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:54.520469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:54.665049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:54.672972 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e3d5a0fa-334b-4513-9fe9-4b3f84631f7d tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1513 microversion: 2.1 time: 0.169319 Jul 25 17:12:54.673577 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3405/6892] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:54 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:55.698875 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:55.700059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:55.711788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:55.712550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:55.713897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:55.714636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:55.846670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:55.858452 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9fae0630-75d2-444c-9fc1-e7c9b32ecd4c tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1513 microversion: 2.1 time: 0.166582 Jul 25 17:12:55.859047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3488/6893] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:55 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:56.879890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:56.880419 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:56.888111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:56.888565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:56.889386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:56.890002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:57.049530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:57.067788 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-34923862-e3de-49ed-a473-0d170e0bda77 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 200 len: 1513 microversion: 2.1 time: 0.192080 Jul 25 17:12:57.070026 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3406/6894] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:56 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:57.074584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a87dc718-38da-42df-8790-0884672181b2 req-fad856d9-7976-4e93-ba91-93380dc10bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1391b7f3-4742-4d37-a7a8-3482ef7dc5cb", "name": "network-vif-deleted", "tag": "250c7f02-768a-460b-b6d6-9c443a1d5158"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:57.094249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a87dc718-38da-42df-8790-0884672181b2 req-fad856d9-7976-4e93-ba91-93380dc10bf5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:57.094972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a87dc718-38da-42df-8790-0884672181b2 req-fad856d9-7976-4e93-ba91-93380dc10bf5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:57.113223 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a87dc718-38da-42df-8790-0884672181b2 req-fad856d9-7976-4e93-ba91-93380dc10bf5 service nova] Creating event network-vif-deleted:250c7f02-768a-460b-b6d6-9c443a1d5158 for instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb on n-h1-846219-13 Jul 25 17:12:57.119028 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a87dc718-38da-42df-8790-0884672181b2 req-fad856d9-7976-4e93-ba91-93380dc10bf5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048744 Jul 25 17:12:57.133654 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3489/6895] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:12:58.092272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:58.092908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.100245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.100736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.101558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.101991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.116060 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] HTTP exception thrown: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb HTTP/1.1 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '1391b7f3-4742-4d37-a7a8-3482ef7dc5cb'} Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:58.117773 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 404 to user: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-40f168f7-9ad0-44e1-9429-fa461c6ab09b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 404 len: 111 microversion: 2.1 time: 0.031232 Jul 25 17:12:58.121935 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3407/6896] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:58 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:58.129658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:58.130386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.138366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.138831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.139624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.140071 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.274192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:58.286545 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7d1ac0f-2b8b-4d8c-af8a-63f6e1da80fa tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.161218 Jul 25 17:12:58.287241 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3490/6897] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:58 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:58.313004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-00b80c6d-0f86-437d-bf8b-b461ec0298ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:58.316595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-00b80c6d-0f86-437d-bf8b-b461ec0298ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 302f0633-7d59-4e0a-98ff-8d89d9926fc6] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.324962 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-00b80c6d-0f86-437d-bf8b-b461ec0298ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] HTTP exception thrown: Instance 302f0633-7d59-4e0a-98ff-8d89d9926fc6 could not be found. Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-00b80c6d-0f86-437d-bf8b-b461ec0298ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/302f0633-7d59-4e0a-98ff-8d89d9926fc6/action HTTP/1.1 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 32 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: {"resize": {"flavorRef": "452"}} Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 302f0633-7d59-4e0a-98ff-8d89d9926fc6 could not be found. Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '302f0633-7d59-4e0a-98ff-8d89d9926fc6', 'body': {'resize': {'flavorRef': '452'}}} Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302f0633-7d59-4e0a-98ff-8d89d9926fc6 could not be found. Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:58.327315 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302f0633-7d59-4e0a-98ff-8d89d9926fc6 could not be found. Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302f0633-7d59-4e0a-98ff-8d89d9926fc6 could not be found. Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-00b80c6d-0f86-437d-bf8b-b461ec0298ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 404 to user: Instance 302f0633-7d59-4e0a-98ff-8d89d9926fc6 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-00b80c6d-0f86-437d-bf8b-b461ec0298ba tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "POST /compute/v2.1/servers/302f0633-7d59-4e0a-98ff-8d89d9926fc6/action" status: 404 len: 111 microversion: 2.1 time: 0.021706 Jul 25 17:12:58.331646 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3408/6898] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:12:58 2022] POST /compute/v2.1/servers/302f0633-7d59-4e0a-98ff-8d89d9926fc6/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:58.337845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:58.338479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.344808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.345312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.346096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.346545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.483286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:58.495006 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b1df6923-f8b5-41d0-86cf-304757ae6844 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.160828 Jul 25 17:12:58.495798 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3491/6899] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:58 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:58.518014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:58.518665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.525926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.526367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.527106 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.527530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.667296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:58.678639 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b2692f2-9951-4d48-aa81-2cb544eb61d9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.164241 Jul 25 17:12:58.679405 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3409/6900] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:58 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:58.702121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "e29ae000-8205-4e00-b44b-0a95fb3888e9"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:58.704392 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.710613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.711078 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.711852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.712304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.800830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:58.807085 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] HTTP exception thrown: Flavor e29ae000-8205-4e00-b44b-0a95fb3888e9 could not be found. Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: request: POST /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272/action HTTP/1.1 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 65 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: {"resize": {"flavorRef": "e29ae000-8205-4e00-b44b-0a95fb3888e9"}} Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: exception: Flavor e29ae000-8205-4e00-b44b-0a95fb3888e9 could not be found. Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4bb48bcd-8297-431e-bd4d-711c7fd7a272', 'body': {'resize': {'flavorRef': 'e29ae000-8205-4e00-b44b-0a95fb3888e9'}}} Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 17:12:58.811597 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e29ae000-8205-4e00-b44b-0a95fb3888e9 could not be found. Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor e29ae000-8205-4e00-b44b-0a95fb3888e9 could not be found. Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e29ae000-8205-4e00-b44b-0a95fb3888e9 could not be found. Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 400 to user: Flavor e29ae000-8205-4e00-b44b-0a95fb3888e9 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-170c71c0-99fe-49c5-b8a3-c2865d8e7c31 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "POST /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272/action" status: 400 len: 107 microversion: 2.1 time: 0.115030 Jul 25 17:12:58.816118 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3492/6901] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:12:58 2022] POST /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272/action => generated 107 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 17:12:58.821822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:58.822434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.828396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.828884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.829667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.830088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.960705 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:58.968558 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-26e2daaa-9844-4b48-9a1f-7b7611562f27 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.150572 Jul 25 17:12:58.969129 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3410/6902] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:58 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:58.989825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:58.990480 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:58.996693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.997234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:58.998000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:58.998443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.002558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:59.139946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:59.147879 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c976af4-466f-406f-af17-26dd60d05789 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.162102 Jul 25 17:12:59.148483 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3493/6903] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:58 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:59.168122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5475fdfe-b5e4-42ba-97db-68ebe2b1c234 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5475fdfe-b5e4-42ba-97db-68ebe2b1c234 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: request: POST /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272/action HTTP/1.1 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 29 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: {"resize": {"flavorRef": ""}} Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4bb48bcd-8297-431e-bd4d-711c7fd7a272', 'body': {'resize': {'flavorRef': ''}}} Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise error Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi '' Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.171814 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5475fdfe-b5e4-42ba-97db-68ebe2b1c234 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5475fdfe-b5e4-42ba-97db-68ebe2b1c234 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "POST /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272/action" status: 400 len: 113 microversion: 2.1 time: 0.009135 Jul 25 17:12:59.177392 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3411/6904] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:12:59 2022] POST /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 17:12:59.186302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:59.187291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:59.194261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.194726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.195507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.195990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.332290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:59.345877 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0c7b9828-8781-4f2e-9d0a-1335135287b8 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1508 microversion: 2.1 time: 0.165433 Jul 25 17:12:59.346629 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3494/6905] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:59 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:12:59.380032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:59.380522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:59.388371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.388829 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.389620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.390056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.403454 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] HTTP exception thrown: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb HTTP/1.1 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '1391b7f3-4742-4d37-a7a8-3482ef7dc5cb'} Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:59.405005 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 404 to user: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22b61f4a-8998-4c8e-86ce-3641518b3c84 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 404 len: 111 microversion: 2.1 time: 0.031599 Jul 25 17:12:59.408895 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3412/6906] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:59 2022] DELETE /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:59.415043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:59.415710 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:59.422096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.422566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.423351 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.423804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.437906 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] HTTP exception thrown: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb HTTP/1.1 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1391b7f3-4742-4d37-a7a8-3482ef7dc5cb'} Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:12:59.439531 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 404 to user: Instance 1391b7f3-4742-4d37-a7a8-3482ef7dc5cb could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-321385c4-c7b3-472c-92a2-10e0bf674834 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb" status: 404 len: 111 microversion: 2.1 time: 0.029903 Jul 25 17:12:59.443601 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3495/6907] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:59 2022] GET /compute/v2.1/servers/1391b7f3-4742-4d37-a7a8-3482ef7dc5cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:12:59.449506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:59.450008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:59.456167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.456627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.457410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.457844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.476174 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=100 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:12:59.484436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:12:59.569445 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a0afa37c-171b-4004-b11e-e0e690528cf6 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 204 len: 0 microversion: 2.1 time: 0.123425 Jul 25 17:12:59.570154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3413/6908] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:12:59 2022] DELETE /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:12:59.579124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:12:59.579750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:12:59.586075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.586537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.587311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:12:59.587756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:12:59.722798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:12:59.734934 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-613d63f1-1768-4be9-b18f-eb6b40c316e7 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1514 microversion: 2.1 time: 0.159765 Jul 25 17:12:59.735528 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3496/6909] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:12:59 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:00.758033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:00.758742 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:00.761624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:00.770158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:00.770603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:00.771389 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:00.771823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:00.904789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93458013f254e8fbb1983b8a0e55c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763f7ba91c8b468abec36bfb48661553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:00.913000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-215271ad-aa57-4605-8244-72b093589cd9 tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 200 len: 1514 microversion: 2.1 time: 0.159346 Jul 25 17:13:00.913633 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3414/6910] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:00 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:01.421254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6dabcb95-6c0f-4029-93f6-7929463e7742 req-9f9ce767-59b9-4d4f-8929-76d3980ec55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb48bcd-8297-431e-bd4d-711c7fd7a272", "name": "network-vif-deleted", "tag": "b63bbe04-51d7-4962-9a81-d5dcdace875d"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:13:01.427119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:01.433174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6dabcb95-6c0f-4029-93f6-7929463e7742 req-9f9ce767-59b9-4d4f-8929-76d3980ec55a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:01.433661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6dabcb95-6c0f-4029-93f6-7929463e7742 req-9f9ce767-59b9-4d4f-8929-76d3980ec55a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:01.447225 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6dabcb95-6c0f-4029-93f6-7929463e7742 req-9f9ce767-59b9-4d4f-8929-76d3980ec55a service nova] Creating event network-vif-deleted:b63bbe04-51d7-4962-9a81-d5dcdace875d for instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 on n-h2-846219-13 Jul 25 17:13:01.452634 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6dabcb95-6c0f-4029-93f6-7929463e7742 req-9f9ce767-59b9-4d4f-8929-76d3980ec55a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035136 Jul 25 17:13:01.453433 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3497/6911] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:13:01.934368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:01.934962 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] [instance: 4bb48bcd-8297-431e-bd4d-711c7fd7a272] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:01.942836 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:01.943282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:01.944049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:01.944495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:01.958407 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] HTTP exception thrown: Instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 could not be found. Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Request method failure captured: Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 HTTP/1.1 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s7-XkjaGEgcZQ19Q8LJi9qq_0YvNDpUHjrMXtkPj19OszBKBifhHR3nUc0IxDzyNXXvu_mqW4dw-CMbEpJhbQ7KG8uJBHxaBmTJwCniWzLMS8G3b701pj5hIAK3DK6VEZokXT9ZJ9crz6JxSrgLirkr1cR83PbEB3gPiLUCiO_ulDE Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/763f7ba91c8b468abec36bfb48661553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_763f7ba91c8b468abec36bfb48661553"}]}] Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 763f7ba91c8b468abec36bfb48661553 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1605770957 Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: b93458013f254e8fbb1983b8a0e55c3d Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-ServersNegativeTestJSON-1605770957-project Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 could not be found. Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '4bb48bcd-8297-431e-bd4d-711c7fd7a272'} Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 could not be found. Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 could not be found. Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:13:01.960077 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 could not be found. Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] Returning 404 to user: Instance 4bb48bcd-8297-431e-bd4d-711c7fd7a272 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4c820ae4-b539-4e86-b8a8-8658c850561b tempest-ServersNegativeTestJSON-1605770957 tempest-ServersNegativeTestJSON-1605770957-project] 10.222.0.105 "GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272" status: 404 len: 111 microversion: 2.1 time: 0.031154 Jul 25 17:13:01.964719 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3415/6912] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:01 2022] GET /compute/v2.1/servers/4bb48bcd-8297-431e-bd4d-711c7fd7a272 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:13:33.750984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=20 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:33.751751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:33.932252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-07e96acd-f681-4752-9aa0-8b738f8ac295 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Action: 'create', calling method: .version_select at 0x7f9d929809d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-647908721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC7f7y4q7Yut9fB1Ash4plMEuo+22/ykaTa1AhIrm5EA+uSqpueyY5yIjlVDElvD1V/BLXOHWaXrBc82jFbuZUethB1Uo1W2fanViid/SVGCp+d/D88GKAgfEuKv9dElA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:13:33.947715 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-07e96acd-f681-4752-9aa0-8b738f8ac295 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:13:33.952898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-07e96acd-f681-4752-9aa0-8b738f8ac295 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for user 95bde8e5d2b64d949dd562a8023193c3 and project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:13:33.979871 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-07e96acd-f681-4752-9aa0-8b738f8ac295 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.231061 Jul 25 17:13:33.980492 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3498/6913] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:13:33 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:13:34.035624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-168807725", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-647908721", "networks": [{"uuid": "05e1b590-85a4-4f1a-ab51-4aba791a336c"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:13:34.051646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:34.052595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:34.105397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] validate_networks() for [('05e1b590-85a4-4f1a-ab51-4aba791a336c', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:13:34.917047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:13:34.917498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:13:34.917974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:13:34.918411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:13:34.918823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:13:34.928347 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:34.928800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:34.929636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:34.930068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:34.948255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:13:34.953525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for user 95bde8e5d2b64d949dd562a8023193c3 and project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:13:34.970150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:13:34.973991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:13:35.022087 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bfff44ef-3060-4073-8006-139a5501ae87 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.991332 Jul 25 17:13:35.022745 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3416/6914] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:13:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:13:35.035496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5392ecf9-5085-4672-8753-377d4e961e62 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:35.036235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5392ecf9-5085-4672-8753-377d4e961e62 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:35.092402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5392ecf9-5085-4672-8753-377d4e961e62 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:35.100848 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5392ecf9-5085-4672-8753-377d4e961e62 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1265 microversion: 2.1 time: 0.070765 Jul 25 17:13:35.101484 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3499/6915] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:35 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:36.123370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:36.124568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:36.131619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:36.132060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:36.132995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:36.133496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:36.199600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:36.207534 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5f26c985-ab89-4f11-9060-a315c7b1b7b2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1325 microversion: 2.1 time: 0.089345 Jul 25 17:13:36.221459 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3417/6916] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:36 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:37.228217 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:37.229441 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:37.237570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:37.238126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:37.239057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:37.240005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:37.390271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:37.404264 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-da505d1a-81f7-4e7b-b1b6-3241e2c959e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.180102 Jul 25 17:13:37.405499 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3500/6917] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:37 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:37.667310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-451d5148-4999-4f32-af02-ba80e80b4910 req-01ed44a9-62f3-4b97-977e-edbb5fe1e831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d4a45e-f12b-498c-b146-3df74bd4afce", "tag": "ca3fb099-6c68-42d1-8037-68cc142b579e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:13:37.681421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-451d5148-4999-4f32-af02-ba80e80b4910 req-01ed44a9-62f3-4b97-977e-edbb5fe1e831 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:37.685324 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-451d5148-4999-4f32-af02-ba80e80b4910 req-01ed44a9-62f3-4b97-977e-edbb5fe1e831 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:37.716739 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-451d5148-4999-4f32-af02-ba80e80b4910 req-01ed44a9-62f3-4b97-977e-edbb5fe1e831 service nova] Creating event network-changed:ca3fb099-6c68-42d1-8037-68cc142b579e for instance 70d4a45e-f12b-498c-b146-3df74bd4afce on n-h1-846219-13 Jul 25 17:13:37.730709 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-451d5148-4999-4f32-af02-ba80e80b4910 req-01ed44a9-62f3-4b97-977e-edbb5fe1e831 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066750 Jul 25 17:13:37.737352 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3418/6918] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:13:38.428409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:38.429316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:38.436831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:38.437419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:38.438227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:38.438686 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:38.578015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:38.586565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9a2bae89-f5ad-4355-8a4d-6ca67253f458 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.162135 Jul 25 17:13:38.587104 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3501/6919] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:38 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:39.612925 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:39.613672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:39.623538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:39.624209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:39.625453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:39.626080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:39.779273 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:39.787143 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bf5f3a12-b5dd-478a-a632-5497b5fd9f70 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.182752 Jul 25 17:13:39.787730 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3419/6920] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:39 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:40.808015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:40.808638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:40.816355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:40.816830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:40.817702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:40.818163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:40.956671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:40.964529 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4fa9dd6a-d9a5-4606-87ff-5f13521b0d4b tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.160660 Jul 25 17:13:40.965143 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3502/6921] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:40 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:41.986244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:41.986848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:41.993343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:41.993816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:41.994658 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:41.995098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:42.133337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:42.144742 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7abd5d0d-e88c-4f83-b150-9d8a1a9e5631 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.162328 Jul 25 17:13:42.145566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3420/6922] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:41 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:13:43.170393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:43.171471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:43.179711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:43.180178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:43.181001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:43.181483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:43.321020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:43.328858 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c5a315c8-3a75-492f-9eb0-1c0093a05fee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.165166 Jul 25 17:13:43.329482 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3503/6923] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:43 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:43.435552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-384b2c07-f7c6-4054-9a87-b332aa1beb12 req-1daaa1e1-b3dd-4669-9fd2-216dfdf7ecde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d4a45e-f12b-498c-b146-3df74bd4afce", "name": "network-vif-plugged", "status": "completed", "tag": "ca3fb099-6c68-42d1-8037-68cc142b579e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:13:43.447169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-384b2c07-f7c6-4054-9a87-b332aa1beb12 req-1daaa1e1-b3dd-4669-9fd2-216dfdf7ecde service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:43.447607 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-384b2c07-f7c6-4054-9a87-b332aa1beb12 req-1daaa1e1-b3dd-4669-9fd2-216dfdf7ecde service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:43.458967 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-384b2c07-f7c6-4054-9a87-b332aa1beb12 req-1daaa1e1-b3dd-4669-9fd2-216dfdf7ecde service nova] Creating event network-vif-plugged:ca3fb099-6c68-42d1-8037-68cc142b579e for instance 70d4a45e-f12b-498c-b146-3df74bd4afce on n-h1-846219-13 Jul 25 17:13:43.464011 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-384b2c07-f7c6-4054-9a87-b332aa1beb12 req-1daaa1e1-b3dd-4669-9fd2-216dfdf7ecde service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Jul 25 17:13:43.464613 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3421/6924] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:13:44.355168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:44.356208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:44.368025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:44.368800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:44.370129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:44.370879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:44.517972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:44.527846 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-94360f78-c668-4def-990d-91e5a5832f7f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1365 microversion: 2.1 time: 0.179579 Jul 25 17:13:44.528503 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3504/6925] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:44 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:45.553821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:45.554777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:45.558927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:45.559659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:45.567442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:45.567888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:45.568645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:45.569077 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:45.727320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:45.739055 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38dacb84-fb62-4191-b711-ee2ce22fdb93 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1556 microversion: 2.1 time: 0.186811 Jul 25 17:13:45.739927 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3422/6926] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:45 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:45.762648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:45.763335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:45.766199 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:45.774961 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:45.775600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:45.776671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:45.777325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:45.917571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:13:45.930001 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-75e8c195-391a-4f10-8301-337f23bbb294 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1556 microversion: 2.1 time: 0.173427 Jul 25 17:13:45.930798 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3505/6927] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:13:45 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:13:47.569501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdd978eb-7262-4e69-b15a-1c27f442445a"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:13:47.571845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:47.579194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:47.579645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:47.580410 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:47.580997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:47.869869 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a18de39e-af28-42cd-9452-b686e2aacd21 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "POST /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304391 Jul 25 17:13:47.870704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3423/6928] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 17:13:47 2022] POST /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:13:59.700497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:59.701086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:59.704066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:59.704818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=36 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:59.710765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:59.711245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:59.712055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:59.712515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:59.796048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lazy-loading 'services' on Instance uuid 70d4a45e-f12b-498c-b146-3df74bd4afce {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:13:59.876945 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c25c63be-9db4-4c8f-a534-687d8ec0b47d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments/cdd978eb-7262-4e69-b15a-1c27f442445a" status: 202 len: 0 microversion: 2.1 time: 0.180387 Jul 25 17:13:59.877607 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3506/6929] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:13:59 2022] DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments/cdd978eb-7262-4e69-b15a-1c27f442445a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:13:59.886980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:13:59.889405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:13:59.892572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:59.893297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:13:59.900236 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:59.900741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:59.901709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:13:59.902169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:13:59.936378 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0bff9498-34ec-4c48-a21f-ff6d12276fe2 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053694 Jul 25 17:13:59.937003 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3424/6930] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:13:59 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:00.951765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:00.954335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:00.961933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:00.962400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:00.963215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:00.963683 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:00.995968 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-02e26a74-1ae3-4608-ae95-d4a48ce0f5c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049795 Jul 25 17:14:00.996597 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3507/6931] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:00 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:02.008803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:02.011083 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:02.018744 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:02.019201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:02.019979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:02.020507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:02.057364 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e34e6359-aa2c-40fa-8b5a-b06b4953cfd0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052675 Jul 25 17:14:02.058193 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3425/6932] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:02 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:03.070313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:03.072720 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:03.080399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:03.080873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:03.081724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:03.082233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:03.117395 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-934689a8-7e9e-43b4-962d-16f08fcd1a4a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051205 Jul 25 17:14:03.118173 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3508/6933] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:03 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:04.130508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:04.132648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:04.140100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:04.140577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:04.141376 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:04.141842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:04.172705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-791190ef-2a2a-4d1b-a6ee-26b2a8b40e86 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 Jul 25 17:14:04.173318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3426/6934] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:04 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:05.190560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:05.193780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:05.201698 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:05.202146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:05.203004 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:05.203479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:05.233878 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1b35953b-6f1b-4a81-af84-bd808ec9e0c4 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050719 Jul 25 17:14:05.234438 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3509/6935] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:05 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 17:14:05.245194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:05.245694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:05.252953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:05.253442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:05.254209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:05.254655 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:05.342982 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] HTTP exception thrown: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce is not attached to volume cdd978eb-7262-4e69-b15a-1c27f442445a Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Request method failure captured: Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments/cdd978eb-7262-4e69-b15a-1c27f442445a HTTP/1.1 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s84UfCWyy_dBJlF3mZnmKR5pECOiEf4cf2q7yph8SDL1nOjrfx0XF56ZK4IXNBytRHzlm5g0yCXDef4BvcJVEYY7a02z1LJd4xDcqFnBAiCrFlrqfKbsVUZNU7CTeOoBdozwLui_Je7IyxCsfUaU_rMyssr7aTksQRhgRtTD25VExk Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7da4dc8870cc4a769d506cd658fd4008"}]}] Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 95bde8e5d2b64d949dd562a8023193c3 Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce is not attached to volume cdd978eb-7262-4e69-b15a-1c27f442445a Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '70d4a45e-f12b-498c-b146-3df74bd4afce', 'id': 'cdd978eb-7262-4e69-b15a-1c27f442445a'} Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cdd978eb-7262-4e69-b15a-1c27f442445a. Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce is not attached to volume cdd978eb-7262-4e69-b15a-1c27f442445a Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:05.364207 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce is not attached to volume cdd978eb-7262-4e69-b15a-1c27f442445a Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Returning 404 to user: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce is not attached to volume cdd978eb-7262-4e69-b15a-1c27f442445a {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0532b464-dbba-463a-913f-86b4ca272e63 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments/cdd978eb-7262-4e69-b15a-1c27f442445a" status: 404 len: 154 microversion: 2.1 time: 0.124636 Jul 25 17:14:05.368180 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3427/6936] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:14:05 2022] DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce/os-volume_attachments/cdd978eb-7262-4e69-b15a-1c27f442445a => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:14:08.731053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:08.731813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:08.741525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:08.741995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:08.742780 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:08.743235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:08.769131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:14:08.857660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9112d987-7fd8-4937-aecb-cdecbec2241a tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 204 len: 0 microversion: 2.1 time: 0.132950 Jul 25 17:14:08.858448 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3510/6937] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:14:08 2022] DELETE /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:14:08.868939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:08.869585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:08.880663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:08.881395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:08.882181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:08.882619 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:09.019254 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:09.027377 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-82718294-5b02-4be7-a8cf-0e9276c16eaa tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1562 microversion: 2.1 time: 0.164172 Jul 25 17:14:09.028083 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3428/6938] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:08 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:10.050428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:10.051200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:10.058904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:10.059377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:10.060182 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:10.060637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:10.193648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:10.201610 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c802d4f3-e755-4e90-898e-c43d9ea47662 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1562 microversion: 2.1 time: 0.155743 Jul 25 17:14:10.202202 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3511/6939] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:10 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:11.223478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:11.224093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:11.232036 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:11.232483 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:11.233272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:11.233702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:11.373234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:11.381282 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6afbe83e-c659-428c-8620-0eca74d07ef9 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1562 microversion: 2.1 time: 0.161979 Jul 25 17:14:11.381863 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3429/6940] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:11 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:12.402785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:12.403400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:12.411564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:12.412346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:12.413345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:12.413967 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:12.421892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ac237383-9851-4ee2-b463-cc2fd6841349 req-cd261b89-b364-4a6d-88b8-32c29b412baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d4a45e-f12b-498c-b146-3df74bd4afce", "name": "network-vif-deleted", "tag": "ca3fb099-6c68-42d1-8037-68cc142b579e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:12.432782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ac237383-9851-4ee2-b463-cc2fd6841349 req-cd261b89-b364-4a6d-88b8-32c29b412baa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:12.433571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ac237383-9851-4ee2-b463-cc2fd6841349 req-cd261b89-b364-4a6d-88b8-32c29b412baa service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:12.445571 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ac237383-9851-4ee2-b463-cc2fd6841349 req-cd261b89-b364-4a6d-88b8-32c29b412baa service nova] Creating event network-vif-deleted:ca3fb099-6c68-42d1-8037-68cc142b579e for instance 70d4a45e-f12b-498c-b146-3df74bd4afce on n-h1-846219-13 Jul 25 17:14:12.451828 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ac237383-9851-4ee2-b463-cc2fd6841349 req-cd261b89-b364-4a6d-88b8-32c29b412baa service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112535 Jul 25 17:14:12.452815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3512/6941] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:12.480238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:12.488193 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7b16c284-b370-4e81-ad47-1b1323dbca89 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 200 len: 1350 microversion: 2.1 time: 0.089353 Jul 25 17:14:12.488781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3430/6942] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:12 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:13.513460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:13.514304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 70d4a45e-f12b-498c-b146-3df74bd4afce] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:13.521740 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:13.522263 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:13.523145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:13.523652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:13.539949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] HTTP exception thrown: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce could not be found. Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Request method failure captured: Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce HTTP/1.1 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s84UfCWyy_dBJlF3mZnmKR5pECOiEf4cf2q7yph8SDL1nOjrfx0XF56ZK4IXNBytRHzlm5g0yCXDef4BvcJVEYY7a02z1LJd4xDcqFnBAiCrFlrqfKbsVUZNU7CTeOoBdozwLui_Je7IyxCsfUaU_rMyssr7aTksQRhgRtTD25VExk Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7da4dc8870cc4a769d506cd658fd4008"}]}] Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 95bde8e5d2b64d949dd562a8023193c3 Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce could not be found. Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '70d4a45e-f12b-498c-b146-3df74bd4afce'} Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce could not be found. Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce could not be found. Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:13.541660 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce could not be found. Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Returning 404 to user: Instance 70d4a45e-f12b-498c-b146-3df74bd4afce could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db79c4f9-c16a-475c-a43d-01c22c70a396 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce" status: 404 len: 111 microversion: 2.1 time: 0.036089 Jul 25 17:14:13.545745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3513/6943] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:13 2022] GET /compute/v2.1/servers/70d4a45e-f12b-498c-b146-3df74bd4afce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:14:13.552126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1e38ea5-be9d-4faf-91d8-42a68f47d8a5 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '.version_select at 0x7f9d928dc4c0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:13.556749 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f1e38ea5-be9d-4faf-91d8-42a68f47d8a5 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [eedb447a-e383-4eb0-aa6d-41c096dddc49] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:14:14.566094 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [None req-f1e38ea5-be9d-4faf-91d8-42a68f47d8a5 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [eedb447a-e383-4eb0-aa6d-41c096dddc49] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 49014. Jul 25 17:14:14.590660 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f1e38ea5-be9d-4faf-91d8-42a68f47d8a5 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-647908721" status: 202 len: 0 microversion: 2.1 time: 1.042468 Jul 25 17:14:14.591233 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3431/6944] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 17:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-647908721 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:14:14.609354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f81623df-86ea-41ec-bf15-e2dcf1cec5ff tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Action: 'create', calling method: .version_select at 0x7f9d902adb80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-508990558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVSG1ujCl19W6mjybHkwyw5g8S2ZrnTNgbu1k/VUG1/7hiEo3cNvi3J1L4if/btKZ9e1VNy//vHrXSWeMx94qHHKrQ/O7K7ZkEWk1MVmbQ9Zkgs8ASimH05tQtGyUScZg=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:14.627107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f81623df-86ea-41ec-bf15-e2dcf1cec5ff tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:14:14.632460 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-f81623df-86ea-41ec-bf15-e2dcf1cec5ff tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for user 95bde8e5d2b64d949dd562a8023193c3 and project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:14:14.659659 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f81623df-86ea-41ec-bf15-e2dcf1cec5ff tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054677 Jul 25 17:14:14.660303 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3514/6945] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:14:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:14.714061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-714640385", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-508990558", "networks": [{"uuid": "05e1b590-85a4-4f1a-ab51-4aba791a336c"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:14.774286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] validate_networks() for [('05e1b590-85a4-4f1a-ab51-4aba791a336c', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:14:15.157759 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:14:15.158370 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:14:15.158974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:14:15.159558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:14:15.160125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:14:15.174260 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:15.174901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:15.176140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:15.176768 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:15.195791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:14:15.201381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Getting quotas for user 95bde8e5d2b64d949dd562a8023193c3 and project 7da4dc8870cc4a769d506cd658fd4008. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:14:15.214865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:14:15.217223 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:14:15.269460 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0287e1a0-29ac-4c2e-adb0-da9ba9a99884 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.559175 Jul 25 17:14:15.270662 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3432/6946] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:14:14 2022] POST /compute/v2.1/servers => generated 382 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 17:14:15.283180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1aee7391-38eb-4cb1-9402-4a6f0fa2348d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:15.283813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1aee7391-38eb-4cb1-9402-4a6f0fa2348d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:15.341251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1aee7391-38eb-4cb1-9402-4a6f0fa2348d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:15.348339 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1aee7391-38eb-4cb1-9402-4a6f0fa2348d tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1265 microversion: 2.1 time: 0.069277 Jul 25 17:14:15.348949 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3515/6947] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:15 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:16.371057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:16.371616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:16.378466 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:16.378909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:16.379668 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:16.380092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:16.450695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:16.459563 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f7585270-b818-4902-a807-a9e66652459f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1325 microversion: 2.1 time: 0.093357 Jul 25 17:14:16.460291 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3433/6948] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:16 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1325 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:14:17.481841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:17.482400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:17.489849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:17.490307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:17.491068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:17.491510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:17.634742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:17.644363 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5dee1e84-387f-420d-a218-db57278e32cb tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.166302 Jul 25 17:14:17.658412 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3516/6949] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:17 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:17.806426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-0284871f-0f0c-47cb-9e6c-7423dcf0e90e req-e1d4c3aa-0d34-4353-adbb-e06e24231754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696d38e5-5a0f-4032-b740-173caaa91c26", "tag": "704ee209-4db5-4c18-a1de-762485e53b4e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:17.818002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0284871f-0f0c-47cb-9e6c-7423dcf0e90e req-e1d4c3aa-0d34-4353-adbb-e06e24231754 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:17.818982 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-0284871f-0f0c-47cb-9e6c-7423dcf0e90e req-e1d4c3aa-0d34-4353-adbb-e06e24231754 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:17.836178 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-0284871f-0f0c-47cb-9e6c-7423dcf0e90e req-e1d4c3aa-0d34-4353-adbb-e06e24231754 service nova] Creating event network-changed:704ee209-4db5-4c18-a1de-762485e53b4e for instance 696d38e5-5a0f-4032-b740-173caaa91c26 on n-h1-846219-13 Jul 25 17:14:17.842633 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-0284871f-0f0c-47cb-9e6c-7423dcf0e90e req-e1d4c3aa-0d34-4353-adbb-e06e24231754 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040748 Jul 25 17:14:17.843458 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3434/6950] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:18.670488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:18.671527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:18.682448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:18.682898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:18.683681 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:18.684124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:18.819229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:18.827619 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-98a513ce-9471-4a8a-8cc0-d9a9735ef948 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.163801 Jul 25 17:14:18.828333 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3517/6951] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:18 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:19.849262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:19.849983 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:19.857875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:19.858322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:19.859137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:19.859545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:20.009805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:20.017935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43d8dc30-802d-487b-b49a-5e4af1057a9f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.173135 Jul 25 17:14:20.018492 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3435/6952] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:19 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:21.039269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:21.039820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:21.047082 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:21.047549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:21.048979 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:21.049520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:21.182968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:21.190660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0d54e951-89b8-4a83-90b7-84271758e989 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.155551 Jul 25 17:14:21.191279 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3518/6953] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:21 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:22.211804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:22.212518 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:22.219771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:22.220299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:22.221138 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:22.221734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:22.356811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:22.364608 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dc437bc0-7494-415d-87cc-906ef96f4565 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.156900 Jul 25 17:14:22.365219 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3436/6954] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:22 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:23.386907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:23.387498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:23.394300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:23.394770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:23.395571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:23.396027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:23.534547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:23.542341 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-03f3f854-d792-47ca-88e6-510ee56a2bee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.160444 Jul 25 17:14:23.542920 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3519/6955] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:23 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:23.613447 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-520fcfe7-3e77-4c00-a730-ab11e1a67351 req-b61fd844-2780-4f54-863a-0ee8e6141766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696d38e5-5a0f-4032-b740-173caaa91c26", "name": "network-vif-plugged", "status": "completed", "tag": "704ee209-4db5-4c18-a1de-762485e53b4e"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:23.624718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-520fcfe7-3e77-4c00-a730-ab11e1a67351 req-b61fd844-2780-4f54-863a-0ee8e6141766 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:23.625284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-520fcfe7-3e77-4c00-a730-ab11e1a67351 req-b61fd844-2780-4f54-863a-0ee8e6141766 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:23.636195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-520fcfe7-3e77-4c00-a730-ab11e1a67351 req-b61fd844-2780-4f54-863a-0ee8e6141766 service nova] Creating event network-vif-plugged:704ee209-4db5-4c18-a1de-762485e53b4e for instance 696d38e5-5a0f-4032-b740-173caaa91c26 on n-h1-846219-13 Jul 25 17:14:23.641035 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-520fcfe7-3e77-4c00-a730-ab11e1a67351 req-b61fd844-2780-4f54-863a-0ee8e6141766 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031408 Jul 25 17:14:23.641665 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3437/6956] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:23.833292 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:14:23.833528 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:14:24.562971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:24.563588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:24.571070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:24.571609 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:24.572406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:24.572896 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:24.704624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:24.712314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d98e538b-61fd-46fe-bb1e-ec9642230db1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1365 microversion: 2.1 time: 0.153667 Jul 25 17:14:24.712902 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3520/6957] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:24 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:25.731704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:25.732594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:25.737142 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:25.737848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:25.745001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:25.745477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:25.746215 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:25.746623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:25.883308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:25.891053 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10b5137d-2b26-4802-9027-7e1d7f34e956 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1557 microversion: 2.1 time: 0.161507 Jul 25 17:14:25.891630 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3438/6958] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:25 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:25.911820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:25.912728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:25.914738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:25.920955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:25.921454 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:25.922243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:25.922704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:26.064381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:26.072940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b34bc20a-3210-4bd2-8294-2c24e10df6ee tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1557 microversion: 2.1 time: 0.165422 Jul 25 17:14:26.073533 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3521/6959] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:25 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:27.633704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1d40c54-676f-4a41-9702-34f3602a9891"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:27.636080 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:27.643337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:27.643789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:27.644550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:27.644981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:27.922971 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3f0c03e-bdbe-4ffc-a4c4-644cbb57cb52 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "POST /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293205 Jul 25 17:14:27.923610 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3439/6960] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 17:14:27 2022] POST /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:14:39.760508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:39.761047 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:39.764134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:39.764957 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:39.770679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:39.771144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:39.771936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:39.772384 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:39.861348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lazy-loading 'services' on Instance uuid 696d38e5-5a0f-4032-b740-173caaa91c26 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:14:39.942981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d1374562-2dee-4566-b00c-38f4fa5e4cc1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments/a1d40c54-676f-4a41-9702-34f3602a9891" status: 202 len: 0 microversion: 2.1 time: 0.186285 Jul 25 17:14:39.943597 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3522/6961] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:14:39 2022] DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments/a1d40c54-676f-4a41-9702-34f3602a9891 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:14:39.950470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:39.951785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:14:39.956216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:39.958631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:39.966448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:39.966917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:39.967671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:39.968100 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:40.002515 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2eb454e-b042-4354-b1a1-ec3e5e0c1440 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054064 Jul 25 17:14:40.003100 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3440/6962] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:39 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:41.017167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:41.019583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:41.026541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:41.027007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:41.027789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:41.028242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:41.064177 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ac3b387-2836-433d-b298-205ee203a231 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052404 Jul 25 17:14:41.064815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3523/6963] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:41 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:42.076533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:42.079484 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:42.086460 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:42.086906 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:42.087675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:42.088107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:42.121840 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dded6c60-8016-49de-84ae-7d9ce9832534 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049569 Jul 25 17:14:42.122396 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3441/6964] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:42 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:43.135309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:43.137679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:43.144779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:43.145316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:43.146158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:43.146614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:43.176692 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a03a6b8-cb57-4764-88a4-05a4c917e43f tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Jul 25 17:14:43.177295 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3524/6965] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:43 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:44.189949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:44.192529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:44.200793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:44.201507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:44.202533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:44.203265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:44.236158 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e34d8489-f3b0-4c76-918c-ffe64a22f3e0 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050408 Jul 25 17:14:44.236607 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3442/6966] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:44 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:45.252407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:45.256040 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:45.266691 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:45.267161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:45.267950 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:45.268406 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:45.298219 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-905ab825-574b-4b81-aa09-881708dd3680 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052732 Jul 25 17:14:45.298846 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3525/6967] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:14:45 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 17:14:45.310018 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:45.310563 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:45.317917 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:45.318306 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:45.319067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:45.319501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:45.395237 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] HTTP exception thrown: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 is not attached to volume a1d40c54-676f-4a41-9702-34f3602a9891 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Request method failure captured: Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: request: DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments/a1d40c54-676f-4a41-9702-34f3602a9891 HTTP/1.1 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s84UfCWyy_dBJlF3mZnmKR5pECOiEf4cf2q7yph8SDL1nOjrfx0XF56ZK4IXNBytRHzlm5g0yCXDef4BvcJVEYY7a02z1LJd4xDcqFnBAiCrFlrqfKbsVUZNU7CTeOoBdozwLui_Je7IyxCsfUaU_rMyssr7aTksQRhgRtTD25VExk Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7da4dc8870cc4a769d506cd658fd4008"}]}] Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 95bde8e5d2b64d949dd562a8023193c3 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 is not attached to volume a1d40c54-676f-4a41-9702-34f3602a9891 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'server_id': '696d38e5-5a0f-4032-b740-173caaa91c26', 'id': 'a1d40c54-676f-4a41-9702-34f3602a9891'} Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1d40c54-676f-4a41-9702-34f3602a9891. Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 is not attached to volume a1d40c54-676f-4a41-9702-34f3602a9891 Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:45.396844 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 is not attached to volume a1d40c54-676f-4a41-9702-34f3602a9891 Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Returning 404 to user: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 is not attached to volume a1d40c54-676f-4a41-9702-34f3602a9891 {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5a277c5e-84e3-49e6-9c70-2d9ec7848edc tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments/a1d40c54-676f-4a41-9702-34f3602a9891" status: 404 len: 154 microversion: 2.1 time: 0.092334 Jul 25 17:14:45.400571 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3443/6968] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:14:45 2022] DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26/os-volume_attachments/a1d40c54-676f-4a41-9702-34f3602a9891 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:14:48.787787 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:48.788370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:48.795929 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:48.796397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:48.797227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:48.797684 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:48.832879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:14:48.911831 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-69e6b54d-83bc-4fc3-8d4f-d0565f3ada76 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 204 len: 0 microversion: 2.1 time: 0.127702 Jul 25 17:14:48.912464 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3526/6969] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:14:48 2022] DELETE /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:14:48.920931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:48.921610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:48.929322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:48.929865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:48.930710 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:48.931217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:49.068973 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:49.076956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f43a3cc-2e89-447d-9f59-93cbb5be5fc7 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1563 microversion: 2.1 time: 0.160026 Jul 25 17:14:49.077573 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3444/6970] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:48 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:50.103168 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:50.106800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:50.116434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:50.117319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:50.118593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:50.119343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:50.269749 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:50.281962 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-546f1147-4779-40c1-b673-6de687f52373 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1563 microversion: 2.1 time: 0.185564 Jul 25 17:14:50.282792 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3527/6971] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:50 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:51.307021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:51.307919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:51.316995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:51.317480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:51.318238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:51.318674 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:51.453046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:51.460744 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5b28df5d-b0d4-4055-b89c-d83e9540f8c1 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1563 microversion: 2.1 time: 0.160459 Jul 25 17:14:51.461395 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3445/6972] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:51 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:51.949050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c183e457-e615-4565-ae77-65947769dc4f req-e617349c-b353-4b8f-aa46-08c661b12640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696d38e5-5a0f-4032-b740-173caaa91c26", "name": "network-vif-deleted", "tag": "704ee209-4db5-4c18-a1de-762485e53b4e"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:14:51.962940 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c183e457-e615-4565-ae77-65947769dc4f req-e617349c-b353-4b8f-aa46-08c661b12640 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:51.963433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c183e457-e615-4565-ae77-65947769dc4f req-e617349c-b353-4b8f-aa46-08c661b12640 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:51.975913 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c183e457-e615-4565-ae77-65947769dc4f req-e617349c-b353-4b8f-aa46-08c661b12640 service nova] Creating event network-vif-deleted:704ee209-4db5-4c18-a1de-762485e53b4e for instance 696d38e5-5a0f-4032-b740-173caaa91c26 on n-h1-846219-13 Jul 25 17:14:51.981447 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c183e457-e615-4565-ae77-65947769dc4f req-e617349c-b353-4b8f-aa46-08c661b12640 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036118 Jul 25 17:14:51.982159 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3528/6973] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:14:52.482669 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:52.483320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:52.490638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:52.491272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:52.492082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:52.492471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:52.526144 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:52.526594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:52.527277 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lazy-loading 'fault' on Instance uuid 696d38e5-5a0f-4032-b740-173caaa91c26 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:14:52.576553 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bde8e5d2b64d949dd562a8023193c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4dc8870cc4a769d506cd658fd4008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:14:52.583729 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-397330e0-e664-491c-a350-65bd23fa2633 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 200 len: 1355 microversion: 2.1 time: 0.105295 Jul 25 17:14:52.584334 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3446/6974] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:52 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:14:53.606694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:53.607409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] [instance: 696d38e5-5a0f-4032-b740-173caaa91c26] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:14:53.614147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:53.614616 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:53.615404 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:14:53.615860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:14:53.629560 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] HTTP exception thrown: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 could not be found. Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Request method failure captured: Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 HTTP/1.1 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s84UfCWyy_dBJlF3mZnmKR5pECOiEf4cf2q7yph8SDL1nOjrfx0XF56ZK4IXNBytRHzlm5g0yCXDef4BvcJVEYY7a02z1LJd4xDcqFnBAiCrFlrqfKbsVUZNU7CTeOoBdozwLui_Je7IyxCsfUaU_rMyssr7aTksQRhgRtTD25VExk Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/7da4dc8870cc4a769d506cd658fd4008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_7da4dc8870cc4a769d506cd658fd4008"}]}] Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 7da4dc8870cc4a769d506cd658fd4008 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-797488959 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 95bde8e5d2b64d949dd562a8023193c3 Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestEncryptedCinderVolumes-797488959-project Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 could not be found. Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '696d38e5-5a0f-4032-b740-173caaa91c26'} Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 could not be found. Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 could not be found. Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:14:53.631203 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 could not be found. Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Returning 404 to user: Instance 696d38e5-5a0f-4032-b740-173caaa91c26 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-721c298b-91e2-4d8c-b396-e720a338b949 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26" status: 404 len: 111 microversion: 2.1 time: 0.031625 Jul 25 17:14:53.635129 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3529/6975] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:14:53 2022] GET /compute/v2.1/servers/696d38e5-5a0f-4032-b740-173caaa91c26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:14:53.641547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-448e7a26-395c-4bf2-95f7-70ee6f812587 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] Calling method '.version_select at 0x7f9d92df5700>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:14:53.664637 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-448e7a26-395c-4bf2-95f7-70ee6f812587 tempest-TestEncryptedCinderVolumes-797488959 tempest-TestEncryptedCinderVolumes-797488959-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-508990558" status: 202 len: 0 microversion: 2.1 time: 0.026900 Jul 25 17:14:53.665268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3447/6976] 10.222.0.105 () {58 vars in 1280 bytes} [Mon Jul 25 17:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-508990558 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:15:20.256859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a2076c7-5da9-4c5e-a3d7-1e893b0b0e2e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'create', calling method: .version_select at 0x7f9da4aea670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-917820580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrY6sAFCOjwv/6sL9GsJPwjXI3UNtV39Cj+NAXKCGJxosGsxg4M/tysCOe2oBnh/se431HFBrTViwmRDq4soFiyA1iXkXUyVsb4ZdnwDif9lrYcSh131N0OESGE9AnqJA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:15:20.262750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:20.263428 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:20.278845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0a2076c7-5da9-4c5e-a3d7-1e893b0b0e2e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:15:20.284000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-0a2076c7-5da9-4c5e-a3d7-1e893b0b0e2e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for user 71681b3afa6041178cbb1a532ea387ce and project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:15:20.310878 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a2076c7-5da9-4c5e-a3d7-1e893b0b0e2e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058040 Jul 25 17:15:20.311506 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3530/6977] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:15:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:15:20.361157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=44 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:20.361919 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:20.366733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-672767478", "imageRef": "7d4dd889-61bb-49f4-b44a-aeead1c7f58a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-917820580", "networks": [{"uuid": "7e8516cf-bdc1-4e1c-a631-2cfec4cb5ae5"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:15:20.419204 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] validate_networks() for [('7e8516cf-bdc1-4e1c-a631-2cfec4cb5ae5', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:15:20.820986 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:15:20.821438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:15:20.821913 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:15:20.822320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:15:20.822728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:15:20.832115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:20.832561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:20.833383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:20.833818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:20.851755 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:15:20.857777 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for user 71681b3afa6041178cbb1a532ea387ce and project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:15:20.870550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:15:20.872772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4dd889-61bb-49f4-b44a-aeead1c7f58a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:15:20.917853 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b6d793b-7bc8-43b0-ae73-cd88fe9543c0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.558501 Jul 25 17:15:20.921152 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3448/6978] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:15:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:15:20.929478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e45e2a2-c429-4994-a9e6-8fd8237e5c83 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:20.930110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e45e2a2-c429-4994-a9e6-8fd8237e5c83 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:20.984601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e45e2a2-c429-4994-a9e6-8fd8237e5c83 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:20.991866 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e45e2a2-c429-4994-a9e6-8fd8237e5c83 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1261 microversion: 2.1 time: 0.066467 Jul 25 17:15:20.992933 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3531/6979] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:20 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:22.014997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:22.015633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:22.025876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:22.026329 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:22.027095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:22.027528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:22.095849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:22.104941 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-da0ba7d5-4c6d-468b-8767-ef7bac944cfb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1321 microversion: 2.1 time: 0.095416 Jul 25 17:15:22.106948 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3449/6980] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:22 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1321 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:23.127497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:23.128716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:23.136345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:23.137104 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:23.138161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:23.138825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:23.414416 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:23.426666 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4f10d90-fcda-49d4-8d96-983d2e3984e2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.302889 Jul 25 17:15:23.428259 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3532/6981] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:23 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:24.448322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:24.449856 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:24.457740 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:24.458545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:24.459538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:24.460476 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:24.607721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:24.618453 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8a80c7b3-9918-4237-b64b-def435b69d1b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.174330 Jul 25 17:15:24.619367 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3450/6982] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:24 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:25.654770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:25.655516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:25.663566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:25.664316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:25.665560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:25.666221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:25.810909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:25.818993 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-777a8ab6-da66-4385-9246-88f226a2383c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.170734 Jul 25 17:15:25.819595 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3533/6983] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:25 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:26.848793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:26.848793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:26.850327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:26.850770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:26.851536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:26.851970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:26.998054 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:27.008968 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2fcd488d-d087-4d82-91ee-4ef30e42fca5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.172869 Jul 25 17:15:27.021331 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3451/6984] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:26 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:28.031981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:28.032552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:28.039139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:28.039600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:28.040374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:28.040812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:28.196429 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:28.204488 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3d7599c0-96a9-425e-85b0-2213902b59af tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.177460 Jul 25 17:15:28.205291 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3534/6985] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:28 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:15:29.225635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:29.226262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:29.235486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:29.235933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:29.236707 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:29.237391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:29.376383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:29.384556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-28dc89c4-a5ba-4778-9572-4d6cc4335593 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.162882 Jul 25 17:15:29.385168 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3452/6986] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:29 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:30.406288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:30.406973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:30.414575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:30.415050 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:30.415851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:30.416309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:30.552563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:30.560618 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b3123f4a-ecb7-45e9-813c-4d03664491cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.158231 Jul 25 17:15:30.561592 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3535/6987] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:30 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:31.582884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:31.583480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:31.586262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:31.586941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:31.592779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:31.593256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:31.594081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:31.594530 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:32.027099 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:32.035154 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-92d08571-78e3-4524-bac8-d11e69b5522e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.456640 Jul 25 17:15:32.035728 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3453/6988] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:31 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:33.061261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:33.061937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:33.064126 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:15:33.071345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:33.071832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:33.072662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:33.073142 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:33.210455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:33.224247 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-af74530e-9c26-4142-a937-df2b9324fcb2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.167297 Jul 25 17:15:33.225201 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3536/6989] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:33 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:34.252714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:34.253305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:34.260914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:34.261393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:34.262149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:34.262575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:34.414969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:34.425526 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5eecf511-5342-4a2e-8d19-a66d85b03b8e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.178147 Jul 25 17:15:34.426158 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3454/6990] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:34 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:35.447504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:35.448160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:35.455869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:35.456341 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:35.457135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:35.457627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:35.594496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:35.603372 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e0318325-0646-46e3-9c3e-9b12497ba143 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.160096 Jul 25 17:15:35.603990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3537/6991] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:35 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:35.817434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8b246a52-17c2-4a3a-87b5-849e8d37d5e9 req-7159c8f5-1a47-41b3-934d-0d80738cec83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:15:35.831965 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8b246a52-17c2-4a3a-87b5-849e8d37d5e9 req-7159c8f5-1a47-41b3-934d-0d80738cec83 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:35.832817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8b246a52-17c2-4a3a-87b5-849e8d37d5e9 req-7159c8f5-1a47-41b3-934d-0d80738cec83 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:35.849352 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8b246a52-17c2-4a3a-87b5-849e8d37d5e9 req-7159c8f5-1a47-41b3-934d-0d80738cec83 service nova] Creating event network-changed:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:15:35.854716 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8b246a52-17c2-4a3a-87b5-849e8d37d5e9 req-7159c8f5-1a47-41b3-934d-0d80738cec83 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041267 Jul 25 17:15:35.855619 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3455/6992] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:15:36.627779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:36.628445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:36.637837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:36.638383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:36.639306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:36.639833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:36.778538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:36.786527 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d2891827-4fc6-42ca-9c7a-5433ca7ce099 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.164976 Jul 25 17:15:36.787131 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3538/6993] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:36 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:37.813823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:37.814975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:37.822094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:37.822604 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:37.823409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:37.823863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:37.964437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:37.973652 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b8cb4c32-7bd5-4ed1-9f4b-b21857381d1a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.168370 Jul 25 17:15:37.974258 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3456/6994] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:37 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:38.999244 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:39.000271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:39.012298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:39.013070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:39.014423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:39.015169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:39.164247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:39.171884 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-50606973-f2bf-4144-a402-f15a3eac27e9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.179358 Jul 25 17:15:39.172464 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3539/6995] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:38 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:40.195621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:40.196485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:40.206256 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:40.206894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:40.207964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:40.208575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:40.348821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:40.356644 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f905b376-7f99-44c0-bbb3-4068cb7efad3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.166995 Jul 25 17:15:40.357258 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3457/6996] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:40 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:41.377212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:41.377806 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:41.386150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:41.386639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:41.387467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:41.387939 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:41.533935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:41.542352 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2eb57a7c-8663-432a-91b6-fe9db7346055 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.169467 Jul 25 17:15:41.543010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3540/6997] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:41 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:42.036313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-9639c9f4-f57e-4f78-9af1-e2e8192db6ff req-3e3ec6d9-abc9-4a55-a5be-b363891756b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "name": "network-vif-plugged", "status": "completed", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:15:42.047841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9639c9f4-f57e-4f78-9af1-e2e8192db6ff req-3e3ec6d9-abc9-4a55-a5be-b363891756b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:42.048327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-9639c9f4-f57e-4f78-9af1-e2e8192db6ff req-3e3ec6d9-abc9-4a55-a5be-b363891756b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:42.060737 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-9639c9f4-f57e-4f78-9af1-e2e8192db6ff req-3e3ec6d9-abc9-4a55-a5be-b363891756b4 service nova] Creating event network-vif-plugged:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:15:42.075519 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-9639c9f4-f57e-4f78-9af1-e2e8192db6ff req-3e3ec6d9-abc9-4a55-a5be-b363891756b4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043500 Jul 25 17:15:42.076142 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3458/6998] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:15:42.566693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:42.567297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:42.575453 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:42.575977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:42.576825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:42.577347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:42.717581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:42.725913 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df6b9991-1574-4043-b1a0-86b90d36d153 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.165884 Jul 25 17:15:42.726516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3541/6999] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:42 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:43.756396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:43.757169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:43.763944 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:43.764383 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:43.765214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:43.765631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:43.910865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:43.919409 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-46854f77-8192-40fa-b2ec-b8196e60d828 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1361 microversion: 2.1 time: 0.171172 Jul 25 17:15:43.919997 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3459/7000] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:43 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:44.945157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:44.946136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:44.957971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:44.958746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:44.960032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:44.960908 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.103595 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:45.112263 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7805a0c0-5beb-407e-886d-11b8ad464cd7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1551 microversion: 2.1 time: 0.173552 Jul 25 17:15:45.112824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3542/7001] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:44 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:45.133945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:45.134560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:45.142474 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:45.142933 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.143728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:45.144147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.274845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:45.283118 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-581d2fa6-158b-40ee-89d0-6fcae1f8305e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1551 microversion: 2.1 time: 0.153513 Jul 25 17:15:45.283704 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3460/7002] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:45 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:45.304825 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:45.309622 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:45.310417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Searching by: {'deleted': False, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4'} {{(pid=119599) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 17:15:45.316124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:45.316581 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.317440 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:45.317890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.343195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.multi_cell_list [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119599) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 17:15:45.370459 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5ab6e9fc-dada-4ea1-8552-353358383173 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.069559 Jul 25 17:15:45.371034 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3543/7003] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 17:15:45 2022] GET /compute/v2.1/servers => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:15:45.382429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:15:45.383119 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:45.389581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:45.390034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.390794 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:45.391224 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:45.522134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:15:45.529861 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d538c16e-0814-4284-a36d-9d2ceeb89d1c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1551 microversion: 2.1 time: 0.151371 Jul 25 17:15:45.530443 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3461/7004] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:15:45 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:15:47.099211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1fdf11f-5abc-42cd-aae8-fe978d5051aa"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:15:47.101690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:15:47.109306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:47.109765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:47.110535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:15:47.110988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:15:47.415940 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a687ffd-71ee-4525-80bd-c55064ef9218 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320567 Jul 25 17:15:47.416569 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3544/7005] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 17:15:47 2022] POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:16:01.599859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:16:01.600437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:16:01.603587 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:16:01.604241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=72 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:16:01.610145 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:01.610591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:01.611342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:01.611766 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:01.752671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:16:01.761289 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9787f59c-f6ce-434e-99d5-dbe5279c4eac tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1597 microversion: 2.1 time: 0.165233 Jul 25 17:16:01.761874 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3462/7006] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:16:01 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1597 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:16:03.526119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:16:03.534785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:16:03.535759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:16:03.540692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a16e70f4-27f9-40ee-9881-52505737f610 req-c41758b9-8eb4-4a65-b3ab-4f43bac44ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:16:03.563435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a16e70f4-27f9-40ee-9881-52505737f610 req-c41758b9-8eb4-4a65-b3ab-4f43bac44ceb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:03.563965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a16e70f4-27f9-40ee-9881-52505737f610 req-c41758b9-8eb4-4a65-b3ab-4f43bac44ceb service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:03.582534 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a16e70f4-27f9-40ee-9881-52505737f610 req-c41758b9-8eb4-4a65-b3ab-4f43bac44ceb service nova] Creating event network-changed:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:16:03.588675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a16e70f4-27f9-40ee-9881-52505737f610 req-c41758b9-8eb4-4a65-b3ab-4f43bac44ceb service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064478 Jul 25 17:16:03.589626 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3545/7007] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:16:04.557676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1146526889"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:16:04.558267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:16:04.566381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:04.567078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:04.568024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:04.568457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:04.707044 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.network.security_group_api [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Adding security group d9f43ce0-a624-4ff2-9420-4e0345e200d2 to port c675ee15-8790-401a-a777-a8d6358d4205 Jul 25 17:16:05.066452 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-568e518d-ddc1-40b5-b6bf-55e439d8b0ea tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/action" status: 202 len: 0 microversion: 2.1 time: 0.513236 Jul 25 17:16:05.067696 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3463/7008] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:16:04 2022] POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:16:05.076015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:16:05.077347 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:16:05.082980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e7ace4cc-c490-4aa1-892e-07287d79eae2 req-9b93f959-1922-4e11-8872-98d24db189c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:16:05.095883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:05.098470 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:05.099687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:05.100300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:05.105886 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e7ace4cc-c490-4aa1-892e-07287d79eae2 req-9b93f959-1922-4e11-8872-98d24db189c8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:16:05.106556 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e7ace4cc-c490-4aa1-892e-07287d79eae2 req-9b93f959-1922-4e11-8872-98d24db189c8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:16:05.135076 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e7ace4cc-c490-4aa1-892e-07287d79eae2 req-9b93f959-1922-4e11-8872-98d24db189c8 service nova] Creating event network-changed:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:16:05.146027 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e7ace4cc-c490-4aa1-892e-07287d79eae2 req-9b93f959-1922-4e11-8872-98d24db189c8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061651 Jul 25 17:16:05.146700 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3464/7009] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:16:05.279111 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:16:05.288387 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8686644f-f602-4d7e-80f8-febc9e7f699e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1763 microversion: 2.1 time: 0.216429 Jul 25 17:16:05.289745 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3546/7010] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:16:05 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1763 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:17:43.842624 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:17:43.843808 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:17:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:17:44.215364 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:17:44.216126 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:17:44.599703 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:17:44.599956 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:18:27.441121 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:18:27.441623 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:18:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:18:31.319624 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e98af31f-6032-407f-97ae-f2fce361f28a] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:18:31.320536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:18:31.321335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=12 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:18:31.326022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:18:31.328395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:18:31.336060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:18:31.336505 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:18:31.337303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:18:31.337745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:18:31.418681 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7675d794-0c8c-4563-b8eb-e5959f536ec5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/action" status: 202 len: 0 microversion: 2.1 time: 0.101869 Jul 25 17:18:31.419295 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3465/7011] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:18:31 2022] POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:18:31.426390 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:18:31.430386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:18:31.431738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:18:31.433481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:18:31.434324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:18:31.439995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:18:31.440496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:18:31.441548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:18:31.441998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:18:31.711935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:18:31.720915 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6301cae6-4c4c-422d-bdc7-1ad3667f953c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1765 microversion: 2.1 time: 0.297096 Jul 25 17:18:31.721526 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3547/7012] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:18:31 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1765 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:18:32.748064 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:18:32.748860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:18:32.757718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:18:32.758161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:18:32.758922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:18:32.759352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:18:32.765853 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [e98af31f-6032-407f-97ae-f2fce361f28a] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 49568. Jul 25 17:18:32.962255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:18:32.970727 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-10c1734d-e4a6-4e79-9646-bd731b59aba2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1763 microversion: 2.1 time: 0.229397 Jul 25 17:18:32.971303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3466/7013] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:18:32 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1763 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:17.835170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:17.835945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:17.847671 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 49612. Jul 25 17:20:17.898093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1146526889"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:17.898660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:17.905378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:17.905852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:17.906645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:17.907097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:18.044144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.network.security_group_api [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Removing security group d9f43ce0-a624-4ff2-9420-4e0345e200d2 from port c675ee15-8790-401a-a777-a8d6358d4205 Jul 25 17:20:18.396660 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-34dc0272-c327-4d46-a6a3-abe6a748c773 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/action" status: 202 len: 0 microversion: 2.1 time: 0.564886 Jul 25 17:20:18.397547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3548/7014] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:20:17 2022] POST /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:20:18.420564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:18.421375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:18.508185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-ddb10c09-b9ba-4e1a-a3e8-685338e6d811 req-1441cfe2-2273-48c0-9455-436c12e14531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:18.518719 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ddb10c09-b9ba-4e1a-a3e8-685338e6d811 req-1441cfe2-2273-48c0-9455-436c12e14531 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:18.519540 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-ddb10c09-b9ba-4e1a-a3e8-685338e6d811 req-1441cfe2-2273-48c0-9455-436c12e14531 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:18.533510 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-ddb10c09-b9ba-4e1a-a3e8-685338e6d811 req-1441cfe2-2273-48c0-9455-436c12e14531 service nova] Creating event network-changed:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:20:18.539618 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-ddb10c09-b9ba-4e1a-a3e8-685338e6d811 req-1441cfe2-2273-48c0-9455-436c12e14531 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135075 Jul 25 17:20:18.541328 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3467/7015] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:19.597242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:19.597758 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:19.604357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:19.604829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:19.605649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:19.606431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:19.688931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lazy-loading 'services' on Instance uuid 977c2216-a1ce-4483-a577-6d97a6868376 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:20:19.768978 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e31f1da0-7035-478c-9bcc-a0641b395767 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments/a1fdf11f-5abc-42cd-aae8-fe978d5051aa" status: 202 len: 0 microversion: 2.1 time: 0.176494 Jul 25 17:20:19.769738 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3549/7016] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:20:19 2022] DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments/a1fdf11f-5abc-42cd-aae8-fe978d5051aa => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 17:20:19.779044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:19.790004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:19.798007 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:19.798450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:19.799218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:19.799676 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:19.830556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77eae119-5c7f-41d5-8cbc-1143fbf9d0a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056029 Jul 25 17:20:19.831126 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3468/7017] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:20:19 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:20.555849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-05489f13-a208-46b1-8155-03bce0ac2ed1 req-7e64df65-c438-40f4-81a9-34c42b866f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:20.568458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-05489f13-a208-46b1-8155-03bce0ac2ed1 req-7e64df65-c438-40f4-81a9-34c42b866f0d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:20.568883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-05489f13-a208-46b1-8155-03bce0ac2ed1 req-7e64df65-c438-40f4-81a9-34c42b866f0d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:20.581685 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-05489f13-a208-46b1-8155-03bce0ac2ed1 req-7e64df65-c438-40f4-81a9-34c42b866f0d service nova] Creating event network-changed:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:20:20.587021 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-05489f13-a208-46b1-8155-03bce0ac2ed1 req-7e64df65-c438-40f4-81a9-34c42b866f0d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035766 Jul 25 17:20:20.587643 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3550/7018] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:20.843578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:20.846014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:20.854002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:20.854529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:20.855516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:20.856510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:20.891790 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37cddebc-693b-4527-94ac-250645945e91 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052530 Jul 25 17:20:20.892349 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3469/7019] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:20:20 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:21.906080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:21.908339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:21.915458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:21.916097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:21.916898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:21.917388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:21.962515 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-db35fc71-8059-4ae1-a4ad-809faf9d0f87 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061835 Jul 25 17:20:21.963228 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3551/7020] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:20:21 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:22.975832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:22.978209 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:22.987026 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:22.987482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:22.988265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:22.988702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:23.036348 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c7f806de-36d8-4281-8e0c-ec8f29d35183 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064733 Jul 25 17:20:23.037611 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3470/7021] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:20:22 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:24.049015 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:24.051538 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:24.059393 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:24.059869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:24.060675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:24.061139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:24.096409 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2565a311-382f-4dac-8e5e-9bec277e6741 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051897 Jul 25 17:20:24.096996 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3552/7022] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:20:24 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:25.113696 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:25.117234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:25.128793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:25.129586 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:25.130881 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:25.131310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:25.161499 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ca241e7d-e6ac-4369-a6ed-78611479576b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054395 Jul 25 17:20:25.162582 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3471/7023] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:20:25 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 17:20:25.172951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:25.173597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:25.180583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:25.181043 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:25.181846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:25.182289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:25.269511 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] HTTP exception thrown: Instance 977c2216-a1ce-4483-a577-6d97a6868376 is not attached to volume a1fdf11f-5abc-42cd-aae8-fe978d5051aa Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Request method failure captured: Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments/a1fdf11f-5abc-42cd-aae8-fe978d5051aa HTTP/1.1 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s-Zso68O3MRE0P6IqjveiUb_N73l23Z71zMdAvx0Ea5krCIljS8HSjIzM86t_evCGKr24QSBckGMx-5md_xJ1O3zzSP8LoTC5jz3ru0BHdjvlhtCl4kQVH5RFS2eT7X1R6p1ib7Y0Ax4KjeYsAr--0XmQ85wLhk4gT28tndtHGlk3c Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e309fcf5e5d47ddb1d8a304c172a3c4"}]}] Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 71681b3afa6041178cbb1a532ea387ce Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 977c2216-a1ce-4483-a577-6d97a6868376 is not attached to volume a1fdf11f-5abc-42cd-aae8-fe978d5051aa Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': '977c2216-a1ce-4483-a577-6d97a6868376', 'id': 'a1fdf11f-5abc-42cd-aae8-fe978d5051aa'} Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1fdf11f-5abc-42cd-aae8-fe978d5051aa. Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977c2216-a1ce-4483-a577-6d97a6868376 is not attached to volume a1fdf11f-5abc-42cd-aae8-fe978d5051aa Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:20:25.271592 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977c2216-a1ce-4483-a577-6d97a6868376 is not attached to volume a1fdf11f-5abc-42cd-aae8-fe978d5051aa Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Returning 404 to user: Instance 977c2216-a1ce-4483-a577-6d97a6868376 is not attached to volume a1fdf11f-5abc-42cd-aae8-fe978d5051aa {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64384c50-819a-46ac-af7b-6c2c20e6380d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments/a1fdf11f-5abc-42cd-aae8-fe978d5051aa" status: 404 len: 154 microversion: 2.1 time: 0.104172 Jul 25 17:20:25.275682 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3553/7024] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:20:25 2022] DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376/os-volume_attachments/a1fdf11f-5abc-42cd-aae8-fe978d5051aa => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:20:28.536565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:28.537184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:28.544694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:28.545213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:28.545992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:28.546426 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:28.571972 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:20:28.650495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-81831ad9-3ddb-492c-a663-652005c49c3f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 204 len: 0 microversion: 2.1 time: 0.117824 Jul 25 17:20:28.654746 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3472/7025] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:20:28 2022] DELETE /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:20:28.661297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:28.661920 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:28.669075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:28.669632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:28.670426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:28.670847 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:28.809372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:28.817697 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4c002dd4-8097-48bf-bd42-af0ae23bd36d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1557 microversion: 2.1 time: 0.161374 Jul 25 17:20:28.818282 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3554/7026] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:28 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:29.844255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:29.845459 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:29.855071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:29.855526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:29.856612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:29.857129 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:29.993528 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:30.001125 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6c1830ba-65f5-4ef5-8365-7c818b411ed0 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1557 microversion: 2.1 time: 0.164272 Jul 25 17:20:30.001708 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3473/7027] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:29 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:31.026723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:31.027478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:31.036200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:31.036808 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:31.037933 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:31.038502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:31.175442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:31.183555 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d609fb2b-6976-4e43-8799-25f6b6e2d59f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 200 len: 1557 microversion: 2.1 time: 0.161835 Jul 25 17:20:31.184212 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3555/7028] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:31 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:31.614905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6af6c90a-50d6-41dd-9cc5-c9352e32c8e7 req-470e08d0-e8ca-47c8-bcee-b2c489631238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977c2216-a1ce-4483-a577-6d97a6868376", "name": "network-vif-deleted", "tag": "c675ee15-8790-401a-a777-a8d6358d4205"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:31.624564 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6af6c90a-50d6-41dd-9cc5-c9352e32c8e7 req-470e08d0-e8ca-47c8-bcee-b2c489631238 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:31.625078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6af6c90a-50d6-41dd-9cc5-c9352e32c8e7 req-470e08d0-e8ca-47c8-bcee-b2c489631238 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:31.636539 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6af6c90a-50d6-41dd-9cc5-c9352e32c8e7 req-470e08d0-e8ca-47c8-bcee-b2c489631238 service nova] Creating event network-vif-deleted:c675ee15-8790-401a-a777-a8d6358d4205 for instance 977c2216-a1ce-4483-a577-6d97a6868376 on n-h1-846219-13 Jul 25 17:20:31.641689 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6af6c90a-50d6-41dd-9cc5-c9352e32c8e7 req-470e08d0-e8ca-47c8-bcee-b2c489631238 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087818 Jul 25 17:20:31.643754 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3474/7029] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:32.204860 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:32.205482 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: 977c2216-a1ce-4483-a577-6d97a6868376] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:32.213151 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:32.213611 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:32.214381 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:32.214823 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:32.228278 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] HTTP exception thrown: Instance 977c2216-a1ce-4483-a577-6d97a6868376 could not be found. Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Request method failure captured: Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 HTTP/1.1 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s-Zso68O3MRE0P6IqjveiUb_N73l23Z71zMdAvx0Ea5krCIljS8HSjIzM86t_evCGKr24QSBckGMx-5md_xJ1O3zzSP8LoTC5jz3ru0BHdjvlhtCl4kQVH5RFS2eT7X1R6p1ib7Y0Ax4KjeYsAr--0XmQ85wLhk4gT28tndtHGlk3c Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e309fcf5e5d47ddb1d8a304c172a3c4"}]}] Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 71681b3afa6041178cbb1a532ea387ce Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 977c2216-a1ce-4483-a577-6d97a6868376 could not be found. Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '977c2216-a1ce-4483-a577-6d97a6868376'} Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977c2216-a1ce-4483-a577-6d97a6868376 could not be found. Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977c2216-a1ce-4483-a577-6d97a6868376 could not be found. Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:20:32.229870 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977c2216-a1ce-4483-a577-6d97a6868376 could not be found. Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Returning 404 to user: Instance 977c2216-a1ce-4483-a577-6d97a6868376 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1849b4c-04d8-4641-9ee5-4eda42145531 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376" status: 404 len: 111 microversion: 2.1 time: 0.030557 Jul 25 17:20:32.234536 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3556/7030] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:32 2022] GET /compute/v2.1/servers/977c2216-a1ce-4483-a577-6d97a6868376 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:20:32.241355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0bae9ce8-a849-47df-91a3-3dd54e84c983 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '.version_select at 0x7f9d939dd280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:32.266000 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0bae9ce8-a849-47df-91a3-3dd54e84c983 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-917820580" status: 202 len: 0 microversion: 2.1 time: 0.028968 Jul 25 17:20:32.266588 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3475/7031] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 17:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-917820580 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:20:41.253046 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-330b8ac5-cb62-4077-a9fd-227a53b556cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'create', calling method: .version_select at 0x7f9d929f6f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-449603401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoVwHvr9VvdvhwAgC7BLHPQu/k6x/svwRWsuknwBtH8pLF80rqd+pWn8DthevyOvgEdQo0AdNQeoC18fg55FqZhq1gqSP8VCf9BrakiXA1URDTCLHTD6uWhYxZqILLUsw=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:41.273395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-330b8ac5-cb62-4077-a9fd-227a53b556cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:20:41.278713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-330b8ac5-cb62-4077-a9fd-227a53b556cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for user 71681b3afa6041178cbb1a532ea387ce and project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:20:41.292399 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [None req-330b8ac5-cb62-4077-a9fd-227a53b556cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [c4dfd66c-9d87-4c77-92e5-ba0b2d024fa9] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:20:42.057503 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] AMQP server on 10.222.0.105:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 25 17:20:42.219883 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:42.301629 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [None req-330b8ac5-cb62-4077-a9fd-227a53b556cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [c4dfd66c-9d87-4c77-92e5-ba0b2d024fa9] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 49772. Jul 25 17:20:42.323086 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-330b8ac5-cb62-4077-a9fd-227a53b556cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.073961 Jul 25 17:20:42.323679 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3557/7032] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:20:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:20:42.375049 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] AMQP server on 10.222.0.105:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 25 17:20:42.375648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:42.376515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:42.381296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1760381342", "imageRef": "71f44c91-e660-4ee6-88ac-148fa1dc763a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-449603401", "networks": [{"uuid": "7e8516cf-bdc1-4e1c-a631-2cfec4cb5ae5"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:42.436126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] validate_networks() for [('7e8516cf-bdc1-4e1c-a631-2cfec4cb5ae5', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:20:42.868196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:20:42.868544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:20:42.869012 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:20:42.869442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:20:42.869843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:20:42.878572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:42.879008 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:42.879783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:42.880302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:42.897372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:20:42.902623 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Getting quotas for user 71681b3afa6041178cbb1a532ea387ce and project 0e309fcf5e5d47ddb1d8a304c172a3c4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:20:42.918301 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:20:42.921806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71f44c91-e660-4ee6-88ac-148fa1dc763a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:20:42.976318 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-217f707b-2c70-4155-93fa-d485b4bf4737 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.604201 Jul 25 17:20:42.976985 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3476/7033] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:20:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:20:42.988030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dded2804-0996-407a-9030-7932211a29a9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:42.988656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dded2804-0996-407a-9030-7932211a29a9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:43.043711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dded2804-0996-407a-9030-7932211a29a9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:43.050965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dded2804-0996-407a-9030-7932211a29a9 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1262 microversion: 2.1 time: 0.066873 Jul 25 17:20:43.051688 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3558/7034] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:42 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:44.074991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:44.075609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:44.083511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:44.083961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:44.084727 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:44.085262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:44.100609 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 49802. Jul 25 17:20:44.150989 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:44.158959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-61475480-dbfc-4e6b-9f0d-509135b3873c tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1314 microversion: 2.1 time: 0.089460 Jul 25 17:20:44.159548 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3477/7035] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:44 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1314 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:45.181859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:45.182518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:45.195471 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:45.195913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:45.196714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:45.197186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:45.217872 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 49822. Jul 25 17:20:45.342191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:45.350229 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f781a2c0-cd70-4b4c-be44-a2c532522da7 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.173688 Jul 25 17:20:45.350815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3559/7036] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:45 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:46.372084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:46.372718 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:46.380407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:46.380857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:46.381646 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:46.382076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:46.525320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:46.532949 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-60faa573-94b2-4b9a-80cc-d8d78559452e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.164877 Jul 25 17:20:46.533574 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3478/7037] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:46 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:47.553885 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:47.554828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:47.562958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:47.563527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:47.564545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:47.565240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:47.714269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:47.722136 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08a7ae2d-550a-4aa7-890a-ce6c93c17e0e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.172420 Jul 25 17:20:47.722941 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3560/7038] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:47 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:48.743838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:48.744513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:48.751737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:48.752182 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:48.752979 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:48.753435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:48.895960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:48.910728 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0e2e5f27-5ba9-429d-ac81-fd4834312a62 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.170910 Jul 25 17:20:48.911419 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3479/7039] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:48 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:49.932068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:49.932723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:49.935271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:49.940508 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:49.940973 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:49.941789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:49.942243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:50.087916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:50.096353 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e1108ca6-823a-480e-a3eb-90580213b12a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.168400 Jul 25 17:20:50.097150 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3561/7040] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:49 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:20:51.118844 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:51.119648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:51.127616 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:51.128052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:51.128882 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:51.129345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:51.273269 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:51.282437 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-79829481-27f0-44d5-988b-0e5de35ac5cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.167805 Jul 25 17:20:51.283360 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3480/7041] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:51 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:52.304819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:52.306245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:52.314160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:52.314531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:52.315545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:52.316103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:52.463810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:52.471712 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3c3b4791-0ac7-4727-9fce-bdaed8d771bd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.171406 Jul 25 17:20:52.472314 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3562/7042] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:52 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:53.495507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:53.496488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:53.500602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:53.501680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:53.511202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:53.511927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:53.513158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:53.513868 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:53.662250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:53.670105 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6e9954c2-8b01-420a-aa50-e4766d667890 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.180676 Jul 25 17:20:53.670687 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3481/7043] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:53 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:54.693188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:54.693832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:54.695990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:20:54.702977 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:54.703492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:54.704435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:54.704862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:54.840350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:54.848630 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b0ee4b67-a467-45f0-88a9-5d3d090de448 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.161819 Jul 25 17:20:54.849369 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3563/7044] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:54 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:55.873839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:55.875663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:55.883959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:55.884413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:55.885218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:55.885653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:56.002399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-86490ef4-7b43-4c15-920f-04904b74e530 req-a5a11643-c061-4587-be4a-e23913ed6638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:20:56.016302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-86490ef4-7b43-4c15-920f-04904b74e530 req-a5a11643-c061-4587-be4a-e23913ed6638 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:56.017167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-86490ef4-7b43-4c15-920f-04904b74e530 req-a5a11643-c061-4587-be4a-e23913ed6638 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:56.038924 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-86490ef4-7b43-4c15-920f-04904b74e530 req-a5a11643-c061-4587-be4a-e23913ed6638 service nova] Creating event network-changed:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:20:56.045022 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-86490ef4-7b43-4c15-920f-04904b74e530 req-a5a11643-c061-4587-be4a-e23913ed6638 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046390 Jul 25 17:20:56.046087 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3564/7045] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:20:56.053486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:56.063808 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-77a74ff9-ca76-47d6-9091-4c6aaa0e7356 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.198349 Jul 25 17:20:56.064358 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3482/7046] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:55 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:20:57.084798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:57.085578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:57.093449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:57.093921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:57.094739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:57.095193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:57.235619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:57.243739 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64231fda-6a34-4bd3-871f-1b719ade3001 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.163405 Jul 25 17:20:57.244319 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3565/7047] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:57 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:58.268379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:58.269415 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:58.281331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:58.282081 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:58.283386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:58.284107 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:58.422582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:58.430697 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-98492b0a-a523-4489-a322-eb0709f8fdde tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.168803 Jul 25 17:20:58.431259 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3483/7048] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:58 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:20:59.456897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:20:59.457894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:20:59.465518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:59.465975 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:59.466763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:20:59.467209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:20:59.600984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:20:59.609484 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c798aa0-4804-424c-969f-1e326d5fdc4e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.160015 Jul 25 17:20:59.610067 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3566/7049] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:20:59 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:00.632025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:00.632927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:00.641615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:00.642159 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:00.643091 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:00.643598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:00.782196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:00.790142 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-96c29f6f-f828-4045-b9a4-1edb1b2fe482 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.163051 Jul 25 17:21:00.790751 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3484/7050] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:00 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:01.813721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:01.814358 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:01.821226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:01.821699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:01.822501 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:01.822956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:01.960386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:01.968071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17ba7a25-8c85-4fc1-ac9c-04177f134a72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.160132 Jul 25 17:21:01.968647 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3567/7051] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:01 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:02.993059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:02.994249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:03.005774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:03.006708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:03.007509 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:03.007948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:03.145212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:03.153145 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0bcb9fd1-8c65-4e1f-8d97-92ae15f6b029 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.166676 Jul 25 17:21:03.153730 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3485/7052] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:02 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:03.854211 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:21:03.854662 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.105) !!! Jul 25 17:21:03.886628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-42bee9ae-bf6d-4354-b8ff-f3051b238d2c req-71f28ba3-b077-4fef-9c48-c7bfbd96e7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "name": "network-vif-plugged", "status": "completed", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:21:03.897239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-42bee9ae-bf6d-4354-b8ff-f3051b238d2c req-71f28ba3-b077-4fef-9c48-c7bfbd96e7b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:03.897703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-42bee9ae-bf6d-4354-b8ff-f3051b238d2c req-71f28ba3-b077-4fef-9c48-c7bfbd96e7b4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:03.908043 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-42bee9ae-bf6d-4354-b8ff-f3051b238d2c req-71f28ba3-b077-4fef-9c48-c7bfbd96e7b4 service nova] Creating event network-vif-plugged:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:21:03.913308 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-42bee9ae-bf6d-4354-b8ff-f3051b238d2c req-71f28ba3-b077-4fef-9c48-c7bfbd96e7b4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140609 Jul 25 17:21:03.913870 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3568/7053] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:21:04.178612 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:04.179276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:04.187952 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:04.188500 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:04.189427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:04.189935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:04.330752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:04.342122 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa6d90b1-e6c6-42e4-86d0-1495a0769fcd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.169595 Jul 25 17:21:04.342903 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3486/7054] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:04 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:05.368214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:05.368794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:05.375563 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:05.376053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:05.376840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:05.377334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:05.509490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:05.517527 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9bb5703-8007-4547-b728-ccc5f7a2c5e8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1362 microversion: 2.1 time: 0.154778 Jul 25 17:21:05.518104 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3569/7055] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:05 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:06.543233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:06.543890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:06.551991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.552465 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.553333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.553799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.688536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:06.696549 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-65b4d800-f454-423c-9ad1-f2c209f380cd tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1553 microversion: 2.1 time: 0.160088 Jul 25 17:21:06.697164 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3487/7056] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:06 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:06.717309 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:06.717944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:06.725394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.725873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.726656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.727100 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.869170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:06.877576 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7752772f-ef3f-4bc4-8afd-ac3e69b43138 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1553 microversion: 2.1 time: 0.164361 Jul 25 17:21:06.878183 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3570/7057] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:06 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:06.898066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:06.902904 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:06.903675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Searching by: {'deleted': False, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4'} {{(pid=119598) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 17:21:06.909636 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.910073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.910855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.911280 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.935720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.multi_cell_list [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 17:21:06.963046 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6e5facf9-c6a1-410f-8e84-617096ec824a tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.068961 Jul 25 17:21:06.963593 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3488/7058] 10.222.0.105 () {58 vars in 1130 bytes} [Mon Jul 25 17:21:06 2022] GET /compute/v2.1/servers => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:21:06.975394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:06.976023 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:06.982642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.983106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:06.983889 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:06.984336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:07.121002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:07.129661 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5611dd7a-8378-42f9-84a9-100a9871fd47 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1553 microversion: 2.1 time: 0.158231 Jul 25 17:21:07.130239 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3571/7059] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:06 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:08.670082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a21ea303-f913-4595-a741-3448d19a0cf7"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:21:08.672534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:08.679625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:08.680092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:08.680847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:08.681310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:08.966298 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-70989dca-11b1-4f1d-ae2f-1059068bd5e5 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301846 Jul 25 17:21:08.966916 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3489/7060] 10.222.0.105 () {60 vars in 1328 bytes} [Mon Jul 25 17:21:08 2022] POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:21:20.836956 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:20.837653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:20.840850 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=21 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:21:20.841794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=70 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:21:20.849815 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:20.850439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:20.851665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:20.852259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:21.009339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:21.021724 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b74bdf5-ac8b-4260-a59b-22eadb4b91f4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1599 microversion: 2.1 time: 0.191280 Jul 25 17:21:21.022489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3572/7061] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:20 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1599 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:21:22.818527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:21:22.819298 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:21:22.820094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:21:22.825645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-27249f5d-ab85-407c-b7c8-82fe20c9caf4 req-859e2965-d636-4e98-9837-a3af467f8fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:21:22.837478 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-27249f5d-ab85-407c-b7c8-82fe20c9caf4 req-859e2965-d636-4e98-9837-a3af467f8fc2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:22.837916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-27249f5d-ab85-407c-b7c8-82fe20c9caf4 req-859e2965-d636-4e98-9837-a3af467f8fc2 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:22.851685 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-27249f5d-ab85-407c-b7c8-82fe20c9caf4 req-859e2965-d636-4e98-9837-a3af467f8fc2 service nova] Creating event network-changed:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:21:22.858505 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-27249f5d-ab85-407c-b7c8-82fe20c9caf4 req-859e2965-d636-4e98-9837-a3af467f8fc2 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041724 Jul 25 17:21:22.859350 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3490/7062] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:21:24.288575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1853903351"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:21:24.289204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:24.296201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:24.296665 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:24.297486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:24.297938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:24.441346 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.network.security_group_api [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Adding security group 86c4c352-c7e4-485e-ac11-30ef2ec49cb0 to port 46298048-051d-447f-9dbc-39643d78a508 Jul 25 17:21:24.821554 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-900df9b3-04a9-4be8-8586-34e537816212 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/action" status: 202 len: 0 microversion: 2.1 time: 0.536554 Jul 25 17:21:24.822439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3573/7063] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:21:24 2022] POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:21:24.832294 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:21:24.832873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:21:24.836992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-4469cc2e-a581-4265-9dc3-2babcffcf154 req-24922035-f3f8-4ce1-8cf1-6ea3a907c3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:21:24.851445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:24.851779 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:24.855748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4469cc2e-a581-4265-9dc3-2babcffcf154 req-24922035-f3f8-4ce1-8cf1-6ea3a907c3bc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:24.856802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-4469cc2e-a581-4265-9dc3-2babcffcf154 req-24922035-f3f8-4ce1-8cf1-6ea3a907c3bc service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:24.861241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:21:24.862061 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:21:24.873820 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-4469cc2e-a581-4265-9dc3-2babcffcf154 req-24922035-f3f8-4ce1-8cf1-6ea3a907c3bc service nova] Creating event network-changed:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:21:24.882071 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-4469cc2e-a581-4265-9dc3-2babcffcf154 req-24922035-f3f8-4ce1-8cf1-6ea3a907c3bc service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050520 Jul 25 17:21:24.883273 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3574/7064] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:21:25.076374 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:21:25.087063 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-901744e2-c9bc-4bed-9026-af4c538dee71 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1765 microversion: 2.1 time: 0.259960 Jul 25 17:21:25.087928 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3491/7065] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:21:24 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1765 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:36.162960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:22:36.163865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:22:36.170303 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:22:36.173402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:36.182465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:36.182928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:36.183708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:36.184157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:36.265306 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d4f030b3-a319-4e1a-b48e-144490e24735 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/action" status: 202 len: 0 microversion: 2.1 time: 0.106204 Jul 25 17:22:36.266646 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3575/7066] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:22:36 2022] POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:22:36.283092 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:36.284196 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:36.290288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:22:36.291346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:22:36.297047 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:36.297602 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:36.298630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:36.299199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:36.450822 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:36.458988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0cfa82da-b341-45b8-8878-25112e250c65 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1757 microversion: 2.1 time: 0.186587 Jul 25 17:22:36.459566 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3492/7067] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:36 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:37.487122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:37.488350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:37.497546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:37.498011 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:37.498797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:37.499249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:37.659723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:37.672509 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d6c3c8e1-7ab3-49a3-a816-0c7941997e19 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.192818 Jul 25 17:22:37.673109 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3576/7068] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:37 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:38.700318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:38.701368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:38.713343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:38.713795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:38.714562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:38.715004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:38.879708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:38.888366 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3ffe8343-c385-4353-8386-6aeb5bbc7ff8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.194825 Jul 25 17:22:38.888962 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3493/7069] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:38 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:39.931327 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:39.931942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:39.940718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:39.941220 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:39.942003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:39.942456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:40.105073 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:40.113654 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-385d345e-e50d-4ad2-b5df-8f3cee2a977b tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.191757 Jul 25 17:22:40.114261 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3577/7070] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:39 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:41.137237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:41.137845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:41.145871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:41.146356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:41.147186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:41.147693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:41.301641 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:41.310024 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-dbe3e86d-b638-440a-8ea2-a1f19b3ec6a3 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.178153 Jul 25 17:22:41.310597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3494/7071] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:41 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:42.336707 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:42.337599 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:42.349618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:42.350395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:42.351719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:42.352479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:42.513668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:42.522459 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-59a72619-8786-4c7c-8143-10e392a27ace tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.192866 Jul 25 17:22:42.523059 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3578/7072] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:42 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:43.548179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:43.549172 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:43.559554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:43.560025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:43.560769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:43.561222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:43.726367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:43.735451 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-45ed28bf-91f2-4571-a8ad-49da675af92f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.193807 Jul 25 17:22:43.736035 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3495/7073] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:43 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:44.227521 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:22:44.227851 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:22:44.612105 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:22:44.612767 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:22:44.759996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:44.761049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:44.772893 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:44.773737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:44.775033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:44.775846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:44.921109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:44.933007 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f434b1b5-f1a4-480d-9d2e-57dc3c1c8d76 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.179633 Jul 25 17:22:44.933634 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3579/7074] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:44 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:45.957939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:45.958902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:45.970279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:45.971013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:45.972246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:45.972958 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:46.140665 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:46.149330 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-38d24e1d-5888-43f4-8042-24a8e979d3cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.197908 Jul 25 17:22:46.149909 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3496/7075] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:45 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:47.174922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:47.175529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:47.185016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:47.185516 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:47.186305 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:47.186753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:47.341335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:47.354490 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4d72e0a1-6ced-4f0d-a2ca-b4d172834f86 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.185827 Jul 25 17:22:47.355084 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3580/7076] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:47 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:48.376039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:48.376597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:48.384042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:48.384479 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:48.385369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:48.385792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:48.534332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:48.545953 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cfec7d4f-21fa-43fa-bead-1639673bc3b2 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.173457 Jul 25 17:22:48.546702 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3497/7077] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:48 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:49.575036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:49.575637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:49.582872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:49.583368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:49.584163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:49.584619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:49.737291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:49.750216 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-48f706dc-928b-449c-b2cd-ca3e8c407daf tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.180854 Jul 25 17:22:49.751055 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3581/7078] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:49 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:50.778985 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:50.780046 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:50.791672 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:50.792421 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:50.793752 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:50.794475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:50.953055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:50.961363 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-02620132-13c4-4ce2-aaa3-762086f4ab72 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.189040 Jul 25 17:22:50.961938 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3498/7079] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:50 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:51.987519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:51.988551 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:52.000276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:52.001054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:52.002483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:52.003245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:52.158020 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:52.169193 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0563fe1d-c46e-4895-b51d-e575bac01c0d tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1762 microversion: 2.1 time: 0.188629 Jul 25 17:22:52.169783 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3582/7080] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:51 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1762 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:22:53.193328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:22:53.194297 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:22:53.204155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:53.204695 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:53.205931 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:22:53.206477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:22:53.361544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:22:53.369706 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99dbb6b0-c8f7-4cd4-abf5-fa083e3bdd4f tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1765 microversion: 2.1 time: 0.181712 Jul 25 17:22:53.370318 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3499/7081] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:22:53 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1765 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:01.852521 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=16 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:01.853295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:01.858442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1853903351"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:01.859008 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:01.867669 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:01.868193 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:01.868995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:01.869479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:02.076083 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.network.security_group_api [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Removing security group 86c4c352-c7e4-485e-ac11-30ef2ec49cb0 from port 46298048-051d-447f-9dbc-39643d78a508 Jul 25 17:24:02.423785 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-55364889-ebfb-4e38-90b8-819d07608fbe tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/action" status: 202 len: 0 microversion: 2.1 time: 0.573574 Jul 25 17:24:02.424586 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3583/7082] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:24:01 2022] POST /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:24:02.437239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=16 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:02.440737 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=48 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:02.457371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:02.493605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:02.494381 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:02.507027 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] Creating event network-changed:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:24:02.511341 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] [289290ad-9203-4a63-ae43-b1a817182cc4] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:24:03.519731 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] [289290ad-9203-4a63-ae43-b1a817182cc4] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 50080. Jul 25 17:24:03.523930 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cc5b2516-9038-4be3-aa0d-61fe2be58330 req-fb142377-5504-4c9b-85e0-374e8fb5d35f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.088874 Jul 25 17:24:03.524597 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3500/7083] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:03.972772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:03.973951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:03.980527 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:03.981000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:03.981817 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:03.982283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:04.071903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lazy-loading 'services' on Instance uuid d27483e0-5e85-4797-8879-4d2e60abd3b8 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:24:04.151271 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6de454d7-1c24-40c9-aad3-2a629806bc78 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments/a21ea303-f913-4595-a741-3448d19a0cf7" status: 202 len: 0 microversion: 2.1 time: 0.182653 Jul 25 17:24:04.151271 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3584/7084] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:24:03 2022] DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments/a21ea303-f913-4595-a741-3448d19a0cf7 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:24:04.160408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:04.163194 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:04.171380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:04.172346 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:04.173511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:04.174137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:04.205297 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-91cd8e3f-6495-4f54-9894-a7e5143743cb tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049299 Jul 25 17:24:04.206173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3501/7085] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:24:04 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:24:05.219971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:05.222438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:05.230750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:05.231212 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:05.232003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:05.232456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:05.263258 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1a7c08af-2f86-4dda-a1e5-4acb332160ae tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048309 Jul 25 17:24:05.263880 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3585/7086] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:24:05 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:05.543073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-50380472-1b40-4e96-b396-e1c5fa560232 req-885fec39-03e9-491e-9e6e-7f72e7a191b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:05.553837 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-50380472-1b40-4e96-b396-e1c5fa560232 req-885fec39-03e9-491e-9e6e-7f72e7a191b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:05.554282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-50380472-1b40-4e96-b396-e1c5fa560232 req-885fec39-03e9-491e-9e6e-7f72e7a191b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:05.566339 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-50380472-1b40-4e96-b396-e1c5fa560232 req-885fec39-03e9-491e-9e6e-7f72e7a191b6 service nova] Creating event network-changed:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:24:05.571471 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-50380472-1b40-4e96-b396-e1c5fa560232 req-885fec39-03e9-491e-9e6e-7f72e7a191b6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032420 Jul 25 17:24:05.572075 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3502/7087] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:06.276986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:06.279421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:06.287868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:06.288434 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:06.289546 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:06.290002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:06.320784 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ed38f3f8-6796-480f-bcff-5b9b3b9dbe29 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048497 Jul 25 17:24:06.321352 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3586/7088] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:24:06 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:07.335166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:07.337539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:07.344533 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:07.344984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:07.345785 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:07.346221 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:07.379422 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03cec7d5-8697-4a62-a801-dd7f437e1b63 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049566 Jul 25 17:24:07.379971 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3503/7089] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:24:07 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:08.392388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:08.394489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:08.401816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:08.402277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:08.403062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:08.403535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:08.433042 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7fe403ec-2542-4b9a-8f3d-a7563c55ee80 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Jul 25 17:24:08.433872 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3587/7090] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:24:08 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:09.449186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:09.452628 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:09.464039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:09.464485 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:09.465289 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:09.465717 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:09.493928 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec7f85a6-4481-488a-9a81-42fe955c3898 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051517 Jul 25 17:24:09.494476 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3504/7091] 10.222.0.105 () {58 vars in 1307 bytes} [Mon Jul 25 17:24:09 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 17:24:09.505362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:09.506485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:09.514293 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:09.514811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:09.515697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:09.516158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:09.605878 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] HTTP exception thrown: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 is not attached to volume a21ea303-f913-4595-a741-3448d19a0cf7 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Request method failure captured: Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: request: DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments/a21ea303-f913-4595-a741-3448d19a0cf7 HTTP/1.1 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3s-Zso68O3MRE0P6IqjveiUb_N73l23Z71zMdAvx0Ea5krCIljS8HSjIzM86t_evCGKr24QSBckGMx-5md_xJ1O3zzSP8LoTC5jz3ru0BHdjvlhtCl4kQVH5RFS2eT7X1R6p1ib7Y0Ax4KjeYsAr--0XmQ85wLhk4gT28tndtHGlk3c Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e309fcf5e5d47ddb1d8a304c172a3c4"}]}] Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: 71681b3afa6041178cbb1a532ea387ce Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 is not attached to volume a21ea303-f913-4595-a741-3448d19a0cf7 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'server_id': 'd27483e0-5e85-4797-8879-4d2e60abd3b8', 'id': 'a21ea303-f913-4595-a741-3448d19a0cf7'} Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a21ea303-f913-4595-a741-3448d19a0cf7. Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 is not attached to volume a21ea303-f913-4595-a741-3448d19a0cf7 Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:24:09.607565 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 is not attached to volume a21ea303-f913-4595-a741-3448d19a0cf7 Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Returning 404 to user: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 is not attached to volume a21ea303-f913-4595-a741-3448d19a0cf7 {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e9ac6ce1-2b1c-4388-95c4-39a5f16ad674 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments/a21ea303-f913-4595-a741-3448d19a0cf7" status: 404 len: 154 microversion: 2.1 time: 0.107848 Jul 25 17:24:09.611456 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3588/7092] 10.222.0.105 () {58 vars in 1421 bytes} [Mon Jul 25 17:24:09 2022] DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8/os-volume_attachments/a21ea303-f913-4595-a741-3448d19a0cf7 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:24:12.894922 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:12.895411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:12.902823 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:12.903288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:12.904056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:12.904495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:12.929365 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:24:13.013349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-95859502-6f24-4852-81b8-f9541e7edbc4 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 204 len: 0 microversion: 2.1 time: 0.121716 Jul 25 17:24:13.018154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3505/7093] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:24:12 2022] DELETE /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:24:13.023986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:13.024666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:13.032736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:13.033252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:13.034300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:13.034970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:13.170475 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:13.178418 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f8e0d5a6-f405-46e0-b862-551c0201bed8 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1559 microversion: 2.1 time: 0.158876 Jul 25 17:24:13.179002 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3589/7094] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:13 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:14.205202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:14.206233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:14.216049 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:14.216486 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:14.217267 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:14.217690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:14.404625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:14.412886 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ee9b2144-db24-4c85-a471-5016fbbe0b1e tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1559 microversion: 2.1 time: 0.215040 Jul 25 17:24:14.413497 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3506/7095] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:14 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:15.437849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:15.438638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:15.447143 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:15.447606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:15.448389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:15.448845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:15.595937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:15.603965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b9c90f4c-a5af-4b68-9da8-22a780dc1283 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1559 microversion: 2.1 time: 0.171177 Jul 25 17:24:15.605460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3590/7096] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:15 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:16.067265 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-add41e98-23f7-4bda-be54-cd67c2b529c3 req-1f1fcfab-4275-40b2-97fb-091968642d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27483e0-5e85-4797-8879-4d2e60abd3b8", "name": "network-vif-deleted", "tag": "46298048-051d-447f-9dbc-39643d78a508"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:16.078225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-add41e98-23f7-4bda-be54-cd67c2b529c3 req-1f1fcfab-4275-40b2-97fb-091968642d7b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:16.078685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-add41e98-23f7-4bda-be54-cd67c2b529c3 req-1f1fcfab-4275-40b2-97fb-091968642d7b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:16.089853 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-add41e98-23f7-4bda-be54-cd67c2b529c3 req-1f1fcfab-4275-40b2-97fb-091968642d7b service nova] Creating event network-vif-deleted:46298048-051d-447f-9dbc-39643d78a508 for instance d27483e0-5e85-4797-8879-4d2e60abd3b8 on n-h1-846219-13 Jul 25 17:24:16.095073 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-add41e98-23f7-4bda-be54-cd67c2b529c3 req-1f1fcfab-4275-40b2-97fb-091968642d7b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031692 Jul 25 17:24:16.095711 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3507/7097] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:16.625843 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:16.626446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:16.633189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:16.633656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:16.634422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:16.634884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:16.667137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:16.667567 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:16.668035 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lazy-loading 'fault' on Instance uuid d27483e0-5e85-4797-8879-4d2e60abd3b8 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:24:16.708797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71681b3afa6041178cbb1a532ea387ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e309fcf5e5d47ddb1d8a304c172a3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:16.717061 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4ed3f18a-2255-45f0-be2a-0282b48f9f56 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 200 len: 1352 microversion: 2.1 time: 0.095387 Jul 25 17:24:16.717752 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3591/7098] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:16 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:17.745477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:17.746192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] [instance: d27483e0-5e85-4797-8879-4d2e60abd3b8] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:17.753435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:17.753914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:17.754741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:17.755192 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:17.769519 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] HTTP exception thrown: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 could not be found. Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Request method failure captured: Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 HTTP/1.1 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3s-Zso68O3MRE0P6IqjveiUb_N73l23Z71zMdAvx0Ea5krCIljS8HSjIzM86t_evCGKr24QSBckGMx-5md_xJ1O3zzSP8LoTC5jz3ru0BHdjvlhtCl4kQVH5RFS2eT7X1R6p1ib7Y0Ax4KjeYsAr--0XmQ85wLhk4gT28tndtHGlk3c Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/0e309fcf5e5d47ddb1d8a304c172a3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_0e309fcf5e5d47ddb1d8a304c172a3c4"}]}] Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 0e309fcf5e5d47ddb1d8a304c172a3c4 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2047660742 Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: 71681b3afa6041178cbb1a532ea387ce Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestMinimumBasicScenario-2047660742-project Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 could not be found. Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'd27483e0-5e85-4797-8879-4d2e60abd3b8'} Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 could not be found. Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 could not be found. Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:24:17.771233 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 could not be found. Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Returning 404 to user: Instance d27483e0-5e85-4797-8879-4d2e60abd3b8 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5d49183-9916-4c93-9d1b-b0f9738f50ab tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8" status: 404 len: 111 microversion: 2.1 time: 0.035576 Jul 25 17:24:17.775994 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3508/7099] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:17 2022] GET /compute/v2.1/servers/d27483e0-5e85-4797-8879-4d2e60abd3b8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:24:17.782101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b016bafa-862e-413b-94cb-48607406fe58 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] Calling method '.version_select at 0x7f9d93845b80>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:17.805290 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b016bafa-862e-413b-94cb-48607406fe58 tempest-TestMinimumBasicScenario-2047660742 tempest-TestMinimumBasicScenario-2047660742-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-449603401" status: 202 len: 0 microversion: 2.1 time: 0.027235 Jul 25 17:24:17.805914 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3592/7100] 10.222.0.105 () {58 vars in 1274 bytes} [Mon Jul 25 17:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-449603401 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:24:23.866292 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:24:23.867178 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:24:27.396901 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-99e402c4-43d1-466c-a36c-37c0e9b60b07 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: .version_select at 0x7f9d9259c1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1073083407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCpbM+yzCef8QteJXLplV+RbISDi6f/Rv1i3XpUeLoOt+UUXLMPWg7he7JXZOGDwY6hE+EZitbBO6QhrbmRII6ayOBkEM4VpNQD1R5+0o7F3Z0v+WowhYqZchFqRRT2nQ=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:27.414072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-99e402c4-43d1-466c-a36c-37c0e9b60b07 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:24:27.419488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-99e402c4-43d1-466c-a36c-37c0e9b60b07 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:24:27.449995 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-99e402c4-43d1-466c-a36c-37c0e9b60b07 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.248804 Jul 25 17:24:27.450809 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3509/7101] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:24:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:33.727701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:33.728996 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:33.735329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1616845766", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "ccf9bc6c-0397-40bb-aba2-7ed5f5ad6685"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1073083407", "security_groups": [{"name": "tempest-secgroup-smoke-1449011449"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:33.857272 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] validate_networks() for [('ccf9bc6c-0397-40bb-aba2-7ed5f5ad6685', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:24:34.347074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:24:34.347717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:24:34.348210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:24:34.348632 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:24:34.349247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:24:34.358970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:34.359435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:34.360252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:34.360699 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:34.378213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:24:34.383522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:24:34.396275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:24:34.398600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:24:34.462725 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d546b11-98b7-4c19-b65f-6316cc0c0414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.736719 Jul 25 17:24:34.463472 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3593/7102] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:24:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:24:34.475429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-69d813a4-1947-4451-be27-2c1258f3ca16 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:34.476113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-69d813a4-1947-4451-be27-2c1258f3ca16 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:34.478397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:34.482275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:34.543673 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-69d813a4-1947-4451-be27-2c1258f3ca16 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:34.551279 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-69d813a4-1947-4451-be27-2c1258f3ca16 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1271 microversion: 2.1 time: 0.080170 Jul 25 17:24:34.551947 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3510/7103] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:34 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:35.575245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5fb77718-ed48-4550-9db1-07c9ae9d4238 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:35.575878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5fb77718-ed48-4550-9db1-07c9ae9d4238 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:35.649002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5fb77718-ed48-4550-9db1-07c9ae9d4238 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:35.661796 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5fb77718-ed48-4550-9db1-07c9ae9d4238 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1271 microversion: 2.1 time: 0.091550 Jul 25 17:24:35.662986 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3594/7104] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:35 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:36.685491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b47092a0-f270-44da-80e4-430d2bc39953 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:36.686098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b47092a0-f270-44da-80e4-430d2bc39953 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:36.741914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b47092a0-f270-44da-80e4-430d2bc39953 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:36.749008 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b47092a0-f270-44da-80e4-430d2bc39953 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1271 microversion: 2.1 time: 0.069116 Jul 25 17:24:36.749663 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3511/7105] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:36 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1271 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:37.770177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a464af03-b496-4b77-90c9-1323104d4aa2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:37.770757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a464af03-b496-4b77-90c9-1323104d4aa2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:37.828101 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a464af03-b496-4b77-90c9-1323104d4aa2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:37.836260 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a464af03-b496-4b77-90c9-1323104d4aa2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1271 microversion: 2.1 time: 0.069831 Jul 25 17:24:37.837161 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3595/7106] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:37 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1271 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:38.862832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:38.863805 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:38.874133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:38.874578 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:38.875330 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:38.875760 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:38.944184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:38.956581 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c0ff3636-70b4-4963-8e79-c801bf0f8d74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1275 microversion: 2.1 time: 0.099919 Jul 25 17:24:38.957516 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3512/7107] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:38 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:39.980659 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:39.981340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:39.989277 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:39.989748 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:39.990539 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:39.990991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:40.075252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:40.082949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5d59b902-f2e0-4038-b741-d2b72dc99eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1329 microversion: 2.1 time: 0.106860 Jul 25 17:24:40.083547 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3596/7108] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:39 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1329 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:41.106398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:41.107002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:41.114783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:41.115279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:41.117393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:41.118164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:41.326679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:41.334470 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-19350df8-63cb-4c25-91fa-720cd0c3594b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1397 microversion: 2.1 time: 0.232538 Jul 25 17:24:41.335059 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3513/7109] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:41 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:41.383803 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-491a9b8a-3b42-463f-b18e-7eeae83c5129 req-44363f44-db99-4f9f-8027-0902b3bbd378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bce780-b782-447c-acd7-ba811637fcdf", "tag": "3b156c06-e032-42fd-8ae0-5a7523571f0a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:41.398906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-491a9b8a-3b42-463f-b18e-7eeae83c5129 req-44363f44-db99-4f9f-8027-0902b3bbd378 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:41.399552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-491a9b8a-3b42-463f-b18e-7eeae83c5129 req-44363f44-db99-4f9f-8027-0902b3bbd378 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:41.414561 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-491a9b8a-3b42-463f-b18e-7eeae83c5129 req-44363f44-db99-4f9f-8027-0902b3bbd378 service nova] Creating event network-changed:3b156c06-e032-42fd-8ae0-5a7523571f0a for instance b4bce780-b782-447c-acd7-ba811637fcdf on n-h2-846219-13 Jul 25 17:24:41.420599 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-491a9b8a-3b42-463f-b18e-7eeae83c5129 req-44363f44-db99-4f9f-8027-0902b3bbd378 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040765 Jul 25 17:24:41.421817 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3597/7110] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:42.358783 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:42.359445 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:42.368435 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:42.368990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:42.369966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:42.370499 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:42.518990 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:42.527112 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6cc02ba-31e9-4ed7-bda8-1570c4e71e81 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1397 microversion: 2.1 time: 0.174342 Jul 25 17:24:42.527664 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3514/7111] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:42 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1397 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:43.549312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:43.549921 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:43.558075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:43.558550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:43.559388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:43.559836 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:43.696858 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:43.704653 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35283c89-212d-4f97-b3af-312d20cf34dc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1397 microversion: 2.1 time: 0.159744 Jul 25 17:24:43.705314 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3598/7112] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:43 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:44.728393 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:44.729418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:44.739547 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:44.740219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:44.741354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:44.741974 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:44.876245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:44.884040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3fb2b14b-e6e0-4fbc-9ad3-8f62f0863ab3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1397 microversion: 2.1 time: 0.161488 Jul 25 17:24:44.884594 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3515/7113] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:44 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1397 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:45.906970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:45.908056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:45.910822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:45.917739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:45.918006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:45.919006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:45.919548 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:46.034671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-64385125-5219-4d75-8f5d-b84cdc8fbb22 req-6da4ce13-d0c9-4943-8628-e34f0c00f5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bce780-b782-447c-acd7-ba811637fcdf", "name": "network-vif-plugged", "status": "completed", "tag": "3b156c06-e032-42fd-8ae0-5a7523571f0a"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:46.047074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-64385125-5219-4d75-8f5d-b84cdc8fbb22 req-6da4ce13-d0c9-4943-8628-e34f0c00f5b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:46.047585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-64385125-5219-4d75-8f5d-b84cdc8fbb22 req-6da4ce13-d0c9-4943-8628-e34f0c00f5b6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:46.061612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:46.069436 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3e0f14cf-1a80-42d6-a742-34d5e4ebf85f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1397 microversion: 2.1 time: 0.168241 Jul 25 17:24:46.080252 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-64385125-5219-4d75-8f5d-b84cdc8fbb22 req-6da4ce13-d0c9-4943-8628-e34f0c00f5b6 service nova] Creating event network-vif-plugged:3b156c06-e032-42fd-8ae0-5a7523571f0a for instance b4bce780-b782-447c-acd7-ba811637fcdf on n-h2-846219-13 Jul 25 17:24:46.080833 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3599/7114] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:45 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1397 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:46.081027 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-64385125-5219-4d75-8f5d-b84cdc8fbb22 req-6da4ce13-d0c9-4943-8628-e34f0c00f5b6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044751 Jul 25 17:24:46.081027 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3516/7115] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:24:47.090895 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:47.091555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:47.098947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:47.099411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:47.100204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:47.100648 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:47.245495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:47.253500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5b27e359-695b-4c70-ab19-8c01a01adf04 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1397 microversion: 2.1 time: 0.166801 Jul 25 17:24:47.254163 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3600/7116] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:47 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1397 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:48.279859 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:48.281037 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:48.284166 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=8 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:48.295320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:48.296108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:48.297477 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:48.298448 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:48.441128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:48.448934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-63112575-ca2f-40f5-bb87-ebc155662429 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1568 microversion: 2.1 time: 0.176206 Jul 25 17:24:48.449555 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3517/7117] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:48 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:48.469736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:48.470357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:48.472409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:24:48.478418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:48.478877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:48.479640 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:48.480399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:48.622984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:48.630846 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e434bef2-9f2d-4887-bea7-9085559a20a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1568 microversion: 2.1 time: 0.165186 Jul 25 17:24:48.631426 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3601/7118] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:48 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:24:50.628304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:24:50.629225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:24:50.631789 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-d884c3c0-28e8-422e-9f26-7c1b7d26cdeb req-8e6d45e3-6391-44c1-ab2f-95aa7b8ad9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bce780-b782-447c-acd7-ba811637fcdf", "tag": "3b156c06-e032-42fd-8ae0-5a7523571f0a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:24:50.637914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:50.638626 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:50.639757 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:50.641642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:50.644788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d884c3c0-28e8-422e-9f26-7c1b7d26cdeb req-8e6d45e3-6391-44c1-ab2f-95aa7b8ad9f1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:24:50.645335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-d884c3c0-28e8-422e-9f26-7c1b7d26cdeb req-8e6d45e3-6391-44c1-ab2f-95aa7b8ad9f1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:24:50.657242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-d884c3c0-28e8-422e-9f26-7c1b7d26cdeb req-8e6d45e3-6391-44c1-ab2f-95aa7b8ad9f1 service nova] Creating event network-changed:3b156c06-e032-42fd-8ae0-5a7523571f0a for instance b4bce780-b782-447c-acd7-ba811637fcdf on n-h2-846219-13 Jul 25 17:24:50.662790 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-d884c3c0-28e8-422e-9f26-7c1b7d26cdeb req-8e6d45e3-6391-44c1-ab2f-95aa7b8ad9f1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036190 Jul 25 17:24:50.663460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3602/7119] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:24:50.870798 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:24:50.881743 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f847296d-8621-4ea7-b5b7-c3e93111852c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1568 microversion: 2.1 time: 0.257704 Jul 25 17:24:50.882335 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3518/7120] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:24:50 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:14.281623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:14.282398 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=36 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:14.287628 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:14.289982 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:14.298066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:14.298540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:14.299306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:14.299791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:14.352651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a7c1fdde-079b-4176-8262-e9b8c8882d2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action" status: 200 len: 24559 microversion: 2.1 time: 0.073760 Jul 25 17:25:14.353336 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3603/7121] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:25:14 2022] POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action => generated 24559 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:25:20.730286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:20.730893 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:20.732871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=21 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:20.733512 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=38 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:20.739650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:20.740093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:20.740845 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:20.741304 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:20.817713 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4a909e45-ca01-4a47-837e-7c40247f2efd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action" status: 202 len: 0 microversion: 2.1 time: 0.091882 Jul 25 17:25:20.818426 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3519/7122] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:25:20 2022] POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:25:20.827781 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:20.828483 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:20.835941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:20.836446 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:20.837268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:20.837700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:20.978545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:20.987147 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c3034816-9b56-4c30-86c8-760da20832d4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1692 microversion: 2.1 time: 0.163769 Jul 25 17:25:20.987664 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3604/7123] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:20 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:22.015871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:22.017014 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:22.024726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:22.025214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:22.025977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:22.026439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:22.162545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:22.170680 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bb0946f9-1d87-480f-8393-3d3f72c40e33 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1672 microversion: 2.1 time: 0.163536 Jul 25 17:25:22.171262 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3520/7124] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:22 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:23.272725 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:23.276365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:23.293140 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:23.293678 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:23.295026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:23.295499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:23.349502 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f5d07ad-98d4-4cc1-8ed8-d7e54c497a1e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action" status: 200 len: 32628 microversion: 2.1 time: 0.083008 Jul 25 17:25:23.350159 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3605/7125] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:25:23 2022] POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action => generated 32628 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:25:23.362044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:23.362572 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:23.369765 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:23.370210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:23.370955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:23.371379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:23.442372 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b5604456-2464-4ec7-a016-862c7514ddf3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action" status: 202 len: 0 microversion: 2.1 time: 0.084013 Jul 25 17:25:23.443198 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3521/7126] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:25:23 2022] POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 17:25:23.452798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:23.453550 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:23.461128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:23.461711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:23.462566 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:23.463025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:23.599618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:23.609284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-871239e6-6105-452f-9dfa-72f5e21d2499 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1679 microversion: 2.1 time: 0.160662 Jul 25 17:25:23.610375 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3606/7127] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:23 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:24.634050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:24.634753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:24.642358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:24.642811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:24.643635 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:24.644072 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:24.783396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:24.795330 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37725d49-44ab-458f-82db-580c3908af62 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1687 microversion: 2.1 time: 0.165423 Jul 25 17:25:24.796258 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3522/7128] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:24 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:24.906131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:24.908568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:24.917332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:24.917840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:24.918642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:24.919106 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:24.968494 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ef3aa720-a831-487c-8dc9-a429d196a4bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action" status: 200 len: 35968 microversion: 2.1 time: 0.066350 Jul 25 17:25:24.969139 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3607/7129] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:25:24 2022] POST /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf/action => generated 35968 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:25:26.040794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-86d94f09-3470-4493-aff5-218aedb879e4 req-347a23ed-5055-4648-997b-16b80a8a4a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bce780-b782-447c-acd7-ba811637fcdf", "tag": "3b156c06-e032-42fd-8ae0-5a7523571f0a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:26.044889 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:26.045496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:26.054554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:26.055074 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:26.056093 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:26.056259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-86d94f09-3470-4493-aff5-218aedb879e4 req-347a23ed-5055-4648-997b-16b80a8a4a3a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:26.056800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:26.061846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-86d94f09-3470-4493-aff5-218aedb879e4 req-347a23ed-5055-4648-997b-16b80a8a4a3a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:26.074199 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-86d94f09-3470-4493-aff5-218aedb879e4 req-347a23ed-5055-4648-997b-16b80a8a4a3a service nova] Creating event network-changed:3b156c06-e032-42fd-8ae0-5a7523571f0a for instance b4bce780-b782-447c-acd7-ba811637fcdf on n-h2-846219-13 Jul 25 17:25:26.079806 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-86d94f09-3470-4493-aff5-218aedb879e4 req-347a23ed-5055-4648-997b-16b80a8a4a3a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042971 Jul 25 17:25:26.080443 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3608/7130] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:25:26.086023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:25:26.167675 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3dee9f4f-2396-4e8b-a1b4-ae6abca803bd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 204 len: 0 microversion: 2.1 time: 0.132861 Jul 25 17:25:26.168364 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3523/7131] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:25:26 2022] DELETE /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:25:26.178724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:26.179714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:26.187455 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:26.187927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:26.188742 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:26.189235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:26.350359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:26.358688 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-42b4de61-ed3a-412c-86b0-d6dd804565f7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1693 microversion: 2.1 time: 0.185213 Jul 25 17:25:26.359280 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3609/7132] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:26 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:27.386331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:27.387720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:27.397660 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:27.398112 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:27.398885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:27.399321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:27.607997 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:27.616661 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-717fa358-f8fa-4145-ab95-4b7043cc2dd3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1693 microversion: 2.1 time: 0.237611 Jul 25 17:25:27.617284 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3524/7133] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:27 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1693 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:25:28.511175 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-70c66918-d4be-4830-8345-09846f090fc8 req-f3fc4397-7208-4d85-831f-8ab16a43d24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bce780-b782-447c-acd7-ba811637fcdf", "name": "network-vif-deleted", "tag": "3b156c06-e032-42fd-8ae0-5a7523571f0a"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:28.521969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-70c66918-d4be-4830-8345-09846f090fc8 req-f3fc4397-7208-4d85-831f-8ab16a43d24f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:28.522432 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-70c66918-d4be-4830-8345-09846f090fc8 req-f3fc4397-7208-4d85-831f-8ab16a43d24f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:28.534120 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-70c66918-d4be-4830-8345-09846f090fc8 req-f3fc4397-7208-4d85-831f-8ab16a43d24f service nova] Creating event network-vif-deleted:3b156c06-e032-42fd-8ae0-5a7523571f0a for instance b4bce780-b782-447c-acd7-ba811637fcdf on n-h2-846219-13 Jul 25 17:25:28.539140 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-70c66918-d4be-4830-8345-09846f090fc8 req-f3fc4397-7208-4d85-831f-8ab16a43d24f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Jul 25 17:25:28.539847 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3610/7134] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:25:28.637956 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:28.639239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:28.646356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:28.646803 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:28.647577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:28.648001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:28.679429 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:28.679858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:28.680296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lazy-loading 'fault' on Instance uuid b4bce780-b782-447c-acd7-ba811637fcdf {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:25:28.724398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:28.732487 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c5f17d6d-d691-4a64-8494-2e38c66f027c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 200 len: 1361 microversion: 2.1 time: 0.098435 Jul 25 17:25:28.733017 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3525/7135] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:28 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 1361 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:29.760119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:29.761321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: b4bce780-b782-447c-acd7-ba811637fcdf] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:29.772968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:29.773846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:29.775229 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:29.775991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:29.797053 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] HTTP exception thrown: Instance b4bce780-b782-447c-acd7-ba811637fcdf could not be found. Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Request method failure captured: Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf HTTP/1.1 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3tHKCJgXFX3nJcsyGcROuseQgXybxRoWfxhO4_N3tc_um8LijkfQPyWl4H_zy1TeMZLOguAPzHuNa_75O0UiKN90UpufFRx59CPVUvbTXRx0Q17zyPpAc27Eb1bG5_y-KmzyOXkefBcgWHAZUMoylhyaKcq9p4h92MtCkHSgHcv5jcc Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8e57e08e1a77434e8f1d157391faddb4"}]}] Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: cc3e0531772d468399c99a8ff4f65226 Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance b4bce780-b782-447c-acd7-ba811637fcdf could not be found. Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'b4bce780-b782-447c-acd7-ba811637fcdf'} Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4bce780-b782-447c-acd7-ba811637fcdf could not be found. Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4bce780-b782-447c-acd7-ba811637fcdf could not be found. Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:25:29.798765 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4bce780-b782-447c-acd7-ba811637fcdf could not be found. Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Returning 404 to user: Instance b4bce780-b782-447c-acd7-ba811637fcdf could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2f5bcee2-4ef9-4565-bc4a-c12d67578f8e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf" status: 404 len: 111 microversion: 2.1 time: 0.048755 Jul 25 17:25:29.802983 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3611/7136] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:29 2022] GET /compute/v2.1/servers/b4bce780-b782-447c-acd7-ba811637fcdf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:25:32.969594 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12a38a1e-c043-465d-8944-58d71c4229b6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '.version_select at 0x7f9d92553280>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:32.990402 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12a38a1e-c043-465d-8944-58d71c4229b6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1073083407" status: 202 len: 0 microversion: 2.1 time: 0.024921 Jul 25 17:25:32.991099 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3526/7137] 10.222.0.105 () {58 vars in 1289 bytes} [Mon Jul 25 17:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1073083407 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:25:33.019462 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5a3827f3-3d21-4399-bea2-1e2815ae59f0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: .version_select at 0x7f9d927a5280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1792041541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkV+Tq4a2RZNg2UxL1VdJBCNklhNSLhwgH2ptwKQZU0GOr3BCH0twSa9tZ8K5fTNegHTOR7zGLXt/oA4vto9EJ7cCBZFG8pi7rMsWYQeYjGlMkPWA3KrBiRrVjAUQCc+w=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:33.038045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5a3827f3-3d21-4399-bea2-1e2815ae59f0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:25:33.043647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-5a3827f3-3d21-4399-bea2-1e2815ae59f0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:25:33.068732 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5a3827f3-3d21-4399-bea2-1e2815ae59f0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053278 Jul 25 17:25:33.069380 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3612/7138] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:25:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:25:39.075023 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:39.079888 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-701088916", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "65ad3e2c-cc4a-457f-9994-3dfc50683c6e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1792041541", "security_groups": [{"name": "tempest-secgroup-smoke-490751739"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:39.210130 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] validate_networks() for [('65ad3e2c-cc4a-457f-9994-3dfc50683c6e', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:25:39.656396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:25:39.656817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:25:39.657318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:25:39.657730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:25:39.658139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:25:39.667814 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:39.668526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:39.669372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:39.669812 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:39.689774 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:25:39.695787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:25:39.709627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:25:39.712286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:25:39.764093 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ba85d46-7fa5-4751-a264-c06ce23023a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.690647 Jul 25 17:25:39.765343 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3527/7139] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:25:39 2022] POST /compute/v2.1/servers => generated 407 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:25:39.778324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1015ec49-acfa-478d-89e1-08f4accb2da5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:39.779525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1015ec49-acfa-478d-89e1-08f4accb2da5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:39.784816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=36 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:39.838577 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1015ec49-acfa-478d-89e1-08f4accb2da5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:39.845544 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1015ec49-acfa-478d-89e1-08f4accb2da5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1270 microversion: 2.1 time: 0.072837 Jul 25 17:25:39.846167 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3613/7140] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:39 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1270 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:25:40.866892 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b3dafe7b-4391-4cbe-b09e-7ff0de203159 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:40.868957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b3dafe7b-4391-4cbe-b09e-7ff0de203159 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:40.926732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b3dafe7b-4391-4cbe-b09e-7ff0de203159 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:40.935277 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b3dafe7b-4391-4cbe-b09e-7ff0de203159 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1270 microversion: 2.1 time: 0.071796 Jul 25 17:25:40.950541 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3528/7141] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:40 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:41.958791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c16071c3-751c-4d78-82db-cbf46195e81e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:41.959493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c16071c3-751c-4d78-82db-cbf46195e81e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:42.025641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c16071c3-751c-4d78-82db-cbf46195e81e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:42.033774 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c16071c3-751c-4d78-82db-cbf46195e81e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1270 microversion: 2.1 time: 0.079104 Jul 25 17:25:42.034449 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3614/7142] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:41 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:43.055300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0a946533-52a5-4697-89e6-71bbece44976 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:43.055890 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0a946533-52a5-4697-89e6-71bbece44976 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:43.113328 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0a946533-52a5-4697-89e6-71bbece44976 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:43.120591 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0a946533-52a5-4697-89e6-71bbece44976 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1270 microversion: 2.1 time: 0.069411 Jul 25 17:25:43.121209 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3529/7143] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:43 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1270 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:44.146291 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:44.147167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:44.160531 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:44.161360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:44.162655 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:44.163350 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:44.226777 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:44.235068 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab8734b7-8e3d-445d-a733-834aa8fb0b7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1274 microversion: 2.1 time: 0.095540 Jul 25 17:25:44.235690 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3615/7144] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:44 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:45.256337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:45.256924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:45.264526 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:45.264995 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:45.265795 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:45.266233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:45.328614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:45.336596 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9f956199-95cf-4f1e-a8a3-7aeacca3299d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1328 microversion: 2.1 time: 0.084544 Jul 25 17:25:45.337213 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3530/7145] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:45 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1328 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:46.358658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:46.359385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:46.362313 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:46.368701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:46.369299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:46.370362 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:46.370812 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:46.538420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:46.547587 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8e8f2f2e-c529-44b2-9388-fbb473300a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.193250 Jul 25 17:25:46.561137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-68d953da-e82e-4615-b4bb-a95f1436ea0f req-c045fc01-e3dc-4ef8-908f-6782991458fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2cb5dfd-430c-4330-ac54-15276c006574", "tag": "c8a28577-5450-4e58-bed7-54cac3b7c643"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:46.561648 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3616/7146] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:46 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:46.564947 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-68d953da-e82e-4615-b4bb-a95f1436ea0f req-c045fc01-e3dc-4ef8-908f-6782991458fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:46.565467 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-68d953da-e82e-4615-b4bb-a95f1436ea0f req-c045fc01-e3dc-4ef8-908f-6782991458fd service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:46.578168 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-68d953da-e82e-4615-b4bb-a95f1436ea0f req-c045fc01-e3dc-4ef8-908f-6782991458fd service nova] Creating event network-changed:c8a28577-5450-4e58-bed7-54cac3b7c643 for instance d2cb5dfd-430c-4330-ac54-15276c006574 on n-h1-846219-13 Jul 25 17:25:46.583255 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-68d953da-e82e-4615-b4bb-a95f1436ea0f req-c045fc01-e3dc-4ef8-908f-6782991458fd service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108999 Jul 25 17:25:46.583934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3531/7147] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:25:47.572338 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:47.573286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:47.585188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:47.586137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:47.586970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:47.587442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:47.735487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:47.744022 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-79d01e3b-1efa-4749-a030-93065fc6df9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.178115 Jul 25 17:25:47.744627 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3617/7148] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:47 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:48.770400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:48.771472 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:48.781546 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:48.782226 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:48.783386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:48.784042 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:48.946434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:48.954624 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ff1a9c10-6366-41e6-b025-941277b67a1a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.192206 Jul 25 17:25:48.955201 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3532/7149] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:48 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:49.976173 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:49.976794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:49.984448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:49.984849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:49.985668 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:49.986115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:50.125770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:50.133538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-72a56151-1143-4d91-98b0-613de07b755b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.161444 Jul 25 17:25:50.134130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3618/7150] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:49 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:51.158833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:51.159877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:51.163113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:51.165966 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:51.174088 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:51.174562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:51.175363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:51.175813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:51.314912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:51.322779 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-35b9ec87-e357-422e-b577-a1cb297d59f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.170488 Jul 25 17:25:51.323427 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3533/7151] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:51 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:52.346153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:52.346872 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:52.350267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:52.357575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:52.358183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:52.359115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:52.359666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:52.500356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:52.508713 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be491e33-7d0a-4e05-80c8-aefe1fb1498e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.167619 Jul 25 17:25:52.509344 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3619/7152] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:52 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:53.321678 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-8775a940-0a2f-44b0-b04b-af7199a3eb51 req-4c2a4948-9f8a-475b-8258-a2cea98e9e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2cb5dfd-430c-4330-ac54-15276c006574", "name": "network-vif-plugged", "status": "completed", "tag": "c8a28577-5450-4e58-bed7-54cac3b7c643"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:53.328953 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:25:53.333608 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8775a940-0a2f-44b0-b04b-af7199a3eb51 req-4c2a4948-9f8a-475b-8258-a2cea98e9e27 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:53.334066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-8775a940-0a2f-44b0-b04b-af7199a3eb51 req-4c2a4948-9f8a-475b-8258-a2cea98e9e27 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:53.348269 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-8775a940-0a2f-44b0-b04b-af7199a3eb51 req-4c2a4948-9f8a-475b-8258-a2cea98e9e27 service nova] Creating event network-vif-plugged:c8a28577-5450-4e58-bed7-54cac3b7c643 for instance d2cb5dfd-430c-4330-ac54-15276c006574 on n-h1-846219-13 Jul 25 17:25:53.353321 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-8775a940-0a2f-44b0-b04b-af7199a3eb51 req-4c2a4948-9f8a-475b-8258-a2cea98e9e27 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035868 Jul 25 17:25:53.354118 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3534/7153] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:25:53.530377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:53.531169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:53.538663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:53.539131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:53.539926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:53.540386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:53.689796 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:53.697870 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3531822c-6def-47cc-a149-300fc7bbe26c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.171603 Jul 25 17:25:53.698461 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3620/7154] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:53 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:54.725044 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:54.726050 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:54.736198 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:54.736645 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:54.737425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:54.737850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:54.888021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:54.897129 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-12861835-aa3b-4cf9-817a-7cfa535031de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1395 microversion: 2.1 time: 0.180836 Jul 25 17:25:54.897908 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3535/7155] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:54 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1395 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:55.922031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:55.923086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:55.935799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:55.936591 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:55.937962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:55.938827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:56.076108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:56.084364 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-239abe70-2af6-4ac7-a42c-23f4f98812f1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1566 microversion: 2.1 time: 0.169127 Jul 25 17:25:56.084955 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3621/7156] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:55 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:56.105577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:56.106235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:56.113290 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:56.113746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:56.114510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:56.114945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:56.249821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:56.261920 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5b40e01e-d61a-4ed7-9ae2-08d963296aef tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1566 microversion: 2.1 time: 0.160379 Jul 25 17:25:56.262744 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3536/7157] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:56 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:25:57.960596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:25:57.961495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:25:57.971315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:57.971785 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:57.972576 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:57.973259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:58.023821 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-922f62fd-bea9-4215-9eb8-c1829ec30bf3 req-1b05c0d3-f2cf-481d-8037-500369001615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2cb5dfd-430c-4330-ac54-15276c006574", "tag": "c8a28577-5450-4e58-bed7-54cac3b7c643"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:25:58.038739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-922f62fd-bea9-4215-9eb8-c1829ec30bf3 req-1b05c0d3-f2cf-481d-8037-500369001615 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:25:58.039462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-922f62fd-bea9-4215-9eb8-c1829ec30bf3 req-1b05c0d3-f2cf-481d-8037-500369001615 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:25:58.051527 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-922f62fd-bea9-4215-9eb8-c1829ec30bf3 req-1b05c0d3-f2cf-481d-8037-500369001615 service nova] Creating event network-changed:c8a28577-5450-4e58-bed7-54cac3b7c643 for instance d2cb5dfd-430c-4330-ac54-15276c006574 on n-h1-846219-13 Jul 25 17:25:58.065399 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-922f62fd-bea9-4215-9eb8-c1829ec30bf3 req-1b05c0d3-f2cf-481d-8037-500369001615 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104902 Jul 25 17:25:58.066151 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3537/7158] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:25:58.117299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:25:58.125359 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-80ac7f72-6f79-447f-bd91-d24549b820b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1566 microversion: 2.1 time: 0.169330 Jul 25 17:25:58.126007 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3622/7159] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:25:57 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:26:39.857941 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=9 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:26:39.859291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=38 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:26:39.864151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:26:39.866442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:26:39.873851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:26:39.874305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:26:39.875068 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:26:39.875501 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:26:39.944187 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-008c9f6f-4bf8-41fa-b17a-a3876b8cda35 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574/action" status: 200 len: 24562 microversion: 2.1 time: 0.090484 Jul 25 17:26:39.944819 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3538/7160] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:26:39 2022] POST /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574/action => generated 24562 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:27:19.105996 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:27:19.106763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=13 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:27:19.107557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=48 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:27:19.112298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:27:19.114717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:19.121679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:19.122149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:19.122927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:19.123385 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:19.208615 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d9a934e6-cdac-4e52-bb80-25a3a112b082 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574/action" status: 202 len: 0 microversion: 2.1 time: 0.104975 Jul 25 17:27:19.209298 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3623/7161] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:27:19 2022] POST /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:27:19.218308 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:19.219015 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:19.222627 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:27:19.223401 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:27:19.228739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:19.229720 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:19.230506 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:19.230926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:19.376605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:19.384423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-577e0bcd-b547-4ca9-bb77-358bd0c6a6eb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1677 microversion: 2.1 time: 0.170590 Jul 25 17:27:19.384982 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3539/7162] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:19 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:20.408218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:20.408938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:20.416466 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:20.416937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:20.417763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:20.418215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:20.421688 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 50588. Jul 25 17:27:20.560287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:20.572557 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2d60a76f-ae14-4f7c-9421-399656511105 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.169887 Jul 25 17:27:20.573539 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3624/7163] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:20 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:21.601371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:21.602592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:21.615683 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:21.616239 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:21.617108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:21.617408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:21.759776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:21.771423 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-53964b77-c812-4bdd-89ae-9fe3907f6507 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.176229 Jul 25 17:27:21.772231 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3540/7164] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:21 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:22.797884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:22.798414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:22.806124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:22.806600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:22.807407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:22.807863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:22.944978 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:22.953446 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-644d8213-c1a4-4e78-a7ae-5aa29aff94ff tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.159516 Jul 25 17:27:22.953995 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3625/7165] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:22 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:23.977371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:23.978225 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:23.989366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:23.990017 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:23.991167 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:23.991787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:24.406681 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:24.414349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-58c7ce12-0c2b-42b0-b8e4-73d36ff24332 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.442394 Jul 25 17:27:24.414921 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3541/7166] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:23 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:25.440337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:25.441402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:25.450365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:25.451103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:25.452172 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:25.452805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:25.602851 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:25.610896 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-63c843de-37d3-483f-a85a-7aec85ce30c0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.177395 Jul 25 17:27:25.611483 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3626/7167] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:25 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:26.637807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:26.638776 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:26.649716 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:26.650187 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:26.650951 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:26.651387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:26.785470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:26.796870 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-542df69c-f278-4067-9888-83dcb0b6ae22 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.165576 Jul 25 17:27:26.797699 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3542/7168] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:26 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:27.823156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:27.823728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:27.831439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:27.831915 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:27.832702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:27.833197 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:27.970492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:27.978676 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-42d465bb-2bcf-422f-a973-7857fa766c68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.160863 Jul 25 17:27:27.979579 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3627/7169] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:27 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:29.008832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:29.009914 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:29.021213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:29.021948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:29.023098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:29.023536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:29.159551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:29.168404 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f4d16cb5-ad0f-46c0-ad95-1cdbe2ea1d5a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.165895 Jul 25 17:27:29.169285 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3543/7170] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:29 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:30.194403 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:30.195389 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:30.207355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:30.208098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:30.209442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:30.210250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:30.359493 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:30.369428 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-fef17ca2-a61e-444b-bcee-18d16a1d18a4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.181643 Jul 25 17:27:30.370039 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3628/7171] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:30 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:31.391830 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:31.392413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:31.399580 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:31.400025 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:31.400780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:31.401238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:31.543082 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:31.551166 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a49f7db0-7a82-4e45-8499-7137f2409605 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.163410 Jul 25 17:27:31.551752 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3544/7172] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:31 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:32.576832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:32.577955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:32.589124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:32.589604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:32.590397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:32.590849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:32.726936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:32.735675 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5763da91-edd8-41e8-90d1-fb5740a61a7e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.165730 Jul 25 17:27:32.736266 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3629/7173] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:32 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:33.757733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:33.758391 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:33.765838 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:33.766291 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:33.767056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:33.767495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:33.911496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:33.923503 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fb05459b-4fc5-4dbc-b5e4-11cc72547f2f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.169441 Jul 25 17:27:33.924264 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3545/7174] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:33 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:34.951445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:34.952507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:34.963541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:34.964014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:34.964807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:34.965299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:35.108916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:35.116910 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a14ecac6-cf0f-4443-a708-bce44208accd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.172065 Jul 25 17:27:35.117532 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3630/7175] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:34 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:36.138869 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:36.139457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:36.146780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:36.147233 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:36.147988 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:36.148417 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:36.286440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:36.294349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2ce4e609-b36f-4d97-9611-a5c5351207fe tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1682 microversion: 2.1 time: 0.159359 Jul 25 17:27:36.294921 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3546/7176] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:36 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:37.320555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:27:37.321540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:27:37.333688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:37.334458 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:37.335778 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:27:37.336515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:27:37.473954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:27:37.486192 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab0c72e1-68bb-40e5-a346-780533cf0ebd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1685 microversion: 2.1 time: 0.171843 Jul 25 17:27:37.486990 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3631/7177] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:27:37 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:27:43.825199 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:27:43.826289 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:27:43.875831 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:27:43.875977 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:27:44.623404 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:27:44.624150 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:28:15.775207 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:28:15.777555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:15.780098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=16 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:15.780784 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=48 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:15.786599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:15.787103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:15.787863 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:15.788274 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:15.870907 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-009d24e2-9d7b-4811-aedd-6116e3ca8287 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574/action" status: 200 len: 69051 microversion: 2.1 time: 0.099203 Jul 25 17:28:15.872032 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3547/7178] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:28:15 2022] POST /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574/action => generated 69051 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:28:39.550631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:39.551859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:39.555195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-534a2391-2eab-4db8-80a7-9ae40541db9d req-9e5344c8-7153-4d3a-883a-59ba23a8c438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2cb5dfd-430c-4330-ac54-15276c006574", "tag": "c8a28577-5450-4e58-bed7-54cac3b7c643"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:28:39.556408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:39.557481 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:39.561811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:39.562462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:39.567517 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:39.568439 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:39.569499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:39.570162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:39.570722 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-534a2391-2eab-4db8-80a7-9ae40541db9d req-9e5344c8-7153-4d3a-883a-59ba23a8c438 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:39.571296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-534a2391-2eab-4db8-80a7-9ae40541db9d req-9e5344c8-7153-4d3a-883a-59ba23a8c438 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:39.583151 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-534a2391-2eab-4db8-80a7-9ae40541db9d req-9e5344c8-7153-4d3a-883a-59ba23a8c438 service nova] Creating event network-changed:c8a28577-5450-4e58-bed7-54cac3b7c643 for instance d2cb5dfd-430c-4330-ac54-15276c006574 on n-h1-846219-13 Jul 25 17:28:39.588509 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-534a2391-2eab-4db8-80a7-9ae40541db9d req-9e5344c8-7153-4d3a-883a-59ba23a8c438 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038555 Jul 25 17:28:39.589638 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3548/7179] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:28:39.604070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:28:39.698419 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-72d03215-81bc-40df-beb9-ff6b126b76ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 204 len: 0 microversion: 2.1 time: 0.149803 Jul 25 17:28:39.703297 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3632/7180] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:28:39 2022] DELETE /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:28:39.709154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:39.709816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:39.716624 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:39.717065 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:39.717847 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:39.718272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:39.852667 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:39.860769 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0069a6ad-3020-4cf3-a509-678796a46ae6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1691 microversion: 2.1 time: 0.155872 Jul 25 17:28:39.861604 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3549/7181] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:39 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:40.886601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:40.887227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:40.896178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:40.896745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:40.897647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:40.898097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:41.048721 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:41.060187 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-17b0536f-f366-4d86-8269-344d05c517da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1691 microversion: 2.1 time: 0.179964 Jul 25 17:28:41.060817 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3633/7182] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:40 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:42.082136 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:42.082732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:42.089648 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:42.090098 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:42.090874 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:42.091305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:42.233840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:42.242166 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-eb64fee3-95cc-4c41-a961-4835a09307bf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1691 microversion: 2.1 time: 0.163948 Jul 25 17:28:42.242712 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3550/7183] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:42 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:42.864422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-49175d68-86f7-4a47-a536-9159c76860ee req-b5984c7c-8511-4514-9e70-a73e55f58df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2cb5dfd-430c-4330-ac54-15276c006574", "name": "network-vif-deleted", "tag": "c8a28577-5450-4e58-bed7-54cac3b7c643"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:28:42.874766 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-49175d68-86f7-4a47-a536-9159c76860ee req-b5984c7c-8511-4514-9e70-a73e55f58df6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:42.875252 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-49175d68-86f7-4a47-a536-9159c76860ee req-b5984c7c-8511-4514-9e70-a73e55f58df6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:42.886685 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-49175d68-86f7-4a47-a536-9159c76860ee req-b5984c7c-8511-4514-9e70-a73e55f58df6 service nova] Creating event network-vif-deleted:c8a28577-5450-4e58-bed7-54cac3b7c643 for instance d2cb5dfd-430c-4330-ac54-15276c006574 on n-h1-846219-13 Jul 25 17:28:42.891495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-49175d68-86f7-4a47-a536-9159c76860ee req-b5984c7c-8511-4514-9e70-a73e55f58df6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030842 Jul 25 17:28:42.892339 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3634/7184] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:28:43.264263 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:43.265652 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:43.273327 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:43.273767 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:43.274625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:43.275086 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:43.306848 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:43.307293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:43.307746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lazy-loading 'fault' on Instance uuid d2cb5dfd-430c-4330-ac54-15276c006574 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:28:43.348680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:43.356959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8d184a06-348b-4814-a046-e7a0a8ffe401 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 200 len: 1360 microversion: 2.1 time: 0.096760 Jul 25 17:28:43.357585 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3551/7185] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:43 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:44.379306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:44.380243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: d2cb5dfd-430c-4330-ac54-15276c006574] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:44.386733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:44.387188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:44.387962 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:44.388405 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:44.401589 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] HTTP exception thrown: Instance d2cb5dfd-430c-4330-ac54-15276c006574 could not be found. Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Request method failure captured: Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 HTTP/1.1 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3tHKCJgXFX3nJcsyGcROuseQgXybxRoWfxhO4_N3tc_um8LijkfQPyWl4H_zy1TeMZLOguAPzHuNa_75O0UiKN90UpufFRx59CPVUvbTXRx0Q17zyPpAc27Eb1bG5_y-KmzyOXkefBcgWHAZUMoylhyaKcq9p4h92MtCkHSgHcv5jcc Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8e57e08e1a77434e8f1d157391faddb4"}]}] Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: cc3e0531772d468399c99a8ff4f65226 Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance d2cb5dfd-430c-4330-ac54-15276c006574 could not be found. Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': 'd2cb5dfd-430c-4330-ac54-15276c006574'} Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2cb5dfd-430c-4330-ac54-15276c006574 could not be found. Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2cb5dfd-430c-4330-ac54-15276c006574 could not be found. Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:28:44.403218 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2cb5dfd-430c-4330-ac54-15276c006574 could not be found. Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Returning 404 to user: Instance d2cb5dfd-430c-4330-ac54-15276c006574 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f4c99e36-d750-4855-87c1-7fe206f39e24 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574" status: 404 len: 111 microversion: 2.1 time: 0.030479 Jul 25 17:28:44.407865 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3635/7186] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:44 2022] GET /compute/v2.1/servers/d2cb5dfd-430c-4330-ac54-15276c006574 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:28:47.722851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-573558d5-7691-450f-9abf-265fb2879e1f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '.version_select at 0x7f9d926665e0>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:47.746735 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-573558d5-7691-450f-9abf-265fb2879e1f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1792041541" status: 202 len: 0 microversion: 2.1 time: 0.027861 Jul 25 17:28:47.747336 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3552/7187] 10.222.0.105 () {58 vars in 1289 bytes} [Mon Jul 25 17:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1792041541 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:28:47.780819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab7d30af-253c-40a0-b24e-2afc673ace08 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: .version_select at 0x7f9d92870310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-838066382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQbxWJsaIjKuAuAMXLqcB1lT5pr3kz5y3bjhvUuIsyUrgUaKAYFSJFqaIBL1CQxv3v8rO2EvFFEXrVk0lVF3t89w92sQCIVrabOMS1Q080FF8pvHs6UPGquUSfcMsWueA=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:28:47.797247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ab7d30af-253c-40a0-b24e-2afc673ace08 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:28:47.803137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-ab7d30af-253c-40a0-b24e-2afc673ace08 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:28:47.829335 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab7d30af-253c-40a0-b24e-2afc673ace08 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052534 Jul 25 17:28:47.829850 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3636/7188] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:28:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:28:53.491552 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=22 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:53.495842 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1768697471", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "edb175a6-fe9d-4053-90e2-2b981fcf01a2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-838066382", "security_groups": [{"name": "tempest-secgroup-smoke-307551104"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:28:53.613647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] validate_networks() for [('edb175a6-fe9d-4053-90e2-2b981fcf01a2', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:28:54.111076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:28:54.111568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:28:54.112147 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:28:54.112632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:28:54.113170 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:28:54.123284 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:54.123813 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:54.124670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:54.125122 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:54.142981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:28:54.148558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:28:54.162364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:28:54.164939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:28:54.218436 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-03eed7da-0292-4ba8-a6e5-a374978ce453 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.729030 Jul 25 17:28:54.221147 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3553/7189] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:28:53 2022] POST /compute/v2.1/servers => generated 407 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:28:54.231886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6d9f5cc9-df9b-4eef-866a-95068677937d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:54.232518 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6d9f5cc9-df9b-4eef-866a-95068677937d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:54.292478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6d9f5cc9-df9b-4eef-866a-95068677937d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:54.299633 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6d9f5cc9-df9b-4eef-866a-95068677937d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1270 microversion: 2.1 time: 0.072304 Jul 25 17:28:54.300246 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3637/7190] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:54 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1270 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:55.321993 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-09efb67c-523d-4fbf-a0d4-e6f09f86d3bc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:55.322684 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-09efb67c-523d-4fbf-a0d4-e6f09f86d3bc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:55.395095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-09efb67c-523d-4fbf-a0d4-e6f09f86d3bc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:55.403116 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-09efb67c-523d-4fbf-a0d4-e6f09f86d3bc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1270 microversion: 2.1 time: 0.085958 Jul 25 17:28:55.403755 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3554/7191] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:55 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:56.424396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1369072e-d7b3-463d-93a6-a109e1202566 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:56.425027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1369072e-d7b3-463d-93a6-a109e1202566 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:56.430449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:28:56.493158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1369072e-d7b3-463d-93a6-a109e1202566 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:56.506706 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1369072e-d7b3-463d-93a6-a109e1202566 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1270 microversion: 2.1 time: 0.086138 Jul 25 17:28:56.507852 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3638/7192] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:56 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:57.532436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-08981004-12b9-4aed-93e8-5b9b27873316 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:57.533441 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-08981004-12b9-4aed-93e8-5b9b27873316 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:57.604588 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-08981004-12b9-4aed-93e8-5b9b27873316 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:57.611782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-08981004-12b9-4aed-93e8-5b9b27873316 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1270 microversion: 2.1 time: 0.085860 Jul 25 17:28:57.612348 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3555/7193] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:57 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:58.632757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:58.633619 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:58.641433 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:58.641910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:58.642702 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:58.643163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:58.716154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:58.725314 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89efbfae-faa8-4d65-8916-89ea613ceb7f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1274 microversion: 2.1 time: 0.096896 Jul 25 17:28:58.725906 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3639/7194] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:58 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:28:59.747440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:28:59.748013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:28:59.756960 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:59.758577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:59.758577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:28:59.758577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:28:59.834230 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:28:59.841977 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-319d0c29-eea4-46b8-995d-fe07ed5d6c69 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1328 microversion: 2.1 time: 0.098510 Jul 25 17:28:59.842880 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3556/7195] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:28:59 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:00.661167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-f4e70d09-8f2a-4da6-b652-b70a06ec59a1 req-f8674609-1664-4d85-b7f3-b9e0df1ec8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:29:00.684170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f4e70d09-8f2a-4da6-b652-b70a06ec59a1 req-f8674609-1664-4d85-b7f3-b9e0df1ec8f7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:00.684935 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-f4e70d09-8f2a-4da6-b652-b70a06ec59a1 req-f8674609-1664-4d85-b7f3-b9e0df1ec8f7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:00.699487 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-f4e70d09-8f2a-4da6-b652-b70a06ec59a1 req-f8674609-1664-4d85-b7f3-b9e0df1ec8f7 service nova] Creating event network-changed:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h2-846219-13 Jul 25 17:29:00.705031 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-f4e70d09-8f2a-4da6-b652-b70a06ec59a1 req-f8674609-1664-4d85-b7f3-b9e0df1ec8f7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049963 Jul 25 17:29:00.706313 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3640/7196] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:29:00.863728 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:00.864498 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:00.872352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:00.872903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:00.873801 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:00.874310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:01.027493 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:01.040673 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fdebe250-fc6e-4e23-ac22-86b2c7de63a7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1395 microversion: 2.1 time: 0.180828 Jul 25 17:29:01.041295 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3557/7197] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:00 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1395 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:02.064164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:02.064617 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:02.072278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:02.072744 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:02.073635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:02.074096 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:02.275332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:02.283439 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-15768dce-e525-4222-af8e-82ceaac6c82a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1395 microversion: 2.1 time: 0.224346 Jul 25 17:29:02.284036 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3641/7198] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:02 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1395 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:03.305487 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:03.306199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:03.315531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:03.315902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:03.316663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:03.317510 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:03.454035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:03.464868 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-bec4c8c6-fcc6-4858-b1f7-f51bcccc4c97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1395 microversion: 2.1 time: 0.163730 Jul 25 17:29:03.465487 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3558/7199] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:03 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1395 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:04.490652 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:04.491685 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:04.499688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:04.500154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:04.500937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:04.501426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:04.642936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:04.651050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-44a98d4c-4281-422c-ba84-2124c0f81b8d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1395 microversion: 2.1 time: 0.167049 Jul 25 17:29:04.651611 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3642/7200] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:04 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:05.284575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:05.343237 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-eed70a24-d9ae-468d-ba9b-c4e5198e2657 req-96fa9358-eafc-4d33-b32b-c4e0d7a91fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "name": "network-vif-plugged", "status": "completed", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:29:05.353561 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-eed70a24-d9ae-468d-ba9b-c4e5198e2657 req-96fa9358-eafc-4d33-b32b-c4e0d7a91fa5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:05.354067 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-eed70a24-d9ae-468d-ba9b-c4e5198e2657 req-96fa9358-eafc-4d33-b32b-c4e0d7a91fa5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:05.365373 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-eed70a24-d9ae-468d-ba9b-c4e5198e2657 req-96fa9358-eafc-4d33-b32b-c4e0d7a91fa5 service nova] Creating event network-vif-plugged:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h2-846219-13 Jul 25 17:29:05.370468 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-eed70a24-d9ae-468d-ba9b-c4e5198e2657 req-96fa9358-eafc-4d33-b32b-c4e0d7a91fa5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090532 Jul 25 17:29:05.371059 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3559/7201] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:29:05.676412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:05.677560 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:05.686763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:05.687234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:05.688027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:05.688478 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:05.823779 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:05.835103 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8255b316-6fc9-4a25-9ef3-f9551ba2c79c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1395 microversion: 2.1 time: 0.165352 Jul 25 17:29:05.835893 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3643/7202] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:05 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:06.861153 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:06.862075 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:06.871424 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:06.872317 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:06.873745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:06.874319 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:07.014903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:07.022869 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a2e652c7-2dea-4a6c-ba52-e6061128b3e6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1568 microversion: 2.1 time: 0.168558 Jul 25 17:29:07.023425 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3560/7203] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:06 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:07.043382 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:07.044002 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:07.046119 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:07.052427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:07.052879 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:07.053687 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:07.054128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:07.199502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:07.207450 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb5820d7-6416-49de-bc10-3d4db40ef156 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1568 microversion: 2.1 time: 0.168121 Jul 25 17:29:07.208074 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3644/7204] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:07 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:09.171014 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5c0e537e-72ec-4a61-a934-c842cfad01a9 req-43220b51-16c1-4301-9f5c-7ad5aa296c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:29:09.178688 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:09.179311 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:09.181456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=10 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:09.187745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:09.188201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:09.188969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:09.190213 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:09.194048 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5c0e537e-72ec-4a61-a934-c842cfad01a9 req-43220b51-16c1-4301-9f5c-7ad5aa296c1a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:09.194509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5c0e537e-72ec-4a61-a934-c842cfad01a9 req-43220b51-16c1-4301-9f5c-7ad5aa296c1a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:09.206771 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5c0e537e-72ec-4a61-a934-c842cfad01a9 req-43220b51-16c1-4301-9f5c-7ad5aa296c1a service nova] Creating event network-changed:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h2-846219-13 Jul 25 17:29:09.211868 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5c0e537e-72ec-4a61-a934-c842cfad01a9 req-43220b51-16c1-4301-9f5c-7ad5aa296c1a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044644 Jul 25 17:29:09.212532 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3645/7205] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:29:09.328706 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:09.336603 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cd69c8f2-01ca-42f8-935f-772d886910af tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1568 microversion: 2.1 time: 0.173542 Jul 25 17:29:09.351224 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3561/7206] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:09 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:32.615624 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:32.616457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=34 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:32.676215 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:29:32.678649 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:32.685627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:32.686092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:32.686874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:32.687325 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:32.736380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-46568bdc-d555-49c6-bc78-a784e9ca279f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action" status: 200 len: 24568 microversion: 2.1 time: 0.122872 Jul 25 17:29:32.736996 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3646/7207] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:29:32 2022] POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action => generated 24568 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:29:43.727000 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:29:43.731923 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:43.734171 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:43.737770 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=34 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:43.744009 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:43.744457 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:43.745264 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:43.745682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:43.790910 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:43.799395 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Old instance type m1.heat2, new instance type m1.heat {{(pid=119598) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 17:29:43.806155 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:29:43.806576 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:29:43.807055 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:29:43.807470 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:29:43.807885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:29:43.878290 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-43cedbc4-c237-48d5-89df-149fa484698a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action" status: 202 len: 0 microversion: 2.1 time: 0.157598 Jul 25 17:29:43.879319 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3562/7208] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:29:43 2022] POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:29:43.888421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:43.889218 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:43.893574 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:43.894408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:29:43.900556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:43.901195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:43.902260 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:43.902877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:44.084627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:44.094186 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4e88d0da-e95c-4a87-a73e-566b98ad6354 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1695 microversion: 2.1 time: 0.210382 Jul 25 17:29:44.094879 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3647/7209] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:43 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:45.120787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:45.121591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:45.127855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:45.128396 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:45.129244 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:45.129736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:45.327303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:45.336874 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2b670ce9-a42a-46ee-b27c-77c6548678c4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1695 microversion: 2.1 time: 0.221318 Jul 25 17:29:45.337531 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3563/7210] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:45 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:46.359934 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:46.360623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:46.372005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:46.372465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:46.373297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:46.373745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:46.515468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:46.523464 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab884178-8555-49ce-8a2f-68fe26fcc797 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.168135 Jul 25 17:29:46.524066 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3648/7211] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:46 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:47.549378 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:47.550033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:47.557685 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:47.558156 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:47.558981 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:47.559411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:47.698436 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:47.706263 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fc4c77af-9ae2-4a45-9f8b-464e53f41b87 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.163397 Jul 25 17:29:47.706872 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3564/7212] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:47 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:29:48.733408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:48.734535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:48.746300 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:48.747066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:48.748344 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:48.749688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:48.896661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:48.904722 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9bcbd74a-7840-4caa-8415-82067c6dfecd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.179136 Jul 25 17:29:48.905335 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3649/7213] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:48 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:49.931313 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:49.932343 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:49.945354 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:49.946123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:49.947490 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:49.948229 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:50.092458 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:50.100491 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-19495d66-b665-4de1-a28a-7efdbc3d1862 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.175991 Jul 25 17:29:50.101087 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3565/7214] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:49 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:51.127968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:51.128877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:51.136523 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:51.136998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:51.137857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:51.138322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:51.281016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:51.293992 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-273705bb-3696-495f-87a5-e35b68826eb1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.173123 Jul 25 17:29:51.294662 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3650/7215] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:51 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:52.322300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:52.323150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:52.334887 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:52.335643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:52.336908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:52.337694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:52.485157 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:52.496541 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2cd283c7-f098-471b-a1b1-4479bdf73195 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.180912 Jul 25 17:29:52.497388 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3566/7216] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:52 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:53.524587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:53.525435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:53.535927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:53.536620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:53.537884 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:53.538603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:53.685635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:53.698040 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b5a62bed-0a3d-4acd-b68b-c47b673235f4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.178854 Jul 25 17:29:53.698935 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3651/7217] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:53 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:54.724168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:54.724912 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:54.732876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:54.733372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:54.734169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:54.734606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:54.875222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:54.883139 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-72c033f1-745a-48b5-b9ad-53e74ae38994 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.163115 Jul 25 17:29:54.883717 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3567/7218] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:54 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:55.905171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:55.905760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:55.913547 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:55.914027 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:55.914834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:55.915286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:56.070180 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:56.078506 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b417c175-3ada-4c45-bb3a-43b414ef37cc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.177661 Jul 25 17:29:56.079094 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3652/7219] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:55 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:57.101270 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:57.101936 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:57.110293 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:57.110804 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:57.111664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:57.112149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:57.260218 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:57.272354 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-e505251a-0373-42cc-a775-f6cf17b1f97e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.175226 Jul 25 17:29:57.273154 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3568/7220] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:57 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:58.298657 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:58.299613 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:58.311394 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:58.312156 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:58.313972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:58.315209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:58.468271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:58.476104 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-213bc3f9-7a05-4b5f-a31c-8575de393999 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.184279 Jul 25 17:29:58.476697 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3653/7221] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:58 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:29:59.503611 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:29:59.504614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:29:59.516524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:59.517305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:59.518639 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:29:59.519366 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:29:59.682408 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:29:59.694664 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f85cbda0-410e-4a19-a417-b791698dd69b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.197495 Jul 25 17:29:59.695586 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3569/7222] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:29:59 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:00.722320 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:00.723348 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:00.733373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:00.733833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:00.734604 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:00.735049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:00.881653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:00.889480 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-903432e1-79ee-4a1c-ac89-a840c2cb2180 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.173775 Jul 25 17:30:00.890066 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3654/7223] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:00 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:01.915282 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:01.916217 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:01.924179 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:01.924613 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:01.925406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:01.925839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:02.071653 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:02.079556 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-451fce73-411c-402b-8864-db476388fcca tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.171041 Jul 25 17:30:02.080132 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3570/7224] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:01 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:03.104904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:03.105900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:03.117170 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:03.117931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:03.119121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:03.119821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:03.263694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:03.271763 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ab87d9a9-d273-4237-bb33-5bbcc3c62147 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1700 microversion: 2.1 time: 0.173494 Jul 25 17:30:03.272349 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3655/7225] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:03 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1700 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:03.834021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-805f7b22-e5a9-4ba8-9b08-0295532fe4f2 req-5d40ee45-6d40-4da3-8b80-f2e69909f24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "name": "network-vif-unplugged", "status": "completed", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:30:03.844938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-805f7b22-e5a9-4ba8-9b08-0295532fe4f2 req-5d40ee45-6d40-4da3-8b80-f2e69909f24a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:03.845439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-805f7b22-e5a9-4ba8-9b08-0295532fe4f2 req-5d40ee45-6d40-4da3-8b80-f2e69909f24a service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:03.857477 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-805f7b22-e5a9-4ba8-9b08-0295532fe4f2 req-5d40ee45-6d40-4da3-8b80-f2e69909f24a service nova] Creating event network-vif-unplugged:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h1-846219-13 Jul 25 17:30:03.862857 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [req-805f7b22-e5a9-4ba8-9b08-0295532fe4f2 req-5d40ee45-6d40-4da3-8b80-f2e69909f24a service nova] Instance 32bca2d9-4084-48e4-8f90-7eec53704431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119598) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:30:03.874197 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-805f7b22-e5a9-4ba8-9b08-0295532fe4f2 req-5d40ee45-6d40-4da3-8b80-f2e69909f24a service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044162 Jul 25 17:30:03.874781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3571/7226] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:30:04.294794 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:04.295902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:04.304316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:04.305506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:04.307365 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:04.308160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:04.553117 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:04.561833 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2e4d0a3e-7de6-446d-abfa-0f4b2b584c74 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1699 microversion: 2.1 time: 0.271227 Jul 25 17:30:04.563762 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3656/7227] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:04 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1699 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:05.587511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:05.588216 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:05.596057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:05.596507 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:05.597345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:05.597782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:05.823368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:05.831436 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c3e05b9a-079e-40eb-b239-c5bbb2c0d77d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1699 microversion: 2.1 time: 0.248083 Jul 25 17:30:05.832257 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3572/7228] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:05 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1699 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:05.889216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-fb366257-7817-464d-82f2-364357133399 req-bab398fa-5d78-42a5-82f2-14ff05430b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:30:05.899675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fb366257-7817-464d-82f2-364357133399 req-bab398fa-5d78-42a5-82f2-14ff05430b0f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:05.900129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-fb366257-7817-464d-82f2-364357133399 req-bab398fa-5d78-42a5-82f2-14ff05430b0f service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:05.914810 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-fb366257-7817-464d-82f2-364357133399 req-bab398fa-5d78-42a5-82f2-14ff05430b0f service nova] Creating event network-changed:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h1-846219-13 Jul 25 17:30:05.920981 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [req-fb366257-7817-464d-82f2-364357133399 req-bab398fa-5d78-42a5-82f2-14ff05430b0f service nova] Instance 32bca2d9-4084-48e4-8f90-7eec53704431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-13', 'n-h1-846219-13'} {{(pid=119599) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 17:30:05.932371 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-fb366257-7817-464d-82f2-364357133399 req-bab398fa-5d78-42a5-82f2-14ff05430b0f service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047132 Jul 25 17:30:05.933047 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3657/7229] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:30:06.857657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:06.858615 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:06.871002 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:06.871820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:06.872597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:06.873034 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:07.020178 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:07.028195 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c7472a7-9815-4993-b916-e2587970bc53 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1697 microversion: 2.1 time: 0.177546 Jul 25 17:30:07.028781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3573/7230] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:06 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:08.051663 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:08.052498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:08.061589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:08.062107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:08.062983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:08.063733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:08.206589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:08.217358 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4f8fcc1e-c90f-4fc3-a99a-1b8b75e62e18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1697 microversion: 2.1 time: 0.170506 Jul 25 17:30:08.217913 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3658/7231] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:08 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:09.242096 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:09.243104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:09.252349 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:09.252793 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:09.253592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:09.254021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:09.389970 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:09.398203 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-22b09a8d-3a8f-4f4c-9183-5612c68fa02a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1697 microversion: 2.1 time: 0.162616 Jul 25 17:30:09.398748 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3574/7232] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:09 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:10.427431 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:10.428200 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:10.436074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.436653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.437568 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.438135 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.576221 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:10.584052 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a1125f61-1a8b-4a43-a1ca-d00a7b3eddbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1694 microversion: 2.1 time: 0.160617 Jul 25 17:30:10.584632 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3659/7233] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:10 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:10.605413 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:30:10.605969 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:10.613442 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.613786 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.615111 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.615409 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.680850 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-002b5734-c873-41a0-95cf-63c3f2c940a8 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action" status: 204 len: 0 microversion: 2.1 time: 0.079872 Jul 25 17:30:10.681560 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3575/7234] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:30:10 2022] POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:30:10.693214 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:10.693937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:10.700774 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.701386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.702315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.702816 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.837137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:10.845657 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c1e60e8f-5734-4729-9502-0adb14321305 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1694 microversion: 2.1 time: 0.158137 Jul 25 17:30:10.846304 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3660/7235] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:10 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:10.867262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:10.868151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:10.874918 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.875454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.876303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:10.876833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:10.892296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:30:11.042427 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:11.050452 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c437bd95-c6ab-4c98-b055-f87acda4fc10 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1694 microversion: 2.1 time: 0.187595 Jul 25 17:30:11.051051 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3576/7236] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:10 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:12.073211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:12.073998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:12.083094 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:12.083559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:12.084383 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:12.084841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:12.225211 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:12.233727 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-083a12c5-42bf-4fe3-a86b-af02b0c324e1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1694 microversion: 2.1 time: 0.164888 Jul 25 17:30:12.234622 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3661/7237] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:12 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:12.546314 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-6ec7caec-bed6-4ce4-a0dd-c928d77c280b req-33c4b9b0-b8a5-432d-9d61-f5f4422c36c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "name": "network-vif-plugged", "status": "completed", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:30:12.557539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6ec7caec-bed6-4ce4-a0dd-c928d77c280b req-33c4b9b0-b8a5-432d-9d61-f5f4422c36c4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:12.557870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-6ec7caec-bed6-4ce4-a0dd-c928d77c280b req-33c4b9b0-b8a5-432d-9d61-f5f4422c36c4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:12.570659 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-6ec7caec-bed6-4ce4-a0dd-c928d77c280b req-33c4b9b0-b8a5-432d-9d61-f5f4422c36c4 service nova] Creating event network-vif-plugged:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h1-846219-13 Jul 25 17:30:12.575925 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-6ec7caec-bed6-4ce4-a0dd-c928d77c280b req-33c4b9b0-b8a5-432d-9d61-f5f4422c36c4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Jul 25 17:30:12.576772 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3577/7238] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:30:13.255285 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:30:13.255911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:13.263388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:13.263873 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:13.264788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:13.265269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:13.402731 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:30:13.411256 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ca6b0e68-822b-412b-bb97-e71ff9c07b3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1686 microversion: 2.1 time: 0.160193 Jul 25 17:30:13.411835 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3662/7239] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:30:13 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:30:51.708438 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=36 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:30:51.709199 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=5 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:30:51.713826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:30:51.716101 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:30:51.723249 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:51.723702 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:51.724462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:30:51.724894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:30:51.803836 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c1aa42b8-3e3c-49c6-a362-702fc8e1d204 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action" status: 200 len: 24517 microversion: 2.1 time: 0.098043 Jul 25 17:30:51.804783 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3578/7240] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:30:51 2022] POST /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431/action => generated 24517 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 17:31:03.884639 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:31:03.885479 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:31:15.819505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:15.820402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:15.821491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:15.822574 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=4 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:15.822722 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=32 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:15.823804 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=94 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:15.835354 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:15.835897 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:15.836760 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:15.837307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:15.865694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:31:15.890322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-729f38fd-a2f9-44bc-ad9b-ef7ce969e331 req-ee2b7bfd-8187-46f3-bd12-07e2775ccb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:15.905567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-729f38fd-a2f9-44bc-ad9b-ef7ce969e331 req-ee2b7bfd-8187-46f3-bd12-07e2775ccb56 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:15.905963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-729f38fd-a2f9-44bc-ad9b-ef7ce969e331 req-ee2b7bfd-8187-46f3-bd12-07e2775ccb56 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:15.917662 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-729f38fd-a2f9-44bc-ad9b-ef7ce969e331 req-ee2b7bfd-8187-46f3-bd12-07e2775ccb56 service nova] Creating event network-changed:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h1-846219-13 Jul 25 17:31:15.923495 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-729f38fd-a2f9-44bc-ad9b-ef7ce969e331 req-ee2b7bfd-8187-46f3-bd12-07e2775ccb56 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107662 Jul 25 17:31:15.924504 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3579/7241] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:31:15.946758 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7ace6f35-465b-44ec-93b7-a0f38cdb0e60 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 204 len: 0 microversion: 2.1 time: 0.134001 Jul 25 17:31:15.947432 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3663/7242] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:31:15 2022] DELETE /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:31:15.956234 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:15.957019 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:15.963560 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:15.964078 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:15.964841 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:15.965305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:16.124555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:16.132762 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-239b0d2d-0902-48a0-92f8-6f411ebe3920 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1692 microversion: 2.1 time: 0.180715 Jul 25 17:31:16.133563 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3580/7243] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:15 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:17.160943 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:17.162084 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:17.174284 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:17.175055 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:17.176340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:17.177131 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:17.311662 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:17.322097 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a1d3b16-6577-4e99-91b9-af45703f046d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1692 microversion: 2.1 time: 0.168370 Jul 25 17:31:17.322684 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3664/7244] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:17 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:18.343731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:18.344358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:18.351630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:18.352387 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:18.353302 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:18.353739 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:18.419679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:18.429685 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d49c5a93-6a47-45a7-b49e-441860e8b75e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 200 len: 1507 microversion: 2.1 time: 0.089884 Jul 25 17:31:18.430230 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3581/7245] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:18 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 1507 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:18.538664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-7275e000-59ad-4845-b751-b789fa3fe256 req-f689f91f-7747-4913-865a-a3cedecf113c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32bca2d9-4084-48e4-8f90-7eec53704431", "name": "network-vif-deleted", "tag": "73516544-b991-4c71-9e50-5980da790bf7"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:18.549087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7275e000-59ad-4845-b751-b789fa3fe256 req-f689f91f-7747-4913-865a-a3cedecf113c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:18.549555 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-7275e000-59ad-4845-b751-b789fa3fe256 req-f689f91f-7747-4913-865a-a3cedecf113c service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:18.561044 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-7275e000-59ad-4845-b751-b789fa3fe256 req-f689f91f-7747-4913-865a-a3cedecf113c service nova] Creating event network-vif-deleted:73516544-b991-4c71-9e50-5980da790bf7 for instance 32bca2d9-4084-48e4-8f90-7eec53704431 on n-h1-846219-13 Jul 25 17:31:18.566449 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-7275e000-59ad-4845-b751-b789fa3fe256 req-f689f91f-7747-4913-865a-a3cedecf113c service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096905 Jul 25 17:31:18.570828 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3665/7246] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:31:19.454771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:19.455708 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32bca2d9-4084-48e4-8f90-7eec53704431] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:19.464400 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:19.464858 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:19.465670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:19.466117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:19.480434 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] HTTP exception thrown: Instance 32bca2d9-4084-48e4-8f90-7eec53704431 could not be found. Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Request method failure captured: Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 HTTP/1.1 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3tHKCJgXFX3nJcsyGcROuseQgXybxRoWfxhO4_N3tc_um8LijkfQPyWl4H_zy1TeMZLOguAPzHuNa_75O0UiKN90UpufFRx59CPVUvbTXRx0Q17zyPpAc27Eb1bG5_y-KmzyOXkefBcgWHAZUMoylhyaKcq9p4h92MtCkHSgHcv5jcc Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8e57e08e1a77434e8f1d157391faddb4"}]}] Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: cc3e0531772d468399c99a8ff4f65226 Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance 32bca2d9-4084-48e4-8f90-7eec53704431 could not be found. Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': '32bca2d9-4084-48e4-8f90-7eec53704431'} Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32bca2d9-4084-48e4-8f90-7eec53704431 could not be found. Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32bca2d9-4084-48e4-8f90-7eec53704431 could not be found. Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:31:19.482133 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32bca2d9-4084-48e4-8f90-7eec53704431 could not be found. Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Returning 404 to user: Instance 32bca2d9-4084-48e4-8f90-7eec53704431 could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-889f02e5-69e6-40df-9f09-6f8d7015dc9b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431" status: 404 len: 111 microversion: 2.1 time: 0.035475 Jul 25 17:31:19.486799 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3582/7247] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:19 2022] GET /compute/v2.1/servers/32bca2d9-4084-48e4-8f90-7eec53704431 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 17:31:22.565357 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-26b78778-1523-4008-b23e-ddbdd964034b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '.version_select at 0x7f9da4a5b790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:22.588351 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-26b78778-1523-4008-b23e-ddbdd964034b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-838066382" status: 202 len: 0 microversion: 2.1 time: 0.028430 Jul 25 17:31:22.589454 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3666/7248] 10.222.0.105 () {58 vars in 1286 bytes} [Mon Jul 25 17:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-838066382 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:31:22.614620 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fd30a048-4663-4258-aeeb-bc17f2632fbb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: .version_select at 0x7f9d92901af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1227760785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4pLdEFcRCuNxg7LEbh+VSPzBZMgPC262vlqTjrZsQOWRsQQ7E0+WZtEZ2w12HTuYhgrBj7JnngeWr7ry8uP8mEGElft4yDdjvrkM3+E6ZKSWgw5zlFp/CKZXSNDD3zaA=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:22.635992 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-fd30a048-4663-4258-aeeb-bc17f2632fbb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:31:22.641258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-fd30a048-4663-4258-aeeb-bc17f2632fbb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:31:22.668037 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fd30a048-4663-4258-aeeb-bc17f2632fbb tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057377 Jul 25 17:31:22.668855 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3583/7249] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:31:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:31:28.427337 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-517064829", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "34e901b2-e6ee-4fe4-bf21-26b1ff1d0229"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1227760785", "security_groups": [{"name": "tempest-secgroup-smoke-1822167621"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:28.554396 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:28.560776 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] validate_networks() for [('34e901b2-e6ee-4fe4-bf21-26b1ff1d0229', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:31:29.029724 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:31:29.030264 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:31:29.030826 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:31:29.031326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:31:29.031878 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:31:29.043029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:29.043590 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:29.044503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:29.045146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:29.070820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:31:29.077188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:31:29.091732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:31:29.094346 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:31:29.145380 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e34c3c73-16eb-4f8a-993a-02b9244a0e76 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.721976 Jul 25 17:31:29.146530 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3667/7250] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:31:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:31:29.158732 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-11abd061-506d-4848-b0da-0b8d549e34c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:29.159318 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-11abd061-506d-4848-b0da-0b8d549e34c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:29.219806 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-11abd061-506d-4848-b0da-0b8d549e34c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:29.227011 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-11abd061-506d-4848-b0da-0b8d549e34c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1270 microversion: 2.1 time: 0.073233 Jul 25 17:31:29.227586 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3584/7251] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:29 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1270 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:30.250656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:30.251399 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:30.260042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:30.260557 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:30.261322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:30.261910 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:30.336495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:30.344340 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5c80ab2d-b055-47c1-98bc-680287c4cb3c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1322 microversion: 2.1 time: 0.098960 Jul 25 17:31:30.344946 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3668/7252] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:30 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:31.366434 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:31.367052 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:31.370414 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=16 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:31.378240 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:31.379181 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:31.380333 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:31.381010 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:31.532027 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:31.541066 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-781493d2-3f9e-4471-9313-622f3033b3b7 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.178772 Jul 25 17:31:31.542319 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3585/7253] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:31 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:31.971103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-528bd27a-2ec1-4e7c-afad-befb04ff02e4 req-793ecfde-cca8-47ae-a99f-60c9754c8659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b3f440-bdd4-42b1-b688-f84f00dea9d2", "tag": "fa6074bb-81d2-40ac-8085-98cdf9d509b3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:31.986068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-528bd27a-2ec1-4e7c-afad-befb04ff02e4 req-793ecfde-cca8-47ae-a99f-60c9754c8659 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:31.987147 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-528bd27a-2ec1-4e7c-afad-befb04ff02e4 req-793ecfde-cca8-47ae-a99f-60c9754c8659 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:32.001698 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-528bd27a-2ec1-4e7c-afad-befb04ff02e4 req-793ecfde-cca8-47ae-a99f-60c9754c8659 service nova] Creating event network-changed:fa6074bb-81d2-40ac-8085-98cdf9d509b3 for instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 on n-h1-846219-13 Jul 25 17:31:32.007201 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-528bd27a-2ec1-4e7c-afad-befb04ff02e4 req-793ecfde-cca8-47ae-a99f-60c9754c8659 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039751 Jul 25 17:31:32.007916 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3669/7254] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:31:32.565392 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:32.565975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:32.573542 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:32.574001 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:32.574772 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:32.575210 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:32.715338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:32.723153 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4c5a50ea-50d0-4112-b1c4-08d8664d10a5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.161823 Jul 25 17:31:32.723728 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3586/7255] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:32 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:33.747386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:33.748312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:33.757756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:33.758324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:33.759302 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:33.759745 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:34.210435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:34.218897 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8eb557b2-8a19-42ae-a68d-252335098f1d tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.477076 Jul 25 17:31:34.219524 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3670/7256] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:33 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:35.241013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:35.241661 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:35.249545 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:35.250456 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:35.252211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:35.252878 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:35.393860 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:35.401696 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-707af823-2168-4f8b-be79-e01db36bc34e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.165468 Jul 25 17:31:35.402533 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3587/7257] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:35 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:36.427970 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:36.428983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:36.437361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:36.437820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:36.438594 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:36.439030 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:36.584368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:36.592373 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b13f3ec0-5354-4efa-9395-bf8b7d0a06b5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.171180 Jul 25 17:31:36.592960 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3671/7258] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:36 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:37.614303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:37.615071 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:37.622450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:37.622909 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:37.623743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:37.624184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:37.761731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:37.769502 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-74168c22-c335-4473-9ccd-02d76664a232 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.159199 Jul 25 17:31:37.770113 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3588/7259] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:37 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:38.795089 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:38.796279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:38.807307 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:38.807770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:38.808540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:38.808983 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:38.947102 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:38.955573 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e046e421-f9ee-44fd-945c-3708d6bc2a18 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.167581 Jul 25 17:31:38.956606 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3672/7260] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:38 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:38.969598 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-cd2f88d2-4cda-443f-a0a7-e982e83ee254 req-7e916ae3-b48f-4a57-a203-121a245d57f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b3f440-bdd4-42b1-b688-f84f00dea9d2", "name": "network-vif-plugged", "status": "completed", "tag": "fa6074bb-81d2-40ac-8085-98cdf9d509b3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:38.983471 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cd2f88d2-4cda-443f-a0a7-e982e83ee254 req-7e916ae3-b48f-4a57-a203-121a245d57f7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:38.984266 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-cd2f88d2-4cda-443f-a0a7-e982e83ee254 req-7e916ae3-b48f-4a57-a203-121a245d57f7 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:38.997951 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-cd2f88d2-4cda-443f-a0a7-e982e83ee254 req-7e916ae3-b48f-4a57-a203-121a245d57f7 service nova] Creating event network-vif-plugged:fa6074bb-81d2-40ac-8085-98cdf9d509b3 for instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 on n-h1-846219-13 Jul 25 17:31:39.003588 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-cd2f88d2-4cda-443f-a0a7-e982e83ee254 req-7e916ae3-b48f-4a57-a203-121a245d57f7 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039098 Jul 25 17:31:39.004490 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3589/7261] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:31:40.070340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:40.070968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:40.073137 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:40.073991 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:40.080783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:40.081271 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:40.082076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:40.082515 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:40.223077 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:40.235916 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e5c52b1c-a227-4b9f-bfcd-722c255ae5da tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1396 microversion: 2.1 time: 0.169173 Jul 25 17:31:40.236820 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3673/7262] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:40 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1396 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:41.255871 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:31:41.261903 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:41.262671 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:41.270062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:41.270519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:41.271292 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:41.271763 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:41.410185 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:41.418923 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-67331cda-044a-4e8e-98aa-26e50f3d28cd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1569 microversion: 2.1 time: 0.164274 Jul 25 17:31:41.419477 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3590/7263] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:41 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:41.441121 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:41.441765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:41.449409 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:41.449868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:41.450637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:41.451080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:41.596814 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:41.605723 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-95136524-e008-4c72-bdd7-d0e1a370b83f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1569 microversion: 2.1 time: 0.169242 Jul 25 17:31:41.606332 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3674/7264] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:41 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:31:43.561862 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5a9dab16-5097-41e5-b568-8d588c439d6f req-ac0deb60-48e8-4c97-8f1e-78d455421c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b3f440-bdd4-42b1-b688-f84f00dea9d2", "tag": "fa6074bb-81d2-40ac-8085-98cdf9d509b3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:31:43.565325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:31:43.565902 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:31:43.580486 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5a9dab16-5097-41e5-b568-8d588c439d6f req-ac0deb60-48e8-4c97-8f1e-78d455421c70 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:43.580741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:43.580916 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5a9dab16-5097-41e5-b568-8d588c439d6f req-ac0deb60-48e8-4c97-8f1e-78d455421c70 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:43.581190 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:43.582051 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:31:43.582491 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:31:43.596308 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5a9dab16-5097-41e5-b568-8d588c439d6f req-ac0deb60-48e8-4c97-8f1e-78d455421c70 service nova] Creating event network-changed:fa6074bb-81d2-40ac-8085-98cdf9d509b3 for instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 on n-h1-846219-13 Jul 25 17:31:43.601491 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5a9dab16-5097-41e5-b568-8d588c439d6f req-ac0deb60-48e8-4c97-8f1e-78d455421c70 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043283 Jul 25 17:31:43.602704 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3675/7265] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:31:43.731123 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:31:43.739598 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-aa89cde7-08c0-4d71-9c0f-ee1334683272 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1569 microversion: 2.1 time: 0.183913 Jul 25 17:31:43.740495 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3591/7266] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:31:43 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:32:27.140355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:32:27.141634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=42 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:32:27.149283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:32:27.151556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:32:27.160114 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:32:27.160585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:32:27.161395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:32:27.161849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:32:27.233167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c97dd8a9-11b8-43cf-8b40-f535033efa68 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action" status: 200 len: 24565 microversion: 2.1 time: 0.096683 Jul 25 17:32:27.233960 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3676/7267] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:32:27 2022] POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action => generated 24565 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:32:44.638296 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:32:44.639182 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:33:06.245162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:33:06.246364 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=38 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:33:06.253488 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c1d06b48-49dc-4254-825c-be99678498dd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:33:06.266529 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1d06b48-49dc-4254-825c-be99678498dd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:06.267262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c1d06b48-49dc-4254-825c-be99678498dd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:06.290513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c1d06b48-49dc-4254-825c-be99678498dd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Going to try to stop instance {{(pid=119598) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 17:33:06.334675 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c1d06b48-49dc-4254-825c-be99678498dd tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action" status: 202 len: 0 microversion: 2.1 time: 0.092665 Jul 25 17:33:06.335272 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3592/7268] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:33:06 2022] POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:33:06.345334 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:06.346133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:06.348819 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:33:06.349498 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:33:06.356601 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:06.357057 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:06.357852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:06.358295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:06.505169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:06.512987 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc6a6d06-6dc9-41dd-85b9-2adb26d01fc0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.172696 Jul 25 17:33:06.513600 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3677/7269] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:06 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:33:07.536600 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:07.537331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:07.544258 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:07.544712 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:07.545531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:07.545971 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:07.687555 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:07.695407 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-88617b91-72fc-4f69-92d4-7ddbd1946593 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.164356 Jul 25 17:33:07.695990 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3593/7270] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:07 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:08.723899 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:08.725080 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:08.732998 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:08.733534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:08.734340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:08.734798 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:08.874714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:08.882845 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a9395185-a575-44cf-8ea9-fd94c0cf55a2 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.165112 Jul 25 17:33:08.883431 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3678/7271] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:08 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:09.909807 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:09.910780 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:09.922503 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:09.923337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:09.924593 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:09.925367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:10.071345 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:10.079371 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f5e0e191-4743-4f60-b56f-47c5e12243a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.176232 Jul 25 17:33:10.079952 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3594/7272] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:09 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:11.102421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:11.103056 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:11.110369 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:11.110859 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:11.111637 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:11.112093 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:11.247625 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:11.257112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a9a4f9d6-3190-4940-bbcb-ed0fcf2e8b20 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.159631 Jul 25 17:33:11.257993 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3679/7273] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:11 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:12.283220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:12.284059 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:12.295726 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:12.296532 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:12.297820 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:12.298538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:12.431332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:12.439347 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-46ec8813-15e6-4117-8f17-7aaa72e5ea61 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.162960 Jul 25 17:33:12.439922 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3595/7274] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:12 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:13.465366 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:13.466401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:13.476597 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:13.477062 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:13.477882 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:13.478335 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:13.618519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:13.630627 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-35a5b376-9a0f-44c9-9d2b-99f276cfa916 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.171750 Jul 25 17:33:13.631442 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3680/7275] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:13 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:14.653380 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:14.653999 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:14.661161 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:14.661633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:14.662388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:14.662817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:14.799945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:14.807604 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3087cb0b-3e44-4f63-8a32-2443869760a9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.158490 Jul 25 17:33:14.808173 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3596/7276] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:14 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:15.835224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:15.835854 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:15.843144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:15.843605 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:15.844401 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:15.844852 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:15.998476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:16.010366 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f0c1475-33e7-4b4c-929a-554fb8b6a579 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.180187 Jul 25 17:33:16.011165 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3681/7277] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:15 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:17.036921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:17.037544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:17.045711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:17.046162 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:17.046940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:17.047361 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:17.197959 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:17.209184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c623cd20-ff0a-4777-8fa3-68d700ab0956 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.176279 Jul 25 17:33:17.210028 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3597/7278] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:17 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:18.240792 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:18.241900 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:18.253988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:18.254761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:18.256029 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:18.256768 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:18.410150 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:18.423055 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-5f8f434c-91f3-44e5-98c0-5f482597bc72 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.188651 Jul 25 17:33:18.423965 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3682/7279] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:18 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:19.448372 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:19.449033 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:19.456296 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:19.456741 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:19.457535 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:19.457963 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:19.597519 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:19.605655 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-cbb5825c-0b25-4dbb-9744-c2803d8e0430 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.161299 Jul 25 17:33:19.606204 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3598/7280] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:19 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:20.634672 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:20.635593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:20.644561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:20.645395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:20.646739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:20.647190 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:20.781490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:20.789585 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-78b3e9a1-1b0a-4c09-a7a2-bc827bb83fc9 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.161599 Jul 25 17:33:20.790176 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3683/7281] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:20 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:21.812927 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:21.813698 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:21.822693 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:21.823261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:21.824220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:21.824771 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:21.967219 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:21.974934 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c6595439-66ff-453c-ba03-17dca429c7c5 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1697 microversion: 2.1 time: 0.167104 Jul 25 17:33:21.975517 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3599/7282] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:21 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:22.996374 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:22.996930 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:23.004345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:23.004810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:23.005736 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:23.006161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:23.146141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:23.154018 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-452fa170-83c6-4787-8d61-0cf980610ddc tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1674 microversion: 2.1 time: 0.161772 Jul 25 17:33:23.154601 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3684/7283] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:22 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:24.254117 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:33:24.257711 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:24.269524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:24.270275 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:24.271614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:24.272063 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:24.340607 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2c4a2b02-e231-45b9-83f2-b6b2a62ba0c1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action" status: 200 len: 38134 microversion: 2.1 time: 0.092374 Jul 25 17:33:24.341514 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3600/7284] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:33:24 2022] POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action => generated 38134 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:33:24.361034 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6c7e90b9-4c8e-4dab-8e52-8041bbcfc492 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:33:24.369922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c7e90b9-4c8e-4dab-8e52-8041bbcfc492 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:24.370387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6c7e90b9-4c8e-4dab-8e52-8041bbcfc492 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:24.392932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6c7e90b9-4c8e-4dab-8e52-8041bbcfc492 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Going to try to start instance {{(pid=119599) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 17:33:24.439284 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6c7e90b9-4c8e-4dab-8e52-8041bbcfc492 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action" status: 202 len: 0 microversion: 2.1 time: 0.084805 Jul 25 17:33:24.440272 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3685/7285] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:33:24 2022] POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:33:24.450644 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:24.451342 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:24.458753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:24.459212 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:24.459975 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:24.460461 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:24.604440 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:24.612261 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c8dc838-ff03-47c9-8a7b-541c52f735e4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1683 microversion: 2.1 time: 0.165993 Jul 25 17:33:24.612925 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3601/7286] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:24 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:33:25.639700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:25.640738 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:25.650402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:25.650870 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:25.651647 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:25.652097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:25.799646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:25.808674 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-ff962c35-e6ca-4c25-b3e7-974cec4de4ab tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1683 microversion: 2.1 time: 0.176392 Jul 25 17:33:25.809273 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3686/7287] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:25 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:33:26.834310 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:33:26.835363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:33:26.848468 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:26.849276 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:26.850220 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:33:26.851011 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:33:26.999531 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:33:27.007952 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5e5536dc-fcb9-412f-98b1-63b04f15c4e0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1687 microversion: 2.1 time: 0.180274 Jul 25 17:33:27.008534 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3602/7288] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:33:26 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:05.322753 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:05.325001 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:05.327278 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=20 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:05.327941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:05.335417 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:05.335906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:05.336696 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:05.337165 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:05.419099 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a9cc282a-e0ab-4ce4-b63b-a078bbbc705c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action" status: 200 len: 62698 microversion: 2.1 time: 0.103577 Jul 25 17:34:05.420062 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3687/7289] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:34:05 2022] POST /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2/action => generated 62698 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:34:23.842819 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:34:23.843580 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:34:23.894733 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:34:23.894955 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:34:24.253244 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:34:24.254163 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:34:29.355832 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=22 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:29.356630 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:29.363387 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-bda3f41b-7a32-4430-9e24-233af2f231e1 req-5db58114-147f-4d13-9eba-854f03939637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b3f440-bdd4-42b1-b688-f84f00dea9d2", "tag": "fa6074bb-81d2-40ac-8085-98cdf9d509b3"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:29.369582 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:29.370095 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:29.378631 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:29.379110 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:29.379943 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:29.380386 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:29.382509 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:29.383169 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:29.390500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bda3f41b-7a32-4430-9e24-233af2f231e1 req-5db58114-147f-4d13-9eba-854f03939637 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:29.390958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-bda3f41b-7a32-4430-9e24-233af2f231e1 req-5db58114-147f-4d13-9eba-854f03939637 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:29.403111 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-bda3f41b-7a32-4430-9e24-233af2f231e1 req-5db58114-147f-4d13-9eba-854f03939637 service nova] Creating event network-changed:fa6074bb-81d2-40ac-8085-98cdf9d509b3 for instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 on n-h1-846219-13 Jul 25 17:34:29.408367 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-bda3f41b-7a32-4430-9e24-233af2f231e1 req-5db58114-147f-4d13-9eba-854f03939637 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049306 Jul 25 17:34:29.408986 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3688/7290] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:34:29.416344 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:34:29.498814 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-23bfc8c5-7524-4ad9-868b-13ca3e3a703f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 204 len: 0 microversion: 2.1 time: 0.144705 Jul 25 17:34:29.499997 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3603/7291] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:34:29 2022] DELETE /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:34:29.509122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:29.509849 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:29.516718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:29.517295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:29.518092 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:29.518545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:29.788507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:29.797013 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7f99a7c4-b60c-4031-b7ad-07132b5da941 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1693 microversion: 2.1 time: 0.292303 Jul 25 17:34:29.797868 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3689/7292] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:29 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1693 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:30.825839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:30.827004 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:30.835843 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:30.836299 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:30.837069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:30.837539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:30.982069 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:30.990069 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-2f739443-0308-4a22-9e35-180de1aa6414 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1693 microversion: 2.1 time: 0.171383 Jul 25 17:34:30.991263 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3604/7293] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:30 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:32.016331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:32.017290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:32.029371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:32.030149 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:32.031449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:32.032206 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:32.182661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:32.190808 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-df20a453-0e3e-4651-a8fc-b1d6cd2bef9e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 200 len: 1693 microversion: 2.1 time: 0.181073 Jul 25 17:34:32.191448 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3690/7294] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:32 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:32.684416 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e3225336-19d3-4660-97eb-77bd2a9b2de8 req-b023f1a8-8ffe-4c11-9f40-490cadf2a9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b3f440-bdd4-42b1-b688-f84f00dea9d2", "name": "network-vif-deleted", "tag": "fa6074bb-81d2-40ac-8085-98cdf9d509b3"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:32.695450 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e3225336-19d3-4660-97eb-77bd2a9b2de8 req-b023f1a8-8ffe-4c11-9f40-490cadf2a9f5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:32.695894 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e3225336-19d3-4660-97eb-77bd2a9b2de8 req-b023f1a8-8ffe-4c11-9f40-490cadf2a9f5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:32.707447 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e3225336-19d3-4660-97eb-77bd2a9b2de8 req-b023f1a8-8ffe-4c11-9f40-490cadf2a9f5 service nova] Creating event network-vif-deleted:fa6074bb-81d2-40ac-8085-98cdf9d509b3 for instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 on n-h1-846219-13 Jul 25 17:34:32.712602 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e3225336-19d3-4660-97eb-77bd2a9b2de8 req-b023f1a8-8ffe-4c11-9f40-490cadf2a9f5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031873 Jul 25 17:34:32.713526 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3605/7295] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:34:33.353844 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:33.354716 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 32b3f440-bdd4-42b1-b688-f84f00dea9d2] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:33.366784 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:33.367495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:33.368304 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:33.368788 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:33.383027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] HTTP exception thrown: Instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 could not be found. Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Request method failure captured: Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 HTTP/1.1 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3tHKCJgXFX3nJcsyGcROuseQgXybxRoWfxhO4_N3tc_um8LijkfQPyWl4H_zy1TeMZLOguAPzHuNa_75O0UiKN90UpufFRx59CPVUvbTXRx0Q17zyPpAc27Eb1bG5_y-KmzyOXkefBcgWHAZUMoylhyaKcq9p4h92MtCkHSgHcv5jcc Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8e57e08e1a77434e8f1d157391faddb4"}]}] Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: cc3e0531772d468399c99a8ff4f65226 Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 could not be found. Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '32b3f440-bdd4-42b1-b688-f84f00dea9d2'} Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 could not be found. Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 could not be found. Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:34:33.384723 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 could not be found. Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Returning 404 to user: Instance 32b3f440-bdd4-42b1-b688-f84f00dea9d2 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-37dd1784-41e5-4836-b9f5-58cfa171a8d6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2" status: 404 len: 111 microversion: 2.1 time: 0.177929 Jul 25 17:34:33.389167 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3691/7296] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:33 2022] GET /compute/v2.1/servers/32b3f440-bdd4-42b1-b688-f84f00dea9d2 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:34:36.469846 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3989af78-dcb5-4193-a435-82f30b87ee4a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '.version_select at 0x7f9d9255f160>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:36.500449 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3989af78-dcb5-4193-a435-82f30b87ee4a tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1227760785" status: 202 len: 0 microversion: 2.1 time: 0.036054 Jul 25 17:34:36.502950 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3606/7297] 10.222.0.105 () {58 vars in 1289 bytes} [Mon Jul 25 17:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1227760785 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:34:36.538155 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-81fcc579-ba95-4c9a-b451-3d3a0c28fbb4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: .version_select at 0x7f9d9027dca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2021186660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaYu41ukTl7FA/sVYO4hTqOvzrIiNOEYRfcc2HpbmYPU9Oo1Rt92frJ+jPzvC/+E9OBbeOC//jnTAHa3qyoBzE7xDnQYs+hCDzGqx1ZBSdkh2G9i8NkAvfjNBW3mDZNEw=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:36.552728 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-81fcc579-ba95-4c9a-b451-3d3a0c28fbb4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:34:36.558635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-81fcc579-ba95-4c9a-b451-3d3a0c28fbb4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:34:36.586565 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-81fcc579-ba95-4c9a-b451-3d3a0c28fbb4 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054221 Jul 25 17:34:36.587185 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3692/7298] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:34:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:34:42.662579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1702029498", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "networks": [{"uuid": "95bf9dca-c688-4bda-9a13-4d945f793366"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2021186660", "security_groups": [{"name": "tempest-secgroup-smoke-1344229731"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:42.701787 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:42.814407 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] validate_networks() for [('95bf9dca-c688-4bda-9a13-4d945f793366', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:34:43.418778 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:34:43.420073 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:34:43.420747 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:34:43.421356 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:34:43.421945 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:34:43.439062 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:43.439791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:43.440791 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:43.441464 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:43.463425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:34:43.470405 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Getting quotas for user cc3e0531772d468399c99a8ff4f65226 and project 8e57e08e1a77434e8f1d157391faddb4. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:34:43.485524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:34:43.488335 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:34:43.554935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8b2d8d8d-930b-4c28-96fa-7a10ed2de23f tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.897319 Jul 25 17:34:43.555623 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3607/7299] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:34:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:34:43.564492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=16 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:43.576994 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-64abd9fc-b020-4dea-94f9-f8e82f59f9b6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:43.581054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-64abd9fc-b020-4dea-94f9-f8e82f59f9b6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:43.638464 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-64abd9fc-b020-4dea-94f9-f8e82f59f9b6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:43.645827 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-64abd9fc-b020-4dea-94f9-f8e82f59f9b6 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1271 microversion: 2.1 time: 0.083196 Jul 25 17:34:43.646616 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3693/7300] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:43 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:44.669211 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:44.670454 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:44.680536 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:44.681433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:44.682680 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:44.684991 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:44.764511 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:44.775544 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-20778fab-cdf9-4cd3-ae78-c150e9d0abce tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1341 microversion: 2.1 time: 0.112250 Jul 25 17:34:44.777059 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3608/7301] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:44 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1341 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:45.797058 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:45.797737 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:45.805413 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:45.806158 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:45.807127 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:45.807772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:45.955236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:45.965493 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f752c449-c138-4729-8d2a-8c0825cf7205 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1397 microversion: 2.1 time: 0.172117 Jul 25 17:34:45.966986 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3694/7302] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:45 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:46.202032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-c7b1c633-370d-41ac-8262-af0d9b5cf03f req-0d924075-1227-4ded-ab3f-ab19a9cf8fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6a2f15-7c91-40d4-9750-c782f1e39320", "tag": "f547b54a-89d6-438b-b280-4add89f08b16"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:46.215303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c7b1c633-370d-41ac-8262-af0d9b5cf03f req-0d924075-1227-4ded-ab3f-ab19a9cf8fab service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:46.215640 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-c7b1c633-370d-41ac-8262-af0d9b5cf03f req-0d924075-1227-4ded-ab3f-ab19a9cf8fab service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:46.229626 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-c7b1c633-370d-41ac-8262-af0d9b5cf03f req-0d924075-1227-4ded-ab3f-ab19a9cf8fab service nova] Creating event network-changed:f547b54a-89d6-438b-b280-4add89f08b16 for instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 on n-h2-846219-13 Jul 25 17:34:46.234798 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-c7b1c633-370d-41ac-8262-af0d9b5cf03f req-0d924075-1227-4ded-ab3f-ab19a9cf8fab service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036485 Jul 25 17:34:46.235462 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3609/7303] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:34:46.991719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:46.992811 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:47.003556 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:47.004024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:47.004813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:47.005306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:47.140136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:47.148572 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-65b9202a-0372-49b1-bc41-03d8ca4743de tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1397 microversion: 2.1 time: 0.163449 Jul 25 17:34:47.149179 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3695/7304] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:46 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:48.177057 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:48.178245 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:48.189262 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:48.189715 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:48.190481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:48.190978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:48.393579 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:48.401782 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-caf9025a-9878-4d9a-b937-aa6b4d6bbe4b tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1397 microversion: 2.1 time: 0.233872 Jul 25 17:34:48.402374 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3610/7305] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:48 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1397 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:49.423036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:49.423639 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:49.433044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:49.433536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:49.434467 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:49.435210 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:49.578361 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:49.589050 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9f7e0f93-6307-40d5-a178-4189981f3d97 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1397 microversion: 2.1 time: 0.169775 Jul 25 17:34:49.590038 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3696/7306] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:49 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1397 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:50.614041 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:50.614730 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:50.623247 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:50.623782 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:50.624690 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:50.625250 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:50.774603 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:50.782799 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c92cf6f5-7ca6-4dcc-a914-6e8c2cca554c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1397 microversion: 2.1 time: 0.173472 Jul 25 17:34:50.783746 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3611/7307] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:50 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1397 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:50.905689 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-713fd80b-4f0d-41d8-9540-fb408232551d req-f4ea65f6-e620-489f-b47d-6fb4e4e11695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6a2f15-7c91-40d4-9750-c782f1e39320", "name": "network-vif-plugged", "status": "completed", "tag": "f547b54a-89d6-438b-b280-4add89f08b16"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:50.915554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-713fd80b-4f0d-41d8-9540-fb408232551d req-f4ea65f6-e620-489f-b47d-6fb4e4e11695 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:50.916005 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-713fd80b-4f0d-41d8-9540-fb408232551d req-f4ea65f6-e620-489f-b47d-6fb4e4e11695 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:50.930023 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-713fd80b-4f0d-41d8-9540-fb408232551d req-f4ea65f6-e620-489f-b47d-6fb4e4e11695 service nova] Creating event network-vif-plugged:f547b54a-89d6-438b-b280-4add89f08b16 for instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 on n-h2-846219-13 Jul 25 17:34:50.935045 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-713fd80b-4f0d-41d8-9540-fb408232551d req-f4ea65f6-e620-489f-b47d-6fb4e4e11695 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088906 Jul 25 17:34:50.935751 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3697/7308] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:34:51.807566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:51.808200 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:51.817295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:51.817756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:51.818527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:51.818964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:51.968515 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:51.976933 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-823b11a7-1458-4848-900b-0a8b2470b3a1 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1397 microversion: 2.1 time: 0.175055 Jul 25 17:34:51.977573 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3612/7309] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:51 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1397 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:53.006228 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:53.007363 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:53.018141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:53.018623 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:53.019643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:53.020099 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:53.158436 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:53.166250 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-24d8b9cd-ac4b-4760-9705-275a1aaab32c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1568 microversion: 2.1 time: 0.169285 Jul 25 17:34:53.166831 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3698/7310] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:52 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:53.186977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:53.187567 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:53.195137 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:53.195591 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:53.196367 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:53.196811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:53.338201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:53.346194 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-5206fbb3-f4d9-498b-b30f-a096c978a040 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1568 microversion: 2.1 time: 0.163200 Jul 25 17:34:53.346792 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3613/7311] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:53 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:34:55.321242 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-e64ae7e0-73ab-48cf-8e8f-720bf2c6de5d req-f262b21c-c458-43c9-b499-51aca5002c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6a2f15-7c91-40d4-9750-c782f1e39320", "tag": "f547b54a-89d6-438b-b280-4add89f08b16"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:34:55.324596 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:34:55.325282 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:34:55.327488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:55.334113 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:55.334802 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:34:55.343537 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:55.343990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:55.344898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:55.345368 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:55.352864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e64ae7e0-73ab-48cf-8e8f-720bf2c6de5d req-f262b21c-c458-43c9-b499-51aca5002c1b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:34:55.353340 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-e64ae7e0-73ab-48cf-8e8f-720bf2c6de5d req-f262b21c-c458-43c9-b499-51aca5002c1b service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:34:55.372578 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-e64ae7e0-73ab-48cf-8e8f-720bf2c6de5d req-f262b21c-c458-43c9-b499-51aca5002c1b service nova] Creating event network-changed:f547b54a-89d6-438b-b280-4add89f08b16 for instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 on n-h2-846219-13 Jul 25 17:34:55.384184 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-e64ae7e0-73ab-48cf-8e8f-720bf2c6de5d req-f262b21c-c458-43c9-b499-51aca5002c1b service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065920 Jul 25 17:34:55.385255 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3614/7312] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:34:55.527660 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:34:55.536553 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4058ae8e-e4b3-4e22-aa3c-81d799ec7577 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1568 microversion: 2.1 time: 0.221713 Jul 25 17:34:55.537923 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3699/7313] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:34:55 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:18.825281 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:18.827222 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=36 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:18.832621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:18.834968 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:18.842709 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:18.843326 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:18.844272 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:18.844714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:18.898467 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-760700a3-1a88-4653-933a-3d5057f4b96e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action" status: 200 len: 24569 microversion: 2.1 time: 0.075428 Jul 25 17:35:18.899115 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3615/7314] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:35:18 2022] POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:35:25.303036 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:25.303666 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:25.305938 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:25.306697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=32 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:25.313762 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:25.314240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:25.315107 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:25.315620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:25.340922 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.objects.instance [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lazy-loading 'flavor' on Instance uuid 5a6a2f15-7c91-40d4-9750-c782f1e39320 {{(pid=119599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:35:25.422136 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a3501c50-49e3-46ef-8d65-0ca10a1db5ae tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action" status: 202 len: 0 microversion: 2.1 time: 0.123671 Jul 25 17:35:25.423048 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3700/7315] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:35:25 2022] POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:35:25.432590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:25.433323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:25.441045 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:25.441524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:25.442295 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:25.442733 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:25.593489 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:25.602114 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3c68c6ce-afe8-4381-8a8a-f1a515947d36 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1695 microversion: 2.1 time: 0.174162 Jul 25 17:35:25.602672 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3616/7316] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:25 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:26.631541 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:26.632138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:26.638723 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:26.639202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:26.639987 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:26.640420 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:26.783813 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:26.795495 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-718bae72-fd7c-4a2e-bf09-56b363033437 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1678 microversion: 2.1 time: 0.170406 Jul 25 17:35:26.796246 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3701/7317] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:26 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:27.895126 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:27.898625 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:27.911375 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:27.911827 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:27.912614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:27.913031 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:27.969935 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c571b21e-1197-45b0-a84a-5bce133dec15 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action" status: 200 len: 35261 microversion: 2.1 time: 0.081231 Jul 25 17:35:27.970945 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3617/7318] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:35:27 2022] POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action => generated 35261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:35:27.983955 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:27.984510 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:27.991913 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:27.992379 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:27.993188 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:27.993643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:28.065781 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08e050c0-3cb1-4e16-86e3-8cb49298804e tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action" status: 202 len: 0 microversion: 2.1 time: 0.085501 Jul 25 17:35:28.067059 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3702/7319] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:35:27 2022] POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:35:28.075816 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:28.076516 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:28.083926 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:28.084379 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:28.085186 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:28.085647 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:28.227840 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:28.235910 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7ee4fdc6-caae-4dd8-a92c-e4fadad9efbf tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1684 microversion: 2.1 time: 0.164409 Jul 25 17:35:28.236726 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3618/7320] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:28 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:29.264269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:29.265479 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:29.274717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:29.275174 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:29.275964 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:29.276414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:29.422570 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:29.430278 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1653c3ad-4cc0-4346-9f7d-dbf618fdac73 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1684 microversion: 2.1 time: 0.173409 Jul 25 17:35:29.430875 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3703/7321] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:29 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:30.455439 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:30.456425 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:30.467575 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:30.468271 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:30.469502 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:30.470184 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:30.611957 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:30.620099 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-151e8b50-4b66-4cf9-bfe2-f44a06fa471c tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1687 microversion: 2.1 time: 0.170759 Jul 25 17:35:30.620701 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3619/7322] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:30 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:31.497456 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:31.501059 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:31.512727 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:31.513562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:31.514846 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:31.515593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:31.556929 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b245143-c5bd-4f62-86a7-0552e5c5d4a3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action" status: 200 len: 35261 microversion: 2.1 time: 0.066121 Jul 25 17:35:31.557659 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3704/7323] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:35:31 2022] POST /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320/action => generated 35261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 17:35:32.632283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:32.632792 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:32.635268 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a8fbf615-17ba-41e9-a2f8-bc6d4d85484e req-dc989143-04ae-47f7-ac8c-5b50aae06178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6a2f15-7c91-40d4-9750-c782f1e39320", "tag": "f547b54a-89d6-438b-b280-4add89f08b16"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:32.640109 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:32.640566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:32.641358 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:32.641789 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:32.647075 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a8fbf615-17ba-41e9-a2f8-bc6d4d85484e req-dc989143-04ae-47f7-ac8c-5b50aae06178 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:32.647809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a8fbf615-17ba-41e9-a2f8-bc6d4d85484e req-dc989143-04ae-47f7-ac8c-5b50aae06178 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:32.660148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a8fbf615-17ba-41e9-a2f8-bc6d4d85484e req-dc989143-04ae-47f7-ac8c-5b50aae06178 service nova] Creating event network-changed:f547b54a-89d6-438b-b280-4add89f08b16 for instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 on n-h2-846219-13 Jul 25 17:35:32.665401 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a8fbf615-17ba-41e9-a2f8-bc6d4d85484e req-dc989143-04ae-47f7-ac8c-5b50aae06178 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034444 Jul 25 17:35:32.666028 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3705/7324] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:35:32.668562 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:35:32.759180 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-70b24f5c-1169-4306-af2d-f52986d5c9c3 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 204 len: 0 microversion: 2.1 time: 0.130671 Jul 25 17:35:32.760303 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3620/7325] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:35:32 2022] DELETE /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:35:32.769380 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:32.770371 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:32.781324 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:32.781925 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:32.782800 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:32.783323 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:32.920250 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:32.928361 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-726c5f1b-95ea-49c7-b4f1-1ce55ad4a9b0 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1693 microversion: 2.1 time: 0.163359 Jul 25 17:35:32.928945 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3706/7326] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:32 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:35:33.955800 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:33.956940 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:33.968609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:33.969418 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:33.970736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:33.971453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:34.116885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:34.124669 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-f1f7b5f4-b4c4-497b-af80-2e5a782d06db tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1693 microversion: 2.1 time: 0.176245 Jul 25 17:35:34.125283 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3621/7327] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:33 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:34.882503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-796956c3-501f-4feb-a21e-fb02cca60e3a req-080e6fce-bcc4-422b-866d-2e151583e7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6a2f15-7c91-40d4-9750-c782f1e39320", "name": "network-vif-deleted", "tag": "f547b54a-89d6-438b-b280-4add89f08b16"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:34.893164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-796956c3-501f-4feb-a21e-fb02cca60e3a req-080e6fce-bcc4-422b-866d-2e151583e7e6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:34.893612 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-796956c3-501f-4feb-a21e-fb02cca60e3a req-080e6fce-bcc4-422b-866d-2e151583e7e6 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:34.905596 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-796956c3-501f-4feb-a21e-fb02cca60e3a req-080e6fce-bcc4-422b-866d-2e151583e7e6 service nova] Creating event network-vif-deleted:f547b54a-89d6-438b-b280-4add89f08b16 for instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 on n-h2-846219-13 Jul 25 17:35:34.911148 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-796956c3-501f-4feb-a21e-fb02cca60e3a req-080e6fce-bcc4-422b-866d-2e151583e7e6 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032285 Jul 25 17:35:34.911914 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3707/7328] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:35:35.146691 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:35.147300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:35.154905 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:35.155355 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:35.156128 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:35.156558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:35.190406 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:35.190852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:35.191305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lazy-loading 'fault' on Instance uuid 5a6a2f15-7c91-40d4-9750-c782f1e39320 {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:35:35.238382 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3e0531772d468399c99a8ff4f65226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e08e1a77434e8f1d157391faddb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:35.250638 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-9bf97c0b-ebfd-4c8a-a92a-16573a1be301 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 200 len: 1361 microversion: 2.1 time: 0.107869 Jul 25 17:35:35.251589 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3622/7329] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:35 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 1361 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:36.281954 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:36.283198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] [instance: 5a6a2f15-7c91-40d4-9750-c782f1e39320] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:36.290984 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:36.291443 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:36.292236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:36.292700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:36.307229 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] HTTP exception thrown: Instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 could not be found. Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Request method failure captured: Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 HTTP/1.1 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3tHKCJgXFX3nJcsyGcROuseQgXybxRoWfxhO4_N3tc_um8LijkfQPyWl4H_zy1TeMZLOguAPzHuNa_75O0UiKN90UpufFRx59CPVUvbTXRx0Q17zyPpAc27Eb1bG5_y-KmzyOXkefBcgWHAZUMoylhyaKcq9p4h92MtCkHSgHcv5jcc Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/8e57e08e1a77434e8f1d157391faddb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_8e57e08e1a77434e8f1d157391faddb4"}]}] Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 8e57e08e1a77434e8f1d157391faddb4 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1138605384 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: cc3e0531772d468399c99a8ff4f65226 Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1138605384-project Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 could not be found. Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '5a6a2f15-7c91-40d4-9750-c782f1e39320'} Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 could not be found. Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 could not be found. Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:35:36.308902 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 could not be found. Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Returning 404 to user: Instance 5a6a2f15-7c91-40d4-9750-c782f1e39320 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c6c3ee51-48bc-4a22-9f42-8d71d7a3e2ea tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320" status: 404 len: 111 microversion: 2.1 time: 0.037237 Jul 25 17:35:36.313356 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3708/7330] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:36 2022] GET /compute/v2.1/servers/5a6a2f15-7c91-40d4-9750-c782f1e39320 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:35:39.654446 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a097f6ef-dc50-40d4-a06e-7621472d1393 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] Calling method '.version_select at 0x7f9d92dc5040>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:39.676220 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a097f6ef-dc50-40d4-a06e-7621472d1393 tempest-TestNetworkAdvancedServerOps-1138605384 tempest-TestNetworkAdvancedServerOps-1138605384-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2021186660" status: 202 len: 0 microversion: 2.1 time: 0.025935 Jul 25 17:35:39.676951 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3623/7331] 10.222.0.105 () {58 vars in 1289 bytes} [Mon Jul 25 17:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2021186660 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:35:51.334946 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=18 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:51.336255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:51.593122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-2a80e452-37eb-478b-8b35-27f9f2141eb3 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Action: 'create', calling method: .version_select at 0x7f9da4a5b790>, body: {"keypair": {"name": "tempest-TestShelveInstance-745457393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFlyKbBict6xaLa6ElwXK4s/BFaGgF0PUy/cz25nNjtFhAjmCcdLQOuvbuM+9NdmufH8jK32d+OlYN44XAx0zciHAv5RRU8sIPL0F/GlissCkJiCIdZTwzqFmrCroMt8A=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:51.613985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2a80e452-37eb-478b-8b35-27f9f2141eb3 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Getting quotas for project 13724fb7644d48c59f3d316fc5f7bd0c. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:35:51.621857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-2a80e452-37eb-478b-8b35-27f9f2141eb3 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Getting quotas for user ef02432a168d4c90adb105c182b8a0c2 and project 13724fb7644d48c59f3d316fc5f7bd0c. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:35:51.652672 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-2a80e452-37eb-478b-8b35-27f9f2141eb3 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.325441 Jul 25 17:35:51.653388 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3709/7332] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:35:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:35:52.706060 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-656366441", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-745457393", "security_groups": [{"name": "tempest-secgroup-smoke-625477015"}], "networks": [{"uuid": "5b05bd3f-a32b-47e8-a999-4a8ad6087c70"}]}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:52.723663 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:52.724632 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:35:52.829938 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.network.neutron [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] validate_networks() for [('5b05bd3f-a32b-47e8-a999-4a8ad6087c70', None, None, None, None, None)] {{(pid=119598) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:35:53.245664 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Flavor limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:35:53.246108 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Image limits 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:35:53.246570 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Flavor pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:35:53.246978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Image pref 0:0:0 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:35:53.247469 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.virt.hardware [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:35:53.256817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:53.257303 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:53.258103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:53.258538 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:53.275921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Getting quotas for project 13724fb7644d48c59f3d316fc5f7bd0c. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:35:53.281238 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Getting quotas for user ef02432a168d4c90adb105c182b8a0c2 and project 13724fb7644d48c59f3d316fc5f7bd0c. Resources: {'ram', 'cores', 'instances'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:35:53.294523 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Going to run 1 instances... {{(pid=119598) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:35:53.296818 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:35:53.343323 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7d9066ad-f896-4308-b71e-746fdd680e12 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.643937 Jul 25 17:35:53.343994 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3624/7333] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:35:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:35:53.356110 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-72316818-6950-454c-9f6c-bf862d1376f9 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:53.357064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-72316818-6950-454c-9f6c-bf862d1376f9 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:53.420414 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-72316818-6950-454c-9f6c-bf862d1376f9 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:53.427865 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-72316818-6950-454c-9f6c-bf862d1376f9 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1249 microversion: 2.1 time: 0.075897 Jul 25 17:35:53.428769 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3710/7334] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:53 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:35:54.449121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:54.449756 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:54.457977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:54.458423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:54.459539 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:54.459980 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:54.533422 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:54.543385 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-8ac6c386-3103-49b4-9251-b634f9bb3deb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1301 microversion: 2.1 time: 0.098671 Jul 25 17:35:54.557122 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3625/7335] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:54 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:55.573412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:55.574183 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:55.583912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:55.584761 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:55.585809 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:55.586469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:55.842232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:55.850981 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-892dbe69-52e3-4721-8e36-71965136ba48 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.282866 Jul 25 17:35:55.851564 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3711/7336] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:55 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:56.195384 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-3cbbdf46-d569-4c83-96cf-2dcc4a868a36 req-7702bf6e-267f-4fbf-b021-58a5ae3260e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:35:56.205808 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3cbbdf46-d569-4c83-96cf-2dcc4a868a36 req-7702bf6e-267f-4fbf-b021-58a5ae3260e5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:56.206176 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-3cbbdf46-d569-4c83-96cf-2dcc4a868a36 req-7702bf6e-267f-4fbf-b021-58a5ae3260e5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:56.230914 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-3cbbdf46-d569-4c83-96cf-2dcc4a868a36 req-7702bf6e-267f-4fbf-b021-58a5ae3260e5 service nova] Creating event network-changed:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h1-846219-13 Jul 25 17:35:56.236141 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-3cbbdf46-d569-4c83-96cf-2dcc4a868a36 req-7702bf6e-267f-4fbf-b021-58a5ae3260e5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044625 Jul 25 17:35:56.237159 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3626/7337] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:35:56.872378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:56.873116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:56.881066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:56.881553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:56.882321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:56.882770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:57.026112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:57.034112 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-535cada0-2b47-4558-81f6-c2d70ce9969d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.165800 Jul 25 17:35:57.034678 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3712/7338] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:56 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:58.062565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:58.063851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:58.073321 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:58.073753 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:58.074544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:58.074976 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:58.230070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:58.238419 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-0386b8c3-3977-46e8-b7b8-8810a7a04461 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.184689 Jul 25 17:35:58.239042 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3627/7339] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:58 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:35:59.260488 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:35:59.261113 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:35:59.268476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:59.268958 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:59.269786 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:35:59.270233 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:35:59.503756 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:35:59.511762 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d9c4c00a-4cd4-427d-accd-901a6e7eab50 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.255426 Jul 25 17:35:59.512623 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3713/7340] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:35:59 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:00.532714 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:36:00.533357 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:36:00.540599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:00.541066 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:00.541852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:00.542286 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:00.686679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:36:00.694490 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-25aba9cd-9b3a-42b2-b984-da3a25395897 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.165845 Jul 25 17:36:00.695076 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3628/7341] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:36:00 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:01.715476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:36:01.716134 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:36:01.723397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:01.724167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:01.724967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:01.725427 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:01.862733 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:36:01.871427 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-d52f7632-f798-4b98-b392-d26182a33f6c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.160047 Jul 25 17:36:01.872010 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3714/7342] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:36:01 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:02.139300 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-149ae4bc-5e53-489d-aa76-de634e6f619b req-836fc131-1e1d-4b9e-bb66-ce31654118b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "name": "network-vif-plugged", "status": "completed", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:36:02.150679 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-149ae4bc-5e53-489d-aa76-de634e6f619b req-836fc131-1e1d-4b9e-bb66-ce31654118b3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:02.151201 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-149ae4bc-5e53-489d-aa76-de634e6f619b req-836fc131-1e1d-4b9e-bb66-ce31654118b3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:02.162956 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-149ae4bc-5e53-489d-aa76-de634e6f619b req-836fc131-1e1d-4b9e-bb66-ce31654118b3 service nova] Creating event network-vif-plugged:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h1-846219-13 Jul 25 17:36:02.168148 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-149ae4bc-5e53-489d-aa76-de634e6f619b req-836fc131-1e1d-4b9e-bb66-ce31654118b3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 Jul 25 17:36:02.168872 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3629/7343] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:36:02.897373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:36:02.898240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:36:02.906507 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:02.906972 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:02.907751 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:02.908227 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:03.067730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:36:03.077532 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1fe3f52b-4dbd-45b3-b105-fc19926c1a94 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.186800 Jul 25 17:36:03.079110 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3715/7344] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:36:02 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:04.102675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=2 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:36:04.103551 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell0:SELECT=6 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:36:04.107609 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:36:04.108331 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:36:04.115508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:04.115954 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:04.116703 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:04.117121 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:04.259852 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:36:04.268040 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-461eb4c3-bd6d-4c8f-8977-76a10d653591 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1374 microversion: 2.1 time: 0.167262 Jul 25 17:36:04.268746 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3630/7345] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:36:04 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:05.292332 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:36:05.293025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:36:05.295248 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:36:05.303116 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:05.303679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:05.304578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:05.305118 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:05.448671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:36:05.457368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc4d68bc-7c4c-4966-b0b5-78125bf6f9e8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1559 microversion: 2.1 time: 0.170961 Jul 25 17:36:05.457987 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3716/7346] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:36:05 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:05.488513 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:36:05.489430 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:36:05.500643 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:05.501115 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:05.501916 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:05.502359 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:05.654731 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:36:05.666271 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-b81573ab-fb59-4fff-ad89-7b630f37ab1b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1559 microversion: 2.1 time: 0.183808 Jul 25 17:36:05.667107 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3631/7347] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:36:05 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:36:07.775533 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-732629e5-4112-4f68-80dd-9a05a193a7b9 req-b867b14d-9826-4753-9207-09a0326939ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:36:07.786670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-732629e5-4112-4f68-80dd-9a05a193a7b9 req-b867b14d-9826-4753-9207-09a0326939ed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:36:07.787120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-732629e5-4112-4f68-80dd-9a05a193a7b9 req-b867b14d-9826-4753-9207-09a0326939ed service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:36:07.798844 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-732629e5-4112-4f68-80dd-9a05a193a7b9 req-b867b14d-9826-4753-9207-09a0326939ed service nova] Creating event network-changed:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h1-846219-13 Jul 25 17:36:07.803965 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-732629e5-4112-4f68-80dd-9a05a193a7b9 req-b867b14d-9826-4753-9207-09a0326939ed service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032821 Jul 25 17:36:07.804885 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3717/7348] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:37:43.904113 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:37:43.905361 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:37:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:38:27.469672 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:38:27.470494 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:38:57.174666 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:38:57.175526 n-d-846219-13 devstack@n-api.service[119598]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e98af31f-6032-407f-97ae-f2fce361f28a] AMQP server on 10.222.0.105:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 17:38:57.176151 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:38:57.176935 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=36 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:38:57.181195 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:38:57.181650 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:38:57.189241 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:57.189687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:57.190449 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:57.190876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:57.215955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.objects.instance [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lazy-loading 'flavor' on Instance uuid e368f868-f91e-4f59-be40-22707d756a0a {{(pid=119598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 17:38:57.437959 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-132616cf-0a1f-4ed2-b337-815121db6915 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "POST /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a/action" status: 202 len: 0 microversion: 2.1 time: 0.265156 Jul 25 17:38:57.438493 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3632/7349] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:38:57 2022] POST /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:38:57.446009 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:38:57.446805 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:38:57.447438 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:38:57.448254 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=38 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:38:57.453692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:38:57.454421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:38:57.464049 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:57.464504 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:57.465301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:57.465746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:57.611316 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:38:57.619142 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-71ea0a62-b9c0-4d0f-b37e-f07651242e1e tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.175210 Jul 25 17:38:57.619697 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3718/7350] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:38:57 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:38:58.644006 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:38:58.644605 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:38:58.654305 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:58.654745 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:58.655496 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:58.655921 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:58.660162 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [0097161d-6b43-4343-82fd-85f23a959a5c] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 51622. Jul 25 17:38:58.660960 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] [e98af31f-6032-407f-97ae-f2fce361f28a] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 51624. Jul 25 17:38:58.796566 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:38:58.804335 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c2741c9e-1fe2-45c9-bd1d-c91947e4ae16 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.167696 Jul 25 17:38:58.804917 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3633/7351] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:38:58 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:38:59.830251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:38:59.831178 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:38:59.842571 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:59.843032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:59.843832 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:38:59.844270 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:38:59.849519 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 51630. Jul 25 17:38:59.852577 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 51628. Jul 25 17:38:59.984923 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:38:59.992831 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a937aa9c-25aa-4079-a43c-fed5016ea0f6 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.169230 Jul 25 17:38:59.993450 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3719/7352] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:38:59 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:01.025437 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:01.026675 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:01.041826 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:01.042743 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:01.043592 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:01.044140 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:01.194657 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:01.202842 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-56606964-ec33-49f3-b1fa-626d30d22c7b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.183429 Jul 25 17:39:01.203439 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3634/7353] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:01 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:02.229697 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:02.230903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:02.242607 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:02.243098 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:02.243874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:02.244318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:02.387053 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:02.396037 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1df2cf19-0587-4ada-a2ac-aa1a6a8da32f tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.173902 Jul 25 17:39:02.396629 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3720/7354] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:02 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:03.423524 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:03.424541 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:03.434169 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:03.434637 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:03.435443 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:03.435875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:03.585948 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:03.594249 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a5d355fe-f7a1-404c-ac65-d0433d18b468 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.177587 Jul 25 17:39:03.594863 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3635/7355] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:03 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:04.620153 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:04.621283 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:04.632829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:04.633321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:04.634088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:04.634535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:04.769019 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:04.777290 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bf585698-fd8e-457e-93d8-819f678007a1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.163814 Jul 25 17:39:04.777873 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3721/7356] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:04 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:05.803875 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:05.804851 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:05.812955 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:05.813517 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:05.814334 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:05.814855 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:05.949462 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:05.957690 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-ec136a71-b99c-4f8e-8fdf-9e10c2898b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.160848 Jul 25 17:39:05.958250 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3636/7357] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:05 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:06.982448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:06.983485 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:06.995235 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:06.996003 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:06.997352 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:06.998097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:07.148630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:07.156908 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-090d1655-37bb-4cdd-bc8a-3b208cc355a5 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.180909 Jul 25 17:39:07.157609 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3722/7358] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:06 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:08.182164 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:08.182949 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:08.192867 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:08.193495 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:08.194565 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:08.195118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:08.357257 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:08.365349 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3ae01a28-e91b-452c-bdba-b138882f89ba tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.189525 Jul 25 17:39:08.365929 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3637/7359] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:08 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:09.391262 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:09.392267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:09.402711 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:09.403179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:09.403971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:09.404424 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:09.564562 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:09.576487 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38e29a92-a442-4fa0-ab74-b90775108196 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1705 microversion: 2.1 time: 0.191794 Jul 25 17:39:09.577269 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3723/7360] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:09 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1705 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:10.602283 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:10.602934 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:10.610168 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:10.610614 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:10.611398 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:10.611817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:10.760070 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:10.768355 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-6b17b4a1-be83-4a62-8fb6-0d6f55197995 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1705 microversion: 2.1 time: 0.170175 Jul 25 17:39:10.768934 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3638/7361] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:10 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1705 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:11.790031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:11.790664 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:11.798534 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:11.799154 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:11.800328 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:11.801000 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:11.940802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:11.948916 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0a34fd55-589e-4b1e-896e-c6807ce387ec tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1705 microversion: 2.1 time: 0.162951 Jul 25 17:39:11.949550 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3724/7362] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:11 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1705 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:12.972246 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:12.972876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:12.981423 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:12.981885 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:12.982659 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:12.983103 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:13.090138 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-67ecaf58-bc2b-47d7-bf26-51b53aae0bc7 req-72af3e1f-c893-4236-bfcf-09846c210287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "name": "network-vif-plugged", "status": "completed", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:39:13.101620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-67ecaf58-bc2b-47d7-bf26-51b53aae0bc7 req-72af3e1f-c893-4236-bfcf-09846c210287 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:13.102112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-67ecaf58-bc2b-47d7-bf26-51b53aae0bc7 req-72af3e1f-c893-4236-bfcf-09846c210287 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:13.116941 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-67ecaf58-bc2b-47d7-bf26-51b53aae0bc7 req-72af3e1f-c893-4236-bfcf-09846c210287 service nova] Creating event network-vif-plugged:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h1-846219-13 Jul 25 17:39:13.119819 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:13.123655 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-67ecaf58-bc2b-47d7-bf26-51b53aae0bc7 req-72af3e1f-c893-4236-bfcf-09846c210287 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037427 Jul 25 17:39:13.124393 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3725/7363] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:39:13.128631 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1d998f68-1689-440d-8bb8-97a844f88c80 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1705 microversion: 2.1 time: 0.161034 Jul 25 17:39:13.129268 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3639/7364] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:12 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1705 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:14.156643 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:14.157840 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:14.168376 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:14.168857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:14.169670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:14.170112 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:14.306688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:14.319059 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c58c0d38-647b-4c31-8eb5-f36e67de57be tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1705 microversion: 2.1 time: 0.170723 Jul 25 17:39:14.319851 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3726/7365] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:14 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1705 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:15.342833 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:15.343453 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:15.351084 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:15.351642 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:15.352548 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:15.353255 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:15.575411 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:15.584623 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a562d011-0dfe-4e6e-85e5-02f5bdc51c96 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.246320 Jul 25 17:39:15.585591 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3640/7366] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:15 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:16.608317 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:16.609076 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:16.616641 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:16.617275 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:16.618207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:16.618901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:16.768032 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:16.779562 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-36f5719e-06cd-459b-aede-6b0097aee021 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.175273 Jul 25 17:39:16.789140 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3727/7367] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:16 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:17.804897 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:17.805537 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:17.812581 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:17.813585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:17.814482 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:17.815032 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:17.964514 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:17.978571 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-fe876656-e780-403c-bff7-2c2c2c894752 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.179400 Jul 25 17:39:17.979484 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3641/7368] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:17 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:19.000528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:19.002016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:19.010130 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:19.010926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:19.011807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:19.012290 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:19.173125 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:19.181521 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93972a55-397d-4cbe-8c4f-cbbd04048986 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.185227 Jul 25 17:39:19.182417 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3728/7369] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:18 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:20.207811 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:20.208597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:20.217139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:20.217139 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:20.217522 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:20.217977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:20.359746 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:20.369988 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4c51da39-cbac-4461-9875-d070b4c47420 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.166098 Jul 25 17:39:20.385145 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3642/7370] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:20 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:21.391986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:21.392564 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:21.400133 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:21.400614 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:21.401448 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:21.401907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:21.547767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:21.556511 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-cc657369-5f12-4606-9102-0d7c0441f205 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.168679 Jul 25 17:39:21.557130 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3729/7371] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:21 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:22.579013 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:22.579736 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:22.588351 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:22.589699 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:22.590508 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:22.591022 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:22.786261 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:22.795307 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-7335877d-fe6a-49f8-a479-c698b74c6bc1 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.220345 Jul 25 17:39:22.801781 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3643/7372] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:22 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:23.816965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:23.817629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:23.835129 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:23.838892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:23.839833 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:23.840301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:24.006402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:24.015508 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0adac2fd-5c0a-4bba-af41-bb35775b6063 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.202423 Jul 25 17:39:24.016106 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3730/7373] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:23 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:25.038150 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:25.039368 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:25.050397 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:25.051094 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:25.052939 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:25.053734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:25.192769 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:25.200486 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-3d3b70af-e3db-4e08-b3c6-4b611f31c0b2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1700 microversion: 2.1 time: 0.166374 Jul 25 17:39:25.201108 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3644/7374] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:25 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:26.222693 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:26.223321 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:26.230520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:26.230980 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:26.231764 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:26.232204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:26.365312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:26.373144 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-9cc5e776-c2f7-4957-b77d-df3e11b2eb03 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1682 microversion: 2.1 time: 0.154782 Jul 25 17:39:26.373774 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3731/7375] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:26 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:27.406021 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:27.406599 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:27.409325 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=27 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:39:27.414908 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:27.415362 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:27.416134 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:27.416568 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:27.419332 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:39:27.579433 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:27.587489 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-a672170f-c5e6-47cf-ac51-6423e00b4ee2 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1682 microversion: 2.1 time: 0.188464 Jul 25 17:39:27.588076 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3645/7376] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:27 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:28.612445 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:28.613259 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:28.616593 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=29 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:39:28.623333 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:28.623888 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:28.624820 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:28.625388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:28.628969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=81 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:39:28.774191 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:28.784044 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-93f9fda4-b835-4a1e-9e15-826f825b25a8 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1685 microversion: 2.1 time: 0.177158 Jul 25 17:39:28.784676 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3732/7377] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:28 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:28.804585 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:39:28.805202 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:28.811554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:28.812053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:28.812876 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:28.813352 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:28.909122 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-06076a2a-ddf6-4e8a-aa96-6c9d603c7759 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "POST /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a/action" status: 202 len: 0 microversion: 2.1 time: 0.108516 Jul 25 17:39:28.909681 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3646/7378] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:39:28 2022] POST /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:39:28.918007 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:28.918631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:28.924828 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:28.925331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:28.926115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:28.926559 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:29.080104 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-901a447d-9685-46ca-80b1-6a3e45299132 req-e945607c-d3a7-4f0d-9519-3362f339af16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "name": "network-vif-unplugged", "status": "completed", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:39:29.093118 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-901a447d-9685-46ca-80b1-6a3e45299132 req-e945607c-d3a7-4f0d-9519-3362f339af16 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:29.093590 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-901a447d-9685-46ca-80b1-6a3e45299132 req-e945607c-d3a7-4f0d-9519-3362f339af16 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:29.106214 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.compute.server_external_events [req-901a447d-9685-46ca-80b1-6a3e45299132 req-e945607c-d3a7-4f0d-9519-3362f339af16 service nova] Unable to find a host for instance e368f868-f91e-4f59-be40-22707d756a0a. Dropping event network-vif-unplugged {{(pid=119598) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 17:39:29.107116 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-901a447d-9685-46ca-80b1-6a3e45299132 req-e945607c-d3a7-4f0d-9519-3362f339af16 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032185 Jul 25 17:39:29.108073 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3647/7379] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 17:39:29.416679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:29.424611 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0eaf9cdd-eb52-43eb-bd03-fb0d17abb780 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1633 microversion: 2.1 time: 0.510338 Jul 25 17:39:29.425113 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3733/7380] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:28 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1633 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:30.446097 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:30.446670 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:30.454550 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:30.454996 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:30.455762 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:30.456189 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:30.658597 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:30.666636 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-37c69828-963e-465f-bb6f-6cbbc0f16e47 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.224432 Jul 25 17:39:30.667218 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3648/7381] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:30 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:31.419054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c103b21a-313b-4373-855b-1d482980e721 req-149c3147-c3dd-4153-909a-7b7133f8bea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:39:31.430435 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c103b21a-313b-4373-855b-1d482980e721 req-149c3147-c3dd-4153-909a-7b7133f8bea8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:31.430892 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c103b21a-313b-4373-855b-1d482980e721 req-149c3147-c3dd-4153-909a-7b7133f8bea8 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:31.443360 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c103b21a-313b-4373-855b-1d482980e721 req-149c3147-c3dd-4153-909a-7b7133f8bea8 service nova] Creating event network-changed:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h2-846219-13 Jul 25 17:39:31.448559 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c103b21a-313b-4373-855b-1d482980e721 req-149c3147-c3dd-4153-909a-7b7133f8bea8 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101285 Jul 25 17:39:31.449576 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3734/7382] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:39:31.690451 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:31.691053 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:31.698402 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:31.698817 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:31.699610 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:31.700039 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:31.928035 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:31.936077 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-147442c0-3456-45b1-88a3-98ec68e943cb tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.249633 Jul 25 17:39:31.936677 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3649/7383] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:31 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:32.958936 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:32.960558 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:32.970010 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:32.970759 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:32.971746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:32.972713 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:33.215585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:33.224636 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-31618b83-baa3-496e-ba5b-3dfd0b986ac0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.269901 Jul 25 17:39:33.225250 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3735/7384] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:32 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:34.246235 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:34.246849 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:34.253950 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:34.254399 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:34.255160 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:34.255595 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:34.400527 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:34.409381 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-702494b5-6f17-4332-922b-5d2a241e9fac tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.166937 Jul 25 17:39:34.410244 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3650/7385] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:34 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:35.430339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:35.431177 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:35.438700 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:35.439164 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:35.439968 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:35.440412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:35.586911 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:35.600014 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7f4f0db-9eec-4e4a-b97d-450b36af1cc7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.173712 Jul 25 17:39:35.600815 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3736/7386] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:35 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:36.621734 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:36.623056 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:36.630873 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:36.631431 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:36.632337 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:36.632831 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:36.770534 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:36.794226 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-1b16d2f5-b72d-41b7-9562-ed8cf3d483d7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.176325 Jul 25 17:39:36.802675 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3651/7387] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:36 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:37.816469 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:37.817152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:37.824468 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:37.825329 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:37.826128 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:37.826569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:37.974985 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:37.985316 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-026847f0-2521-4be9-91ad-f61208d22736 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.173107 Jul 25 17:39:37.986633 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3737/7388] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:37 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:39.012781 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:39.013480 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:39.021638 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:39.022089 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:39.022850 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:39.023279 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:39.189322 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:39.199509 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-df0e867d-f21b-49fd-ae5e-491a1b4bab11 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.192818 Jul 25 17:39:39.200479 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3652/7389] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:39 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:40.221974 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:40.222971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:40.230208 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:40.230621 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:40.231422 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:40.231871 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:40.371088 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:40.379027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f5c5c473-6d3a-4510-bcdf-e6b531e11b04 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.161308 Jul 25 17:39:40.379617 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3738/7390] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:40 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:41.404870 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:41.405721 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:41.416558 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:41.417149 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:41.418404 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:41.418977 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:41.571475 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:41.582919 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d4f39a82-8364-4c53-a423-96c65b94a88a tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.183019 Jul 25 17:39:41.583674 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3653/7391] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:41 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:42.609549 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:42.610419 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:42.618189 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:42.618656 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:42.619473 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:42.619926 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:42.763105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:42.771158 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-22269fb2-219c-4a65-9d23-f76e1bda9152 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.169272 Jul 25 17:39:42.771757 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3739/7392] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:42 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:43.801924 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:43.802544 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:43.812964 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:43.813633 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:43.814549 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:43.814984 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:43.951692 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:43.961115 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-4166f55a-2dd7-4161-9092-8384af721200 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.165715 Jul 25 17:39:43.961765 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3654/7393] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:43 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:44.982772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:44.983336 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:44.990818 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:44.991279 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:44.992070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:44.992519 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:45.132746 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:45.140955 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3a2dff27-f679-422a-bdf7-6ed45f2e003d tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.162279 Jul 25 17:39:45.141812 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3740/7394] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:44 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:45.910554 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [req-a22d8e44-0d70-4454-b936-24f9b3da4715 req-bdec78f2-4db7-4394-9171-f19395b33720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "name": "network-vif-plugged", "status": "completed", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:39:45.920865 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a22d8e44-0d70-4454-b936-24f9b3da4715 req-bdec78f2-4db7-4394-9171-f19395b33720 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:45.921323 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [req-a22d8e44-0d70-4454-b936-24f9b3da4715 req-bdec78f2-4db7-4394-9171-f19395b33720 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:45.933332 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.compute.server_external_events [req-a22d8e44-0d70-4454-b936-24f9b3da4715 req-bdec78f2-4db7-4394-9171-f19395b33720 service nova] Creating event network-vif-plugged:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h2-846219-13 Jul 25 17:39:45.938399 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [req-a22d8e44-0d70-4454-b936-24f9b3da4715 req-bdec78f2-4db7-4394-9171-f19395b33720 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 Jul 25 17:39:45.939107 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3655/7395] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:39:46.162963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:46.163552 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:46.170810 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:46.171331 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:46.172120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:46.172569 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:46.311868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:46.321368 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6958db5a-7bef-4cc6-a2ef-cba48882d198 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.162042 Jul 25 17:39:46.322215 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3741/7396] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:46 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:47.344606 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:47.345388 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:47.352125 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:47.352577 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:47.353369 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:47.353978 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:47.498371 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:47.506564 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d269092c-465a-443a-9bae-e202820e803b tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1691 microversion: 2.1 time: 0.167138 Jul 25 17:39:47.507159 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3656/7397] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:47 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:39:48.532580 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:39:48.533494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:39:48.542086 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:48.542631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:48.543553 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:39:48.544074 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:39:48.685585 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:39:48.694372 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b6df92fc-61cd-4cdf-92f9-c8272601bc9c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1678 microversion: 2.1 time: 0.168129 Jul 25 17:39:48.694963 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3742/7398] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:39:48 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:41:02.311687 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_api:SELECT=25 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:41:02.315529 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=21 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:41:02.316390 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=61 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:41:02.316788 n-d-846219-13 devstack@n-api.service[119598]: DEBUG dbcounter [-] [119598] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:41:02.321132 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:41:02.321621 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:41:02.331587 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-9863f17e-ab95-44a4-9172-2d52c5030f99 req-41ca83bc-5f21-4283-90e7-6f5f541f2e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:41:02.343525 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:02.344024 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:02.344839 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:02.345288 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:02.346620 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9863f17e-ab95-44a4-9172-2d52c5030f99 req-41ca83bc-5f21-4283-90e7-6f5f541f2e2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:02.347160 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-9863f17e-ab95-44a4-9172-2d52c5030f99 req-41ca83bc-5f21-4283-90e7-6f5f541f2e2d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:02.359400 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-9863f17e-ab95-44a4-9172-2d52c5030f99 req-41ca83bc-5f21-4283-90e7-6f5f541f2e2d service nova] Creating event network-changed:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h2-846219-13 Jul 25 17:41:02.364855 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-9863f17e-ab95-44a4-9172-2d52c5030f99 req-41ca83bc-5f21-4283-90e7-6f5f541f2e2d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051173 Jul 25 17:41:02.365725 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3743/7399] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:41:02.379348 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Going to try to terminate instance {{(pid=119598) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:41:02.465705 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-de086da4-ed17-4db3-a54f-2ec20be2deaf tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "DELETE /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 204 len: 0 microversion: 2.1 time: 0.155800 Jul 25 17:41:02.467177 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3657/7400] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:41:02 2022] DELETE /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:41:02.476960 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:41:02.477718 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:41:02.485989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:02.485989 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:02.486703 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:02.487136 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:02.971204 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:41:02.979500 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-89383928-3083-4573-b3d2-7006a9f92c51 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.507948 Jul 25 17:41:02.980080 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3744/7401] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:41:02 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:41:03.873852 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:41:03.874596 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:41:03.915745 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:41:03.916083 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:41:04.006363 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:41:04.007864 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:41:04.022704 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:04.023076 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:04.023884 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:04.024320 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:04.275749 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.policy [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef02432a168d4c90adb105c182b8a0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13724fb7644d48c59f3d316fc5f7bd0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119598) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:41:04.279226 n-d-846219-13 devstack@n-api.service[119598]: Traceback (most recent call last): Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: timer() Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: cb(*args, **kw) Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: waiter.switch() Jul 25 17:41:04.279378 n-d-846219-13 devstack@n-api.service[119598]: greenlet.error: cannot switch to a different thread Jul 25 17:41:04.285520 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-c04f7329-4698-47da-ac13-1999454de27c tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 200 len: 1684 microversion: 2.1 time: 0.286424 Jul 25 17:41:04.286210 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3658/7402] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:41:03 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 1684 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:41:04.642162 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-559991e6-e74e-4db8-bef1-f736c416673d req-7f656765-4a9f-4d41-85fc-6295731f8cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e368f868-f91e-4f59-be40-22707d756a0a", "name": "network-vif-deleted", "tag": "3149e296-0911-4f08-af5a-61cd4084ab76"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:41:04.653286 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-559991e6-e74e-4db8-bef1-f736c416673d req-7f656765-4a9f-4d41-85fc-6295731f8cd5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:04.653829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-559991e6-e74e-4db8-bef1-f736c416673d req-7f656765-4a9f-4d41-85fc-6295731f8cd5 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:04.665949 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-559991e6-e74e-4db8-bef1-f736c416673d req-7f656765-4a9f-4d41-85fc-6295731f8cd5 service nova] Creating event network-vif-deleted:3149e296-0911-4f08-af5a-61cd4084ab76 for instance e368f868-f91e-4f59-be40-22707d756a0a on n-h2-846219-13 Jul 25 17:41:04.671062 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-559991e6-e74e-4db8-bef1-f736c416673d req-7f656765-4a9f-4d41-85fc-6295731f8cd5 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095215 Jul 25 17:41:04.671702 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3745/7403] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:41:05.310682 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '>' {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:41:05.311694 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.compute.api [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] [instance: e368f868-f91e-4f59-be40-22707d756a0a] Fetching instance by UUID {{(pid=119598) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:41:05.322481 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:05.322961 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:05.323729 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:41:05.324158 n-d-846219-13 devstack@n-api.service[119598]: DEBUG oslo_concurrency.lockutils [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:41:05.337970 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.wsgi [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] HTTP exception thrown: Instance e368f868-f91e-4f59-be40-22707d756a0a could not be found. Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Request method failure captured: Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: request: GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a HTTP/1.1 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Accept: application/json Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Accept-Encoding: identity Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Connection: close Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Content-Length: 0 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Content-Type: application/json Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Host: 10.222.0.105 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: Openstack-System-Scope: None Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: User-Agent: python-urllib3/1.26.10 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Auth-Token: gAAAAABi3tRxxszQYo-Y8usaf1vn9LzVRomHF4bXg3oa9MQCK92VFizuCQ50dUXLHA8PeyNAB3BrdCD7JjNk-H4iO22TTUSxG98nSKhSZoAIqGxVr7GAlrQSSqW3dPu-Qos1Qf6sgGz-1sa3FbcsBHnoaGFQkNFZcC0O7-lNXLMxdJuPyyNnrtg Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Id: None Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Domain-Name: None Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Identity-Status: Confirmed Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Is-Admin-Project: True Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Id: default Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Domain-Name: Default Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Id: 13724fb7644d48c59f3d316fc5f7bd0c Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Project-Name: tempest-TestShelveInstance-433026112 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Role: member,reader Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Roles: member,reader Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/13724fb7644d48c59f3d316fc5f7bd0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/13724fb7644d48c59f3d316fc5f7bd0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/13724fb7644d48c59f3d316fc5f7bd0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_13724fb7644d48c59f3d316fc5f7bd0c"}]}] Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant: tempest-TestShelveInstance-433026112 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Id: 13724fb7644d48c59f3d316fc5f7bd0c Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-Tenant-Name: tempest-TestShelveInstance-433026112 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-User: tempest-TestShelveInstance-433026112-project Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Id: default Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-User-Domain-Name: Default Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-User-Id: ef02432a168d4c90adb105c182b8a0c2 Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: X-User-Name: tempest-TestShelveInstance-433026112-project Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: method: > Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: exception: Instance e368f868-f91e-4f59-be40-22707d756a0a could not be found. Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: action_args: {'id': 'e368f868-f91e-4f59-be40-22707d756a0a'} Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e368f868-f91e-4f59-be40-22707d756a0a could not be found. Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e368f868-f91e-4f59-be40-22707d756a0a could not be found. Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:41:05.339634 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e368f868-f91e-4f59-be40-22707d756a0a could not be found. Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: ERROR nova.api.openstack.wsgi Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Returning 404 to user: Instance e368f868-f91e-4f59-be40-22707d756a0a could not be found. {{(pid=119598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: INFO nova.api.openstack.requestlog [None req-d1bf3c60-6ebc-4bc3-8802-c2c2d1f387f7 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a" status: 404 len: 111 microversion: 2.1 time: 0.037206 Jul 25 17:41:05.344877 n-d-846219-13 devstack@n-api.service[119598]: [pid: 119598|app: 0|req: 3659/7404] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:41:05 2022] GET /compute/v2.1/servers/e368f868-f91e-4f59-be40-22707d756a0a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:41:05.512868 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e75c9efc-9a05-4b19-afc4-2c0d8251cab0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Calling method '.version_select at 0x7f9d902a2430>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:41:05.538300 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e75c9efc-9a05-4b19-afc4-2c0d8251cab0 tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-745457393" status: 202 len: 0 microversion: 2.1 time: 0.029585 Jul 25 17:41:05.538909 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3746/7405] 10.222.0.105 () {58 vars in 1256 bytes} [Mon Jul 25 17:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-745457393 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 17:41:05.558338 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.api.openstack.wsgi [None req-44eb301d-853c-45d7-8f32-4ee8e6d573fe tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Action: 'create', calling method: .version_select at 0x7f9d92901820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1720301047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3O7VN1j0/uDzxPN1vF2W0G+BFoqhZR6HC7IM+FgRUv9RnzlV2y5+2VcBJYleL89oxv4JoerZfV/BkHMTF37d9kTbR1nBBhyBpmfchaAQEj81Jci/lfLR1Ask0IO2d44Q=="}} {{(pid=119598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:41:05.575085 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-44eb301d-853c-45d7-8f32-4ee8e6d573fe tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Getting quotas for project 13724fb7644d48c59f3d316fc5f7bd0c. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:41:05.583154 n-d-846219-13 devstack@n-api.service[119598]: DEBUG nova.quota [None req-44eb301d-853c-45d7-8f32-4ee8e6d573fe tempest-TestShelveInstance-433026112 tempest-TestShelveInstance-433026112-project] Getting quotas for user ef02432a168d4c90adb105c182b8a0c2 and project 13724fb7644d48c59f3d316fc5f7bd0c. Resources: {'key_pairs'} {{(pid=119598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:42:23.985986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=10 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:42:23.987031 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:42:24.176951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7211daee-5c56-4e29-b608-cb59e32dd0d2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Action: 'create', calling method: .version_select at 0x7f9d902b9a60>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1847023868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo8jSD6qoaJkUKnHt+6Jw0Xmj9CWVbr6KgjFRIgPMfWI+4ILkFkiiSojmhnqTHUUWvTLDuh+3xS0hwnggV8oU7obA300ctPXc/QeRwrFjDtyhAiOqw5hAFWb55vuvHk9Q=="}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:42:24.193520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7211daee-5c56-4e29-b608-cb59e32dd0d2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Getting quotas for project 60865e1237ca4c65bf71754a94e1a26f. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:42:24.199589 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-7211daee-5c56-4e29-b608-cb59e32dd0d2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Getting quotas for user d41a5510006c44efa1aa09880520becf and project 60865e1237ca4c65bf71754a94e1a26f. Resources: {'key_pairs'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:42:24.227223 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7211daee-5c56-4e29-b608-cb59e32dd0d2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.243478 Jul 25 17:42:24.227836 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3747/7406] 10.222.0.105 () {60 vars in 1164 bytes} [Mon Jul 25 17:42:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:42:25.265490 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1105970674", "imageRef": "984a5010-f259-40b9-952b-c497908cc5d8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1847023868", "security_groups": [{"name": "tempest-secgroup-smoke-603681348"}], "networks": [{"uuid": "9d1da11c-3e39-41fa-83f9-1fad32336e7f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:42:25.391963 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] validate_networks() for [('9d1da11c-3e39-41fa-83f9-1fad32336e7f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:42:25.879245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:42:25.880636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:42:25.881195 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:42:25.881627 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:42:25.882060 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:42:25.891152 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:25.891618 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:25.892993 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:25.893646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:25.910757 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Getting quotas for project 60865e1237ca4c65bf71754a94e1a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:42:25.915965 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Getting quotas for user d41a5510006c44efa1aa09880520becf and project 60865e1237ca4c65bf71754a94e1a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:42:25.929735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:42:25.932249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='984a5010-f259-40b9-952b-c497908cc5d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:42:25.980203 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dfef49c9-bc3a-4ef5-95fd-93dac93ab8cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.719510 Jul 25 17:42:25.980876 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3748/7407] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:42:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:42:25.991743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-53c5b02e-336b-4633-971f-6b872f83a71c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:25.992372 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-53c5b02e-336b-4633-971f-6b872f83a71c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:26.048232 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-53c5b02e-336b-4633-971f-6b872f83a71c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:26.056290 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-53c5b02e-336b-4633-971f-6b872f83a71c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1253 microversion: 2.1 time: 0.068429 Jul 25 17:42:26.057088 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3749/7408] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:25 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1253 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:42:27.078411 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:27.079070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:27.090706 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:27.091251 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:27.092213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:27.092730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:27.162827 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:27.170712 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-be55779d-045e-4882-bceb-f26b69141f55 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1305 microversion: 2.1 time: 0.096208 Jul 25 17:42:27.171584 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3750/7409] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:27 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:42:28.192767 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:28.193500 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:28.201402 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:28.201869 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:28.202857 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:28.203322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:28.428947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:28.437118 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b2696c19-6b8b-4663-86ac-234b596761c1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.248708 Jul 25 17:42:28.437735 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3751/7410] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:28 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:28.981226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-b652c36b-8caf-4107-94e3-8e812be8b0bc req-15d2cc92-d44f-4d0b-b056-4045a909e2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:42:28.999903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b652c36b-8caf-4107-94e3-8e812be8b0bc req-15d2cc92-d44f-4d0b-b056-4045a909e2f4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:29.000839 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-b652c36b-8caf-4107-94e3-8e812be8b0bc req-15d2cc92-d44f-4d0b-b056-4045a909e2f4 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:29.014985 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-b652c36b-8caf-4107-94e3-8e812be8b0bc req-15d2cc92-d44f-4d0b-b056-4045a909e2f4 service nova] Creating event network-changed:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:42:29.021855 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-b652c36b-8caf-4107-94e3-8e812be8b0bc req-15d2cc92-d44f-4d0b-b056-4045a909e2f4 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046006 Jul 25 17:42:29.022489 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3752/7411] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:42:29.459042 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:29.459747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:29.467267 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:29.467730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:29.468495 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:29.468931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:29.611226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:29.619932 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-eb013a0c-02cd-47cb-abde-3c508df2e75f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.165171 Jul 25 17:42:29.620519 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3753/7412] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:29 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:42:30.645582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:30.646274 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:30.653927 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:30.654465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:30.655364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:30.655886 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:30.799743 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:30.807587 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a298e712-a2e1-495d-bd44-ff19edca4a5c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.168656 Jul 25 17:42:30.808139 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3754/7413] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:30 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:31.832674 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:31.833407 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:31.840629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:31.841103 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:31.841898 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:31.842345 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:31.977400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:31.985868 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0595b730-492e-4651-a6fa-8882ca37517e tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.159799 Jul 25 17:42:31.986460 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3755/7414] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:31 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:33.011714 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:33.012690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:33.024502 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:33.025301 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:33.026584 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:33.027319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:33.177452 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:33.185207 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a878d458-3122-4e06-aaf2-e4d6c592f2d7 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.180356 Jul 25 17:42:33.185824 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3756/7415] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:33 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:34.210171 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:34.210830 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:34.218630 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:34.219124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:34.220242 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:34.220750 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:34.366395 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:34.375606 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-38e1570a-3cca-4d86-aca5-31afc535b3b6 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.172942 Jul 25 17:42:34.376374 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3757/7416] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:34 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:35.403326 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:35.404295 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:35.415109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:35.415575 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:35.416356 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:35.416805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:35.553087 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:35.561364 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-3b2b41c4-b09f-45f9-9457-4778fbbfcac2 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.164903 Jul 25 17:42:35.561976 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3758/7417] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:35 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:36.046209 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:42:36.052947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=12 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:42:36.112971 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-c7ffb4a5-3a29-4ccc-89cf-e861fdfbcfdd req-ee57ff1c-f79a-4fdf-9c15-d9d909b873ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "name": "network-vif-plugged", "status": "completed", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:42:36.122914 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c7ffb4a5-3a29-4ccc-89cf-e861fdfbcfdd req-ee57ff1c-f79a-4fdf-9c15-d9d909b873ac service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:36.123377 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-c7ffb4a5-3a29-4ccc-89cf-e861fdfbcfdd req-ee57ff1c-f79a-4fdf-9c15-d9d909b873ac service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:36.134533 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-c7ffb4a5-3a29-4ccc-89cf-e861fdfbcfdd req-ee57ff1c-f79a-4fdf-9c15-d9d909b873ac service nova] Creating event network-vif-plugged:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:42:36.139550 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-c7ffb4a5-3a29-4ccc-89cf-e861fdfbcfdd req-ee57ff1c-f79a-4fdf-9c15-d9d909b873ac service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098515 Jul 25 17:42:36.140168 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3759/7418] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:42:36.584497 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:36.585187 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:36.592477 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:36.593021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:36.593928 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:36.594412 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:36.739535 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:36.747651 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f2d0a636-b6a3-4455-bc91-e8ec61653386 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.168478 Jul 25 17:42:36.748280 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3760/7419] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:36 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:37.772967 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:37.774139 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:37.783054 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:37.783631 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:37.784635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:37.785243 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:37.925064 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:37.933819 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-dc43046e-bda9-4e1c-9e17-25f5eed68d30 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1378 microversion: 2.1 time: 0.167432 Jul 25 17:42:37.934516 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3761/7420] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:37 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1378 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:38.959237 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:38.960287 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:38.971912 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:38.972675 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:38.974025 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:38.974769 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:39.120931 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:39.128713 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-6dcc1a10-e6c5-4eec-b86c-4888fe7240e9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1564 microversion: 2.1 time: 0.176104 Jul 25 17:42:39.129320 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3762/7421] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:38 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:39.148426 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:42:39.149045 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:42:39.155141 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:39.155606 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:39.156388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:39.156831 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:39.296603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:42:39.304337 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4642da97-fd9c-4ed3-a8d4-d65c9ce1ffab tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1564 microversion: 2.1 time: 0.159458 Jul 25 17:42:39.305032 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3763/7422] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:42:39 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:42:41.266835 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-ed57dd38-b708-414d-8c82-3f85aa9a975a req-64cb10e9-02fc-4ab5-9433-4c44a82df112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:42:41.277437 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ed57dd38-b708-414d-8c82-3f85aa9a975a req-64cb10e9-02fc-4ab5-9433-4c44a82df112 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:42:41.277901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-ed57dd38-b708-414d-8c82-3f85aa9a975a req-64cb10e9-02fc-4ab5-9433-4c44a82df112 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:42:41.290265 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-ed57dd38-b708-414d-8c82-3f85aa9a975a req-64cb10e9-02fc-4ab5-9433-4c44a82df112 service nova] Creating event network-changed:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:42:41.295705 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-ed57dd38-b708-414d-8c82-3f85aa9a975a req-64cb10e9-02fc-4ab5-9433-4c44a82df112 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032541 Jul 25 17:42:41.296739 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3764/7423] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:42:44.659457 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:42:44.660438 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:45:18.917533 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:45:18.918502 n-d-846219-13 devstack@n-api.service[119599]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] AMQP server on 10.222.0.105:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 17:45:18.919236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:18.920021 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=80 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:18.925192 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-97802311"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:45:18.927690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:18.936186 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:18.936694 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:18.937543 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:18.938026 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:19.273014 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b4017df3-8f5e-43bd-9b63-b626fca7f0f9 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "POST /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a/action" status: 202 len: 0 microversion: 2.1 time: 0.357066 Jul 25 17:45:19.273671 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3765/7424] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:45:18 2022] POST /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 17:45:26.999339 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-a7de1e81-8205-4178-8450-98505e23fa19 req-498549d9-3747-4c94-a832-c4fca449acb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "name": "network-vif-plugged", "status": "completed", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:45:27.015711 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dfac858-1980-406e-9a9f-52155cbcf8cd] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 52228. Jul 25 17:45:27.021989 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c6c6802-4626-4b39-9249-60d43db7fc89] Reconnected to AMQP server on 10.222.0.105:5672 via [amqp] client with port 52226. Jul 25 17:45:27.027986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a7de1e81-8205-4178-8450-98505e23fa19 req-498549d9-3747-4c94-a832-c4fca449acb1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:27.028449 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-a7de1e81-8205-4178-8450-98505e23fa19 req-498549d9-3747-4c94-a832-c4fca449acb1 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:27.039441 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-a7de1e81-8205-4178-8450-98505e23fa19 req-498549d9-3747-4c94-a832-c4fca449acb1 service nova] Creating event network-vif-plugged:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:45:27.044665 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-a7de1e81-8205-4178-8450-98505e23fa19 req-498549d9-3747-4c94-a832-c4fca449acb1 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051972 Jul 25 17:45:27.045556 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3766/7425] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:45:41.069771 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-386444801", "imageRef": "eb190298-7e76-453d-8ec1-02ebd6fc9052", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1847023868", "security_groups": [{"name": "tempest-secgroup-smoke-603681348"}], "networks": [{"uuid": "9d1da11c-3e39-41fa-83f9-1fad32336e7f"}]}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:45:41.079249 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=4 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:41.079949 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:41.190311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.network.neutron [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] validate_networks() for [('9d1da11c-3e39-41fa-83f9-1fad32336e7f', None, None, None, None, None)] {{(pid=119599) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 17:45:41.596219 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Flavor limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 17:45:41.596661 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Image limits 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 17:45:41.597213 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Flavor pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 17:45:41.597638 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Image pref 0:0:0 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 17:45:41.598068 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.virt.hardware [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 17:45:41.607874 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:41.608340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:41.609578 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:41.610033 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:41.628115 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Getting quotas for project 60865e1237ca4c65bf71754a94e1a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 17:45:41.633634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.quota [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Getting quotas for user d41a5510006c44efa1aa09880520becf and project 60865e1237ca4c65bf71754a94e1a26f. Resources: {'ram', 'cores', 'instances'} {{(pid=119599) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 17:45:41.646782 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Going to run 1 instances... {{(pid=119599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 17:45:41.649311 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb190298-7e76-453d-8ec1-02ebd6fc9052',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 17:45:41.705397 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1cb9888d-1eec-4630-9a7c-00d68d5c2604 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.639906 Jul 25 17:45:41.706257 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3767/7426] 10.222.0.105 () {60 vars in 1152 bytes} [Mon Jul 25 17:45:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 17:45:41.716932 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-e518b92b-327b-4cbb-a773-a689e5e43e01 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:41.717704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-e518b92b-327b-4cbb-a773-a689e5e43e01 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:41.776238 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-e518b92b-327b-4cbb-a773-a689e5e43e01 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:41.783100 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-e518b92b-327b-4cbb-a773-a689e5e43e01 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1252 microversion: 2.1 time: 0.069850 Jul 25 17:45:41.783675 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3768/7427] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:41 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1252 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:45:42.803951 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:42.804947 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:42.812829 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:42.813442 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:42.814450 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:42.815006 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:42.883226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:42.891971 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c7099879-da51-4425-b4ff-c93bd3695775 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1312 microversion: 2.1 time: 0.091906 Jul 25 17:45:42.892769 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3769/7428] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:42 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:43.914024 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:43.914644 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:43.921890 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:43.922340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:43.923122 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:43.923554 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:44.079797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:44.088018 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-4b7a9dff-c870-4008-855b-358cb947c0ca tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.177966 Jul 25 17:45:44.088860 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3770/7429] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:43 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:45:45.059109 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-8bdc8034-1ce9-4282-a4b2-96d108307fc3 req-3d336497-eb1c-46e5-96eb-8e76ddb3cf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "name": "network-vif-unplugged", "status": "completed", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:45:45.082692 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8bdc8034-1ce9-4282-a4b2-96d108307fc3 req-3d336497-eb1c-46e5-96eb-8e76ddb3cf28 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:45.083247 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-8bdc8034-1ce9-4282-a4b2-96d108307fc3 req-3d336497-eb1c-46e5-96eb-8e76ddb3cf28 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:45.096317 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-8bdc8034-1ce9-4282-a4b2-96d108307fc3 req-3d336497-eb1c-46e5-96eb-8e76ddb3cf28 service nova] Creating event network-vif-unplugged:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:45:45.102242 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-8bdc8034-1ce9-4282-a4b2-96d108307fc3 req-3d336497-eb1c-46e5-96eb-8e76ddb3cf28 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047985 Jul 25 17:45:45.103580 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3771/7430] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:45:45.115525 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:45.116306 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:45.123240 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:45.123712 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:45.124522 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:45.124990 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:45.283944 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:45.293923 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-44748d2c-7943-4e31-904f-c5619e48c046 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.182962 Jul 25 17:45:45.294657 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3772/7431] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:45 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:46.316530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:46.317261 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:46.324904 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:46.325487 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:46.326373 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:46.326894 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:46.479704 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:46.488133 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f1295468-084a-4251-a024-30fe39d4ba1f tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.176176 Jul 25 17:45:46.488724 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3773/7432] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:46 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:45:47.510388 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:47.511903 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:47.519653 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:47.520370 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:47.521400 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:47.522120 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:47.675157 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:47.683732 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8ca0ee19-3bf1-4350-9cbb-a62daa752504 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.177410 Jul 25 17:45:47.684280 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3774/7433] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:47 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:45:48.704041 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:48.704726 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:48.712070 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:48.712588 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:48.713343 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:48.713802 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:48.887544 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:48.895926 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c93030a1-3815-47f7-af47-afae4f2ab461 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.195686 Jul 25 17:45:48.896922 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3775/7434] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:48 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:45:49.919378 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:49.920108 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:49.936016 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:49.936492 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:49.937340 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:49.937797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:50.088511 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:50.097419 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-08713b37-1422-4c94-8ad4-3cdfa5bc3806 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.182059 Jul 25 17:45:50.107842 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3776/7435] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:49 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:51.120179 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:51.120906 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:51.127907 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:51.128355 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:51.129161 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:51.129608 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:51.272909 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:51.280626 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-7342d4c4-b82b-45e7-a754-cef5a09552d1 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.164453 Jul 25 17:45:51.281275 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3777/7436] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:51 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:51.669770 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-444dd58e-f0f6-4bf3-9e88-9100ee9c33ad req-0da33830-59c4-4683-8335-6da98399bb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3f501b-7055-469b-98fe-13fd10e1b471", "tag": "e33fc872-acce-4200-b275-6748e72077cb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:45:51.678167 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=2 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:51.696359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-444dd58e-f0f6-4bf3-9e88-9100ee9c33ad req-0da33830-59c4-4683-8335-6da98399bb0d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:51.697038 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-444dd58e-f0f6-4bf3-9e88-9100ee9c33ad req-0da33830-59c4-4683-8335-6da98399bb0d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:51.710123 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-444dd58e-f0f6-4bf3-9e88-9100ee9c33ad req-0da33830-59c4-4683-8335-6da98399bb0d service nova] Creating event network-changed:e33fc872-acce-4200-b275-6748e72077cb for instance 1d3f501b-7055-469b-98fe-13fd10e1b471 on n-h2-846219-13 Jul 25 17:45:51.715829 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-444dd58e-f0f6-4bf3-9e88-9100ee9c33ad req-0da33830-59c4-4683-8335-6da98399bb0d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052649 Jul 25 17:45:51.716560 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3778/7437] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:45:52.301865 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell0:SELECT=8 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:52.308864 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:52.309719 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:52.317866 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:52.318318 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:52.319216 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:52.319739 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:52.460234 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:52.467893 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-c9b91dad-98ff-4e7d-83b8-1cd4fd14decd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.167906 Jul 25 17:45:52.468451 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3779/7438] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:52 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:53.488837 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:53.489565 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:53.496877 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:53.497364 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:53.498146 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:53.498583 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:53.637545 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:53.645634 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0b435c77-25b7-4aba-9a8b-acdfc5f51fdc tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.160554 Jul 25 17:45:53.646120 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3780/7439] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:53 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:54.675572 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:54.676645 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:54.688465 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:54.689308 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:54.690603 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:54.691353 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:54.829066 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:54.837390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-86bd9ecd-4a1b-454b-8470-61e35666a730 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.169484 Jul 25 17:45:54.838000 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3781/7440] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:54 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:55.859105 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:55.859834 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:55.867315 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:55.867701 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:55.868494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:55.868945 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:56.006397 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:56.014574 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-05361284-d0e5-4171-9ffd-5bbac6c147c3 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.159842 Jul 25 17:45:56.015400 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3782/7441] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:55 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:57.036322 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:57.036992 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:57.043682 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:57.044148 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:57.044937 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:57.045421 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:57.183063 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:57.190990 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8a8b29ed-7dfd-4b5f-9c26-8d515d8793b4 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.159022 Jul 25 17:45:57.191578 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3783/7442] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:57 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:57.543044 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-01411528-b13f-4862-8b5a-5f86b8b86753 req-a227137a-e18f-4f05-a968-b205689be315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3f501b-7055-469b-98fe-13fd10e1b471", "name": "network-vif-plugged", "status": "completed", "tag": "e33fc872-acce-4200-b275-6748e72077cb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:45:57.553226 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-01411528-b13f-4862-8b5a-5f86b8b86753 req-a227137a-e18f-4f05-a968-b205689be315 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:57.553690 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-01411528-b13f-4862-8b5a-5f86b8b86753 req-a227137a-e18f-4f05-a968-b205689be315 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:57.566886 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-01411528-b13f-4862-8b5a-5f86b8b86753 req-a227137a-e18f-4f05-a968-b205689be315 service nova] Creating event network-vif-plugged:e33fc872-acce-4200-b275-6748e72077cb for instance 1d3f501b-7055-469b-98fe-13fd10e1b471 on n-h2-846219-13 Jul 25 17:45:57.571996 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-01411528-b13f-4862-8b5a-5f86b8b86753 req-a227137a-e18f-4f05-a968-b205689be315 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Jul 25 17:45:57.572843 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3784/7443] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:45:58.218582 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:58.219772 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:58.230635 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:58.231408 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:58.232765 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:58.233561 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:58.374530 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:58.382231 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-73ffae6b-4d29-45d7-9198-753648f08335 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1377 microversion: 2.1 time: 0.172867 Jul 25 17:45:58.382884 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3785/7444] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:58 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1377 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:59.404224 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:59.404901 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:59.415359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:59.415821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:59.416600 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:59.417051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:59.558636 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:59.570738 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f96fdc14-2d6e-4643-a7d5-0d3ca5082c92 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1562 microversion: 2.1 time: 0.171351 Jul 25 17:45:59.571597 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3786/7445] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:59 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:45:59.596097 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:45:59.596708 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:45:59.603276 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:59.603730 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:59.604503 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:45:59.604942 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:45:59.609451 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=100 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:45:59.744163 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:45:59.752206 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-1027465b-4d45-4a26-b4dc-5d5e31bc22cd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1562 microversion: 2.1 time: 0.159759 Jul 25 17:45:59.752796 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3787/7446] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:45:59 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 17:46:01.762863 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-3fccfbc3-1e08-4486-850f-c504cb2b2208 req-5a32711c-33fc-4153-aaa4-2a1d272dc5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3f501b-7055-469b-98fe-13fd10e1b471", "tag": "e33fc872-acce-4200-b275-6748e72077cb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:46:01.773520 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3fccfbc3-1e08-4486-850f-c504cb2b2208 req-5a32711c-33fc-4153-aaa4-2a1d272dc5e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:46:01.773988 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-3fccfbc3-1e08-4486-850f-c504cb2b2208 req-5a32711c-33fc-4153-aaa4-2a1d272dc5e0 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:46:01.785884 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-3fccfbc3-1e08-4486-850f-c504cb2b2208 req-5a32711c-33fc-4153-aaa4-2a1d272dc5e0 service nova] Creating event network-changed:e33fc872-acce-4200-b275-6748e72077cb for instance 1d3f501b-7055-469b-98fe-13fd10e1b471 on n-h2-846219-13 Jul 25 17:46:01.791221 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-3fccfbc3-1e08-4486-850f-c504cb2b2208 req-5a32711c-33fc-4153-aaa4-2a1d272dc5e0 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032027 Jul 25 17:46:01.792029 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3788/7447] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:46:04.675765 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:46:04.676774 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:46:20.765605 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:46:20.766571 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:47:29.023677 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:47:29.024536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG dbcounter [-] [119599] Writing DB stats nova_cell1:SELECT=6 {{(pid=119599) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 17:47:29.079269 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-756480061"}} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:47:29.081799 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:29.088528 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:29.088986 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:29.089797 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:29.090245 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:29.301346 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0634e29c-7d50-4f34-9f1d-8721a481b8fb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "POST /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471/action" status: 202 len: 0 microversion: 2.1 time: 0.281675 Jul 25 17:47:29.301966 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3789/7448] 10.222.0.105 () {60 vars in 1283 bytes} [Mon Jul 25 17:47:29 2022] POST /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 17:47:33.950783 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-639f1cd1-7477-4b1c-8796-04287363d5ff req-5b6380aa-2486-440f-953c-65a402a405c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3f501b-7055-469b-98fe-13fd10e1b471", "name": "network-vif-plugged", "status": "completed", "tag": "e33fc872-acce-4200-b275-6748e72077cb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:47:33.967288 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-639f1cd1-7477-4b1c-8796-04287363d5ff req-5b6380aa-2486-440f-953c-65a402a405c3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:33.967855 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-639f1cd1-7477-4b1c-8796-04287363d5ff req-5b6380aa-2486-440f-953c-65a402a405c3 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:33.983791 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-639f1cd1-7477-4b1c-8796-04287363d5ff req-5b6380aa-2486-440f-953c-65a402a405c3 service nova] Creating event network-vif-plugged:e33fc872-acce-4200-b275-6748e72077cb for instance 1d3f501b-7055-469b-98fe-13fd10e1b471 on n-h2-846219-13 Jul 25 17:47:33.990538 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-639f1cd1-7477-4b1c-8796-04287363d5ff req-5b6380aa-2486-440f-953c-65a402a405c3 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043561 Jul 25 17:47:33.991383 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3790/7449] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:47:42.992821 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:42.993506 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:42.999941 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:43.000391 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:43.001201 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:43.001646 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:43.027484 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:47:43.108945 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-33214752-9dca-46ab-a4ae-9ff65022aa34 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "DELETE /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 204 len: 0 microversion: 2.1 time: 0.121253 Jul 25 17:47:43.109713 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3791/7450] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:47:42 2022] DELETE /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:47:43.186670 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-89f82852-4bf0-48f3-9600-e562b2a35ec1 req-60603230-632f-4a2d-bbba-70a60d26cd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3f501b-7055-469b-98fe-13fd10e1b471", "tag": "e33fc872-acce-4200-b275-6748e72077cb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:47:43.196230 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-89f82852-4bf0-48f3-9600-e562b2a35ec1 req-60603230-632f-4a2d-bbba-70a60d26cd12 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:43.196688 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-89f82852-4bf0-48f3-9600-e562b2a35ec1 req-60603230-632f-4a2d-bbba-70a60d26cd12 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:43.208591 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-89f82852-4bf0-48f3-9600-e562b2a35ec1 req-60603230-632f-4a2d-bbba-70a60d26cd12 service nova] Creating event network-changed:e33fc872-acce-4200-b275-6748e72077cb for instance 1d3f501b-7055-469b-98fe-13fd10e1b471 on n-h2-846219-13 Jul 25 17:47:43.214034 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-89f82852-4bf0-48f3-9600-e562b2a35ec1 req-60603230-632f-4a2d-bbba-70a60d26cd12 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102964 Jul 25 17:47:43.214725 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3792/7451] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:47:43.219952 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:43.220717 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:43.227496 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:43.227969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:43.228747 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:43.229236 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:43.365319 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:47:43.373027 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f37b7797-c390-43d2-9b39-17df3e09119c tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1687 microversion: 2.1 time: 0.157102 Jul 25 17:47:43.373885 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3793/7452] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:47:43 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:47:43.888441 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:47:43.888667 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:47:44.394658 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:44.395386 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:44.402540 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:44.402995 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:44.403763 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:44.404207 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:44.549732 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:47:44.557715 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-bc74bd21-fc93-4e80-9792-3c5b66a0c8dd tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 200 len: 1687 microversion: 2.1 time: 0.166946 Jul 25 17:47:44.558252 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3794/7453] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:47:44 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:47:45.184266 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-6832e8fd-b430-4256-867c-b8c7cc28da31 req-b638fa52-ad79-45c8-ac4a-f6407ede028d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3f501b-7055-469b-98fe-13fd10e1b471", "name": "network-vif-deleted", "tag": "e33fc872-acce-4200-b275-6748e72077cb"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:47:45.193805 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6832e8fd-b430-4256-867c-b8c7cc28da31 req-b638fa52-ad79-45c8-ac4a-f6407ede028d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:45.194969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-6832e8fd-b430-4256-867c-b8c7cc28da31 req-b638fa52-ad79-45c8-ac4a-f6407ede028d service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:45.211545 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-6832e8fd-b430-4256-867c-b8c7cc28da31 req-b638fa52-ad79-45c8-ac4a-f6407ede028d service nova] Creating event network-vif-deleted:e33fc872-acce-4200-b275-6748e72077cb for instance 1d3f501b-7055-469b-98fe-13fd10e1b471 on n-h2-846219-13 Jul 25 17:47:45.217352 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-6832e8fd-b430-4256-867c-b8c7cc28da31 req-b638fa52-ad79-45c8-ac4a-f6407ede028d service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091308 Jul 25 17:47:45.218439 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3795/7454] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 17:47:45.581360 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:45.582312 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 1d3f501b-7055-469b-98fe-13fd10e1b471] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:45.589634 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:45.590223 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:45.591083 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:45.591536 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:45.605390 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] HTTP exception thrown: Instance 1d3f501b-7055-469b-98fe-13fd10e1b471 could not be found. Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Request method failure captured: Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 HTTP/1.1 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3tX6cLym28danmXvr1a6_4X_POXFRVoHfb50JAnsO_1rhOvrWyU6rB7-CwxCFeiYR8Fsrpcf7_DDdB7d4FRH4hnfT72pvuNKNqx5xVymCmHbn_bkjntF_Z0rDgLsA5_RSXlCOevCcUhKTBAWcFMHYoMV5byb9GLWb0SlUdbwPICknRA Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 60865e1237ca4c65bf71754a94e1a26f Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestSnapshotPattern-542386038 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/60865e1237ca4c65bf71754a94e1a26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/60865e1237ca4c65bf71754a94e1a26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/60865e1237ca4c65bf71754a94e1a26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_60865e1237ca4c65bf71754a94e1a26f"}]}] Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestSnapshotPattern-542386038 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 60865e1237ca4c65bf71754a94e1a26f Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestSnapshotPattern-542386038 Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestSnapshotPattern-542386038-project Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d41a5510006c44efa1aa09880520becf Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestSnapshotPattern-542386038-project Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 1d3f501b-7055-469b-98fe-13fd10e1b471 could not be found. Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '1d3f501b-7055-469b-98fe-13fd10e1b471'} Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3f501b-7055-469b-98fe-13fd10e1b471 could not be found. Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3f501b-7055-469b-98fe-13fd10e1b471 could not be found. Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:47:45.607202 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3f501b-7055-469b-98fe-13fd10e1b471 could not be found. Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Returning 404 to user: Instance 1d3f501b-7055-469b-98fe-13fd10e1b471 could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-8cda44be-bfc6-4bdf-83d0-475f89378a37 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471" status: 404 len: 111 microversion: 2.1 time: 0.033768 Jul 25 17:47:45.612807 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3796/7455] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:47:45 2022] GET /compute/v2.1/servers/1d3f501b-7055-469b-98fe-13fd10e1b471 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 17:47:47.037505 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:47.038124 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:47.045457 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:47.046051 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:47.046845 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:47.047299 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:47.076494 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Going to try to terminate instance {{(pid=119599) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 17:47:47.156276 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-0137b5a5-4a5c-4828-842b-8591010ef0b8 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "DELETE /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 204 len: 0 microversion: 2.1 time: 0.122700 Jul 25 17:47:47.157184 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3797/7456] 10.222.0.105 () {58 vars in 1244 bytes} [Mon Jul 25 17:47:47 2022] DELETE /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 17:47:47.162671 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-42384dc9-87fd-4078-ba18-cc81ab75357c req-0eb50d75-a610-4270-9997-7ba6a6176026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:47:47.172969 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-42384dc9-87fd-4078-ba18-cc81ab75357c req-0eb50d75-a610-4270-9997-7ba6a6176026 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:47.173491 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-42384dc9-87fd-4078-ba18-cc81ab75357c req-0eb50d75-a610-4270-9997-7ba6a6176026 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:47.184944 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-42384dc9-87fd-4078-ba18-cc81ab75357c req-0eb50d75-a610-4270-9997-7ba6a6176026 service nova] Creating event network-changed:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:47:47.189867 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-42384dc9-87fd-4078-ba18-cc81ab75357c req-0eb50d75-a610-4270-9997-7ba6a6176026 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Jul 25 17:47:47.190479 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3798/7457] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:47:47.195841 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:47.196735 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:47.202891 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:47.203359 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:47.204144 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:47.204592 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:47.349289 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:47:47.357327 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-b7ecbb23-a1da-4148-a945-f489858b06ea tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1688 microversion: 2.1 time: 0.165617 Jul 25 17:47:47.358143 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3799/7458] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:47:47 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:47:48.378499 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:48.379198 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:48.387679 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:48.388297 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:48.389298 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:48.390013 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:48.608145 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.policy [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41a5510006c44efa1aa09880520becf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60865e1237ca4c65bf71754a94e1a26f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119599) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 17:47:48.616942 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-257deaf6-e79c-4356-a77e-ba8a678f6bbb tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 200 len: 1688 microversion: 2.1 time: 0.242583 Jul 25 17:47:48.617659 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3800/7459] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:47:48 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 17:47:49.204476 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [req-5551695e-9993-4217-9d5f-8501698a3429 req-0c6e9379-7e02-418f-81c3-e6901d4eda98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a", "name": "network-vif-deleted", "tag": "fca9d3be-bc3e-4cbe-b415-cb32e0289885"}]} {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 17:47:49.214642 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5551695e-9993-4217-9d5f-8501698a3429 req-0c6e9379-7e02-418f-81c3-e6901d4eda98 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:49.215091 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [req-5551695e-9993-4217-9d5f-8501698a3429 req-0c6e9379-7e02-418f-81c3-e6901d4eda98 service nova] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:49.227286 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.compute.server_external_events [req-5551695e-9993-4217-9d5f-8501698a3429 req-0c6e9379-7e02-418f-81c3-e6901d4eda98 service nova] Creating event network-vif-deleted:fca9d3be-bc3e-4cbe-b415-cb32e0289885 for instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a on n-h1-846219-13 Jul 25 17:47:49.232520 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [req-5551695e-9993-4217-9d5f-8501698a3429 req-0c6e9379-7e02-418f-81c3-e6901d4eda98 service nova] 10.222.0.105 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Jul 25 17:47:49.233370 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3801/7460] 10.222.0.105 () {64 vars in 1322 bytes} [Mon Jul 25 17:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 17:47:49.645790 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:49.646791 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.compute.api [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] [instance: 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a] Fetching instance by UUID {{(pid=119599) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 17:47:49.657489 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:49.658255 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:49.659629 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 17:47:49.660418 n-d-846219-13 devstack@n-api.service[119599]: DEBUG oslo_concurrency.lockutils [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Lock "ead5885e-2d03-43f4-b304-6ac8e514b7e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 17:47:49.676523 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.wsgi [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] HTTP exception thrown: Instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a could not be found. Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Request method failure captured: Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: request: GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a HTTP/1.1 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Accept: application/json Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Accept-Encoding: identity Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Connection: close Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Content-Length: 0 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Content-Type: application/json Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Host: 10.222.0.105 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: Openstack-System-Scope: None Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: User-Agent: python-urllib3/1.26.10 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Auth-Token: gAAAAABi3tX6cLym28danmXvr1a6_4X_POXFRVoHfb50JAnsO_1rhOvrWyU6rB7-CwxCFeiYR8Fsrpcf7_DDdB7d4FRH4hnfT72pvuNKNqx5xVymCmHbn_bkjntF_Z0rDgLsA5_RSXlCOevCcUhKTBAWcFMHYoMV5byb9GLWb0SlUdbwPICknRA Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Id: None Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Domain-Name: None Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Identity-Status: Confirmed Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Is-Admin-Project: True Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Id: default Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Domain-Name: Default Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Id: 60865e1237ca4c65bf71754a94e1a26f Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Project-Name: tempest-TestSnapshotPattern-542386038 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Role: member,reader Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Roles: member,reader Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/60865e1237ca4c65bf71754a94e1a26f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/volume/v3/60865e1237ca4c65bf71754a94e1a26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.105/compute/v2/60865e1237ca4c65bf71754a94e1a26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.105:8080", "publicURL": "http://10.222.0.105:8080/v1/AUTH_60865e1237ca4c65bf71754a94e1a26f"}]}] Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant: tempest-TestSnapshotPattern-542386038 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Id: 60865e1237ca4c65bf71754a94e1a26f Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-Tenant-Name: tempest-TestSnapshotPattern-542386038 Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-User: tempest-TestSnapshotPattern-542386038-project Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Id: default Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-User-Domain-Name: Default Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-User-Id: d41a5510006c44efa1aa09880520becf Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: X-User-Name: tempest-TestSnapshotPattern-542386038-project Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: method: > Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: exception: Instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a could not be found. Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: action_args: {'id': '4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a'} Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a could not be found. Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a could not be found. Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 17:47:49.678239 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a could not be found. Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: ERROR nova.api.openstack.wsgi Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Returning 404 to user: Instance 4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a could not be found. {{(pid=119599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-f27d81cf-a732-414e-a1f4-61774a10bc02 tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a" status: 404 len: 111 microversion: 2.1 time: 0.042770 Jul 25 17:47:49.682822 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3802/7461] 10.222.0.105 () {58 vars in 1241 bytes} [Mon Jul 25 17:47:49 2022] GET /compute/v2.1/servers/4b1e74fc-730c-4f7a-8c8d-4f63cd45a21a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 17:47:49.856423 n-d-846219-13 devstack@n-api.service[119599]: DEBUG nova.api.openstack.wsgi [None req-a53fda5f-d59b-4413-aaa2-a7c4920fcf4d tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] Calling method '.version_select at 0x7f9d900f4790>' {{(pid=119599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 17:47:49.881892 n-d-846219-13 devstack@n-api.service[119599]: INFO nova.api.openstack.requestlog [None req-a53fda5f-d59b-4413-aaa2-a7c4920fcf4d tempest-TestSnapshotPattern-542386038 tempest-TestSnapshotPattern-542386038-project] 10.222.0.105 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1847023868" status: 202 len: 0 microversion: 2.1 time: 0.029352 Jul 25 17:47:49.882512 n-d-846219-13 devstack@n-api.service[119599]: [pid: 119599|app: 0|req: 3803/7462] 10.222.0.105 () {58 vars in 1262 bytes} [Mon Jul 25 17:47:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1847023868 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 17:49:24.688016 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:49:24.689020 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:49:40.778423 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:49:40.779543 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:51:03.898956 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:51:03.899946 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:51:03.932637 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:51:03.932902 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:52:44.699775 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:52:44.700443 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:52:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:53:00.791518 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:53:00.792282 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:53:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:53:27.494096 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:53:27.494808 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:54:23.910433 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:54:23.911198 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:54:23.943332 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:54:23.943654 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 17:56:04.710510 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:56:04.711209 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:56:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:56:20.802116 n-d-846219-13 devstack@n-api.service[119598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:56:20.803247 n-d-846219-13 devstack@n-api.service[119598]: Mon Jul 25 17:56:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.105) !!! Jul 25 17:56:47.505289 n-d-846219-13 devstack@n-api.service[119599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 17:56:47.506382 n-d-846219-13 devstack@n-api.service[119599]: Mon Jul 25 17:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!